-- Logs begin at Tue 2022-10-18 12:30:12 UTC, end at Tue 2022-10-18 15:16:35 UTC. -- Oct 18 13:13:02.938404 n-d-858383-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 13:13:02.945693 n-d-858383-13 devstack@n-api.service[105103]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 13:13:02 2022] *** Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: nodename: n-d-858383-13 Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: machine: x86_64 Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: clock source: unix Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: pcre jit disabled Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: detected number of CPU cores: 4 Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: current working directory: / Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: detected binary path: /usr/bin/uwsgi-core Oct 18 13:13:02.949501 n-d-858383-13 devstack@n-api.service[105103]: your processes number limit is 47680 Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: your memory page size is 4096 bytes Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: detected max file descriptor number: 2048 Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: lock engine: pthread robust mutexes Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: thunder lock: enabled Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 13:13:02.950320 n-d-858383-13 devstack@n-api.service[105103]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 13:13:02.988660 n-d-858383-13 devstack@n-api.service[105103]: Python main interpreter initialized at 0x55e214e109c0 Oct 18 13:13:02.988660 n-d-858383-13 devstack@n-api.service[105103]: python threads support enabled Oct 18 13:13:02.988660 n-d-858383-13 devstack@n-api.service[105103]: your server socket listen backlog is limited to 100 connections Oct 18 13:13:02.988660 n-d-858383-13 devstack@n-api.service[105103]: your mercy for graceful operations on workers is 90 seconds Oct 18 13:13:02.989040 n-d-858383-13 devstack@n-api.service[105103]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 13:13:02.989116 n-d-858383-13 devstack@n-api.service[105103]: *** Operational MODE: preforking *** Oct 18 13:13:02.989322 n-d-858383-13 devstack@n-api.service[105103]: *** uWSGI is running in multiple interpreter mode *** Oct 18 13:13:02.989322 n-d-858383-13 devstack@n-api.service[105103]: spawned uWSGI master process (pid: 105103) Oct 18 13:13:02.989525 n-d-858383-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 13:13:02.990652 n-d-858383-13 devstack@n-api.service[105103]: spawned uWSGI worker 1 (pid: 105104, cores: 1) Oct 18 13:13:02.990652 n-d-858383-13 devstack@n-api.service[105103]: spawned uWSGI worker 2 (pid: 105105, cores: 1) Oct 18 13:13:02.990652 n-d-858383-13 devstack@n-api.service[105103]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 13:13:03.639603 n-d-858383-13 devstack@n-api.service[105105]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:13:03.640223 n-d-858383-13 devstack@n-api.service[105104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:13:04.709804 n-d-858383-13 devstack@n-api.service[105104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:13:04.709804 n-d-858383-13 devstack@n-api.service[105104]: from cryptography.utils import int_from_bytes Oct 18 13:13:04.710518 n-d-858383-13 devstack@n-api.service[105104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:13:04.710518 n-d-858383-13 devstack@n-api.service[105104]: from cryptography.utils import int_from_bytes Oct 18 13:13:04.710681 n-d-858383-13 devstack@n-api.service[105105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:13:04.710681 n-d-858383-13 devstack@n-api.service[105105]: from cryptography.utils import int_from_bytes Oct 18 13:13:04.711076 n-d-858383-13 devstack@n-api.service[105105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:13:04.711076 n-d-858383-13 devstack@n-api.service[105105]: from cryptography.utils import int_from_bytes Oct 18 13:13:07.186308 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:13:07.186871 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:13:07.187227 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:13:07.187325 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:13:07.187414 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:13:07.187507 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:13:07.187587 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:13:07.187677 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:13:07.187756 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:13:07.187840 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:13:07.188033 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188183 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188352 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188486 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188668 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188803 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.188986 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189123 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189311 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189448 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189620 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189755 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.189936 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190088 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190284 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190405 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190605 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190728 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190860 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.190984 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191179 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191312 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191494 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-13 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191596 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-13 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191810 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.191899 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192110 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192198 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192414 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192502 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192725 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.192813 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193022 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193110 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193338 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193426 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193637 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.193725 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.194152 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.195402 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.195402 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.195676 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.195809 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.195941 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196065 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196202 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196327 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196457 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196588 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196716 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196838 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.196973 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197104 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197228 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197350 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197487 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197622 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197753 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197869 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.197992 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198161 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-13 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198287 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-13 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198410 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198540 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198678 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198803 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.198926 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199065 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199190 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199332 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199466 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199592 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199724 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199849 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.199984 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200109 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200232 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200377 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200502 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200631 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200766 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.200897 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201022 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201145 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201324 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201487 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201615 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201740 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.201884 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202017 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202210 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202351 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202511 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202647 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202821 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.202955 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203116 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203262 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203410 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203548 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203674 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203796 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.203933 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204066 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204243 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204369 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204553 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204688 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.204869 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205009 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205137 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205261 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205385 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205517 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205651 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205775 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.205938 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206093 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206266 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206405 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206568 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206705 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.206871 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207004 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207168 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207296 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207466 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207593 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207763 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.207890 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208099 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208233 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208359 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208483 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208646 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208775 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.208951 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209080 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209265 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209399 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209564 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209690 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.209873 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210001 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210283 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210429 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210562 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210694 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210819 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.210942 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211132 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211266 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211469 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211606 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211771 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.211899 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212084 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212213 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212395 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212530 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212697 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212828 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.212994 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213119 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213293 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213429 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213602 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213735 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.213926 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214126 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214270 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214406 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214532 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214655 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214779 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.214902 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215033 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215158 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215338 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215466 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215637 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215770 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.215935 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216063 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216232 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216358 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216522 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216648 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216821 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.216949 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217117 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217255 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217415 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217557 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217755 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.217881 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218009 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218156 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218305 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218450 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218601 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218728 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.218898 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219032 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219195 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219331 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219491 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219626 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219801 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.219935 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220111 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220246 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220409 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220529 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220706 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.220843 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221003 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221131 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221299 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221426 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221610 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221744 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.221907 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222047 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222223 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222347 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222531 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222658 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222829 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.222970 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223125 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223253 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223437 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223565 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223738 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.223875 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224038 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224174 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224349 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224484 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224643 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224779 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.224940 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225068 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225249 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225377 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225549 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225684 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225846 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.225981 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226163 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226292 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226459 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226589 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226754 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.226888 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.227567 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.227702 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.227861 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.227990 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228156 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228291 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228447 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228566 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228755 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.228890 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229070 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229367 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229506 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229666 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229794 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.229961 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.230130 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.230297 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.230442 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:13:07.230625 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.230761 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.230950 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.231078 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.231284 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.231417 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.231843 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.231971 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232168 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232298 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232491 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232620 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232801 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.232930 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233105 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233234 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233412 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233551 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233730 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.233857 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234031 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234175 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234360 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234489 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234660 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234788 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.234971 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235124 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235285 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235414 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235605 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235733 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.235914 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236040 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236218 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236348 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236527 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236732 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236860 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.236983 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237119 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237246 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237434 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237563 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237745 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.237871 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238046 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238215 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238404 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238545 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238741 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.238882 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239047 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239174 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239363 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239492 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239676 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239813 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.239983 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240110 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240284 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240411 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240606 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240746 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.240919 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241049 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241231 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241394 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241512 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241646 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241820 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.241941 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.242150 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.242292 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.242470 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.242598 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.243326 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.243464 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.243634 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.243764 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.243943 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244071 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244252 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244379 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244558 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244684 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.244886 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245014 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245194 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245322 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245508 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245634 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245817 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.245946 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246148 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246290 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246463 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246600 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246773 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.246909 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247077 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247213 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247383 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247519 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247682 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247808 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.247982 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248108 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248281 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248416 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248584 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248712 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.248883 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249012 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249332 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249518 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249646 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249819 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.249945 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250163 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250305 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250467 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250601 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250769 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.250903 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251071 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251207 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251372 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251499 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251672 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251798 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.251974 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252103 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252277 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252403 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252574 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252702 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.252891 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253019 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253190 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253325 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253489 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253617 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253804 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.253939 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254122 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254252 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254425 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254564 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254731 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.254857 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255034 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255170 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255338 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255473 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255644 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255771 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.255945 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256072 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256261 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256402 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256561 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256697 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256863 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.256990 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257189 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257319 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257513 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257639 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257811 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.257937 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258167 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258329 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258484 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258612 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258797 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.258924 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259096 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259233 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259398 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259525 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259696 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259831 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.259993 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260132 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260290 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260416 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260589 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260723 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.260885 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261014 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261182 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261310 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261477 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261613 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261774 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.261902 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262101 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262233 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262403 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262543 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262701 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262829 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.262999 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263127 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263294 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263429 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263589 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263725 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.263922 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264049 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264220 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264356 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264552 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264687 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.264879 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265021 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265189 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265317 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265505 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265631 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265810 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.265936 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266139 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266269 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266444 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266582 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266748 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.266876 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267051 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267179 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267353 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267487 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267664 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267791 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.267966 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268094 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268274 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268401 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268576 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268715 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.268890 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269017 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269191 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269318 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269500 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269635 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269798 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.269927 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270122 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270253 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270455 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270599 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270779 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.270916 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271086 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271214 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271400 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271536 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271702 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.271828 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272009 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272137 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272310 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272446 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272612 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272738 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.272912 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273041 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273212 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273342 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273520 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273653 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273839 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.273971 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274177 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274309 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274483 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274609 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274798 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.274926 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275099 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275228 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275407 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275534 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275704 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.275831 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276009 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276136 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276328 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276455 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276656 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276797 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.276959 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277086 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277264 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277392 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277576 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277711 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.277879 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278005 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278208 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278336 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278513 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278653 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278812 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.278938 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279110 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279236 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279414 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279549 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279722 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.279856 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280024 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280150 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280328 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280457 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280627 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280754 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.280930 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281064 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281232 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281359 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281527 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281654 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281823 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.281950 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282148 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282278 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282464 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282600 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282767 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.282894 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283082 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283209 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283394 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283522 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283692 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283818 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.283988 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284123 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284302 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284428 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284602 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284738 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.284901 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285028 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285185 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285311 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285480 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285618 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285811 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.285938 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286133 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286262 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286434 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286636 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286764 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.286895 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287083 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287214 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287352 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287479 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287630 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287768 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.287932 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288060 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288233 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288368 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288546 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288674 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288853 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.288981 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.289154 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.289282 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.289979 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290148 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290299 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290427 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290607 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290736 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.290911 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291030 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291227 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291361 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291529 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291657 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291833 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.291969 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292136 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292273 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292435 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292570 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292736 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.292863 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.293046 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.293182 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.293601 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.293730 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.293930 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294113 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294252 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294387 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294572 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294714 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.294908 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295044 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295221 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295358 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295544 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295681 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295866 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.295994 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296175 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296313 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296473 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296608 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296777 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.296905 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297078 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297206 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297377 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297515 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297680 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297807 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.297980 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298125 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298304 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298444 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298605 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298740 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.298908 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299035 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299207 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299335 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299503 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299637 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299799 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.299927 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300098 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300226 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300405 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300534 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300704 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.300839 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301009 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301137 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301307 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301435 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301624 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301758 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.301924 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302071 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302248 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302378 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302549 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302687 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302849 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.302978 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303186 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303315 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303484 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303626 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303816 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.303953 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304141 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304268 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304475 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304611 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304776 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.304903 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.305088 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.305731 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.305934 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306091 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306264 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306379 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306565 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306685 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.306866 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.307896 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.307896 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308146 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308270 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308394 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308527 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308653 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308779 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.308903 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309026 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309150 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309287 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309402 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309525 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309649 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309782 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309919 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.309919 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310187 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310313 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310436 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310559 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310695 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310824 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.310947 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311071 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311184 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311307 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311508 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311636 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311759 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.311885 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312018 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312144 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312276 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312402 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312525 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312649 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312772 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.312906 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313031 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313162 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313287 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313411 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313534 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313674 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313800 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.313924 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314047 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314208 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314331 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314473 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314597 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314722 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314845 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.314994 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315122 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315292 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315422 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315588 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315714 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.315888 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316023 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316185 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316313 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316480 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316613 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316780 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.316916 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317093 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317221 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317403 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317552 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317713 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317857 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.317984 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318128 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318303 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318429 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318600 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318739 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.318897 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319033 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319330 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319494 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319622 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319788 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.319916 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320083 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320209 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320381 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320508 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320675 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.320828 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321014 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321143 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321316 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321445 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321613 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321740 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.321909 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322036 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322228 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322351 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322562 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322697 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.322858 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323007 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323212 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323340 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323512 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323640 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323822 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.323964 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324135 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324265 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324444 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324581 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324748 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.324887 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325055 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325189 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325350 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325478 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325656 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325798 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.325960 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326109 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326288 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326415 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326584 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326728 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.326883 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327013 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327331 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327498 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327627 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327799 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.327934 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328113 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328240 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328428 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328562 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328741 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.328868 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329039 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329165 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329342 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329470 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329646 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329774 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.329944 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330137 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330278 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330404 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330563 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330700 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.330867 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331003 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331172 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331298 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331475 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331602 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331778 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.331914 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332078 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332216 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332375 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332502 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332678 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332816 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.332979 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333127 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333279 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333436 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333596 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333758 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.333889 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334075 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334207 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334395 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334558 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334704 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334868 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.334998 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.335175 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.335315 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.335476 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.335605 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.335896 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336024 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336203 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336360 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336549 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336678 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336855 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.336984 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337161 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337290 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337468 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337597 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337776 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.337904 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338103 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338246 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338406 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338533 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338814 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.338951 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339119 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339325 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339453 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339575 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339697 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339821 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.339998 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340136 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340296 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340428 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340598 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340718 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.340913 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341048 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341211 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341338 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341506 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341633 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341803 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.341931 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342136 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342266 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342437 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342564 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342752 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.342887 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343156 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343284 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343460 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343589 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343759 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.343888 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344164 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344298 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344467 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344594 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344768 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.344910 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345083 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345212 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345398 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345527 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345716 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.345851 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346015 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346195 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346334 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346462 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346638 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346776 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.346956 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347093 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347271 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347399 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347575 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347716 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.347880 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348008 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348178 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348306 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348494 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348636 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348810 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.348944 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349116 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349251 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349433 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349637 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349840 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.349969 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350181 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350311 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350490 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350619 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350802 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.350929 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351122 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351249 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351420 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351556 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351717 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.351850 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.352537 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.352667 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.352841 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.352977 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353139 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353267 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353457 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353584 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353754 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.353884 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354100 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354232 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354386 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354526 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354685 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354813 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.354983 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355110 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355279 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355416 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355597 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355724 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.355892 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.356020 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.356209 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.356345 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.356762 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.356901 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357082 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357211 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357399 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357537 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357698 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.357825 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358016 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358161 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358342 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358479 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358641 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358768 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.358939 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359066 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359237 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359366 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359572 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359711 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.359871 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360000 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360184 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360313 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360506 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360640 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360827 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.360955 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361131 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361261 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361455 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361583 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361771 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.361912 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362102 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362233 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362409 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362537 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362718 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.362857 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363035 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363163 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363333 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363461 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363627 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363763 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.363927 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364054 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364225 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364354 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364521 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364657 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364818 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.364946 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365116 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365243 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365409 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365537 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365703 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365831 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.365998 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366150 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366342 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366472 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366642 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366771 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.366958 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.367086 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.367259 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.367390 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.367558 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.368211 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.368390 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.368521 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.368693 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.368847 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369066 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369366 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369503 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369691 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369838 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.369995 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370176 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370339 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370476 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370651 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370778 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.370959 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371087 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371269 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371405 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371576 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371705 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.371882 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372009 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372191 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372327 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372499 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372638 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372805 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.372932 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373115 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373243 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373425 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373552 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373736 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.373864 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.374276 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.374407 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.374604 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.374743 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.374911 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375047 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375216 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375345 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375519 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375656 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375826 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.375954 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376132 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376261 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376436 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376564 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376738 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.376876 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377041 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377168 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377345 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377475 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377667 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377803 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.377981 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378122 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378326 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378454 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378656 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378787 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.378969 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379099 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379278 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379397 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379587 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379713 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.379880 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380010 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380230 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380369 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380538 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380666 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380837 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.380964 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381142 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381279 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381451 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381578 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381759 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.381886 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382105 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382250 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382389 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382517 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382686 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382814 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.382990 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383119 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383317 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383442 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383608 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383738 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.383913 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384043 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384219 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384347 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384536 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384670 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384862 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.384991 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385173 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385325 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385477 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385613 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385784 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.385911 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.386114 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.386245 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.386628 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.386766 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.386935 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387063 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387262 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387393 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387580 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387716 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.387896 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388023 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388202 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388329 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388512 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388648 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388832 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.388968 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389132 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389269 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389430 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389560 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389734 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.389869 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390065 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390191 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390364 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390497 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390681 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390816 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.390985 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391113 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391286 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391422 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391597 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391726 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.391899 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.392026 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.392420 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.392557 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.392757 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.392894 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393067 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393208 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393385 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393515 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393742 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.393873 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394094 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394245 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394373 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394499 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394694 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394824 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.394997 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395135 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395298 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395418 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395605 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395734 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.395910 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396046 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396209 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396337 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396507 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396636 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396809 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.396945 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397110 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397239 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397406 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397534 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397708 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.397838 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398003 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398150 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398344 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398482 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398646 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398782 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.398970 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399098 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399270 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399406 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399574 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399710 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.399874 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400001 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400171 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400305 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400467 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400603 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400762 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.400889 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401064 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401199 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401360 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401487 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401662 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401788 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.401959 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402122 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402289 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402423 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402629 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402757 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.402931 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403068 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403228 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403355 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403543 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403661 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403840 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.403969 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404134 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404261 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404441 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404568 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404742 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.404870 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405056 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405185 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405359 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405486 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405662 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405791 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.405999 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.406162 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.406333 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.406471 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.406856 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.406985 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407186 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407314 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407499 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407634 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407824 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.407952 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408149 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408275 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408448 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408653 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408786 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.408910 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409034 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409158 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409338 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409478 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409642 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409769 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.409946 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410102 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410271 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410393 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410575 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410711 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.410875 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411003 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411176 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411311 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411477 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411604 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411777 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.411900 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412078 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412207 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412377 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412514 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412677 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412813 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.412978 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413105 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413277 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413412 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413578 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413715 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.413885 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.414013 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.414243 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.414371 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415078 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415218 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415392 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415520 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415698 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.415827 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416008 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416147 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416312 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416446 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416614 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416743 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.416916 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417053 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417222 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417352 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417571 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417711 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417847 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.417974 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.418173 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.418305 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.418472 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.418600 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419132 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419264 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419446 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419576 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419766 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.419909 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420085 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420218 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420391 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420513 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420710 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.420848 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421030 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421161 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421340 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421478 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421657 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421796 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.421963 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422176 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422304 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422428 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422629 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422760 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.422955 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423093 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423276 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423407 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423581 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423711 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.423883 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424012 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424183 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424319 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424489 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424626 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424801 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.424937 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425106 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425244 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425407 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425537 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425705 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.425832 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426005 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426167 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426332 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426459 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426629 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426756 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.426928 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427068 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427229 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427359 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427529 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427656 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427824 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.427961 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428121 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428256 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428416 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428544 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428712 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.428841 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429007 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429141 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429302 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429430 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429606 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429735 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.429903 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.430031 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.430759 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.430893 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431062 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431196 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431359 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431502 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431654 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431782 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.431979 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432108 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432304 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432432 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432611 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432752 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.432928 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433056 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433233 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433360 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433547 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433682 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433847 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.433975 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434187 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434317 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434503 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434640 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434811 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.434938 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435115 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435244 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435438 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435576 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435743 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.435877 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436047 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436174 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436400 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436536 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436665 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436788 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.436949 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437091 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437255 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437386 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437575 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437704 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.437894 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438022 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438207 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438291 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438526 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438614 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438835 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.438931 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439146 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439240 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439456 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439544 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439764 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.439859 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440086 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440173 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440392 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440479 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440698 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.440832 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441003 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441137 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441308 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441436 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441613 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441740 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.441921 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442049 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442251 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442379 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442557 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442686 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442867 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.442995 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443176 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443303 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443498 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443626 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443817 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.443945 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444119 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444254 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444437 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444565 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444757 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.444884 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445099 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445240 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445407 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445534 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445768 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.445945 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446108 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446249 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446417 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446547 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446724 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.446850 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.447023 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.447160 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:13:07.447286 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:13:07.447427 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:13:07.600080 n-d-858383-13 devstack@n-api.service[105104]: INFO dbcounter [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Registered counter for database nova_api Oct 18 13:13:07.600306 n-d-858383-13 devstack@n-api.service[105105]: INFO dbcounter [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Registered counter for database nova_api Oct 18 13:13:07.621673 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_db.sqlalchemy.engines [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.625082 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.628490 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writer thread running {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.631951 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writer thread running {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.691803 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.context [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=105105) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:13:07.695603 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:13:07.696049 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.context [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=105104) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:13:07.696153 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:13:07.697635 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:13:07.698375 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:13:07.698813 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:13:07.699936 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:13:07.700410 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:13:07.700770 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:13:07.702000 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:13:07.702756 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:13:07.702852 n-d-858383-13 devstack@n-api.service[105105]: INFO dbcounter [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Registered counter for database nova_cell0 Oct 18 13:13:07.703202 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:13:07.705168 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_concurrency.lockutils [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:13:07.706740 n-d-858383-13 devstack@n-api.service[105105]: INFO dbcounter [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Registered counter for database nova_cell1 Oct 18 13:13:07.707199 n-d-858383-13 devstack@n-api.service[105104]: INFO dbcounter [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Registered counter for database nova_cell0 Oct 18 13:13:07.711224 n-d-858383-13 devstack@n-api.service[105104]: INFO dbcounter [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Registered counter for database nova_cell1 Oct 18 13:13:07.715897 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.716632 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.721066 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_db.sqlalchemy.engines [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.721855 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_db.sqlalchemy.engines [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.722270 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writer thread running {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.725071 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writer thread running {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.729493 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writer thread running {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.731003 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writer thread running {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.868541 n-d-858383-13 devstack@n-api.service[105105]: INFO dbcounter [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Registered counter for database nova_cell0 Oct 18 13:13:07.872915 n-d-858383-13 devstack@n-api.service[105104]: INFO dbcounter [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Registered counter for database nova_cell0 Oct 18 13:13:07.875564 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.880306 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writer thread running {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:07.881717 n-d-858383-13 devstack@n-api.service[105104]: DEBUG oslo_db.sqlalchemy.engines [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:13:07.886534 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writer thread running {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:13:08.284290 n-d-858383-13 devstack@n-api.service[105105]: WARNING keystonemiddleware.auth_token [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:13:08.291562 n-d-858383-13 devstack@n-api.service[105105]: WARNING keystonemiddleware.auth_token [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:13:08.317614 n-d-858383-13 devstack@n-api.service[105104]: WARNING keystonemiddleware.auth_token [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:13:08.325322 n-d-858383-13 devstack@n-api.service[105104]: WARNING keystonemiddleware.auth_token [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:13:08.629322 n-d-858383-13 devstack@n-api.service[105105]: WARNING keystonemiddleware.auth_token [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:13:08.635927 n-d-858383-13 devstack@n-api.service[105105]: WARNING keystonemiddleware.auth_token [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:13:08.641221 n-d-858383-13 devstack@n-api.service[105105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e214e109c0 pid: 105105 (default app) Oct 18 13:13:08.643292 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:13:08.644458 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001699 Oct 18 13:13:08.644870 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Oct 18 13:13:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:13:08.670573 n-d-858383-13 devstack@n-api.service[105104]: WARNING keystonemiddleware.auth_token [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:13:08.677231 n-d-858383-13 devstack@n-api.service[105104]: WARNING keystonemiddleware.auth_token [None req-724bb20b-247b-4c7f-9826-e1349619a26e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:13:08.683156 n-d-858383-13 devstack@n-api.service[105104]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e214e109c0 pid: 105104 (default app) Oct 18 13:14:32.421240 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:32.425566 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 18 13:14:32.425566 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:32.439601 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_api:SELECT=3 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.441268 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_cell0:SELECT=3 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.442307 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_cell1:SELECT=3 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.443311 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:33.298949 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-2fa383f2-b8bb-4e95-a6e3-8897af3f5c24 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:33.330581 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-2fa383f2-b8bb-4e95-a6e3-8897af3f5c24 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.900998 Oct 18 13:14:33.332121 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:14:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:35.920263 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:35.921264 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-7eb651bb-2e74-4973-b41c-a169123f7a90 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 18 13:14:35.921672 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:36.387431 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-d61c0d37-6cf9-477e-9dd6-c7fc4556c4f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:36.492947 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-d61c0d37-6cf9-477e-9dd6-c7fc4556c4f5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.565059 Oct 18 13:14:36.494116 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:36.507739 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_api:SELECT=3 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:36.508695 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_cell0:SELECT=3 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:36.510683 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_cell1:SELECT=3 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:36.511485 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:36.715581 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-6a8ed336-0933-4d3e-b615-7678fffa30c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:36.845284 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-6a8ed336-0933-4d3e-b615-7678fffa30c8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342748 Oct 18 13:14:36.846023 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 18 13:14:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:14:39.471823 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-d61c0d37-6cf9-477e-9dd6-c7fc4556c4f5 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:39.473025 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-d61c0d37-6cf9-477e-9dd6-c7fc4556c4f5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Oct 18 13:14:39.473563 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:40.299988 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-20946720-d4c5-42a1-86b6-ee4fb0c6d660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:40.435956 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-20946720-d4c5-42a1-86b6-ee4fb0c6d660 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.953590 Oct 18 13:14:40.437443 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:40.454144 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-d81938f3-7f58-46d5-ba02-bb5d6e97c9fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:40.621206 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-d81938f3-7f58-46d5-ba02-bb5d6e97c9fd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.174562 Oct 18 13:14:40.632053 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 18 13:14:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:43.545672 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-20946720-d4c5-42a1-86b6-ee4fb0c6d660 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:43.546742 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-20946720-d4c5-42a1-86b6-ee4fb0c6d660 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 18 13:14:43.552311 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:44.008302 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-889ae78d-6bbf-41ce-a39b-8962ff04ec09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:44.076032 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-889ae78d-6bbf-41ce-a39b-8962ff04ec09 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521947 Oct 18 13:14:44.078175 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:44.089777 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-d123b02e-035d-42b5-8f38-99acbc5428fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:44.186212 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-d123b02e-035d-42b5-8f38-99acbc5428fe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100530 Oct 18 13:14:44.206091 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 18 13:14:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:46.815187 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-889ae78d-6bbf-41ce-a39b-8962ff04ec09 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:46.816224 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-889ae78d-6bbf-41ce-a39b-8962ff04ec09 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 18 13:14:46.816637 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:14:47.278691 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-39329a5d-63fe-40d8-96f2-adbf07538f1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "swap": 0}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:47.352829 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-39329a5d-63fe-40d8-96f2-adbf07538f1a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528766 Oct 18 13:14:47.354150 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:47.366569 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-75cede11-84ee-485e-a851-edd49b5636b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:47.462623 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-75cede11-84ee-485e-a851-edd49b5636b2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099673 Oct 18 13:14:47.465363 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 18 13:14:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:50.150658 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-39329a5d-63fe-40d8-96f2-adbf07538f1a admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:50.152446 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-39329a5d-63fe-40d8-96f2-adbf07538f1a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002255 Oct 18 13:14:50.162827 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:50.640494 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "rxtx_factor": 1.0}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:50.729705 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.570288 Oct 18 13:14:50.731256 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:50.744612 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-3edc77e0-f47e-4bcb-8ba6-e71765d3d300 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:50.836386 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-3edc77e0-f47e-4bcb-8ba6-e71765d3d300 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096173 Oct 18 13:14:50.856949 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 18 13:14:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:53.503963 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:53.505243 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Oct 18 13:14:53.505785 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:53.936862 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-040ecaeb-0507-4754-b34f-6695f64af288 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:53.962665 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-040ecaeb-0507-4754-b34f-6695f64af288 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450702 Oct 18 13:14:53.963230 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:14:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:14:56.522308 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:56.523270 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-a42bf9c8-aa9c-4db6-8a23-2b007e4e46c1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 18 13:14:56.523636 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:56.972166 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-a3afd2c1-bb7d-4717-96b2-22a04b698c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:57.058544 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-a3afd2c1-bb7d-4717-96b2-22a04b698c09 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.528230 Oct 18 13:14:57.059670 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:14:57.071782 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-509a1cf2-05e7-4d3f-9610-81f352537fec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:14:57.168926 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-509a1cf2-05e7-4d3f-9610-81f352537fec admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100533 Oct 18 13:14:57.169875 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 18 13:14:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:59.761437 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-a3afd2c1-bb7d-4717-96b2-22a04b698c09 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:59.762502 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-a3afd2c1-bb7d-4717-96b2-22a04b698c09 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 18 13:14:59.762912 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:15:00.156287 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-72b31978-0221-40c4-b980-c2abf13fbefc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "disk": 20, "name": "m1.small"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:00.237855 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-72b31978-0221-40c4-b980-c2abf13fbefc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468335 Oct 18 13:15:00.238462 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:14:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:00.251390 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f5132998-ed26-4a4b-a155-e257efa2e7d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:00.331603 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-f5132998-ed26-4a4b-a155-e257efa2e7d5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084038 Oct 18 13:15:00.332110 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 18 13:15:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:15:02.919149 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-72b31978-0221-40c4-b980-c2abf13fbefc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:02.920168 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-72b31978-0221-40c4-b980-c2abf13fbefc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Oct 18 13:15:02.920567 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:03.335706 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-e60156e4-42ad-4363-9306-93ef2699dc13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:03.406341 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-e60156e4-42ad-4363-9306-93ef2699dc13 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479597 Oct 18 13:15:03.406904 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:15:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:03.420069 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-81436946-b252-472a-b08e-acc6bea44972 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:03.424968 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:03.499004 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-81436946-b252-472a-b08e-acc6bea44972 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082951 Oct 18 13:15:03.499597 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 18 13:15:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:15:06.112906 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-e60156e4-42ad-4363-9306-93ef2699dc13 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:06.113921 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-e60156e4-42ad-4363-9306-93ef2699dc13 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 18 13:15:06.114365 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:15:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:06.559123 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-64890530-c4a3-46ba-abc2-9d8483e2b3a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:06.674350 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-64890530-c4a3-46ba-abc2-9d8483e2b3a1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.553859 Oct 18 13:15:06.675584 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:15:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:15:06.687418 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-14d8b730-e61b-491f-abcd-9e45473f0a1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:06.772284 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-14d8b730-e61b-491f-abcd-9e45473f0a1a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088663 Oct 18 13:15:06.782185 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 18 13:15:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:15:09.408788 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-64890530-c4a3-46ba-abc2-9d8483e2b3a1 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:09.409816 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-64890530-c4a3-46ba-abc2-9d8483e2b3a1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 18 13:15:09.410253 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:09.865660 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:09.874194 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:09.970006 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.552313 Oct 18 13:15:09.970537 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 18 13:15:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:09.982947 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-a3cf8472-a920-4fa0-93d9-da5ae04bc57a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:10.069308 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-a3cf8472-a920-4fa0-93d9-da5ae04bc57a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090122 Oct 18 13:15:10.070085 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 18 13:15:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:15:31.923353 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:31.924363 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 18 13:15:31.924793 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:31.935905 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:32.312053 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-8625128a-53d9-4843-a851-840b4314edcc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:32.330270 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-8625128a-53d9-4843-a851-840b4314edcc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398834 Oct 18 13:15:32.330825 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:15:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:15:33.624189 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:33.625193 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-06aa2b49-cfb0-40b2-aca4-43bc850435e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 18 13:15:33.626181 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:34.167066 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-7e57e8f2-7e38-4b58-907b-31840b59985f admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:34.172336 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.wsgi [None req-7e57e8f2-7e38-4b58-907b-31840b59985f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-7e57e8f2-7e38-4b58-907b-31840b59985f admin admin] Request method failure captured: Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Accept: application/json Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Accept-Encoding: gzip, deflate Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Connection: keep-alive Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Content-Length: 0 Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Host: 10.222.0.27 Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: Openstack-System-Scope: None Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: User-Agent: python-novaclient Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Auth-Token: gAAAAABjTqb1fArdFQ2MjRdg16ByVyi5_IozD2Reqk3jUeOzkqw8-8HC1DCd5qSbKMejdiuZ0ow5ljPavNK-PHnpZ_Z3oHH0v0zDZJHaFBKq6TpPGGwgShooqtwej78-GKkiEzP2b-ggfqA5-2LlU-Yc8WlIMwKi5ziXb5U7RMOsmLi--zqGCSI Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Id: None Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Name: None Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Identity-Status: Confirmed Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Is-Admin-Project: True Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Id: default Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Name: Default Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Name: admin Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Role: reader,member,admin Oct 18 13:15:34.175545 n-d-858383-13 devstack@n-api.service[105104]: X-Roles: reader,member,admin Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant: admin Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Name: admin Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-User: admin Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Id: default Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Name: Default Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: X-User-Name: admin Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: method: > Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: exception: Flavor 42 could not be found. Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: action_args: {'id': '42'} Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:34.177170 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:34.178222 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.179297 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-7e57e8f2-7e38-4b58-907b-31840b59985f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:34.180954 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-7e57e8f2-7e38-4b58-907b-31840b59985f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391671 Oct 18 13:15:34.180954 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:15:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:34.187748 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-d3e0f1d0-b7b3-4222-9e0b-edc443ca2ed3 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:34.216901 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-d3e0f1d0-b7b3-4222-9e0b-edc443ca2ed3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025723 Oct 18 13:15:34.216901 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:34.228040 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-86aae763-b982-439f-8196-83d1d91496ca admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:34.250177 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-86aae763-b982-439f-8196-83d1d91496ca admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027070 Oct 18 13:15:34.250704 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:34.259917 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-5d2976ba-7222-4d56-9d8b-976776df4876 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:34.265563 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.wsgi [None req-5d2976ba-7222-4d56-9d8b-976776df4876 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-5d2976ba-7222-4d56-9d8b-976776df4876 admin admin] Request method failure captured: Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Accept: application/json Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Accept-Encoding: gzip, deflate Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Connection: keep-alive Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Content-Length: 0 Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Host: 10.222.0.27 Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: Openstack-System-Scope: None Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: User-Agent: python-novaclient Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Auth-Token: gAAAAABjTqb1fArdFQ2MjRdg16ByVyi5_IozD2Reqk3jUeOzkqw8-8HC1DCd5qSbKMejdiuZ0ow5ljPavNK-PHnpZ_Z3oHH0v0zDZJHaFBKq6TpPGGwgShooqtwej78-GKkiEzP2b-ggfqA5-2LlU-Yc8WlIMwKi5ziXb5U7RMOsmLi--zqGCSI Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Id: None Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Name: None Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Identity-Status: Confirmed Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Is-Admin-Project: True Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Id: default Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Name: Default Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Name: admin Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Role: reader,member,admin Oct 18 13:15:34.268809 n-d-858383-13 devstack@n-api.service[105105]: X-Roles: reader,member,admin Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant: admin Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Name: admin Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-User: admin Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Id: default Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Name: Default Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: X-User-Name: admin Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: method: > Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: exception: Flavor 42 could not be found. Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: action_args: {'id': '42'} Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:34.275885 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:34.276651 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:34.277668 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-5d2976ba-7222-4d56-9d8b-976776df4876 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:34.278817 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-5d2976ba-7222-4d56-9d8b-976776df4876 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013795 Oct 18 13:15:34.278817 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:15:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:35.475861 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-86aae763-b982-439f-8196-83d1d91496ca admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:35.476914 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-86aae763-b982-439f-8196-83d1d91496ca admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 18 13:15:35.477318 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:35.992986 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f276f18f-c348-4476-9349-248232aa3dee admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:35.997964 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.wsgi [None req-f276f18f-c348-4476-9349-248232aa3dee admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f276f18f-c348-4476-9349-248232aa3dee admin admin] Request method failure captured: Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Accept: application/json Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Accept-Encoding: gzip, deflate Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Connection: keep-alive Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Content-Length: 0 Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Host: 10.222.0.27 Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: Openstack-System-Scope: None Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: User-Agent: python-novaclient Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Auth-Token: gAAAAABjTqb3zUE-ay2dNzlqcioHtzimsGtRpFfeXfl7F5kCvXjblCSsz04T5NxYR4FWiO7IUXP81be6AMCVlqM6ft3F_pcr-5qBQeqjhmfTWKx2hNRFV0FOLw0KKgzXqqpbya66hOtzRSVvt2IAoHO_MosYkTg1Y94kDpj3yMaYuSI1bcToQsc Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Id: None Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Name: None Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Identity-Status: Confirmed Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Is-Admin-Project: True Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Id: default Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Name: Default Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Name: admin Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Role: reader,member,admin Oct 18 13:15:35.999492 n-d-858383-13 devstack@n-api.service[105105]: X-Roles: reader,member,admin Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant: admin Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Name: admin Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-User: admin Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Id: default Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Name: Default Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: X-User-Name: admin Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: method: > Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: exception: Flavor 84 could not be found. Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: action_args: {'id': '84'} Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:36.001007 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:36.002011 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.003396 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f276f18f-c348-4476-9349-248232aa3dee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:36.004611 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-f276f18f-c348-4476-9349-248232aa3dee admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386771 Oct 18 13:15:36.004611 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:15:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:36.010642 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-7c57e2bd-1ee6-4f3d-bea0-44dc07eb653e admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:36.025671 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-7c57e2bd-1ee6-4f3d-bea0-44dc07eb653e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018665 Oct 18 13:15:36.026235 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:36.035165 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-703966f6-f117-41b0-9649-b1e73ae8bb16 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:36.050640 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-703966f6-f117-41b0-9649-b1e73ae8bb16 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018920 Oct 18 13:15:36.051153 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:36.059959 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1bd3c163-09e8-4825-bd79-edce086ab12b admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:36.064759 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.wsgi [None req-1bd3c163-09e8-4825-bd79-edce086ab12b admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1bd3c163-09e8-4825-bd79-edce086ab12b admin admin] Request method failure captured: Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Accept: application/json Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Accept-Encoding: gzip, deflate Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Connection: keep-alive Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Content-Length: 0 Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Host: 10.222.0.27 Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: Openstack-System-Scope: None Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: User-Agent: python-novaclient Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Auth-Token: gAAAAABjTqb3zUE-ay2dNzlqcioHtzimsGtRpFfeXfl7F5kCvXjblCSsz04T5NxYR4FWiO7IUXP81be6AMCVlqM6ft3F_pcr-5qBQeqjhmfTWKx2hNRFV0FOLw0KKgzXqqpbya66hOtzRSVvt2IAoHO_MosYkTg1Y94kDpj3yMaYuSI1bcToQsc Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Id: None Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Name: None Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Identity-Status: Confirmed Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Is-Admin-Project: True Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Id: default Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Name: Default Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Name: admin Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Role: reader,member,admin Oct 18 13:15:36.066292 n-d-858383-13 devstack@n-api.service[105104]: X-Roles: reader,member,admin Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant: admin Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Name: admin Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-User: admin Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Id: default Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Name: Default Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: X-User-Name: admin Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: method: > Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: exception: Flavor 84 could not be found. Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: action_args: {'id': '84'} Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:36.067784 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:36.069394 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:36.070514 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1bd3c163-09e8-4825-bd79-edce086ab12b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:36.071483 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-1bd3c163-09e8-4825-bd79-edce086ab12b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011147 Oct 18 13:15:36.071483 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:15:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 18 13:15:37.272643 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-703966f6-f117-41b0-9649-b1e73ae8bb16 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:37.273680 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-703966f6-f117-41b0-9649-b1e73ae8bb16 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 18 13:15:37.274078 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:37.791628 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-6eeeb8b1-435a-4c03-8c40-3a7b9ca37358 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:37.797315 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.wsgi [None req-6eeeb8b1-435a-4c03-8c40-3a7b9ca37358 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-6eeeb8b1-435a-4c03-8c40-3a7b9ca37358 admin admin] Request method failure captured: Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Accept: application/json Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Accept-Encoding: gzip, deflate Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Connection: keep-alive Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Content-Length: 0 Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Host: 10.222.0.27 Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: Openstack-System-Scope: None Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: User-Agent: python-novaclient Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Auth-Token: gAAAAABjTqb5jEX0vSRugXH71gUOdM68x9QlKmb3fNWDzVXdUFNpCUsTceFE9_LxSeD8p_WBQNL_N9FfSiiqrnaKckfeVYHG1vLz0-g2WympPpffSuhEYl8qVF62JU-KNDydfCmgBH1CBW1GQ7L1RmGusXojW0dwRwemz8t9R7BpxCWIpEkzGQw Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Id: None Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Domain-Name: None Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Identity-Status: Confirmed Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Is-Admin-Project: True Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Id: default Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Domain-Name: Default Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Project-Name: admin Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Role: reader,member,admin Oct 18 13:15:37.798859 n-d-858383-13 devstack@n-api.service[105104]: X-Roles: reader,member,admin Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant: admin Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-Tenant-Name: admin Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-User: admin Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Id: default Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-User-Domain-Name: Default Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: X-User-Name: admin Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: method: > Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: exception: Flavor 451 could not be found. Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: action_args: {'id': '451'} Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:37.800396 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:37.802829 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.803899 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-6eeeb8b1-435a-4c03-8c40-3a7b9ca37358 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:37.804880 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-6eeeb8b1-435a-4c03-8c40-3a7b9ca37358 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390761 Oct 18 13:15:37.804880 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:15:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:37.810181 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-888fbb25-6b6d-4597-85aa-3013c3ed2b2f admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:37.825242 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-888fbb25-6b6d-4597-85aa-3013c3ed2b2f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018643 Oct 18 13:15:37.825753 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:37.834956 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:37.850340 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018803 Oct 18 13:15:37.850870 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 18 13:15:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:37.860075 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f0f41582-7aa5-47bd-94cc-76366cf5c57a admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:37.864927 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.wsgi [None req-f0f41582-7aa5-47bd-94cc-76366cf5c57a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f0f41582-7aa5-47bd-94cc-76366cf5c57a admin admin] Request method failure captured: Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Accept: application/json Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Accept-Encoding: gzip, deflate Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Connection: keep-alive Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Content-Length: 0 Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Host: 10.222.0.27 Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Openstack-Api-Version: compute 2.92 Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: Openstack-System-Scope: None Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: User-Agent: python-novaclient Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Auth-Token: gAAAAABjTqb5jEX0vSRugXH71gUOdM68x9QlKmb3fNWDzVXdUFNpCUsTceFE9_LxSeD8p_WBQNL_N9FfSiiqrnaKckfeVYHG1vLz0-g2WympPpffSuhEYl8qVF62JU-KNDydfCmgBH1CBW1GQ7L1RmGusXojW0dwRwemz8t9R7BpxCWIpEkzGQw Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Id: None Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Domain-Name: None Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Identity-Status: Confirmed Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Is-Admin-Project: True Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Id: default Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Domain-Name: Default Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Project-Name: admin Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Role: reader,member,admin Oct 18 13:15:37.866465 n-d-858383-13 devstack@n-api.service[105105]: X-Roles: reader,member,admin Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5197f824fa2b4aa1886cdd12c796a5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant: admin Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Id: 5197f824fa2b4aa1886cdd12c796a5bc Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-Tenant-Name: admin Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-User: admin Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Id: default Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-User-Domain-Name: Default Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-User-Id: 046cf75832784d19837da245ab0a0009 Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: X-User-Name: admin Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: method: > Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: exception: Flavor 451 could not be found. Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: action_args: {'id': '451'} Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:15:37.868072 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:37.869133 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: ERROR nova.api.openstack.wsgi Oct 18 13:15:37.870419 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f0f41582-7aa5-47bd-94cc-76366cf5c57a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:15:37.871611 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-f0f41582-7aa5-47bd-94cc-76366cf5c57a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011459 Oct 18 13:15:37.871611 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:15:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:39.083847 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:39.084969 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 18 13:15:39.085362 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:39.603022 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-8ff3896a-a304-48c8-9f94-6f4be3c6fa12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:39.692587 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-8ff3896a-a304-48c8-9f94-6f4be3c6fa12 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.469471 Oct 18 13:15:39.693151 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 18 13:15:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:15:40.901353 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:40.902409 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 18 13:15:40.902805 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:41.425782 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-ded362b4-b5b1-4988-91dd-6e186b212edc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:41.504233 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-ded362b4-b5b1-4988-91dd-6e186b212edc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.460536 Oct 18 13:15:41.504814 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 18 13:15:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:42.710670 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:42.711728 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 18 13:15:42.712124 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:43.230338 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-a603ba4a-7371-4412-9578-5053527f4137 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:43.333597 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-a603ba4a-7371-4412-9578-5053527f4137 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.485248 Oct 18 13:15:43.334091 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 18 13:15:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:44.546745 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:44.547761 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 18 13:15:44.548159 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:45.065659 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-faa5a0e7-6e77-4d32-a31e-6bc5b8504d9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:15:45.140906 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-faa5a0e7-6e77-4d32-a31e-6bc5b8504d9e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.453986 Oct 18 13:15:45.141457 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 18 13:15:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:15:46.336772 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:46.337785 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Oct 18 13:15:46.338225 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:15:46.853609 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-f7629cb4-8c4c-4867-990f-15744592867c admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:15:46.874630 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-f7629cb4-8c4c-4867-990f-15744592867c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399996 Oct 18 13:15:46.875178 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Oct 18 13:15:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:42.974921 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.975969 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-27a9426e-7e76-4982-a87c-e061175596bc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 18 13:16:42.976384 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:42.987728 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:43.367932 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-56f86352-777e-49cd-9ff0-183a7dfa1ae0 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.389469 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-56f86352-777e-49cd-9ff0-183a7dfa1ae0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406491 Oct 18 13:16:43.390013 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:16:43.411244 n-d-858383-13 devstack@n-api.service[105104]: DEBUG dbcounter [-] [105104] Writing DB stats nova_api:SELECT=14 {{(pid=105104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:43.414964 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-4716abea-c991-44ab-a2e4-dd930d54c931 admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.422179 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-4716abea-c991-44ab-a2e4-dd930d54c931 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012473 Oct 18 13:16:43.422694 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:43.434883 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-0281b1b9-2c2d-4a0c-ac86-4258ddfd6080 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.442083 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-0281b1b9-2c2d-4a0c-ac86-4258ddfd6080 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011416 Oct 18 13:16:43.442612 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:43.454567 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.461758 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010760 Oct 18 13:16:43.467874 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:43.473971 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-a0fd83d2-910f-4f4a-be6d-2cbc14b334b6 admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.481488 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-a0fd83d2-910f-4f4a-be6d-2cbc14b334b6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011154 Oct 18 13:16:43.482005 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:10.843599 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:10.844660 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 18 13:22:10.845057 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:10.985033 n-d-858383-13 devstack@n-api.service[105105]: DEBUG dbcounter [-] [105105] Writing DB stats nova_api:SELECT=6 {{(pid=105105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:11.127234 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:11.132689 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.134398 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.134398 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.134398 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.134781 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.135181 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.173233 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-705f2297-a9a7-4510-bf44-bf5c74e86a0c admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.189377 Oct 18 13:22:11.173792 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:22:10 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:12.244115 n-d-858383-13 devstack@n-api.service[105104]: DEBUG nova.api.openstack.wsgi [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] Calling method '>' {{(pid=105104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:12.245118 n-d-858383-13 devstack@n-api.service[105104]: INFO nova.api.openstack.requestlog [None req-1a027602-41f3-4c46-a867-4fffdc4a11fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 18 13:22:12.245517 n-d-858383-13 devstack@n-api.service[105104]: [pid: 105104|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 18 13:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:12.433175 n-d-858383-13 devstack@n-api.service[105105]: DEBUG nova.api.openstack.wsgi [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Calling method '>' {{(pid=105105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:12.436557 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.437031 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.437455 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.438191 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.438637 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.439051 n-d-858383-13 devstack@n-api.service[105105]: DEBUG oslo_concurrency.lockutils [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.463716 n-d-858383-13 devstack@n-api.service[105105]: INFO nova.api.openstack.requestlog [None req-96db1abf-3f28-4b73-ab04-50132b47e6ea admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081760 Oct 18 13:22:12.464288 n-d-858383-13 devstack@n-api.service[105105]: [pid: 105105|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:22:12 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:59.291630 n-d-858383-13 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 18 13:22:59.292872 n-d-858383-13 devstack@n-api.service[105103]: Tue Oct 18 13:22:59 2022 - graceful shutdown triggered... Oct 18 13:22:59.293373 n-d-858383-13 devstack@n-api.service[105105]: Gracefully killing worker 2 (pid: 105105)... Oct 18 13:22:59.293744 n-d-858383-13 devstack@n-api.service[105104]: Gracefully killing worker 1 (pid: 105104)... Oct 18 13:23:00.293375 n-d-858383-13 devstack@n-api.service[105103]: worker 1 buried after 1 seconds Oct 18 13:23:00.293375 n-d-858383-13 devstack@n-api.service[105103]: worker 2 buried after 1 seconds Oct 18 13:23:00.293949 n-d-858383-13 devstack@n-api.service[105103]: goodbye to uWSGI. Oct 18 13:23:00.294959 n-d-858383-13 systemd[1]: devstack@n-api.service: Succeeded. Oct 18 13:23:00.295531 n-d-858383-13 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 18 13:23:00.298285 n-d-858383-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 13:23:00.318345 n-d-858383-13 devstack@n-api.service[120992]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 13:23:00 2022] *** Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: nodename: n-d-858383-13 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: machine: x86_64 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: clock source: unix Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: pcre jit disabled Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: detected number of CPU cores: 4 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: current working directory: / Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: detected binary path: /usr/bin/uwsgi-core Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: your processes number limit is 47680 Oct 18 13:23:00.334444 n-d-858383-13 devstack@n-api.service[120992]: your memory page size is 4096 bytes Oct 18 13:23:00.335394 n-d-858383-13 devstack@n-api.service[120992]: detected max file descriptor number: 2048 Oct 18 13:23:00.335394 n-d-858383-13 devstack@n-api.service[120992]: lock engine: pthread robust mutexes Oct 18 13:23:00.335394 n-d-858383-13 devstack@n-api.service[120992]: thunder lock: enabled Oct 18 13:23:00.335394 n-d-858383-13 devstack@n-api.service[120992]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 13:23:00.335394 n-d-858383-13 devstack@n-api.service[120992]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 13:23:00.380459 n-d-858383-13 devstack@n-api.service[120992]: Python main interpreter initialized at 0x560f9a0bd9c0 Oct 18 13:23:00.380459 n-d-858383-13 devstack@n-api.service[120992]: python threads support enabled Oct 18 13:23:00.380459 n-d-858383-13 devstack@n-api.service[120992]: your server socket listen backlog is limited to 100 connections Oct 18 13:23:00.380459 n-d-858383-13 devstack@n-api.service[120992]: your mercy for graceful operations on workers is 90 seconds Oct 18 13:23:00.380934 n-d-858383-13 devstack@n-api.service[120992]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 13:23:00.380934 n-d-858383-13 devstack@n-api.service[120992]: *** Operational MODE: preforking *** Oct 18 13:23:00.381159 n-d-858383-13 devstack@n-api.service[120992]: *** uWSGI is running in multiple interpreter mode *** Oct 18 13:23:00.381159 n-d-858383-13 devstack@n-api.service[120992]: spawned uWSGI master process (pid: 120992) Oct 18 13:23:00.381367 n-d-858383-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 13:23:00.381969 n-d-858383-13 devstack@n-api.service[120992]: spawned uWSGI worker 1 (pid: 121009, cores: 1) Oct 18 13:23:00.383065 n-d-858383-13 devstack@n-api.service[120992]: spawned uWSGI worker 2 (pid: 121010, cores: 1) Oct 18 13:23:00.383366 n-d-858383-13 devstack@n-api.service[120992]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 13:23:01.048158 n-d-858383-13 devstack@n-api.service[121010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:23:01.055240 n-d-858383-13 devstack@n-api.service[121009]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:23:02.202508 n-d-858383-13 devstack@n-api.service[121010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:23:02.202508 n-d-858383-13 devstack@n-api.service[121010]: from cryptography.utils import int_from_bytes Oct 18 13:23:02.203125 n-d-858383-13 devstack@n-api.service[121010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:23:02.203125 n-d-858383-13 devstack@n-api.service[121010]: from cryptography.utils import int_from_bytes Oct 18 13:23:02.204276 n-d-858383-13 devstack@n-api.service[121009]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:23:02.204276 n-d-858383-13 devstack@n-api.service[121009]: from cryptography.utils import int_from_bytes Oct 18 13:23:02.204717 n-d-858383-13 devstack@n-api.service[121009]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:23:02.204717 n-d-858383-13 devstack@n-api.service[121009]: from cryptography.utils import int_from_bytes Oct 18 13:23:04.616786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:23:04.617453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:23:04.617729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:23:04.617942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:23:04.618221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:23:04.618610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.618938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.619268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.619735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.620070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.620380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.620702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.621023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.621352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.621615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.621931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.622285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-13 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.622611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.622919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.623231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.623551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.623855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.624194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.624482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.624982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.625424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.625734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.626123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.626404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.626717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.627027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.627365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.627660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.627985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.628097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:23:04.628484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:23:04.628575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.628697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-13 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.628830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:23:04.629016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.629116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:23:04.629320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.629532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:23:04.629755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.629957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.630787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.630979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.631165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.631384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.631588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.631758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.631924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.632961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-13 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.633987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.634323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.634510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.634647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.634777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.634915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.635877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.636947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.637868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.638966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.639997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-13 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.640954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.641975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.642903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.643997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.644180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.644560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.644560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.644836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.644836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.645091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.645232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.645374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.645514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.645652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.646730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.646876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.647871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.648882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.649870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.650970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.651908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.652961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.653889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.654030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.654222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.654366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.654755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.654903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.655996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.656945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.657959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.658923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.659843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.660896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.661035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.661214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.661942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.662994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.663144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.663312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.663445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.663624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.663757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.663901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.664033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.664234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.664368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.664563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.664948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.665098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.665231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.665362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.665500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.665648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.665789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.665921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.666097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.666245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.666389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.666521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.666650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.666788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.666926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.667063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.667208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.667340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.667480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.667602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.667738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.667914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.668092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.668232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.668412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.668559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.668699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.668846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.668977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.669114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.669253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.669416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.669558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.669739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.669881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.670074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.670211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.670379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.670517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.670689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.670830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.671000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.671135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.671308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.671450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.671617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.671757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.671925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.672065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.672234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.672375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.672537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.672678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.672857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.673012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.673188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.673340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.673489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.673621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.673795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.673936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.674131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.674281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.674445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:23:04.674588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.674753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.675951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.676897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.677968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.678903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.679997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.680912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.681866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.682896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.683841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.684770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.685878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.686870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.687968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.688900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.689877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.690990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.691905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.692074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.692216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.692362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.692985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.693938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.694852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.695952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.696876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.697929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.698911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.699977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.700934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.701879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.702986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.703935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.704874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.705971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.706931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.707999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.708143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.708864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.708995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.709873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.710989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.711922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.712868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.713928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.714863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.715966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.716922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.717926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.718968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.719928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.720891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.721991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.722965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.723662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.723853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.723853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.724908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.725950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.726933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.727991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.728963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.729975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.730929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.731852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.732783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.733987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.734866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.735963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.736920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.737300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.737437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.737567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.737742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.737869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.738061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.738391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.738544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.738686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.738818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.739809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.740879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.741949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.742894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.743918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.744072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.744211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.744344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.744517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.744659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.745212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.745362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.745496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.745628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.745758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.746934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.747876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.748974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.749916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.750920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.751989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.752937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.753832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.754943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.755591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.755802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.755941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.756912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.757937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.758896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.759950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.760868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.761835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.765406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.767393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.767626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.767626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.768055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.768275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.768504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.768736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.768950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.769172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.769393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.769629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.769869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.770155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.770376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.770643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.771419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.771640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.771890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.772109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.772324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.772537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.772759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.772977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.773207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.773435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.773654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.773875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.774140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.774389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.774750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.775093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.775317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.775578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.775807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.776909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.777069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.777629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.777806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.777953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.778980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.779935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.780893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.781946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.782845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.783887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.784965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.785898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.786994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.787113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.787225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.787363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.787651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.787871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.788885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.789888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.790871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.791977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.792926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.793148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.793370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.793580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.793814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.794024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.794281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.794520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.794746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.794964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.795188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.795408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.795408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.795850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.796086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.796322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.796536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.796764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.796983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.797209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.797439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.797935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.798319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.798554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.798779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.799002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.799234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.799534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.799753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.799987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.800216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.800445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.800664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.800906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.801134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.801353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.801580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.801797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.802049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.802313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.802542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.802770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.802991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.803225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.803480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.803695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.803921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.804152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.804372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.804372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.804828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.805044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.805268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.805484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.805714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.805892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.806028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.806212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.806453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.806689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.806871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.807998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.808907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.809997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.810984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.811930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.812906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.813920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.814979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.815910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.816993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.817132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.817132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.817389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.818990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.819973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.820871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.821953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.822752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.823940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.824958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.825931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.826929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.827860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.828961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.829917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.830907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.831906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.832985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.833180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.833837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.833972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.834868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.835948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.836890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.837970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.838954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.839966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.840971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.841892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.842004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.851382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.851697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.851847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.851981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.852947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.853901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.854881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.855958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.856916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.857860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.858863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.859972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.860974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.861932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.862375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.862510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.862640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.862772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.862904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.863861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.864977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.865921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.866883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.867969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.868811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.869925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.870981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.871945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.872894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.873991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.874895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.875946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.876986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.877953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.878901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.879212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.879376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.879538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.879691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.879846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.880532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.880772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.880936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.881883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.882854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.883980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.884958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.885968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.886936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.887885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.888979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.889960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.890948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.891908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.892884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.893569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.894595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.895484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.897046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:23:04.898012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:23:04.941651 n-d-858383-13 devstack@n-api.service[121010]: INFO dbcounter [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Registered counter for database nova_api Oct 18 13:23:04.955115 n-d-858383-13 devstack@n-api.service[121009]: INFO dbcounter [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Registered counter for database nova_api Oct 18 13:23:04.962941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:04.969573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:04.975976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_db.sqlalchemy.engines [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:04.982655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writer thread running {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.025909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.context [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121010) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:23:05.029960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.030464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.032034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.032755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.033204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.035199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.037208 n-d-858383-13 devstack@n-api.service[121010]: INFO dbcounter [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Registered counter for database nova_cell0 Oct 18 13:23:05.039744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.context [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121009) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:23:05.041277 n-d-858383-13 devstack@n-api.service[121010]: INFO dbcounter [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Registered counter for database nova_cell1 Oct 18 13:23:05.043800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.044271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.048028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.048028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.048028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.048797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.049061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.051160 n-d-858383-13 devstack@n-api.service[121009]: INFO dbcounter [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Registered counter for database nova_cell0 Oct 18 13:23:05.053012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.055159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.055866 n-d-858383-13 devstack@n-api.service[121009]: INFO dbcounter [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Registered counter for database nova_cell1 Oct 18 13:23:05.063319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_db.sqlalchemy.engines [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.066159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_db.sqlalchemy.engines [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.074458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writer thread running {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.074827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writer thread running {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.200416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.209882 n-d-858383-13 devstack@n-api.service[121010]: INFO dbcounter [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Registered counter for database nova_cell0 Oct 18 13:23:05.217127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.222491 n-d-858383-13 devstack@n-api.service[121009]: INFO dbcounter [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Registered counter for database nova_cell0 Oct 18 13:23:05.222708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.229791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_db.sqlalchemy.engines [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:23:05.234669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writer thread running {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:23:05.536942 n-d-858383-13 devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:23:05.544217 n-d-858383-13 devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:23:05.557127 n-d-858383-13 devstack@n-api.service[121009]: WARNING keystonemiddleware.auth_token [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:23:05.564367 n-d-858383-13 devstack@n-api.service[121009]: WARNING keystonemiddleware.auth_token [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:23:05.883285 n-d-858383-13 devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:23:05.889322 n-d-858383-13 devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-2de0a1ea-0093-4cf8-b027-32968fe7ce00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:23:05.894593 n-d-858383-13 devstack@n-api.service[121010]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f9a0bd9c0 pid: 121010 (default app) Oct 18 13:23:05.905502 n-d-858383-13 devstack@n-api.service[121009]: WARNING keystonemiddleware.auth_token [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:23:05.911510 n-d-858383-13 devstack@n-api.service[121009]: WARNING keystonemiddleware.auth_token [None req-f32c298c-e1b5-4100-a6d5-b6ccbe7e26d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:23:05.916781 n-d-858383-13 devstack@n-api.service[121009]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f9a0bd9c0 pid: 121009 (default app) Oct 18 13:23:47.875963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.876865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.877835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.878879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.186021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.186858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.187551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.188267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.414955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ba243e8-766b-4e07-8ad6-75ef4d678cb4 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Calling method '.version_select at 0x7fb332b65c10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:49.418558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ba243e8-766b-4e07-8ad6-75ef4d678cb4 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '22dc271d4d7b4add8a4efc8c7c766379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7877794986c42e7832288b3b53816b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ba243e8-766b-4e07-8ad6-75ef4d678cb4 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Request method failure captured: Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhxx2xl-vYlIocpeMdNiS3E7s8KoQ1MtuWIZTt-T5pmOPYA1s-ZVVmFSvnsrddndqr5TI9jYFEe7vJaeosSVBdDTbFSThwEOIXZTOD_t6mpg5ADKqS4pecRtL09G4La4N_KX8Fd-_a0GB69hI-WmSuXIDjos_vqBMv7xgajwfUtnU Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:23:49.423551 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7877794986c42e7832288b3b53816b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7877794986c42e7832288b3b53816b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 22dc271d4d7b4add8a4efc8c7c766379 Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:23:49.428644 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:49.429387 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:23:49.430299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.431368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ba243e8-766b-4e07-8ad6-75ef4d678cb4 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:49.431368 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ba243e8-766b-4e07-8ad6-75ef4d678cb4 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.556995 Oct 18 13:23:49.431700 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:49.438655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e6f3f80-de85-4bbb-8f38-da734c559c3b tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Calling method '.version_select at 0x7fb332a2b5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:49.441531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e6f3f80-de85-4bbb-8f38-da734c559c3b tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '22dc271d4d7b4add8a4efc8c7c766379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7877794986c42e7832288b3b53816b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e6f3f80-de85-4bbb-8f38-da734c559c3b tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Request method failure captured: Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhxx2xl-vYlIocpeMdNiS3E7s8KoQ1MtuWIZTt-T5pmOPYA1s-ZVVmFSvnsrddndqr5TI9jYFEe7vJaeosSVBdDTbFSThwEOIXZTOD_t6mpg5ADKqS4pecRtL09G4La4N_KX8Fd-_a0GB69hI-WmSuXIDjos_vqBMv7xgajwfUtnU Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:23:49.443748 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7877794986c42e7832288b3b53816b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7877794986c42e7832288b3b53816b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 22dc271d4d7b4add8a4efc8c7c766379 Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:23:49.445130 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:49.445814 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:23:49.446874 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.448691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e6f3f80-de85-4bbb-8f38-da734c559c3b tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:49.450296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e6f3f80-de85-4bbb-8f38-da734c559c3b tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.016351 Oct 18 13:23:49.452553 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2/2] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:23:49 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:49.466850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab248f1c-c315-46a4-88e0-0d97027a1d0c tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Calling method '.version_select at 0x7fb332a2b5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:49.469407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab248f1c-c315-46a4-88e0-0d97027a1d0c tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '22dc271d4d7b4add8a4efc8c7c766379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7877794986c42e7832288b3b53816b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab248f1c-c315-46a4-88e0-0d97027a1d0c tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Request method failure captured: Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhxx2xl-vYlIocpeMdNiS3E7s8KoQ1MtuWIZTt-T5pmOPYA1s-ZVVmFSvnsrddndqr5TI9jYFEe7vJaeosSVBdDTbFSThwEOIXZTOD_t6mpg5ADKqS4pecRtL09G4La4N_KX8Fd-_a0GB69hI-WmSuXIDjos_vqBMv7xgajwfUtnU Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:23:49.471224 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7877794986c42e7832288b3b53816b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7877794986c42e7832288b3b53816b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 22dc271d4d7b4add8a4efc8c7c766379 Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:23:49.472380 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:49.473920 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:23:49.475030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:49.477122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab248f1c-c315-46a4-88e0-0d97027a1d0c tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:49.478888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab248f1c-c315-46a4-88e0-0d97027a1d0c tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021724 Oct 18 13:23:49.480335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3/3] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Oct 18 13:23:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:49.681390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '.version_select at 0x7fb332b63c10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:49.688389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121009) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 13:23:49.689470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.690117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.690712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.723950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.724737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.745995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.747262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.747730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.755978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4df7233-2233-4e3b-9324-55667093caa2 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.579113 Oct 18 13:23:49.756977 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1/4] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:23:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:49.998299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Calling method '.version_select at 0x7fb333392b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.006535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121010) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 13:23:50.007605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.008138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.008654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.036559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.037373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.038006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.053350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.054104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.054984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.064675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-252ef498-9bce-46ea-a609-09015699754f tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.575023 Oct 18 13:23:50.069987 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4/5] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:23:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.074840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1aa368a0-79c4-4fbd-bf2d-d57d359c19d8 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-630955413", "name": "tempest-test_aggregate-1678920356"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:50.117310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-1aa368a0-79c4-4fbd-bf2d-d57d359c19d8 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid de3a3efa-2f64-4b10-8bb9-efe197976c46 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:23:50.161853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.164448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.165635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.166188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.166943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.169412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.169916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.227370 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88d10aad-2520-4c92-a4d7-efc0762e400c tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.469057 Oct 18 13:23:50.228175 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2/6] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 18 13:23:49 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:50.294084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Calling method '.version_select at 0x7fb332a62b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.304110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.304609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.304812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1aa368a0-79c4-4fbd-bf2d-d57d359c19d8 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.233474 Oct 18 13:23:50.305115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.310297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 5/7] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 18 13:23:50 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.338839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.342435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.342435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.373647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.376120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.377661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.407766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-379b4095-72f2-4ca4-8290-19405961ea05 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.178382 Oct 18 13:23:50.408697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3/8] 10.222.0.27 () {60 vars in 1208 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:50.583613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4c0f5a0-89b3-4f6c-9d94-cdfcd3826c1b tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1469719566", "ram": 512, "vcpus": 1, "disk": 10, "id": 1863630560, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:50.634917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.638482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.638969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.639462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.640186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.642890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.642890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.665611 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-362251c4-4381-4ae9-87c2-98f45d6ea71b tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.255169 Oct 18 13:23:50.666394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4/9] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.672224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9455de37-c83c-4e06-8c41-e3437712cfa2 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Calling method '.version_select at 0x7fb3329eff70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.674890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9455de37-c83c-4e06-8c41-e3437712cfa2 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '22dc271d4d7b4add8a4efc8c7c766379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7877794986c42e7832288b3b53816b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9455de37-c83c-4e06-8c41-e3437712cfa2 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Request method failure captured: Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjhxx2xl-vYlIocpeMdNiS3E7s8KoQ1MtuWIZTt-T5pmOPYA1s-ZVVmFSvnsrddndqr5TI9jYFEe7vJaeosSVBdDTbFSThwEOIXZTOD_t6mpg5ADKqS4pecRtL09G4La4N_KX8Fd-_a0GB69hI-WmSuXIDjos_vqBMv7xgajwfUtnU Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:23:50.679966 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7877794986c42e7832288b3b53816b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7877794986c42e7832288b3b53816b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 22dc271d4d7b4add8a4efc8c7c766379 Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1'} Oct 18 13:23:50.680937 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:50.681976 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:23:50.683047 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.683893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9455de37-c83c-4e06-8c41-e3437712cfa2 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:50.683893 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9455de37-c83c-4e06-8c41-e3437712cfa2 tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012811 Oct 18 13:23:50.687386 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:50.692324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.694368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.694866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.695474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.696343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.697140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.697811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.720520 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4c0f5a0-89b3-4f6c-9d94-cdfcd3826c1b tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.408271 Oct 18 13:23:50.723500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93c269ea-a62a-412b-851e-63ffd7d347e3 tempest-AZAdminV2TestJSON-515838644 tempest-AZAdminV2TestJSON-515838644-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.034261 Oct 18 13:23:50.724081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.725062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 6/12] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:50 2022] POST /compute/v2.1/flavors => generated 416 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.733428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4cf3b6a9-0287-4736-ab51-806bcaffae96 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.742964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aafbed7-ef8e-4f77-873e-8dad8cbb0bc0 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Calling method '.version_select at 0x7fb332106310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.747612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9aafbed7-ef8e-4f77-873e-8dad8cbb0bc0 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] HTTP exception thrown: Hypervisor with ID '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' could not be found. Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aafbed7-ef8e-4f77-873e-8dad8cbb0bc0 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Request method failure captured: Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors/3e9611f0-efc1-4582-8989-b6d7d3ac1b37/uptime HTTP/1.1 Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjj4DkraoquaFE0NGCuHdvXL3DiDJJKyYs-DaxQHSUedO-KBujbFLM_bXS_31UuyJYOsgoHts4T4jp9Kew1aCqGSeoXsqal9trKwtRf0XRkXeprw4PZNhJxKs0vWlJFDjCjRcPg4dFxErfZ7m4ivQzJ7qt_zgMtctIZDSq-a1xXzYE Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b8041278f3fb45fc85b8b2fcbd710cdb Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:23:50.752637 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b8041278f3fb45fc85b8b2fcbd710cdb Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 74bf20bbe43347699c4730b47d4b4030 Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: exception: Hypervisor with ID '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' could not be found. Oct 18 13:23:50.753671 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3e9611f0-efc1-4582-8989-b6d7d3ac1b37'} Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 13:23:50.754321 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' could not be found. Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:50.755308 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' could not be found. Oct 18 13:23:50.756221 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:50.756542 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4cf3b6a9-0287-4736-ab51-806bcaffae96 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.027636 Oct 18 13:23:50.756542 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:50.758367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6eff920-7b10-447b-9cf9-c3a97d27523e tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:50.760003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aafbed7-ef8e-4f77-873e-8dad8cbb0bc0 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Returning 404 to user: Hypervisor with ID '3e9611f0-efc1-4582-8989-b6d7d3ac1b37' could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:50.761425 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9aafbed7-ef8e-4f77-873e-8dad8cbb0bc0 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/3e9611f0-efc1-4582-8989-b6d7d3ac1b37/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035393 Oct 18 13:23:50.766434 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-hypervisors/3e9611f0-efc1-4582-8989-b6d7d3ac1b37/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:50.771894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1beb3e87-baa6-407e-a07e-1622dfe59983 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:50.797364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1beb3e87-baa6-407e-a07e-1622dfe59983 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.801766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1beb3e87-baa6-407e-a07e-1622dfe59983 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.807190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1beb3e87-baa6-407e-a07e-1622dfe59983 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.909381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6eff920-7b10-447b-9cf9-c3a97d27523e tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.154290 Oct 18 13:23:50.915539 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 8/15] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 18 13:23:50 2022] POST /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:50.915835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Calling method '.version_select at 0x7fb3329f1c10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.917707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.918313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.918767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.934102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.935098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.935914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.947262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.947987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.948590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.955648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8fc2a4f0-88c0-4c96-ab38-bc61fa1d3d7c tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.043658 Oct 18 13:23:50.956573 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:51.169070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-559542b3-829c-4ea7-b954-1398566504bc tempest-FlavorsExtraSpecsTestJSON-30885518 tempest-FlavorsExtraSpecsTestJSON-30885518-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.189169 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-559542b3-829c-4ea7-b954-1398566504bc tempest-FlavorsExtraSpecsTestJSON-30885518 tempest-FlavorsExtraSpecsTestJSON-30885518-project] 10.222.0.27 "GET /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.230944 Oct 18 13:23:51.189986 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 10/17] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.210080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f92801c-38fc-4251-903d-217dbd46516e tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Calling method '.version_select at 0x7fb332980a60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.211992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5f92801c-38fc-4251-903d-217dbd46516e tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '22dc271d4d7b4add8a4efc8c7c766379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7877794986c42e7832288b3b53816b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f92801c-38fc-4251-903d-217dbd46516e tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Request method failure captured: Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjhxx2xl-vYlIocpeMdNiS3E7s8KoQ1MtuWIZTt-T5pmOPYA1s-ZVVmFSvnsrddndqr5TI9jYFEe7vJaeosSVBdDTbFSThwEOIXZTOD_t6mpg5ADKqS4pecRtL09G4La4N_KX8Fd-_a0GB69hI-WmSuXIDjos_vqBMv7xgajwfUtnU Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:23:51.213656 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7877794986c42e7832288b3b53816b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7877794986c42e7832288b3b53816b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7877794986c42e7832288b3b53816b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a7877794986c42e7832288b3b53816b7 Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878 Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 22dc271d4d7b4add8a4efc8c7c766379 Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1587725878-project Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1'} Oct 18 13:23:51.214936 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:51.215884 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:23:51.217594 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.219490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f92801c-38fc-4251-903d-217dbd46516e tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:51.220079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5f92801c-38fc-4251-903d-217dbd46516e tempest-HypervisorAdminNegativeTestJSON-1587725878 tempest-HypervisorAdminNegativeTestJSON-1587725878-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.028934 Oct 18 13:23:51.220619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 11/18] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:51.232978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69949e13-b385-40ba-a3b4-4080112d2d31 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:51.270738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69949e13-b385-40ba-a3b4-4080112d2d31 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046474 Oct 18 13:23:51.275295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 12/19] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 18 13:23:51 2022] POST /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.280919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ae94007-e1e3-4626-92ad-184df3fd8b06 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Calling method '.version_select at 0x7fb3328da940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.283115 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0ae94007-e1e3-4626-92ad-184df3fd8b06 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] HTTP exception thrown: Hypervisor with ID '93e2bb7a-ca22-489c-ad34-919b8f3850db' could not be found. Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ae94007-e1e3-4626-92ad-184df3fd8b06 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Request method failure captured: Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hypervisors/93e2bb7a-ca22-489c-ad34-919b8f3850db HTTP/1.1 Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjj4DkraoquaFE0NGCuHdvXL3DiDJJKyYs-DaxQHSUedO-KBujbFLM_bXS_31UuyJYOsgoHts4T4jp9Kew1aCqGSeoXsqal9trKwtRf0XRkXeprw4PZNhJxKs0vWlJFDjCjRcPg4dFxErfZ7m4ivQzJ7qt_zgMtctIZDSq-a1xXzYE Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b8041278f3fb45fc85b8b2fcbd710cdb Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:23:51.285770 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8041278f3fb45fc85b8b2fcbd710cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b8041278f3fb45fc85b8b2fcbd710cdb Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165 Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 74bf20bbe43347699c4730b47d4b4030 Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: exception: Hypervisor with ID '93e2bb7a-ca22-489c-ad34-919b8f3850db' could not be found. Oct 18 13:23:51.286813 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93e2bb7a-ca22-489c-ad34-919b8f3850db'} Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '93e2bb7a-ca22-489c-ad34-919b8f3850db' Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 13:23:51.287383 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:23:51.288389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '93e2bb7a-ca22-489c-ad34-919b8f3850db' could not be found. Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '93e2bb7a-ca22-489c-ad34-919b8f3850db' could not be found. Oct 18 13:23:51.289286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:23:51.291506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ae94007-e1e3-4626-92ad-184df3fd8b06 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] Returning 404 to user: Hypervisor with ID '93e2bb7a-ca22-489c-ad34-919b8f3850db' could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:51.292526 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ae94007-e1e3-4626-92ad-184df3fd8b06 tempest-HypervisorAdminNegativeTestJSON-2144293165 tempest-HypervisorAdminNegativeTestJSON-2144293165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/93e2bb7a-ca22-489c-ad34-919b8f3850db" status: 404 len: 123 microversion: 2.1 time: 0.016064 Oct 18 13:23:51.293374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 13/20] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/os-hypervisors/93e2bb7a-ca22-489c-ad34-919b8f3850db => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:51.307824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-debd2c3e-a662-4249-832a-7e236aad4f5b tempest-FlavorsExtraSpecsTestJSON-30885518 tempest-FlavorsExtraSpecsTestJSON-30885518-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.319488 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-debd2c3e-a662-4249-832a-7e236aad4f5b tempest-FlavorsExtraSpecsTestJSON-30885518 tempest-FlavorsExtraSpecsTestJSON-30885518-project] 10.222.0.27 "GET /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024219 Oct 18 13:23:51.320552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 14/21] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.330111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42762538-28f7-4a89-90de-e97fd4c947b9 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:51.358242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42762538-28f7-4a89-90de-e97fd4c947b9 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031500 Oct 18 13:23:51.359476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 15/22] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Oct 18 13:23:51 2022] POST /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.372751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6615bbb3-f92e-407e-8392-a75283c7e2a6 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.400459 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6615bbb3-f92e-407e-8392-a75283c7e2a6 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035423 Oct 18 13:23:51.406805 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 16/23] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.413825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ab8ed68-56fe-4219-8056-014736b62bdb tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:51.533294 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ab8ed68-56fe-4219-8056-014736b62bdb tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.125200 Oct 18 13:23:51.534743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 17/24] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 18 13:23:51 2022] PUT /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes => generated 22 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.543172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c975e25-73fd-43fb-8617-aea7c3f25454 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.565366 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c975e25-73fd-43fb-8617-aea7c3f25454 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026216 Oct 18 13:23:51.569351 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 18/25] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/flavors/1863630560/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:23:51.586302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-440934ee-bb4d-4ea4-bc33-862168569b8b tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.697164 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-440934ee-bb4d-4ea4-bc33-862168569b8b tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.121332 Oct 18 13:23:51.700771 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 19/26] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:23:51 2022] DELETE /compute/v2.1/flavors/1863630560/os-extra_specs/hw:numa_nodes => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:23:51.712577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28a1f017-fb98-414e-ae37-f041215ec502 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.818266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28a1f017-fb98-414e-ae37-f041215ec502 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1863630560/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.116177 Oct 18 13:23:51.819574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 20/27] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:23:51 2022] DELETE /compute/v2.1/flavors/1863630560/os-extra_specs/hw:cpu_policy => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:23:51.827489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c827b226-e80d-4362-92a9-ab94f1151718 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.841717 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c827b226-e80d-4362-92a9-ab94f1151718 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1863630560/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018341 Oct 18 13:23:51.843000 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 21/28] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/flavors/1863630560/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:51.855132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0aebfbac-0e13-461a-a172-dc9a2f9ea9d3 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.867480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=76,nova_api:SAVEPOINT=9,nova_api:INSERT=2,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:51.973844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0aebfbac-0e13-461a-a172-dc9a2f9ea9d3 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1863630560" status: 202 len: 0 microversion: 2.1 time: 0.122685 Oct 18 13:23:51.977520 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 22/29] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:23:51 2022] DELETE /compute/v2.1/flavors/1863630560 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:51.983278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f5da4d8-5a1a-4a7f-bba4-c463cb63b4e8 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:52.053197 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f5da4d8-5a1a-4a7f-bba4-c463cb63b4e8 tempest-FlavorsExtraSpecsTestJSON-850824149 tempest-FlavorsExtraSpecsTestJSON-850824149-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073394 Oct 18 13:23:52.056737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 23/30] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:52.213474 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1beb3e87-baa6-407e-a07e-1622dfe59983 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.446251 Oct 18 13:23:52.218150 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 8/31] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:23:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:53.184946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1302327555", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "availability_zone": "tempest-test_az-630955413"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:53.222937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:53.223661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:53.224282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:53.225187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:53.225909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:53.226456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:54.763368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:55.132887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:55.133321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:55.133782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:55.134232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:55.134796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:55.159043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.159710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.160181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.160925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.161387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.161816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.206710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Getting quotas for project 36b87172368b42f4b089504ac3b545a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:55.214124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Getting quotas for user a448bc53c0d343f2bbc87667c88cbd0d and project 36b87172368b42f4b089504ac3b545a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:55.241296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:55.244774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:55.413131 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21dd2bee-2c99-427f-a95c-62ad3f331934 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.737100 Oct 18 13:23:55.419865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 24/32] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:23:55.427014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ec47c54-d689-4942-a432-62d126b2869f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:55.429124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ec47c54-d689-4942-a432-62d126b2869f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:56.572271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-74767041", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:56.626521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ec47c54-d689-4942-a432-62d126b2869f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:56.639943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:56.652543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ec47c54-d689-4942-a432-62d126b2869f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1242 microversion: 2.1 time: 1.231054 Oct 18 13:23:56.653643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 9/33] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:55 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1242 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:56.947986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:56.948591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:56.949215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:56.949769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:56.950367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:56.966547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:56.970974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:56.972032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:56.975636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:56.978214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:56.978768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:57.035503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Getting quotas for project 3a90038712264f0a852d014124619cfc. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:57.045792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Getting quotas for user 31f765d197374f1cb5bdfa5890d74f7d and project 3a90038712264f0a852d014124619cfc. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:57.059263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:57.061439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:57.252710 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4779b3ac-c8b6-4b5f-9589-23ff968a04ee tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242258 Oct 18 13:23:57.266263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e94f41d2-a50f-4d7d-a5cb-9ffd433a8fb8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:57.267167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e94f41d2-a50f-4d7d-a5cb-9ffd433a8fb8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:57.271236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 25/34] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:23:57.343851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e94f41d2-a50f-4d7d-a5cb-9ffd433a8fb8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:57.353249 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e94f41d2-a50f-4d7d-a5cb-9ffd433a8fb8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1218 microversion: 2.1 time: 0.090670 Oct 18 13:23:57.354196 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 10/35] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:57 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:57.678155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a162a33c-ddec-4070-9273-7fb04e19e05d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:57.678155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a162a33c-ddec-4070-9273-7fb04e19e05d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:57.835377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a162a33c-ddec-4070-9273-7fb04e19e05d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:57.875390 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a162a33c-ddec-4070-9273-7fb04e19e05d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1242 microversion: 2.1 time: 0.202392 Oct 18 13:23:57.878240 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 26/36] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:57 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:58.378578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0f4492c-1abb-4ba4-924d-dbdfd4d927fa tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:58.379215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0f4492c-1abb-4ba4-924d-dbdfd4d927fa tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:58.484127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0f4492c-1abb-4ba4-924d-dbdfd4d927fa tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:58.494551 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0f4492c-1abb-4ba4-924d-dbdfd4d927fa tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1218 microversion: 2.1 time: 0.119640 Oct 18 13:23:58.509456 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 11/37] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:58 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:58.906250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:58.906874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:58.919437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.920781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.921400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:58.922677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.924559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.925153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.139856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:59.159457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34d1a9d6-ad8d-4679-9ce2-8c0522112c76 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1242 microversion: 2.1 time: 0.259434 Oct 18 13:23:59.161525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 27/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:58 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1242 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:59.523019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:59.523989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:59.536231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:59.537951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:59.540619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.550280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:59.552070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:59.553388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.825088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:59.834946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20e7f44b-acd5-4e4d-9569-400b5e222adb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1222 microversion: 2.1 time: 0.315791 Oct 18 13:23:59.835848 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 28/39] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:59 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1222 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:59.952942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ac6f1dc-fb57-4f4d-9600-68f3b415fd70 tempest-AZAdminNegativeTestJSON-827013281 tempest-AZAdminNegativeTestJSON-827013281-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:59.954660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ac6f1dc-fb57-4f4d-9600-68f3b415fd70 tempest-AZAdminNegativeTestJSON-827013281 tempest-AZAdminNegativeTestJSON-827013281-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '7f4af9a980a64d1e98c7d58fbdadcee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddd7c4776dd4f8dbb24e1389d48ca88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ac6f1dc-fb57-4f4d-9600-68f3b415fd70 tempest-AZAdminNegativeTestJSON-827013281 tempest-AZAdminNegativeTestJSON-827013281-project] Request method failure captured: Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjt-5hCidOCBJkk1vWjn0M8F6gWAS5xpwJuU6Qnf9-8TOg_FYcV8Q8iZ19U1pNflWi7OG1gVMIjeZIr4q4WgiGLpWogt86eP2i-rgTN_5bJo530V_kZ_3-NdQlb-8m4P167aNEQ8YDt0KOG-7Mm_xd9XrHd67yjSbpx5RM3lHQapDs Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fddd7c4776dd4f8dbb24e1389d48ca88 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AZAdminNegativeTestJSON-827013281 Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:23:59.957916 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fddd7c4776dd4f8dbb24e1389d48ca88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fddd7c4776dd4f8dbb24e1389d48ca88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fddd7c4776dd4f8dbb24e1389d48ca88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fddd7c4776dd4f8dbb24e1389d48ca88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AZAdminNegativeTestJSON-827013281 Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fddd7c4776dd4f8dbb24e1389d48ca88 Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-827013281 Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AZAdminNegativeTestJSON-827013281-project Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7f4af9a980a64d1e98c7d58fbdadcee5 Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AZAdminNegativeTestJSON-827013281-project Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:23:59.959040 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:23:59.959646 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:23:59.960530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:23:59.962976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ac6f1dc-fb57-4f4d-9600-68f3b415fd70 tempest-AZAdminNegativeTestJSON-827013281 tempest-AZAdminNegativeTestJSON-827013281-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:59.964862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ac6f1dc-fb57-4f4d-9600-68f3b415fd70 tempest-AZAdminNegativeTestJSON-827013281 tempest-AZAdminNegativeTestJSON-827013281-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.476591 Oct 18 13:23:59.965775 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 12/40] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:23:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:00.192365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.193219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:00.205729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.209019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.210335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.211245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.213158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.213829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.407668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:00.420831 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4beb689b-2ca6-464a-9b1d-e159cddbd92f tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1290 microversion: 2.1 time: 0.236721 Oct 18 13:24:00.421452 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 29/41] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1290 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:00.890357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c397e8d1-c757-4484-8431-89c5d1c765fd tempest-InstanceUsageAuditLogTestJSON-1544425417 tempest-InstanceUsageAuditLogTestJSON-1544425417-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.890357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c397e8d1-c757-4484-8431-89c5d1c765fd tempest-InstanceUsageAuditLogTestJSON-1544425417 tempest-InstanceUsageAuditLogTestJSON-1544425417-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 13:24:00" status: 200 len: 318 microversion: 2.1 time: 0.402096 Oct 18 13:24:00.890357 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 13/42] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013%3A24%3A00 => generated 318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:00.893818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62ead103-18c6-4b58-b517-f9222df85ba1 tempest-InstanceUsageAuditLogTestJSON-1544425417 tempest-InstanceUsageAuditLogTestJSON-1544425417-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.893818 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62ead103-18c6-4b58-b517-f9222df85ba1 tempest-InstanceUsageAuditLogTestJSON-1544425417 tempest-InstanceUsageAuditLogTestJSON-1544425417-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.024556 Oct 18 13:24:00.893818 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 30/43] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:00.899787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.899787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:00.899787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.899787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.902897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.902897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.902897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.902897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.080181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:01.101308 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9fe99a81-56a2-4627-93be-7da0c8881568 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1270 microversion: 2.1 time: 0.246094 Oct 18 13:24:01.101946 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 14/44] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:01.451344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:01.452248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:01.465806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:01.477363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:01.477879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.478779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:01.483596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:01.484373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.630017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:01.637767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a7b40854-cb21-41fc-bb0f-f7dbeb6c168b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1308 microversion: 2.1 time: 0.190355 Oct 18 13:24:01.641574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 31/45] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:01 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:02.127863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:02.129161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:02.139283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.141175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.141791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.143820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.145290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.146206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.317410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:02.336570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47a6d125-4912-400f-8705-a3e2af5159de tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1288 microversion: 2.1 time: 0.212904 Oct 18 13:24:02.337157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 15/46] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:02 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1288 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:02.662331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:02.663560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:02.675167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.676875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.679905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.680824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.681489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.682142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.819380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:02.831235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94a5fc62-9131-44ad-b066-7d6e1ea074be tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1296 microversion: 2.1 time: 0.174192 Oct 18 13:24:02.836538 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 32/47] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:02 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:03.364007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:03.364717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:03.389913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.403061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.403394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.408917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.410943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.417794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.812762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:03.842742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3451ef90-32b6-4bc4-b0bd-d143cfab7aa4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1276 microversion: 2.1 time: 0.479729 Oct 18 13:24:03.848017 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 16/48] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:03 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1276 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:03.861583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:03.864045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:03.883051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.884948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.885764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.888608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.889600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.890296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.080166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:04.139125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96d6ab79-edc9-438e-b0c8-9664c093534c tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1296 microversion: 2.1 time: 0.259421 Oct 18 13:24:04.139125 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 33/49] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:03 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:04.875298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:04.875929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:04.892628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.892628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.892628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.892628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.893085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.899176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:05.153468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:05.154599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:05.166274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:05.177134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:05.181532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97850147-c94a-4906-9d9f-b7d4836aa994 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1276 microversion: 2.1 time: 0.304049 Oct 18 13:24:05.182427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 17/50] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:04 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:05.199887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:05.200434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:05.213342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:05.213984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:05.221881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:05.900540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:05.920690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc25a2e5-cc1b-4878-bc70-0fa7cc401c16 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.771523 Oct 18 13:24:05.924029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 34/51] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:05 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:06.204542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:06.205161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:06.228885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:06.229718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:06.231988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:06.235845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:06.238244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:06.239399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:06.707115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:06.721415 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-244569c5-eed5-4ed6-a5d7-94e8e8d0f7c0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1276 microversion: 2.1 time: 0.520824 Oct 18 13:24:06.749287 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 18/52] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:06 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1276 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:06.953302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:06.957433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:06.991936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:06.994496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:06.998701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:07.002224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:07.004997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:07.007577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:07.010690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:07.751817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:07.753173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:07.768448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:07.773432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:07.776834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:07.778772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:07.782237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:07.784299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:07.811791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:07.825840 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4762558a-777c-4186-8475-6ce9eacdc9e9 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.878205 Oct 18 13:24:07.836194 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 35/53] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:06 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:08.863204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:08.866427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:08.874674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:08.875719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:08.876549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:08.877799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:08.879673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:08.880434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:09.584747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:09.598555 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8f4924f-852f-414e-b64b-b02aeb350ba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.742785 Oct 18 13:24:09.601788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 36/54] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:08 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:09.938223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:09.973349 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50ec2c2b-8730-429f-8da3-5018b9128d76 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 2.225545 Oct 18 13:24:09.974749 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 19/55] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:07 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:10.568790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25c608df-6c72-4766-8382-c233d26a63bb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:10.586852 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25c608df-6c72-4766-8382-c233d26a63bb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.615419 Oct 18 13:24:10.603299 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 37/56] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:24:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:10.635993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:10.637051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:10.648056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.655039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.657984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.660641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.662864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.674766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.691725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:10.811510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:10.976952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:11.004480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6d74625-66a3-40da-b179-6d0f5b4e9633 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.380849 Oct 18 13:24:11.027857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 38/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:10 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:11.042641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:11.044076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:11.067737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.072846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.072846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.072846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.072846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.073191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.228046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c65b287b-a6df-4fab-b841-149d9db757f3 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1996647449", "id": 803507013, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:11.366251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c65b287b-a6df-4fab-b841-149d9db757f3 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.763858 Oct 18 13:24:11.367324 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 20/58] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:10 2022] POST /compute/v2.1/flavors => generated 422 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:11.388783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12d8579e-fb01-4ef3-9018-b23c3c747469 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:11.497596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12d8579e-fb01-4ef3-9018-b23c3c747469 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.119939 Oct 18 13:24:11.501537 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 21/59] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 18 13:24:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:24:11.529918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcf8876c-85f9-452b-81f5-4eac51bcd862 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-647075578", "id": 303231382, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:11.658948 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcf8876c-85f9-452b-81f5-4eac51bcd862 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.146355 Oct 18 13:24:11.662212 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 22/60] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:11 2022] POST /compute/v2.1/flavors => generated 421 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:11.679672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:11.680205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c4ec23c-ff29-443e-b859-95db30a45895 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:11.688168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98e03ed7-6709-40ae-9077-53a8d13f79e1 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.659406 Oct 18 13:24:11.704714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c4ec23c-ff29-443e-b859-95db30a45895 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035228 Oct 18 13:24:11.711650 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 39/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:11 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:11.720939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 23/62] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 18 13:24:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:24:11.727860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5be0e97-8eaa-47a4-b8b3-f6882382f8a8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Action: 'create', calling method: .version_select at 0x7fb331f1b310>, body: {"keypair": {"name": "tempest-keypair-1153960216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9ByA4zitlX7uRlAbiU2+G6Xxe3Vaqv+yO6EFFpQOCHWV7dO/vdZnuJk/gQ7PadOdaZcVpx0uOjxO47j13eelS9V33qlHwGhhGLJvgTYicCW2P588VSS8hFeza+o1T5aA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:11.812783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b5be0e97-8eaa-47a4-b8b3-f6882382f8a8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:11.824345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b5be0e97-8eaa-47a4-b8b3-f6882382f8a8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for user d75623286dda46cfb4d8d70608655b9c and project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:11.962135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5be0e97-8eaa-47a4-b8b3-f6882382f8a8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244001 Oct 18 13:24:11.969833 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 40/63] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:24:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:12.055948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:12.055948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:12.061453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.063761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.066545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.067411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.075907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.079260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.867135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:12.879423 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7923b374-f5d0-47bc-9acb-efe44fa940d6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.845167 Oct 18 13:24:12.881277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 24/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:12 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:12.891507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:12.894988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:12.927392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.927910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.932354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.933886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.937791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.942375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:13.260430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d79ce6-c390-4b52-bb04-98b58d28746e", "tag": "bca3ed3b-ee4e-4e8a-9302-49cf6026e99a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:13.344985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:13.345512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:13.353065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:13.477786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Creating event network-changed:bca3ed3b-ee4e-4e8a-9302-49cf6026e99a for instance a0d79ce6-c390-4b52-bb04-98b58d28746e on n-h1-858383-13 Oct 18 13:24:13.506574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:24:13.507200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad9eb3d7-e7b7-485f-897c-14bbde10a16c req-a6a53c2b-21fd-4815-a727-98566cfcd7a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:24:13.508647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:13.509352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:13.510566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:13.513899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:13.515516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:13.516772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:13.544682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:13.545997 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.compute.rpcapi [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 13:24:13.547379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] Releasing lock "compute-rpcapi-router" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:24:13.584599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d506d2b0-d1ce-4248-b214-5fe52d1d532d None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.010952 Oct 18 13:24:13.585662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 41/65] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:14.112101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13e005b4-f0ed-4007-bd30-e2762cf2c877 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T13%3A24%3A13.497125&end=2022-10-19T13%3A24%3A13.497125" status: 404 len: 112 microversion: - time: 0.522891 Oct 18 13:24:14.121991 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 42/66] 10.222.0.27 () {58 vars in 1316 bytes} [Tue Oct 18 13:24:13 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T13%3A24%3A13.497125&end=2022-10-19T13%3A24%3A13.497125 => generated 112 bytes in 534 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:24:14.129899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:14.132785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:14.140622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.142482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.143164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.145540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.146593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.147373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.206127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:14.218468 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ced31e7-5514-4af1-8cc5-feabea5bc0e7 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 1.335391 Oct 18 13:24:14.220882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 25/67] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:12 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:14.463014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8807b8d2-ac24-48a6-9750-6eb19f0c667a tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1466386174", "id": 1523151853, "os-flavor-access:is_public": "False"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:14.550404 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8807b8d2-ac24-48a6-9750-6eb19f0c667a tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.327957 Oct 18 13:24:14.551626 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 26/68] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:14 2022] POST /compute/v2.1/flavors => generated 439 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:14.568421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81dd65fe-8861-43d2-84c4-a2867baecef5 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] Calling method '.version_select at 0x7fb331f55ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:14.592012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-81dd65fe-8861-43d2-84c4-a2867baecef5 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81dd65fe-8861-43d2-84c4-a2867baecef5 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] Request method failure captured: Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-simple-tenant-usage/748ad38d438a464d8d73664f969a1962?start=2022-10-19T13%3A24%3A13.497125&end=2022-10-17T13%3A24%3A13.497125 HTTP/1.1 Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqj9BY36njUWS7x--d_q6pL4zMXvWKGxQwXeaFCBNIj6cgxINevUwaSYgjABB_CCckUplH5YySzgncoSAcSxizzjWkMjQlAHOW7YU1p1QeSQpFEFDumei8adW8x0_T7paUNLlc5EEUeQ8lr9MO-UJIwe3tdZLWkcsoSrrdU8jFGjVko Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 537cf3b6d17640568fbd1693b4df84ae Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-266242431 Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:14.607305 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/537cf3b6d17640568fbd1693b4df84ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/537cf3b6d17640568fbd1693b4df84ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/537cf3b6d17640568fbd1693b4df84ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_537cf3b6d17640568fbd1693b4df84ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-266242431 Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 537cf3b6d17640568fbd1693b4df84ae Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-266242431 Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TenantUsagesNegativeTestJSON-266242431-project-admin Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9a79b34ddcf644e8834892ff9e326fc1 Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-266242431-project-admin Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid start time. The start time cannot occur after the end time. Oct 18 13:24:14.608488 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '748ad38d438a464d8d73664f969a1962'} Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:24:14.609158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81dd65fe-8861-43d2-84c4-a2867baecef5 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:14.610203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81dd65fe-8861-43d2-84c4-a2867baecef5 tempest-TenantUsagesNegativeTestJSON-266242431 tempest-TenantUsagesNegativeTestJSON-266242431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/748ad38d438a464d8d73664f969a1962?start=2022-10-19T13%3A24%3A13.497125&end=2022-10-17T13%3A24%3A13.497125" status: 400 len: 111 microversion: 2.1 time: 0.049945 Oct 18 13:24:14.611342 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 27/69] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 18 13:24:14 2022] GET /compute/v2.1/os-simple-tenant-usage/748ad38d438a464d8d73664f969a1962?start=2022-10-19T13%3A24%3A13.497125&end=2022-10-17T13%3A24%3A13.497125 => generated 111 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:24:14.619688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59cfbbce-7c46-4301-9930-723bda4d8e98 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:14.823373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59cfbbce-7c46-4301-9930-723bda4d8e98 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1523151853/action" status: 200 len: 97 microversion: 2.1 time: 0.207183 Oct 18 13:24:14.825274 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 28/70] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:24:14 2022] POST /compute/v2.1/flavors/1523151853/action => generated 97 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:24:14.939491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:14.955119 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4af2f916-6d7c-4f61-8018-184d31b53057 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.831004 Oct 18 13:24:14.970481 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 43/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:14 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:14.987246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec81365-34ab-412f-bce5-54068527684c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:15.207279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1e0f467-95b5-48c6-94d7-c64e694ccc78 tempest-TenantUsagesNegativeTestJSON-577151624 tempest-TenantUsagesNegativeTestJSON-577151624-project] Calling method '.version_select at 0x7fb332005790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.212824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1e0f467-95b5-48c6-94d7-c64e694ccc78 tempest-TenantUsagesNegativeTestJSON-577151624 tempest-TenantUsagesNegativeTestJSON-577151624-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '09e3840ef0034fd9b5a1c7c7efc55f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748ad38d438a464d8d73664f969a1962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1e0f467-95b5-48c6-94d7-c64e694ccc78 tempest-TenantUsagesNegativeTestJSON-577151624 tempest-TenantUsagesNegativeTestJSON-577151624-project] Request method failure captured: Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A24%3A13.497125&end=2022-10-19T13%3A24%3A13.497125&detailed=1 HTTP/1.1 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqj5FRzZuGFc-_CrmbgNXVJy8WjFGr-rLnAuFV8wqZuAFZxWmXYcF6E9cECWEbKnltwTsuwvyCtuQQG8ppcGBxKPuK06r22gPAEm-AI8PWMOW-yErp9fOZ4E_7Y55VRSX4K91NjUd89alUshiB1CPoQt3aQBYyQtnbfu6jbtgdgp_8o Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 748ad38d438a464d8d73664f969a1962 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-577151624 Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:15.215940 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748ad38d438a464d8d73664f969a1962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748ad38d438a464d8d73664f969a1962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/748ad38d438a464d8d73664f969a1962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_748ad38d438a464d8d73664f969a1962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-577151624 Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 748ad38d438a464d8d73664f969a1962 Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-577151624 Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TenantUsagesNegativeTestJSON-577151624-project Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 09e3840ef0034fd9b5a1c7c7efc55f16 Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-577151624-project Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:24:15.217574 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:15.218568 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:15.219924 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:15.221375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:24:15.221375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.222926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1e0f467-95b5-48c6-94d7-c64e694ccc78 tempest-TenantUsagesNegativeTestJSON-577151624 tempest-TenantUsagesNegativeTestJSON-577151624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:15.226458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1e0f467-95b5-48c6-94d7-c64e694ccc78 tempest-TenantUsagesNegativeTestJSON-577151624 tempest-TenantUsagesNegativeTestJSON-577151624-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A24%3A13.497125&end=2022-10-19T13%3A24%3A13.497125&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.398626 Oct 18 13:24:15.227883 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 29/72] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Oct 18 13:24:14 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A24%3A13.497125&end=2022-10-19T13%3A24%3A13.497125&detailed=1 => generated 123 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:15.236467 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0ec81365-34ab-412f-bce5-54068527684c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. Oct 18 13:24:15.260628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.262730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec81365-34ab-412f-bce5-54068527684c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Request method failure captured: Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/flavors/1523151853/action HTTP/1.1 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 67 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqj7TH2G_Kj8_pgpQ7xH3L4U-D9gw_3u6mSm-7ledxHPZ-DEIEWnEboJlJoKAWre-wvYCB0UOdOfpV3GzIR4YKvslVcd3PRylR4LYfLduMRvpXZqHBf6FqjyIUbOJkEy2Bu8IFn0FxFrxTp1Nnb1z8CLCyljcxsVpymyoVsPClGyOi4 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:24:15.266813 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 8c07b4e1493f4f90bf08b3add5b49497 Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} Oct 18 13:24:15.271013 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1523151853', 'body': {'addTenantAccess': {'tenant': 'a2ffcc468ee541168d57f0be0f0dacf5'}}} Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:24:15.271851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-a2ffcc468ee541168d57f0be0f0dacf5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:24:15.273093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:24:15.274425 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:24:15.275554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-a2ffcc468ee541168d57f0be0f0dacf5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 24, 15, 192041), 'updated_at': None, 'flavor_id': 18, 'project_id': 'a2ffcc468ee541168d57f0be0f0dacf5'}] Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:15.276698 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:15.277736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:15.279308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:15.283222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. Oct 18 13:24:15.283222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:15.283222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec81365-34ab-412f-bce5-54068527684c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project a2ffcc468ee541168d57f0be0f0dacf5 combination. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:15.283425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:15.283425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:15.283738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:15.285678 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ec81365-34ab-412f-bce5-54068527684c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1523151853/action" status: 409 len: 152 microversion: 2.1 time: 0.313773 Oct 18 13:24:15.286886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 44/73] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:24:14 2022] POST /compute/v2.1/flavors/1523151853/action => generated 152 bytes in 315 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:15.298921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:15.299526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:15.303530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:15.304791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a849f699-0f94-42d5-9a0d-5b685bf0eb62 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:15.680103 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a849f699-0f94-42d5-9a0d-5b685bf0eb62 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1523151853/action" status: 200 len: 21 microversion: 2.1 time: 0.388588 Oct 18 13:24:15.691772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 45/74] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:24:15 2022] POST /compute/v2.1/flavors/1523151853/action => generated 21 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:24:15.716247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8cec26ea-a558-46c6-87a2-112a46ba43b0 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.774561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:15.845693 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8cec26ea-a558-46c6-87a2-112a46ba43b0 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1523151853" status: 202 len: 0 microversion: 2.1 time: 0.149184 Oct 18 13:24:15.848705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 46/75] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:24:15 2022] DELETE /compute/v2.1/flavors/1523151853 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:15.861586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d76f9a7e-1321-4fb9-962b-997d28b98977 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.922430 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d76f9a7e-1321-4fb9-962b-997d28b98977 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.068864 Oct 18 13:24:15.926000 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 47/76] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:24:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:15.952054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59892db4-fe04-4918-aa14-8811f1f123cb tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-495693001", "id": 1001796761, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:16.059893 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59892db4-fe04-4918-aa14-8811f1f123cb tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.112969 Oct 18 13:24:16.060753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 48/77] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:15 2022] POST /compute/v2.1/flavors => generated 437 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:16.077101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.077748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:16.094350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.097400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.098070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.098984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.099600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.102650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.348377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:16.360334 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-255a5f98-e332-4b12-8380-f282ee670fb2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 1.111516 Oct 18 13:24:16.367067 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 30/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:15 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:16.376480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3383fbf-bef4-409d-a042-0e711c705359 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.405941 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d3383fbf-bef4-409d-a042-0e711c705359 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3383fbf-bef4-409d-a042-0e711c705359 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Request method failure captured: Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/flavors/1001796761/os-flavor-access HTTP/1.1 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqj7TH2G_Kj8_pgpQ7xH3L4U-D9gw_3u6mSm-7ledxHPZ-DEIEWnEboJlJoKAWre-wvYCB0UOdOfpV3GzIR4YKvslVcd3PRylR4LYfLduMRvpXZqHBf6FqjyIUbOJkEy2Bu8IFn0FxFrxTp1Nnb1z8CLCyljcxsVpymyoVsPClGyOi4 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:16.407554 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8c07b4e1493f4f90bf08b3add5b49497 Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: exception: Access list not available for public flavors. Oct 18 13:24:16.408927 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'flavor_id': '1001796761'} Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 18 13:24:16.409783 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:16.411079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3383fbf-bef4-409d-a042-0e711c705359 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:16.411079 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3383fbf-bef4-409d-a042-0e711c705359 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1001796761/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.040237 Oct 18 13:24:16.419944 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 31/79] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:24:16 2022] GET /compute/v2.1/flavors/1001796761/os-flavor-access => generated 91 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:16.437273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f0660a2-10ed-488f-ab1e-c817003360ef tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.596861 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f0660a2-10ed-488f-ab1e-c817003360ef tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1001796761" status: 202 len: 0 microversion: 2.1 time: 0.174161 Oct 18 13:24:16.602196 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 32/80] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:24:16 2022] DELETE /compute/v2.1/flavors/1001796761 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:16.615133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9eda39d7-f48d-44f8-9961-d0f00f611737 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.699974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9eda39d7-f48d-44f8-9961-d0f00f611737 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.089028 Oct 18 13:24:16.700569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 33/81] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:24:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:16.724699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27c66377-e859-4f10-95a8-78c78f1c8aa3 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-162142213", "id": 915207634, "os-flavor-access:is_public": "False"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:16.853063 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27c66377-e859-4f10-95a8-78c78f1c8aa3 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.131998 Oct 18 13:24:16.853663 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 34/82] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:16 2022] POST /compute/v2.1/flavors => generated 435 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:17.240613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:17.261550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-755c5f0a-9c4f-4b7f-a958-cbcbd8e924dc tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 1.199416 Oct 18 13:24:17.268889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 49/83] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:16 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:17.288539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e38598-f622-45e7-928c-dc94f8e6bf5b", "tag": "4c7959da-e66c-4584-ba5b-b476fdcbd78d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:17.340194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.341629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.343160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.384186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92c9f281-3955-40e4-9371-4b00f0fd0217 tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:17.405736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-92c9f281-3955-40e4-9371-4b00f0fd0217 tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba43223a52484c4b9391e6376f8a3e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ffcc468ee541168d57f0be0f0dacf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:17.414933 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] Creating event network-changed:4c7959da-e66c-4584-ba5b-b476fdcbd78d for instance 97e38598-f622-45e7-928c-dc94f8e6bf5b on n-h2-858383-13 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92c9f281-3955-40e4-9371-4b00f0fd0217 tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Request method failure captured: Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/flavors/915207634/action HTTP/1.1 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 67 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqj59vMfdjfax4bnmwwR8kUh78qXiejB-NoMNmiJ-uT-Mk5PVIR6R-6W8WDQfM4GoJj-PlSQ9fE-ikOJNBu71pArMIfcVDPzgU2SIGBD-GywS9HHDYiqNhNXUlahEyTHu2CNbuH2qhu7_30oBkQtXfrIouscrzcG-iIxZOcVdmvUWgA Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a2ffcc468ee541168d57f0be0f0dacf5 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:17.436029 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a2ffcc468ee541168d57f0be0f0dacf5 Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsAccessNegativeTestJSON-40156462-project Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ba43223a52484c4b9391e6376f8a3e66 Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-40156462-project Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} Oct 18 13:24:17.437718 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '915207634', 'body': {'addTenantAccess': {'tenant': 'a2ffcc468ee541168d57f0be0f0dacf5'}}} Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:17.438414 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:24:17.439353 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.440435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92c9f281-3955-40e4-9371-4b00f0fd0217 tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:17.440435 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-92c9f281-3955-40e4-9371-4b00f0fd0217 tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] 10.222.0.27 "POST /compute/v2.1/flavors/915207634/action" status: 403 len: 130 microversion: 2.1 time: 0.575048 Oct 18 13:24:17.446842 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 35/84] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 18 13:24:16 2022] POST /compute/v2.1/flavors/915207634/action => generated 130 bytes in 584 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:24:17.456549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4d44d547-cec4-4f08-bd3d-14705320286c req-e9922274-67dd-40e5-a344-9fa3b243cb3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185960 Oct 18 13:24:17.463272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 50/85] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:17.479835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:17.480450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:17.484875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-84b28d6e-091a-4906-8b0d-fa264e012958 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:17.529438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.530172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.532797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.545074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.545841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.547574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.609125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-84b28d6e-091a-4906-8b0d-fa264e012958 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/915207634" status: 202 len: 0 microversion: 2.1 time: 0.141665 Oct 18 13:24:17.616325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 51/86] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:24:17 2022] DELETE /compute/v2.1/flavors/915207634 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:17.642164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b8c22314-1d58-432c-b86a-34876cd9d74c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:17.760650 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b8c22314-1d58-432c-b86a-34876cd9d74c tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.128483 Oct 18 13:24:17.761250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 52/87] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:24:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:17.783054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a965914-b79f-4ada-a3c2-c19c8fe80b74 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-433172169", "id": 264444311, "os-flavor-access:is_public": "False"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:17.888283 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a965914-b79f-4ada-a3c2-c19c8fe80b74 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.110511 Oct 18 13:24:17.898337 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 53/88] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:17 2022] POST /compute/v2.1/flavors => generated 435 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:17.913060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b5ac9cf-8672-487c-a557-b5daae205674 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:18.186374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:18.196077 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d64da893-6d0e-457c-95c1-03171dcb11ba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.747910 Oct 18 13:24:18.199770 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 36/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:17 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:18.288219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:18.289009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:18.292109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:18.304322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.310439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.311475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.312249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.317039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.317573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.361990 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b5ac9cf-8672-487c-a557-b5daae205674 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/264444311/action" status: 200 len: 96 microversion: 2.1 time: 0.461992 Oct 18 13:24:18.363220 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 54/90] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 18 13:24:17 2022] POST /compute/v2.1/flavors/264444311/action => generated 96 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:24:18.378540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25918f96-02e3-4f2c-949e-fd841c0ec33a tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:18.386611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=71 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:18.415813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25918f96-02e3-4f2c-949e-fd841c0ec33a tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba43223a52484c4b9391e6376f8a3e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ffcc468ee541168d57f0be0f0dacf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25918f96-02e3-4f2c-949e-fd841c0ec33a tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Request method failure captured: Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/flavors/264444311/action HTTP/1.1 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 70 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqj59vMfdjfax4bnmwwR8kUh78qXiejB-NoMNmiJ-uT-Mk5PVIR6R-6W8WDQfM4GoJj-PlSQ9fE-ikOJNBu71pArMIfcVDPzgU2SIGBD-GywS9HHDYiqNhNXUlahEyTHu2CNbuH2qhu7_30oBkQtXfrIouscrzcG-iIxZOcVdmvUWgA Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2ffcc468ee541168d57f0be0f0dacf5 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:24:18.420310 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2ffcc468ee541168d57f0be0f0dacf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2ffcc468ee541168d57f0be0f0dacf5 Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-40156462 Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsAccessNegativeTestJSON-40156462-project Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ba43223a52484c4b9391e6376f8a3e66 Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-40156462-project Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: {"removeTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} Oct 18 13:24:18.421479 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '264444311', 'body': {'removeTenantAccess': {'tenant': 'a2ffcc468ee541168d57f0be0f0dacf5'}}} Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can( Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:18.422114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:24:18.423187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:18.428332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25918f96-02e3-4f2c-949e-fd841c0ec33a tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:18.430413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25918f96-02e3-4f2c-949e-fd841c0ec33a tempest-FlavorsAccessNegativeTestJSON-40156462 tempest-FlavorsAccessNegativeTestJSON-40156462-project] 10.222.0.27 "POST /compute/v2.1/flavors/264444311/action" status: 403 len: 133 microversion: 2.1 time: 0.060963 Oct 18 13:24:18.433216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 55/91] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 18 13:24:18 2022] POST /compute/v2.1/flavors/264444311/action => generated 133 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:18.445615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9a7c0c0-1763-46c1-aea8-983d07754f0b tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a2ffcc468ee541168d57f0be0f0dacf5"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:18.614015 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9a7c0c0-1763-46c1-aea8-983d07754f0b tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/264444311/action" status: 200 len: 21 microversion: 2.1 time: 0.177918 Oct 18 13:24:18.616871 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 56/92] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Oct 18 13:24:18 2022] POST /compute/v2.1/flavors/264444311/action => generated 21 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:24:18.634757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-018ca9e2-cf83-49d3-b9c7-552396ac4929 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:18.785695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-018ca9e2-cf83-49d3-b9c7-552396ac4929 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/264444311" status: 202 len: 0 microversion: 2.1 time: 0.162250 Oct 18 13:24:18.786518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 57/93] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:24:18 2022] DELETE /compute/v2.1/flavors/264444311 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:18.795033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e665542-1d69-47fc-a97a-71f271ce9b25 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:18.795409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:18.804724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcf33934-d9df-4b4f-9184-5b948dc5d371 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.520832 Oct 18 13:24:18.809205 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 37/94] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:18 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:18.850081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e665542-1d69-47fc-a97a-71f271ce9b25 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.058679 Oct 18 13:24:18.850842 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 58/95] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:24:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:18.875449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f62bf0d3-37e5-4351-a02f-a92b43a75ebf tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1058991607", "id": 1148994443, "os-flavor-access:is_public": "False"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:18.957288 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f62bf0d3-37e5-4351-a02f-a92b43a75ebf tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.089143 Oct 18 13:24:18.958487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 38/96] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:18 2022] POST /compute/v2.1/flavors => generated 439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:18.973148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-514603ee-6cc5-4c5c-988b-a3ded09dbe1e tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d63f7fb4c4ee4195ab078dd195dca65b"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:19.228230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.229693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:19.248597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.252295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.255208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.259102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.267188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.268942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.433211 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-514603ee-6cc5-4c5c-988b-a3ded09dbe1e tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] HTTP exception thrown: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-514603ee-6cc5-4c5c-988b-a3ded09dbe1e tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Request method failure captured: Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/flavors/1148994443/action HTTP/1.1 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 70 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqj7TH2G_Kj8_pgpQ7xH3L4U-D9gw_3u6mSm-7ledxHPZ-DEIEWnEboJlJoKAWre-wvYCB0UOdOfpV3GzIR4YKvslVcd3PRylR4LYfLduMRvpXZqHBf6FqjyIUbOJkEy2Bu8IFn0FxFrxTp1Nnb1z8CLCyljcxsVpymyoVsPClGyOi4 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:24:19.436027 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ee74c28e2f545aebde0db93c4427d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9ee74c28e2f545aebde0db93c4427d3d Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148 Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 8c07b4e1493f4f90bf08b3add5b49497 Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: {"removeTenantAccess": {"tenant": "d63f7fb4c4ee4195ab078dd195dca65b"}} Oct 18 13:24:19.437157 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1148994443', 'body': {'removeTenantAccess': {'tenant': 'd63f7fb4c4ee4195ab078dd195dca65b'}}} Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 18 13:24:19.437854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:19.439369 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-514603ee-6cc5-4c5c-988b-a3ded09dbe1e tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Returning 404 to user: Flavor access not found for 22 / d63f7fb4c4ee4195ab078dd195dca65b combination. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-514603ee-6cc5-4c5c-988b-a3ded09dbe1e tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1148994443/action" status: 404 len: 124 microversion: 2.1 time: 0.470036 Oct 18 13:24:19.441446 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 59/97] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:24:18 2022] POST /compute/v2.1/flavors/1148994443/action => generated 124 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:19.458861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ecbd549-d198-43b8-a9e8-8484531b8bde tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.595980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ecbd549-d198-43b8-a9e8-8484531b8bde tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1148994443" status: 202 len: 0 microversion: 2.1 time: 0.145719 Oct 18 13:24:19.597123 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 60/98] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:24:19 2022] DELETE /compute/v2.1/flavors/1148994443 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:19.606588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bd19811-6922-4efb-b17f-398d169b6234 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.642564 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bd19811-6922-4efb-b17f-398d169b6234 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040526 Oct 18 13:24:19.644832 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 61/99] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:24:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:19.705376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.745289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef4c408f-da30-4dc1-b86b-f151326eff93 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.523653 Oct 18 13:24:19.764380 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 39/100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:19 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:19.840688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.841524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:19.854700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.855448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.855898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.856658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.857126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.857600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.101600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1418707507", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "303231382", "adminPass": "***", "networks": [{"uuid": "aadff68e-aca1-4085-8674-6bcf1f9b4b33"}], "security_groups": [{"name": "tempest-securitygroup--2006672599"}], "key_name": "tempest-keypair-1153960216", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:20.166399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:20.175152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9ef6b5b-4f53-4683-b458-48ea2de865c8 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.339767 Oct 18 13:24:20.198498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 62/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:19 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:20.329597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] validate_networks() for [('aadff68e-aca1-4085-8674-6bcf1f9b4b33', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:20.772194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:20.772812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:20.792990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.793640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.794291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.795563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.796177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.796761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.301605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.313380 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-486a0402-41ad-4f60-9c1e-64b4e6ef0a19 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.545708 Oct 18 13:24:21.322655 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 63/102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:20 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:21.322655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:21.322655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:21.352466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.353032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.356004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.356969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.357616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.359618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.688284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.698233 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3743995f-64c6-44e4-8ebd-bcfc07968eaa tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.383012 Oct 18 13:24:21.707588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 64/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:21 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:21.833625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:21.833625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:21.833625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:21.833625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:21.833625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:21.885659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.888002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.888002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.888895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.889458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.890087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.940109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:21.948100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for user d75623286dda46cfb4d8d70608655b9c and project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:21.985294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:21.997464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:22.224427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b60ae81-7159-48d1-ace7-42ec4f440973 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.129681 Oct 18 13:24:22.232546 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 40/104] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:22.239635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b3d2448-a21a-4d75-90ee-c9be9d99e73f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.241809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b3d2448-a21a-4d75-90ee-c9be9d99e73f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.249578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:22.339837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.340658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.367350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.370312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.371714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.372740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.375384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.376096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.397820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b3d2448-a21a-4d75-90ee-c9be9d99e73f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.409343 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b3d2448-a21a-4d75-90ee-c9be9d99e73f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1263 microversion: 2.1 time: 0.175799 Oct 18 13:24:22.423005 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 65/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:22.721568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.722743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.730148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.735911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.736419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.737172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.738253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.738735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.758796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.775617 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9984a5ba-c88f-42be-ac4d-a5b58249a2a5 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.441095 Oct 18 13:24:22.778458 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 41/106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:23.067250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.084853 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-892c1573-2445-4f5b-b3e5-a3afbcbd7c96 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.363225 Oct 18 13:24:23.084853 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 66/107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:23.441588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d31bb7ec-1735-431a-b9ee-32ea46122530 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.443070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d31bb7ec-1735-431a-b9ee-32ea46122530 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.633100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d31bb7ec-1735-431a-b9ee-32ea46122530 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.644700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d31bb7ec-1735-431a-b9ee-32ea46122530 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1263 microversion: 2.1 time: 0.207199 Oct 18 13:24:23.649109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 42/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:23.801790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.803111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.805527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:23.817873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.818650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.819421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.820377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.821040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.821729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.275422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77d4d3ab-1d7e-4927-a27b-d7db43656f2b tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.279948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.288819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77d4d3ab-1d7e-4927-a27b-d7db43656f2b tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.396766 Oct 18 13:24:24.289899 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 43/109] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:24.295248 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e608a410-f3c3-4ff0-8590-04280bb8c9da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.495553 Oct 18 13:24:24.299091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.300662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:24.313951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.314967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.316381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.317964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.319003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.319625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.330741 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 67/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:24.683072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.683717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:24.709845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.709845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.719014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.723005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.725672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.726608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.879381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.890604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e491787d-1c9f-4968-9e68-49cb64ea39a2 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1259 microversion: 2.1 time: 0.218412 Oct 18 13:24:24.927700 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 68/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:24 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:25.014124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.070246 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed1465e9-57d6-4456-b37d-36e4b1a74ea4 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.734085 Oct 18 13:24:25.070246 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 44/112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:24 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:25.320476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:25.321101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:25.328564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.332055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.333883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.335066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.337561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.339965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.624233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.634268 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83dd4bf1-7ef4-4996-92ff-032002a0ea7b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.318773 Oct 18 13:24:25.636156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 69/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:25 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:25.917601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:25.918529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:25.925348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.925849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.926325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.927022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.927459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.927888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.998822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.006854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f36f6f4b-30c6-4b92-affb-19289aec0d4d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1315 microversion: 2.1 time: 0.092984 Oct 18 13:24:26.007445 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 45/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:25 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:26.094304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:26.094926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:26.101943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.102463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.103487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.103700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.104097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.105413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.249741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.257450 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c86077bd-23d3-457b-9058-a6cde9d42a3d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.167239 Oct 18 13:24:26.258018 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 70/115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:26 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:26.661273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:26.661989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:26.678374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.680129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.681790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.682992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.683658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.684679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.935912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1453739702", "imageRef": "44aae145-5bd2-4fc7-9895-d58812ac6e00", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:27.030505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:27.308674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.318661 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc54c177-8439-4da7-8745-ef338dfb30e4 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.663262 Oct 18 13:24:27.335788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 18 13:24:27.341222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 46/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:26 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] Request method failure captured: Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 143 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkHVdUY_h1MHercQcOyaKsZ2SPhROHW719CNlRHHaae7h0D6aca6473BC9tJzyo7gmU7FYhL43U6p6LlbMyDJZwsdN6DGOVsUOpcMmBBYXBM32o0evpG84xI0WD3N4VS_cirN6jFhPBhxfa0e2CgmY0YPd6Hou0akn-Wj6Ktbnv9PA Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d9d8a78277cd451788a3199c919ff4c4 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsV2NegativeTest-695157441 Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:24:27.349927 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9d8a78277cd451788a3199c919ff4c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9d8a78277cd451788a3199c919ff4c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9d8a78277cd451788a3199c919ff4c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9d8a78277cd451788a3199c919ff4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsV2NegativeTest-695157441 Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d9d8a78277cd451788a3199c919ff4c4 Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-695157441 Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsV2NegativeTest-695157441-project Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: fb6df13bd2ce4713ac97f91b19421baf Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsV2NegativeTest-695157441-project Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1453739702", "imageRef": "44aae145-5bd2-4fc7-9895-d58812ac6e00", "flavorRef": "452"}} Oct 18 13:24:27.351741 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor's memory is too small for requested image. Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1453739702', 'imageRef': '44aae145-5bd2-4fc7-9895-d58812ac6e00', 'flavorRef': '452'}}} Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:27.352495 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:27.354015 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a43ed917-cb41-49c6-99db-83a8193be0ea tempest-FlavorsV2NegativeTest-695157441 tempest-FlavorsV2NegativeTest-695157441-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.413327 Oct 18 13:24:27.355308 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 71/117] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:26 2022] POST /compute/v2.1/servers => generated 93 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:27.371824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:27.372464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:27.392580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.393344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.394558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.395518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.396470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.397102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.484130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e38598-f622-45e7-928c-dc94f8e6bf5b", "name": "network-vif-plugged", "status": "completed", "tag": "4c7959da-e66c-4584-ba5b-b476fdcbd78d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:27.522965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.535021 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b79d2b99-0cd0-454d-83c1-d6307427ac69 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1323 microversion: 2.1 time: 0.189560 Oct 18 13:24:27.535865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 72/118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:27 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:27.546453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.547246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.549013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.552554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:27.553175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:27.569207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.575025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.575728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.576468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.576939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.577354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.605149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Creating event network-vif-plugged:4c7959da-e66c-4584-ba5b-b476fdcbd78d for instance 97e38598-f622-45e7-928c-dc94f8e6bf5b on n-h2-858383-13 Oct 18 13:24:27.605687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:24:27.606096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7009c60-fa0b-49c7-90db-40ead4732dbb req-2d4b820b-1f7f-4f43-91ef-0f8bb477fc8b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:24:27.607634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.607634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.608061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.608778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.609231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.609655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.636329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.rpcapi [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 13:24:27.637226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] Releasing lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:24:27.658436 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfd386c0-7ec0-49db-8e15-b44b7686257f None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315812 Oct 18 13:24:27.662282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 47/119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:27.979879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.991682 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-777b3f08-1a24-442a-a41c-a7100dc4c379 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.454208 Oct 18 13:24:27.993468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 73/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:27 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:28.350075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:28.350899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:28.362847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.363826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.364776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.365795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.366468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.367098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.565578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:28.566437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:28.572995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.573489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.573956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.574677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.575191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.575615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.646344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:28.654238 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-03c39899-4cdc-489c-ac33-879b24f45a36 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1321 microversion: 2.1 time: 0.093132 Oct 18 13:24:28.656637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 74/121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:28 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:28.686095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:28.693683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-296b179e-cfcc-4b29-9991-04ab01c734da tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.348396 Oct 18 13:24:28.694562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 48/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:28 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:29.015729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:29.016413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:29.026851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.027699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.028148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.028863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.029325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.030682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.623854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.642521 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2fce88a-5b0f-4349-95a9-c5c02e8a9dd1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.625010 Oct 18 13:24:29.655987 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 75/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:29 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:29.680471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:29.681484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:29.687767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.688538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.689236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.690741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.691619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.692417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.717788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:29.718718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:29.728550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.730276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.730735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.734017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.736228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.743699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.935900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.950961 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b461af4c-20f4-483c-99db-ac10da2f94d5 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.274498 Oct 18 13:24:29.951579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 49/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:29 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:30.210840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.219978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4c5e511-c256-4fa3-b3a2-c2bbea840d41 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1318 microversion: 2.1 time: 0.507076 Oct 18 13:24:30.222839 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 76/125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:29 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:30.442460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5de646-635f-47ff-b877-9e2a5f6d2bbb", "tag": "eefd0227-bb30-402f-917b-f10e5871999a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:30.468670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.471890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.472588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.509437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] Creating event network-changed:eefd0227-bb30-402f-917b-f10e5871999a for instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb on n-h2-858383-13 Oct 18 13:24:30.523784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-885c0f15-2fed-4b0f-b6c4-702d915133ea req-e58b04e0-850e-48c3-a5d7-1076627dd338 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084246 Oct 18 13:24:30.526967 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 50/126] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:30.662346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:30.663719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:30.674402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.675775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.677258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.686601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.687328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.689677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.028989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:31.042546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b06b1523-bccc-448f-9e32-cf64f3157fad tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.384021 Oct 18 13:24:31.045069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 77/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:30 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:31.061306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:31.061306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:31.073212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.074193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.074642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.077026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.077496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.077928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.100590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:31.276012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a3ee795-e804-4e20-8b50-cb74d97ddcff tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-171265962", "id": 140040944, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:31.385632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a3ee795-e804-4e20-8b50-cb74d97ddcff tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.676043 Oct 18 13:24:31.386276 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 51/128] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:24:30 2022] POST /compute/v2.1/flavors => generated 445 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:24:31.398011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:31.402801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:31.418779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.419553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.422629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.423467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.423941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.424386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.548482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:31.564103 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb629e71-fc5b-47ef-8750-64805c1f7af8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.516361 Oct 18 13:24:31.566518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 78/129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:31 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:31.940446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:31.941727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02b2020a-bdb0-4c4a-9eb3-6d3504ec9c1b tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:31.951582 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-035f111a-84e2-4be4-a8ca-1b297dca428b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1468 microversion: 2.1 time: 0.563952 Oct 18 13:24:31.953602 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 52/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:31 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1468 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:31.956764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02b2020a-bdb0-4c4a-9eb3-6d3504ec9c1b tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] 10.222.0.27 "GET /compute/v2.1/flavors/140040944" status: 200 len: 445 microversion: 2.55 time: 0.385285 Oct 18 13:24:31.961319 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 79/131] 10.222.0.27 () {60 vars in 1196 bytes} [Tue Oct 18 13:24:31 2022] GET /compute/v2.1/flavors/140040944 => generated 445 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:31.975363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc15d774-3135-4007-b5da-17ec7e5eb682 tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] Action: 'update', calling method: .version_select at 0x7fb332f23b80>, body: {"flavor": {"description": "new"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:32.150111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc15d774-3135-4007-b5da-17ec7e5eb682 tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/140040944" status: 200 len: 446 microversion: 2.55 time: 0.178636 Oct 18 13:24:32.160887 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 53/132] 10.222.0.27 () {62 vars in 1216 bytes} [Tue Oct 18 13:24:31 2022] PUT /compute/v2.1/flavors/140040944 => generated 446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:32.165995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.177417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:32.177417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.177417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.177417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.178175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.178175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.178175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.298537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.299041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:32.310777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:32.314400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.314893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.315357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.316069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.316533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.316977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.408327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:32.425665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:32.552733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:32.566327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ecdaea7-fc86-4ca2-96f8-d9d476cd26b5 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.403558 Oct 18 13:24:32.567006 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 54/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:32 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:32.572557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90e2a740-1337-458f-aba2-2979160c9393 tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.607558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90e2a740-1337-458f-aba2-2979160c9393 tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6586 microversion: 2.55 time: 0.039314 Oct 18 13:24:32.608455 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 55/134] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:24:32 2022] GET /compute/v2.1/flavors/detail => generated 6586 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:32.669263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-470395924", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6d7b5541-416a-4285-abcb-d7b8dba55d22"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:32.740983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] validate_networks() for [('6d7b5541-416a-4285-abcb-d7b8dba55d22', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:32.806101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b55e3929-4e16-4435-a76e-c20097cfe56f tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 204 len: 0 microversion: 2.1 time: 0.828678 Oct 18 13:24:32.806705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 80/135] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:31 2022] DELETE /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 0 bytes in 830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:24:32.811766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d79ce6-c390-4b52-bb04-98b58d28746e", "name": "network-vif-plugged", "status": "completed", "tag": "bca3ed3b-ee4e-4e8a-9302-49cf6026e99a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:32.822637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.823126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.823566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.835876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] Creating event network-vif-plugged:bca3ed3b-ee4e-4e8a-9302-49cf6026e99a for instance a0d79ce6-c390-4b52-bb04-98b58d28746e on n-h1-858383-13 Oct 18 13:24:32.840950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-49e554db-921b-4b40-bb86-cb914bf25014 req-fe17a9a4-1fb2-4378-8f78-13b69946876e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Oct 18 13:24:32.841901 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 81/136] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:32.847144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.847858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:32.863694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.865390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.865894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.866675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.867668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.868170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.102735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.111601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9bbaba3b-19df-4b42-9a98-fb7c58de553e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.268451 Oct 18 13:24:33.126459 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 82/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:32 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:33.134041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54482334-9a2a-4957-b49d-7b6829c62849 tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.174274 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54482334-9a2a-4957-b49d-7b6829c62849 tempest-FlavorsV255TestJSON-407807877 tempest-FlavorsV255TestJSON-407807877-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.55 time: 0.046167 Oct 18 13:24:33.175843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 83/138] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:33.181738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.183004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:33.192132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.192661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.193137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.193858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.194351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.194788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.265172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:33.265851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:33.268193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:33.268695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:33.269344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:33.290019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.294406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.294406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.294406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.294406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.295054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.314861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:33.319897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for user fa4ca05a0c6a405f8fa014ee06dbcef4 and project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:33.333496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:33.336116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:33.350548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.363935 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-659911ef-be19-489f-91df-0fd1114a145f tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1474 microversion: 2.1 time: 0.186664 Oct 18 13:24:33.366145 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 84/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:33.372765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-784ea52a-20c9-4594-978d-ab5a7fcb6f1d tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.466824 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-907148d2-3dfa-42f7-af4b-879d534ae6b9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.857151 Oct 18 13:24:33.467817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 56/140] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:24:33.480177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-784ea52a-20c9-4594-978d-ab5a7fcb6f1d tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/140040944" status: 202 len: 0 microversion: 2.55 time: 0.112978 Oct 18 13:24:33.481682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 85/141] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Oct 18 13:24:33 2022] DELETE /compute/v2.1/flavors/140040944 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:33.486244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.487299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:33.493380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d9c30bb-ef5b-4288-b3a6-9d7d70db694e tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.534734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d9c30bb-ef5b-4288-b3a6-9d7d70db694e tempest-FlavorsV255TestJSON-737817015 tempest-FlavorsV255TestJSON-737817015-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.048308 Oct 18 13:24:33.535782 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 86/142] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:24:33.590514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.591412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:33.599231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.600620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.601641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.605384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.607387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.609850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.610564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.619524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.620402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.621666 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dccf04fa-99b5-4c0e-915d-df7c3635c887 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1261 microversion: 2.25 time: 0.141264 Oct 18 13:24:33.622440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 57/143] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:33.822491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.833973 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aeef74dc-d98e-44ff-8ae2-f0a011083e64 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.248302 Oct 18 13:24:33.835495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 87/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:34.139103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.142049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.150960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.151820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.152414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.153302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.153762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.154212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.338349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.347162 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3718bdc-afb2-423f-950a-4f46061339dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.213264 Oct 18 13:24:34.347749 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 58/145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:34.389459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.390180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.403868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.405669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.406303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.408688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.411456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.412108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.648885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.649505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.667846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.685445 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a9438b9-a38e-4070-8e7c-df60e348b8eb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1474 microversion: 2.1 time: 0.301329 Oct 18 13:24:34.686031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 88/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1474 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:34.749251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.757015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.758548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.759876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c02c9f5-b85c-4e28-9ad0-e2a603773c0a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1261 microversion: 2.25 time: 0.114893 Oct 18 13:24:34.760584 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 59/147] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:24:34.857896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.858658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.865826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.866441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.867117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.868089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.868774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.869420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.044241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:35.058319 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85a6767d-97a2-47df-92e0-d2b9e35b2fe0 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1338 microversion: 2.1 time: 0.204057 Oct 18 13:24:35.059072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 89/148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:35.375659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:35.395956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:35.420514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.425310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.425310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.426322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.426988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.427444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.709396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:35.710017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:35.724455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.724959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.725401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.726171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.726635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.727068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.908844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:35.923920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2aa7c68-f8dc-455e-a5ce-defd63389fc3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.555897 Oct 18 13:24:35.924720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 60/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:35 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:35.932730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:35.935485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:35.944531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:35.946629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.948017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.949282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.950214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.951906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.953109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.955027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5894416c-e124-49c2-b4e0-298e4c2014cd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1474 microversion: 2.1 time: 0.249510 Oct 18 13:24:35.962403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 90/150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:35 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:36.080992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.081896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.100162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.101191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.101676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.109915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.109915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.109915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.143061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.168434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.177683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.183974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43703a14-afef-450e-aed2-fc67dc139ebb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1334 microversion: 2.25 time: 0.257886 Oct 18 13:24:36.203158 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 61/151] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:35 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:36.308821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.325764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c69b18ff-38dc-4c10-a320-0cda3e7e7704 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1487 microversion: 2.1 time: 0.248592 Oct 18 13:24:36.327069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 91/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:36 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1487 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:36.356246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.357561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.366382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.367989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.368656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.369921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.372758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.381129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.955875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.956804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.964973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.966089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.966778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.968045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.968818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.977893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.210078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.223156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-225acf8c-8996-4bfa-89b5-b6f2078e16b7 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.276692 Oct 18 13:24:37.228336 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 92/153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:36 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.235024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e38598-f622-45e7-928c-dc94f8e6bf5b", "name": "network-vif-deleted", "tag": "4c7959da-e66c-4584-ba5b-b476fdcbd78d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:37.253223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.253712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.254176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.273210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] Creating event network-vif-deleted:4c7959da-e66c-4584-ba5b-b476fdcbd78d for instance 97e38598-f622-45e7-928c-dc94f8e6bf5b on n-h2-858383-13 Oct 18 13:24:37.281340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-614f7065-4d37-4ad4-abc3-2dabb7629789 req-beba6976-1316-478c-9f58-a1a201a85fd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050388 Oct 18 13:24:37.282175 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 93/154] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:37.290845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.296153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.298922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.299742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.300575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.301538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.302242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.302900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.388915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.412529 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e4bb616-19a9-4a81-8d4c-e84e5418edb3 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1303 microversion: 2.1 time: 0.129266 Oct 18 13:24:37.413594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 94/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.420542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.422274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.449107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.449976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.450462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.451192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.453634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.456814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.505717 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ece6f047-8eb4-441b-81b8-324c85adaa1e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1640 microversion: 2.1 time: 1.159439 Oct 18 13:24:37.514983 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 62/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:36 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1640 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.535959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.536474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.552027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.552522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.553161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.554019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.554557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.554998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.635004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:37.661944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.679026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.681332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.682781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be8723aa-87a4-489c-a234-94a79adbba1a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1340 microversion: 2.25 time: 0.267828 Oct 18 13:24:37.684314 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 95/157] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1340 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:37.714807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:38.003837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:38.139343 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd6f6010-b22d-4275-9bb4-50d56c37aba3 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 204 len: 0 microversion: 2.1 time: 0.614379 Oct 18 13:24:38.140753 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 63/158] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:37 2022] DELETE /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:38.150770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.152310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.158406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.159741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.160287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.161083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.161645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.162210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.264637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.266253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.285472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.286305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.287837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.289372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.290743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.292009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.359953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.370724 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6b08eb7e-0bdf-4799-870f-7cec349ff9c6 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1493 microversion: 2.1 time: 0.224524 Oct 18 13:24:38.371784 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 96/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1493 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:38.437745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.438990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.448225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.449185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.449959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.450910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.451533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.452323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.492930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.493754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.494371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.495044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lazy-loading 'fault' on Instance uuid 97e38598-f622-45e7-928c-dc94f8e6bf5b {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:38.562527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.573419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-285eb3f8-4bec-484c-b700-3829937da3ea tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 200 len: 1308 microversion: 2.1 time: 0.139623 Oct 18 13:24:38.575020 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 97/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:38.675447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5de646-635f-47ff-b877-9e2a5f6d2bbb", "name": "network-vif-plugged", "status": "completed", "tag": "eefd0227-bb30-402f-917b-f10e5871999a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:38.689350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.689908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.691562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.696978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:38.705258 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] Creating event network-vif-plugged:eefd0227-bb30-402f-917b-f10e5871999a for instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb on n-h2-858383-13 Oct 18 13:24:38.720157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e37580e7-440b-474c-8310-ef9cd07e3b66 req-26e305bf-1de9-4f97-b2d8-1610c57a59ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051156 Oct 18 13:24:38.723026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 98/161] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:38.733427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.733556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.745669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.746982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.747642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.748589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.749343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.749927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.947114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.961622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d622a167-474b-450f-a6f1-98487383a1a3 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.707622 Oct 18 13:24:38.988542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 64/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:39.201961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.211303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.212772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.213906 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4209b163-913a-4500-b857-c6809554b8ea tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1382 microversion: 2.25 time: 0.489699 Oct 18 13:24:39.214811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 99/163] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1382 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:39.414519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:39.419578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:39.445386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.445879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.446343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.447037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.452692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.452692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.603939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:39.605447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:39.631089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.631089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.631089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.633916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.636596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.637311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.668532 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b HTTP/1.1 Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:24:39.684533 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:24:39.685652 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '97e38598-f622-45e7-928c-dc94f8e6bf5b'} Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:39.686402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:24:39.687422 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:39.688770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:39.688770 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0188446c-3466-4aa1-bd7c-15136ef979ca tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 404 len: 111 microversion: 2.1 time: 0.087205 Oct 18 13:24:39.692520 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 100/164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:39 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:39.926258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.936431 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a14ac6fb-23d7-4c3f-b34a-c4ba27b2f357 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1493 microversion: 2.1 time: 0.544436 Oct 18 13:24:39.937285 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 65/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:39 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1493 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:39.948113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-662947553", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:39.958856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:39.962646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.966249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.966249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.966249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.966249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.966587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.012183 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14b4e641-7bee-45de-ad2f-0935617fd8be tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 970 microversion: 2.1 time: 0.281879 Oct 18 13:24:40.013087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 101/166] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:24:39 2022] GET /compute/v2.1/os-services => generated 970 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:40.017858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.018702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:40.025145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.025871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.026779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.027655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.028278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.028869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.052810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:40.404440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:40.414322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e708b2f-9b70-4261-8f0a-13b59cc91fa8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1389 microversion: 2.1 time: 0.399905 Oct 18 13:24:40.415095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 102/167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1389 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:40.436192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.443294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.444078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.444675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.445594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.446431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.448814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.475047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:40.475476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:40.478848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:40.478848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:40.478848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:40.497141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.497141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.497706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.501021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.501021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.501021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.503234 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f501f43e-8c7a-47bf-8d0d-fc07278ee5d3 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-13" status: 200 len: 581 microversion: 2.1 time: 0.074810 Oct 18 13:24:40.504076 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 103/168] 10.222.0.27 () {58 vars in 1174 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/os-services?host=n-d-858383-13 => generated 581 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:40.517570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.519232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:40.525776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.528862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.528862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.528862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.528862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.529177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.544039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Getting quotas for project 3a90038712264f0a852d014124619cfc. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:40.548435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Getting quotas for user 31f765d197374f1cb5bdfa5890d74f7d and project 3a90038712264f0a852d014124619cfc. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:40.562366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:40.564942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:40.736104 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b92a04c8-0406-4dbb-8086-52a885b87a12 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797243 Oct 18 13:24:40.737032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 66/169] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:40.742096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.745857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.746388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.746804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.747524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.747973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.748390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.780849 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbb69c24-d031-4d2b-ba13-aec927658833 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 403 microversion: 2.1 time: 0.042347 Oct 18 13:24:40.781774 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 67/170] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:40.795638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa60c9d-d83f-4f3f-8974-69ceb98836ae", "tag": "369422a0-3597-4d1c-9a37-b27b2052317e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:40.805580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.806091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.806510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.817809 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] Creating event network-changed:369422a0-3597-4d1c-9a37-b27b2052317e for instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae on n-h1-858383-13 Oct 18 13:24:40.823005 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b6d4499e-c751-4e51-8733-60d106fa09b9 req-c73ee666-ac4f-4a80-b6b6-a1c2f4f74eba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Oct 18 13:24:40.825801 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 68/171] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:40.848391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b295c97a-a741-4019-a8a4-9c283be41d05 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.849364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b295c97a-a741-4019-a8a4-9c283be41d05 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:41.017535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b295c97a-a741-4019-a8a4-9c283be41d05 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.037904 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b295c97a-a741-4019-a8a4-9c283be41d05 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1219 microversion: 2.1 time: 0.212804 Oct 18 13:24:41.038971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 69/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:41.051719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.061231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.061948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.068443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.068443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.068443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.068443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.093627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7f9b130-d219-4e8b-9dd6-5358dff54b15 tempest-ServicesAdminTestJSON-1463594404 tempest-ServicesAdminTestJSON-1463594404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 970 microversion: 2.1 time: 0.053521 Oct 18 13:24:41.094574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 70/173] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/os-services => generated 970 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:41.121400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.135086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:41.144279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.168762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.171029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.173965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.177370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.178037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.180027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.188492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.190813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.192878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6cdbd670-1a83-4164-8d9e-ac42ddd60dbb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1382 microversion: 2.25 time: 0.679222 Oct 18 13:24:41.193607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 104/174] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1382 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:41.348009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.353057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d79ce6-c390-4b52-bb04-98b58d28746e", "name": "network-vif-deleted", "tag": "bca3ed3b-ee4e-4e8a-9302-49cf6026e99a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:41.365896 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-302d5235-0709-47a2-bd23-de904ca9ff30 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1451 microversion: 2.1 time: 0.261030 Oct 18 13:24:41.366727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 71/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:41.376387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.379479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.380678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.414844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] Creating event network-vif-deleted:bca3ed3b-ee4e-4e8a-9302-49cf6026e99a for instance a0d79ce6-c390-4b52-bb04-98b58d28746e on n-h1-858383-13 Oct 18 13:24:41.421679 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-79ee5e10-3464-4183-bf08-be490cd9522e req-7b4a2fda-d612-42f3-96db-856f040b4237 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147462 Oct 18 13:24:41.443213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.444179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:41.448523 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 105/176] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:41.451489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.452223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.453054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.454048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.454758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.455650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.978334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.991416 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a73d9346-8a61-4ec4-8af0-81fbce2c08cd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1588 microversion: 2.1 time: 0.550028 Oct 18 13:24:42.005485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 72/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1588 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:42.016760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.017465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.025442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.026445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.027097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.028114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.029472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.030019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.067455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5f9c507-40ac-41bf-82ee-a2dd3c7070bd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.068734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5f9c507-40ac-41bf-82ee-a2dd3c7070bd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.182644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5f9c507-40ac-41bf-82ee-a2dd3c7070bd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.191798 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5f9c507-40ac-41bf-82ee-a2dd3c7070bd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1219 microversion: 2.1 time: 0.128468 Oct 18 13:24:42.192376 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 73/178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:42.222336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.222947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.229819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.230364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.230989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.231873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.232163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.232741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.288995 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5880b86-feb0-45dc-91be-900c8fcfe98f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277527 Oct 18 13:24:42.289788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 106/179] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:42.403036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.403669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.419066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.419625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.420017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.420742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.421200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.421807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.477980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.478840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.479387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.480080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lazy-loading 'fault' on Instance uuid a0d79ce6-c390-4b52-bb04-98b58d28746e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:42.597452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.612252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.612839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a448bc53c0d343f2bbc87667c88cbd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b87172368b42f4b089504ac3b545a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.618382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.622179 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29f7bee8-ad64-44c0-b81f-0ce0c5a15898 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1382 microversion: 2.25 time: 0.402345 Oct 18 13:24:42.625766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 74/180] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1382 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:42.630663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff06588c-1601-4cac-bf5f-706a28950fa1 tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 200 len: 1328 microversion: 2.1 time: 0.227156 Oct 18 13:24:42.631371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 107/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 1328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:43.216106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:43.217364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:43.225239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.226205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.226852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.227812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.228481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.241043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.316441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.324095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4940f446-cebe-4f99-b443-093ff9c19132 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1271 microversion: 2.1 time: 0.111933 Oct 18 13:24:43.324849 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 75/182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:43 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:43.655963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:43.657317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:43.664823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:43.667809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:43.673006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.673764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.676774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.677670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.678350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.678953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.685229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.685229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.686023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.687012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.687672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.688339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.709709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] HTTP exception thrown: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Request method failure captured: Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e HTTP/1.1 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhaVLTzWObDF1INiI-gVgNkpJHVRcs5HYf9qwG8sltZQzkR8BTNybmEYvINr6t4oqMDrgFVND0fnaFudemu_iMx0npuOXHbUMUZJZnVBdH6Ccs2spuh_F2LN0nxwjHxoEmR4NNLWRdipqSSEo2Yq_3JId51GQj3HTB0O36_QqbEjE Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:43.728294 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36b87172368b42f4b089504ac3b545a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a448bc53c0d343f2bbc87667c88cbd0d Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:43.729471 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a0d79ce6-c390-4b52-bb04-98b58d28746e'} Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:43.730594 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:43.731611 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:43.732554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Returning 404 to user: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:43.732554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-451c07af-d452-45fe-bb0f-eb78a6e32b7d tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 404 len: 111 microversion: 2.1 time: 0.072176 Oct 18 13:24:43.733454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 76/183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:43 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:43.739476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1236ced1-9169-4b48-bc92-4ccbda229bae tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:43.751771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1236ced1-9169-4b48-bc92-4ccbda229bae tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.752585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1236ced1-9169-4b48-bc92-4ccbda229bae tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.753211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1236ced1-9169-4b48-bc92-4ccbda229bae tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:44.018737 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1236ced1-9169-4b48-bc92-4ccbda229bae tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.283231 Oct 18 13:24:44.019573 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 77/184] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:44.033211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b86f7048-6833-4083-b39a-22c00570eb40 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:44.042340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:44.056811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:44.058836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:44.060345 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4d69873-c5c3-4fea-a9c4-ee9a2eb2924b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1382 microversion: 2.25 time: 0.416599 Oct 18 13:24:44.061318 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 108/185] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:43 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1382 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:44.140476 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b86f7048-6833-4083-b39a-22c00570eb40 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.113166 Oct 18 13:24:44.147977 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 78/186] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:44 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:44.155513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a4b9609-14d2-40b0-99fa-7f7a13c33d9d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-910383822"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:44.160564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-6a4b9609-14d2-40b0-99fa-7f7a13c33d9d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid 45fc7e31-08ca-40df-ab21-20b426a3af72 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:44.349175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:44.350501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:44.371577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a4b9609-14d2-40b0-99fa-7f7a13c33d9d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.220982 Oct 18 13:24:44.379322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:44.379322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:44.379322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:44.379322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:44.380327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:44.380519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 109/187] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:44.382548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:44.391790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88b76d0b-aebd-4e41-83df-0982a9a8bfe1 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:44.405260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88b76d0b-aebd-4e41-83df-0982a9a8bfe1 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:44.406004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88b76d0b-aebd-4e41-83df-0982a9a8bfe1 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:44.414151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88b76d0b-aebd-4e41-83df-0982a9a8bfe1 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:44.616873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:44.626842 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3d33e70-6e90-466f-8d33-72878e358739 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1277 microversion: 2.1 time: 0.283110 Oct 18 13:24:44.642289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 79/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:44 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:44.789263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-812705713", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:45.252277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:45.336520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88b76d0b-aebd-4e41-83df-0982a9a8bfe1 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.954239 Oct 18 13:24:45.337336 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 110/189] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:45.348601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:45.349398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:45.367550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.368070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.368522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.373594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.374155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.376711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.652390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:45.672353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3fb1d8ea-a3e2-4498-bf77-9102d7e5b90c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 200 len: 1588 microversion: 2.1 time: 0.333726 Oct 18 13:24:45.672952 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 111/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:45 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 1588 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:45.685799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5de646-635f-47ff-b877-9e2a5f6d2bbb", "tag": "eefd0227-bb30-402f-917b-f10e5871999a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:45.700131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.703189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.703189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.718374 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] Creating event network-changed:eefd0227-bb30-402f-917b-f10e5871999a for instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb on n-h2-858383-13 Oct 18 13:24:45.723969 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40f75f23-8bb3-4314-99ea-e93136c3fba8 req-a8535d3b-615b-4b64-87c9-249606bfe23d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047620 Oct 18 13:24:45.724702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 112/191] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:45.731582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:45.732488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:45.739665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.740162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.740629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.741502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.742168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.743791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.997595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.005997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:46.007007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:46.007687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:46.008459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:46.009070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:46.012003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.017582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.018778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dea32d69-ff7f-437f-bc4e-4c2a3b30d38b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1361 microversion: 2.25 time: 0.292584 Oct 18 13:24:46.019368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 113/192] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:45 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:46.023552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.024269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.024902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.025839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.026815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.027621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.028715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1999dff6-915b-44af-a90a-5b321e5fe70d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:46.048103 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1999dff6-915b-44af-a90a-5b321e5fe70d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.026932 Oct 18 13:24:46.048663 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 114/193] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:46 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:46.052012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:46.058913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:46.065789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:46.067125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:46.073311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:46.076052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:46.082632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.087257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.088457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.091645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.092349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.093017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.253217 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cdfd7bb-d5ce-4873-a845-ac22254bc637 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619018 Oct 18 13:24:46.257293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 80/194] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:46.265579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fbef20a-d858-40c8-8de7-0dd7745ceb94 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:46.279840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbef20a-d858-40c8-8de7-0dd7745ceb94 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.280555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbef20a-d858-40c8-8de7-0dd7745ceb94 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.281347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbef20a-d858-40c8-8de7-0dd7745ceb94 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.650311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fbef20a-d858-40c8-8de7-0dd7745ceb94 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.391413 Oct 18 13:24:46.651375 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 81/195] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:46 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:46.657725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b952ff90-7e4f-4b7a-a825-b25872725026 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:46.657725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b952ff90-7e4f-4b7a-a825-b25872725026 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:46.668501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.678743 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-375604bf-ed83-4597-a20e-cd378edfb91c tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.626580 Oct 18 13:24:46.686998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 115/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:46 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:46.707242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a91d3ef-03e9-4050-b90d-4451aee1fef7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:46.712908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:46.751900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b952ff90-7e4f-4b7a-a825-b25872725026 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.760210 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b952ff90-7e4f-4b7a-a825-b25872725026 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1207 microversion: 2.1 time: 0.107552 Oct 18 13:24:46.771926 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 82/197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:46 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1207 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:46.817181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a91d3ef-03e9-4050-b90d-4451aee1fef7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.113818 Oct 18 13:24:46.818317 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 116/198] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:46 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:46.828273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b294fae-d254-433a-bf95-c7fd7e57fc5e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122343703"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:46.833670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-2b294fae-d254-433a-bf95-c7fd7e57fc5e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid d3e6f5eb-1144-4f89-b95b-1caee3802617 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:46.869502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:46.961837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b294fae-d254-433a-bf95-c7fd7e57fc5e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.137099 Oct 18 13:24:46.962477 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 83/199] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:46.978438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-803df77f-4e9d-4d2d-998e-324e573af878 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:46.993167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803df77f-4e9d-4d2d-998e-324e573af878 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.993974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803df77f-4e9d-4d2d-998e-324e573af878 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.994686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803df77f-4e9d-4d2d-998e-324e573af878 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.049550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.050293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:47.065669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.066417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.067536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.071656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.072689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.073348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.317389 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-803df77f-4e9d-4d2d-998e-324e573af878 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.347027 Oct 18 13:24:47.325699 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 117/200] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:47.333395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b01846-9fb8-4278-99f7-ec2bddb4532d", "tag": "3c498e3c-a41a-4ca4-b639-3a6c1757e95c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:47.358576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.359142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.359654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.384514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] Creating event network-changed:3c498e3c-a41a-4ca4-b639-3a6c1757e95c for instance d7b01846-9fb8-4278-99f7-ec2bddb4532d on n-h2-858383-13 Oct 18 13:24:47.393946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0c7b18ef-6007-47c0-b48e-f62ef5958ece req-7641b372-e11d-49a4-bdd9-0d133069135d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066362 Oct 18 13:24:47.396244 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 118/201] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:47.402614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f07c125-5811-49b8-96ea-5b6a3472e490 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.411949 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f07c125-5811-49b8-96ea-5b6a3472e490 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.013933 Oct 18 13:24:47.420334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 119/202] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:47.425631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-883ffdca-0b5e-4268-9b2b-601bfc6a1872 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:47.444230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883ffdca-0b5e-4268-9b2b-601bfc6a1872 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.445284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883ffdca-0b5e-4268-9b2b-601bfc6a1872 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.445950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883ffdca-0b5e-4268-9b2b-601bfc6a1872 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.643807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.656939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.663913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.663913 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5047c3bc-098d-430f-9716-5bd6a86e1458 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1361 microversion: 2.25 time: 0.615642 Oct 18 13:24:47.663913 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 84/203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1361 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:47.717655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.717655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:47.718294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.718952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.719521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.720407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.721107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.722184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.810196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-883ffdca-0b5e-4268-9b2b-601bfc6a1872 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.388516 Oct 18 13:24:47.810879 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 120/204] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:47.826018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.827476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:47.836776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.837711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.838366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.839527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.840185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.841163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.916583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.926238 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1fcdc3dc-1838-4f40-927c-2ef2674d0e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1211 microversion: 2.1 time: 0.113747 Oct 18 13:24:47.938284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.954197 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f994eb2-1ff9-43b5-9ea2-ac83efed8dbb tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.248805 Oct 18 13:24:47.954911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 121/205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:47.956426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 85/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:47.971663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6b2935c-5c23-42b9-a3f7-acad827dfce6 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.077920 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6b2935c-5c23-42b9-a3f7-acad827dfce6 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.121735 Oct 18 13:24:48.078977 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 122/207] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:47 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:48.088834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e04a9d75-45df-4b1e-83e9-326bb94dd5a3 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1870341533"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.092586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-e04a9d75-45df-4b1e-83e9-326bb94dd5a3 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid d825f94b-bac1-4c1d-b38d-790ff752e493 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:48.193024 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e04a9d75-45df-4b1e-83e9-326bb94dd5a3 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107775 Oct 18 13:24:48.201765 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 86/208] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:48.205209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ceb9847-4428-4f45-932a-a858a238886f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.222082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ceb9847-4428-4f45-932a-a858a238886f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.222646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ceb9847-4428-4f45-932a-a858a238886f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.223092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ceb9847-4428-4f45-932a-a858a238886f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.268751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa60c9d-d83f-4f3f-8974-69ceb98836ae", "name": "network-vif-plugged", "status": "completed", "tag": "369422a0-3597-4d1c-9a37-b27b2052317e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.293235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.294015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.294985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.311835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] Creating event network-vif-plugged:369422a0-3597-4d1c-9a37-b27b2052317e for instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae on n-h1-858383-13 Oct 18 13:24:48.318428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1b4f3502-5a99-4127-997d-d5a239fa52fd req-87549ec8-1449-4ba7-8a65-7528cb779f78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053570 Oct 18 13:24:48.319684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 87/209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:48.511812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-60648137", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.514845 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ceb9847-4428-4f45-932a-a858a238886f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.313231 Oct 18 13:24:48.515378 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 123/210] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:48.531230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aede33ca-7c77-4a1c-b8ed-d524203c70f7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.546734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aede33ca-7c77-4a1c-b8ed-d524203c70f7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.547388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aede33ca-7c77-4a1c-b8ed-d524203c70f7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.547828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aede33ca-7c77-4a1c-b8ed-d524203c70f7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.586206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:48.800422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:48.800923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:48.801524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:48.801951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:48.806080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:48.817349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aede33ca-7c77-4a1c-b8ed-d524203c70f7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.291802 Oct 18 13:24:48.818971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.819679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.820132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.820873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.821335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.821768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.825416 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 124/211] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:48.829412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=15 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:48.834363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.835975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:48.842320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Getting quotas for project 585e27ca2dd143b9bb193fbebb8400e5. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:48.847800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Getting quotas for user 8f04d39830d04cf99527919cbccf46e7 and project 585e27ca2dd143b9bb193fbebb8400e5. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:48.851567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.852064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.852505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.853211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.853662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.858884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.867256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:48.870201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:49.005241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.013450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.014949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.016072 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6602bb0a-aa2f-425d-9f60-b797c18aebb6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1361 microversion: 2.25 time: 0.189605 Oct 18 13:24:49.016635 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 125/212] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:49.021740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2bdde98-8109-4dee-9b66-405651accc4e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.031935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1457e136-2216-4bc8-9272-a337967accb4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703562 Oct 18 13:24:49.032861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 88/213] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:49.038677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.039298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.046603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.049971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.049971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.049971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.049971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.050355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.099811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2bdde98-8109-4dee-9b66-405651accc4e tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.082027 Oct 18 13:24:49.100834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 126/214] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:49.108914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.109695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.119023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.119517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.120162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.120958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.121416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.124885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.127245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:49.131571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.141624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6933705-555a-48a8-a74c-0e4e6eb25a71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1259 microversion: 2.1 time: 0.106171 Oct 18 13:24:49.142755 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 89/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1259 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:49.148765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6e9c501-be3a-4e3b-bb57-552a693cce62 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.149375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6e9c501-be3a-4e3b-bb57-552a693cce62 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.217891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6e9c501-be3a-4e3b-bb57-552a693cce62 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.223522 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6e9c501-be3a-4e3b-bb57-552a693cce62 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1212 microversion: 2.1 time: 0.078761 Oct 18 13:24:49.234560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 90/216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:49.234560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-877a5600-a94e-4f42-b63e-0903f91e5788 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2025756244"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.243246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-877a5600-a94e-4f42-b63e-0903f91e5788 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid 60ba8dda-dc49-42bc-b566-a3b17c5d4e1d for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:49.300559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.309363 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c14fee62-80d9-4cb0-af68-25cdd82bb1a9 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.207267 Oct 18 13:24:49.310272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 127/217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:49.311627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-877a5600-a94e-4f42-b63e-0903f91e5788 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082927 Oct 18 13:24:49.318941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 91/218] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.324079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fe7ef9e-48fa-409e-9850-5e59cf9e05ca tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1956709444"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.327520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-6fe7ef9e-48fa-409e-9850-5e59cf9e05ca tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Generated uuid f1b2015d-09e4-47f6-bf71-25d71d2ea649 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:49.331894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f9f5ca-fbc3-466d-b3b5-6974651d9805 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.407558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f9f5ca-fbc3-466d-b3b5-6974651d9805 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.087322 Oct 18 13:24:49.408446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 92/219] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 13:24:49.412736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fe7ef9e-48fa-409e-9850-5e59cf9e05ca tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.101161 Oct 18 13:24:49.413773 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 128/220] 10.222.0.27 () {62 vars in 1205 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:49.418669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c95c0882-daa6-4bab-81d4-b08e47a5ad46 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.425942 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c95c0882-daa6-4bab-81d4-b08e47a5ad46 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c95c0882-daa6-4bab-81d4-b08e47a5ad46 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Request method failure captured: Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjkYaOsZC5LYYAeM7OCAbAE8IekbiJldYgAU5DqX21iQHGhMQzJWCbIw7RXRH6LZ9uycQtotI0gwBlT_LCbRzPb0dD-y7hoX4PDj8tl3l_q_gTPs88WCMtL2aI8S_N_BqO5pxwjBLg3PnHtA3B5ZeZaBtmZMQu8h1UQzHlv7_QOz6A Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:49.429225 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6f7b9527ab624cae898a2046f25cf4d8 Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate 5 could not be found. Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5'} Oct 18 13:24:49.438282 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.439257 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.440890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c95c0882-daa6-4bab-81d4-b08e47a5ad46 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:49.442071 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c95c0882-daa6-4bab-81d4-b08e47a5ad46 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.016031 Oct 18 13:24:49.442232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7587a2cd-2805-4355-b5b0-088ec6b9664d tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2041462388"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.442328 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 93/221] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:49.452099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-900ce49f-2ca0-47b5-9582-262baad2536b tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.496639 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-900ce49f-2ca0-47b5-9582-262baad2536b tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-900ce49f-2ca0-47b5-9582-262baad2536b tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Request method failure captured: Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjkYaOsZC5LYYAeM7OCAbAE8IekbiJldYgAU5DqX21iQHGhMQzJWCbIw7RXRH6LZ9uycQtotI0gwBlT_LCbRzPb0dD-y7hoX4PDj8tl3l_q_gTPs88WCMtL2aI8S_N_BqO5pxwjBLg3PnHtA3B5ZeZaBtmZMQu8h1UQzHlv7_QOz6A Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:49.498669 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6f7b9527ab624cae898a2046f25cf4d8 Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate 5 could not be found. Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5'} Oct 18 13:24:49.508388 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:49.509189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.510204 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-900ce49f-2ca0-47b5-9582-262baad2536b tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-900ce49f-2ca0-47b5-9582-262baad2536b tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.057171 Oct 18 13:24:49.511307 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 94/222] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:49.515707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ecedda9a-5857-4c82-80c1-7bf49c1aebd5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-668116519", "name": "tempest-test_aggregate-1989193712"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.518639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-ecedda9a-5857-4c82-80c1-7bf49c1aebd5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid 3db15750-1b18-4bf7-af43-6805bef65c2f for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:49.650815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ecedda9a-5857-4c82-80c1-7bf49c1aebd5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.139374 Oct 18 13:24:49.659299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 95/223] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.664111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f60903d-0dbc-4cc9-89a6-cf5202d2931f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.701423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7587a2cd-2805-4355-b5b0-088ec6b9664d tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.279970 Oct 18 13:24:49.708904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 129/224] 10.222.0.27 () {62 vars in 1210 bytes} [Tue Oct 18 13:24:49 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:24:49.714110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdc5bc47-d919-4e5d-a216-01e7dd34b053 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.722938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdc5bc47-d919-4e5d-a216-01e7dd34b053 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.012692 Oct 18 13:24:49.729601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 130/225] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:49.736332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d19e81a7-d57e-4960-81a5-3e16bce3045a tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.746973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d19e81a7-d57e-4960-81a5-3e16bce3045a tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.747474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d19e81a7-d57e-4960-81a5-3e16bce3045a tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.747918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d19e81a7-d57e-4960-81a5-3e16bce3045a tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.780382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f60903d-0dbc-4cc9-89a6-cf5202d2931f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.119941 Oct 18 13:24:49.780965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 96/226] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:49.790046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7318f0ee-fa64-4812-87a7-f5b35fc0019d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.796682 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7318f0ee-fa64-4812-87a7-f5b35fc0019d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7318f0ee-fa64-4812-87a7-f5b35fc0019d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Request method failure captured: Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjkYaOsZC5LYYAeM7OCAbAE8IekbiJldYgAU5DqX21iQHGhMQzJWCbIw7RXRH6LZ9uycQtotI0gwBlT_LCbRzPb0dD-y7hoX4PDj8tl3l_q_gTPs88WCMtL2aI8S_N_BqO5pxwjBLg3PnHtA3B5ZeZaBtmZMQu8h1UQzHlv7_QOz6A Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:49.798485 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6f7b9527ab624cae898a2046f25cf4d8 Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate 7 could not be found. Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7'} Oct 18 13:24:49.800271 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.801016 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.802107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7318f0ee-fa64-4812-87a7-f5b35fc0019d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:49.803134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7318f0ee-fa64-4812-87a7-f5b35fc0019d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.014806 Oct 18 13:24:49.803134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 97/227] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:49.809107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4392a0e1-fa87-4ee5-b52f-759f1cb0b476 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.819111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4392a0e1-fa87-4ee5-b52f-759f1cb0b476 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4392a0e1-fa87-4ee5-b52f-759f1cb0b476 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Request method failure captured: Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjkYaOsZC5LYYAeM7OCAbAE8IekbiJldYgAU5DqX21iQHGhMQzJWCbIw7RXRH6LZ9uycQtotI0gwBlT_LCbRzPb0dD-y7hoX4PDj8tl3l_q_gTPs88WCMtL2aI8S_N_BqO5pxwjBLg3PnHtA3B5ZeZaBtmZMQu8h1UQzHlv7_QOz6A Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:49.822385 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e8a2ab3d1d341e89321eb0daa775f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 8e8a2ab3d1d341e89321eb0daa775f15 Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-642609217 Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6f7b9527ab624cae898a2046f25cf4d8 Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-642609217-project-admin Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate 7 could not be found. Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7'} Oct 18 13:24:49.823556 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:49.824230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:49.825292 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4392a0e1-fa87-4ee5-b52f-759f1cb0b476 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4392a0e1-fa87-4ee5-b52f-759f1cb0b476 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.018779 Oct 18 13:24:49.828577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 98/228] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:24:49.836344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3ca3661-5f9c-49da-b603-20cdb93e565f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2030069631"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:49.856647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-a3ca3661-5f9c-49da-b603-20cdb93e565f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid b64f2430-cc98-4cdd-b643-2e74043561f8 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:49.936137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3ca3661-5f9c-49da-b603-20cdb93e565f tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103238 Oct 18 13:24:49.944248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 99/229] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.949904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0703b906-5b6a-4714-a950-8f70b3f22432 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.957750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0703b906-5b6a-4714-a950-8f70b3f22432 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.012234 Oct 18 13:24:49.959630 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 100/230] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.975056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0ea97e6-fe73-465f-b8b1-97ad89fd0827 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.014840 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d19e81a7-d57e-4960-81a5-3e16bce3045a tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.41 time: 0.283350 Oct 18 13:24:50.023024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 131/231] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:50.029140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3894c70-fe7c-4544-9415-b74c27806299 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.043643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3894c70-fe7c-4544-9415-b74c27806299 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.044243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3894c70-fe7c-4544-9415-b74c27806299 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.044750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3894c70-fe7c-4544-9415-b74c27806299 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.099731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0ea97e6-fe73-465f-b8b1-97ad89fd0827 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.128854 Oct 18 13:24:50.102145 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 101/232] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Oct 18 13:24:49 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:50.108490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.113731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.135511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.136157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.136658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.137643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.138513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.139160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.298423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.306768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.308274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.309433 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44aeffd9-334a-4328-bd66-b42099a1dfdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1556 microversion: 2.25 time: 0.208044 Oct 18 13:24:50.310283 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 102/233] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:50.314554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-faeac9b2-f534-4b8e-ad8b-d7d70246e962 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.322029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-faeac9b2-f534-4b8e-ad8b-d7d70246e962 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.010789 Oct 18 13:24:50.322624 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 103/234] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:50.334906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.335511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.341334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.341816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.342287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.342966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.343417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.343839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.348469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:50.381210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3894c70-fe7c-4544-9415-b74c27806299 tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.356713 Oct 18 13:24:50.381854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 132/235] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Oct 18 13:24:50 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:50.387448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.388304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.396226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.396947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.397399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.398214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.398679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.399344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.432699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.442562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b5a650a-ec34-4215-b168-b3d71bc89bb1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1265 microversion: 2.1 time: 0.112438 Oct 18 13:24:50.443231 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 104/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.448807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdbf6f3a-dc41-4381-bc3b-30b1e14fd73d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.466225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.475440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:50.478479 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a94d0f7-a8ce-4be8-8312-3a77151101f4 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1216 microversion: 2.1 time: 0.095520 Oct 18 13:24:50.479278 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 133/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.483690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.484313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.498102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.498656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.501815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.501815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.501815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.501815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.541645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdbf6f3a-dc41-4381-bc3b-30b1e14fd73d tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.097082 Oct 18 13:24:50.546254 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 105/238] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:50 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:50.659125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.667295 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13444c14-3a7d-40c8-8c7c-5cc48394f3a6 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.187273 Oct 18 13:24:50.667981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 134/239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.673753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c05be47-cb89-47ee-b794-5ccffc0b6d0f tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.689753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.690972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.696816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.697295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.697727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.698446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.698901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.699323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.786670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c05be47-cb89-47ee-b794-5ccffc0b6d0f tempest-AggregatesAdminTestV241-1529624088 tempest-AggregatesAdminTestV241-1529624088-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.117481 Oct 18 13:24:50.792112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 135/240] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:24:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:50.801104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ab46314-5169-430b-a38a-61aa45a9bf44 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-321910346", "availability_zone": "tempest-test_az-702739825"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.822101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-2ab46314-5169-430b-a38a-61aa45a9bf44 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid 79213665-8c00-4b19-b540-1a20a07603a8 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:50.915976 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ab46314-5169-430b-a38a-61aa45a9bf44 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.126816 Oct 18 13:24:50.918134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 136/241] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 18 13:24:50 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:50.930900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9457a43f-4ed7-4857-9c4c-80d7ffe43c4c tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1510119004"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.934370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-9457a43f-4ed7-4857-9c4c-80d7ffe43c4c tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 78ef278e-5238-40ed-9418-3b58500d3172 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:50.940992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=11,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:51.010099 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9457a43f-4ed7-4857-9c4c-80d7ffe43c4c tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082063 Oct 18 13:24:51.011454 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 137/242] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:51.026786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-121a1462-085c-4361-a92d-7ef5a305dbc5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-321910346_new", "availability_zone": "tempest-test_az-702739825_new"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:51.124179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 7aa60c9d-d83f-4f3f-8974-69ceb98836ae {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:51.180197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-121a1462-085c-4361-a92d-7ef5a305dbc5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.180949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-121a1462-085c-4361-a92d-7ef5a305dbc5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.184724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-121a1462-085c-4361-a92d-7ef5a305dbc5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.213553 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5025f59-d38a-4120-a710-e75a3f1f4b35 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 2050 microversion: 2.25 time: 0.666172 Oct 18 13:24:51.216982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 106/243] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 2050 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:51.223413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99e5cc20-180f-4f89-92a3-57eeb112d75e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:51.235946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e5cc20-180f-4f89-92a3-57eeb112d75e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.236441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e5cc20-180f-4f89-92a3-57eeb112d75e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.237444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e5cc20-180f-4f89-92a3-57eeb112d75e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.250771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:51.290766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-121a1462-085c-4361-a92d-7ef5a305dbc5 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.277554 Oct 18 13:24:51.293988 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 138/244] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:24:51 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:51.303770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.306869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:51.317006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.317516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.323502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.324283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.324755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.325188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.511848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99e5cc20-180f-4f89-92a3-57eeb112d75e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.292965 Oct 18 13:24:51.512962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 107/245] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:51.519957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e5a7956-369c-4ba6-987a-c7543ed84d20 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.545163 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e5a7956-369c-4ba6-987a-c7543ed84d20 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 567 microversion: 2.1 time: 0.031453 Oct 18 13:24:51.546185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 7aa60c9d-d83f-4f3f-8974-69ceb98836ae {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:51.551845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 108/246] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/os-aggregates => generated 567 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:51.567949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.568755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:51.579870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.581332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.581781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.582773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.583243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.583676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.613350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fce70904-c080-4729-90c5-e58e642802c5 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 2050 microversion: 2.25 time: 0.317891 Oct 18 13:24:51.630093 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 139/247] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 2050 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:51.638090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.642440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:51.655496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.656002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.656445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.657158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.657614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.658041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.748369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:51.761963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ea47aaa-73d9-4b52-bd6a-1f9de418bf32 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1264 microversion: 2.1 time: 0.146332 Oct 18 13:24:51.762587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 140/248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:51.787500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:51.805488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.806095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.806895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.858595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:51.868005 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7109bac9-b581-466a-be3f-5c05e9cf8a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.315051 Oct 18 13:24:51.869162 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 109/249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:51.875185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52bd8265-b8d2-4911-9d22-68551b62c7a7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.885107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Aggregate 10 already has host n-h1-858383-13. Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 40 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:24:51.889313 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: {"add_host": {"host": "n-h1-858383-13"}} Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:51.894607 n-d-858383-13 devstack@n-api.service[121009]: exception: Aggregate 10 already has host n-h1-858383-13. Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-858383-13'}}} Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:24:51.895324 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858383-13-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:24:51.896339 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:24:51.897335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:24:51.898300 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858383-13-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 24, 51, 825711), 'updated_at': None, 'host': 'n-h1-858383-13', 'aggregate_id': 10}] Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:51.901485 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 10 already has host n-h1-858383-13. Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.903083 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 10 already has host n-h1-858383-13. Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:51.905014 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 already has host n-h1-858383-13. Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 409 to user: Aggregate 10 already has host n-h1-858383-13. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2e3e8541-a149-4a55-b7bb-6c85d801ae44 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 409 len: 97 microversion: 2.1 time: 0.113822 Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 141/250] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 97 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 18 13:24:51.907670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.915848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.915848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.915848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.916133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.920794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.921262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.961849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc1fff7c-4951-4c4d-9ea9-0de9d556b69e tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.063017 Oct 18 13:24:51.970224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 142/251] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:51.976095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.977070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:51.983379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.984085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.984613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.985542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.986250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.986928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.011929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52bd8265-b8d2-4911-9d22-68551b62c7a7 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.135922 Oct 18 13:24:52.011929 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 110/252] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:52.016785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba2c5ebc-aee6-4785-b691-92465d3d98b6 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:52.061683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba2c5ebc-aee6-4785-b691-92465d3d98b6 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.062639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba2c5ebc-aee6-4785-b691-92465d3d98b6 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.063419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba2c5ebc-aee6-4785-b691-92465d3d98b6 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.252823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:52.258254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0540898d-ccc1-4148-afc6-eb4d9997fdb0 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.286618 Oct 18 13:24:52.258798 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 143/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:52.263766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-13", "block_migration": "auto"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:52.266746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:52.274787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.275278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.275954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.276410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.276860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.277287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.412250 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba2c5ebc-aee6-4785-b691-92465d3d98b6 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.399908 Oct 18 13:24:52.412250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 111/254] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:52.417687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d06d7de4-7653-4ddc-8acf-6cd6e2d295cc tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1134374697"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:52.421091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-d06d7de4-7653-4ddc-8acf-6cd6e2d295cc tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Generated uuid ff99f798-7b59-49d8-9826-2aba4ef6e7ff for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:52.491952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'flavor' on Instance uuid 7aa60c9d-d83f-4f3f-8974-69ceb98836ae {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:52.547295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Going to try to live migrate instance to n-h2-858383-13 {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:24:52.570042 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d06d7de4-7653-4ddc-8acf-6cd6e2d295cc tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.159041 Oct 18 13:24:52.572041 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 112/255] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:52.578217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ee13229-5437-4210-b94a-2ffb351f6157 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.730899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ee13229-5437-4210-b94a-2ffb351f6157 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.157478 Oct 18 13:24:52.732474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 113/256] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:52 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:52.740266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d74fea-1d0c-47dd-8bd7-7a74658cd0cb", "tag": "20a10dfc-3310-4caf-b21d-b4de7f2fd29e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:52.760394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.760892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.761407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.772046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] Creating event network-changed:20a10dfc-3310-4caf-b21d-b4de7f2fd29e for instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb on n-h1-858383-13 Oct 18 13:24:52.777126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b5581f0b-0832-4c70-b584-445d132ddfb4 req-59c99cd1-6bb3-41bf-9732-b56b75f8d079 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043477 Oct 18 13:24:52.777770 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 114/257] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:52.782682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1d50410-28b6-4de3-931f-2992e8bb01b4 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.790311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1d50410-28b6-4de3-931f-2992e8bb01b4 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.011348 Oct 18 13:24:52.790879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 115/258] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:24:52 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:52.795296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dcc54249-f31a-4065-a106-1f8795ca5133 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153116269"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:52.798582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-dcc54249-f31a-4065-a106-1f8795ca5133 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 72204568-5ab6-41bf-88c2-f7cda5cff9fc for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:52.895738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dcc54249-f31a-4065-a106-1f8795ca5133 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.103685 Oct 18 13:24:52.896717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 116/259] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:52.901701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.902476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:52.909999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.910542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.910965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.911883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.912534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.913166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.021242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.029380 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbeb156e-7c3c-4107-b3f8-7b2a839b6e55 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1270 microversion: 2.1 time: 0.131392 Oct 18 13:24:53.029962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 117/260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:52 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:53.045411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8157a56c-73b8-4c74-aaa1-68949a049d22 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.145640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8157a56c-73b8-4c74-aaa1-68949a049d22 tempest-AggregatesAdminTestJSON-642609217 tempest-AggregatesAdminTestJSON-642609217-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.103779 Oct 18 13:24:53.146682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 118/261] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:53.176362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.177340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.194687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.196787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.199062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.200039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.206735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.207409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.443147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.456359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17fe37b6-1543-4023-8ff5-4ee078e4ad0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.303528 Oct 18 13:24:53.459393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 119/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:53.733292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3b59298-5ee2-4096-8d5f-09581752ea05 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:53.736691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3b59298-5ee2-4096-8d5f-09581752ea05 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3b59298-5ee2-4096-8d5f-09581752ea05 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 40 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:53.740186 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: {"add_host": {"host": "n-h1-858383-13"}} Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:53.741414 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858383-13'}}} Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:53.742166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:24:53.743231 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.745714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3b59298-5ee2-4096-8d5f-09581752ea05 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:53.745714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3b59298-5ee2-4096-8d5f-09581752ea05 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.279521 Oct 18 13:24:53.745714 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 120/263] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 281 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:53.747533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.748033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.755615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.756622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.756622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.757272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.757902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.758214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.777533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] HTTP exception thrown: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Request method failure captured: Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e HTTP/1.1 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhaVLTzWObDF1INiI-gVgNkpJHVRcs5HYf9qwG8sltZQzkR8BTNybmEYvINr6t4oqMDrgFVND0fnaFudemu_iMx0npuOXHbUMUZJZnVBdH6Ccs2spuh_F2LN0nxwjHxoEmR4NNLWRdipqSSEo2Yq_3JId51GQj3HTB0O36_QqbEjE Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:53.779201 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36b87172368b42f4b089504ac3b545a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a448bc53c0d343f2bbc87667c88cbd0d Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:53.780402 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a0d79ce6-c390-4b52-bb04-98b58d28746e'} Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:53.781042 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:53.782101 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.783675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Returning 404 to user: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:53.783675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2822d590-cee1-44fa-956e-c97dabbbb3fe tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 404 len: 111 microversion: 2.1 time: 0.038962 Oct 18 13:24:53.783675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 121/264] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:53 2022] DELETE /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:53.787037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.787810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.796756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.797303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.797906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.798900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.799909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.800348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.037670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:54.045692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f5b4dd7-fb3c-4db2-aeb3-f78aeafea733 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.263226 Oct 18 13:24:54.046299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 122/265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:54.052613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c55feb4b-5c1c-4575-b5a2-67cee7290921 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:54.169424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c55feb4b-5c1c-4575-b5a2-67cee7290921 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.121723 Oct 18 13:24:54.170642 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 123/266] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:54.176576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:54.177649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] [instance: a0d79ce6-c390-4b52-bb04-98b58d28746e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:54.187464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.191369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.191369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.191369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.191369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.191734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.204270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] HTTP exception thrown: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Request method failure captured: Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e HTTP/1.1 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjhaVLTzWObDF1INiI-gVgNkpJHVRcs5HYf9qwG8sltZQzkR8BTNybmEYvINr6t4oqMDrgFVND0fnaFudemu_iMx0npuOXHbUMUZJZnVBdH6Ccs2spuh_F2LN0nxwjHxoEmR4NNLWRdipqSSEo2Yq_3JId51GQj3HTB0O36_QqbEjE Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:54.205907 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36b87172368b42f4b089504ac3b545a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36b87172368b42f4b089504ac3b545a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 36b87172368b42f4b089504ac3b545a8 Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-336485024 Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a448bc53c0d343f2bbc87667c88cbd0d Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminTestJSON-336485024-project Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:54.207236 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a0d79ce6-c390-4b52-bb04-98b58d28746e'} Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:54.207883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. Oct 18 13:24:54.209645 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:54.210677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] Returning 404 to user: Instance a0d79ce6-c390-4b52-bb04-98b58d28746e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:54.210677 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c29ac030-7da2-4574-9f0a-aa48e355d44b tempest-AggregatesAdminTestJSON-336485024 tempest-AggregatesAdminTestJSON-336485024-project] 10.222.0.27 "GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e" status: 404 len: 111 microversion: 2.1 time: 0.035481 Oct 18 13:24:54.210677 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 124/267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:54 2022] GET /compute/v2.1/servers/a0d79ce6-c390-4b52-bb04-98b58d28746e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:54.213154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:54.213848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:54.220189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.221560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.222553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.224096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.224725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.225612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.562215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:54.574709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ad4b274-f069-4ede-bb4a-9f44419162c5 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.365118 Oct 18 13:24:54.588751 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 125/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:54 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:54.598726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b01846-9fb8-4278-99f7-ec2bddb4532d", "name": "network-vif-plugged", "status": "completed", "tag": "3c498e3c-a41a-4ca4-b639-3a6c1757e95c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:54.611455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.612126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.612900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.631301 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] Creating event network-vif-plugged:3c498e3c-a41a-4ca4-b639-3a6c1757e95c for instance d7b01846-9fb8-4278-99f7-ec2bddb4532d on n-h2-858383-13 Oct 18 13:24:54.637923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3ca00e32-e7b1-454c-be03-98d21423f05c req-bc5187a5-4bc5-4692-b66b-70cef65a9bba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047902 Oct 18 13:24:54.638579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 126/269] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:54.644700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-121b6ae9-6b7b-4044-bc3d-f29230afa214 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1167009719"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:54.648261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-121b6ae9-6b7b-4044-bc3d-f29230afa214 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 66de067b-c06e-453c-8c68-bd4ac9c489d6 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:54.736256 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-121b6ae9-6b7b-4044-bc3d-f29230afa214 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.096283 Oct 18 13:24:54.737538 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 127/270] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:54.742694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:54.743777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:54.751063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.751723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.752160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:54.752847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:54.753296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:54.753710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.016911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:55.028664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0af025b-8a51-444a-8997-417efec4b9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.289593 Oct 18 13:24:55.030173 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 128/271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:54 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:55.036414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-157209822"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.052509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.053436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.054135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.066613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.068807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.068807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.079635 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-157209822 could not be found. Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 57 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:55.083025 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: {"add_host": {"host": "tempest-nonexist_host-157209822"}} Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:55.084409 n-d-858383-13 devstack@n-api.service[121010]: exception: Compute host tempest-nonexist_host-157209822 could not be found. Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-157209822'}}} Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-157209822' is not mapped to any cell Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.085256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 18 13:24:55.094365 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-157209822 could not be found. Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-157209822 could not be found. Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.095524 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-157209822 could not be found. Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-157209822 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ce8bd9d-bcf0-45d4-96b4-cbc7ace70caf tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.054731 Oct 18 13:24:55.097200 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 129/272] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:55.101603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:55.102295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:55.113481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.113982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.114853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.115155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.115625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.118537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.361897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:55.372798 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c610aa00-2d1b-4177-94f7-2a8485d6d6ad tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1319 microversion: 2.1 time: 0.283691 Oct 18 13:24:55.386991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 130/273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:55 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:55.395313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d14d308b-afe4-432d-87e0-d23e983e6592 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:55.475366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d14d308b-afe4-432d-87e0-d23e983e6592 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.087018 Oct 18 13:24:55.475958 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 131/274] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:55.482249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4329238c-efbf-4be4-be15-ccf622753b59", "tag": "5a5148ca-b2be-4282-b1ca-0391d4af22e5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.493704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.494262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.494704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.505608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] Creating event network-changed:5a5148ca-b2be-4282-b1ca-0391d4af22e5 for instance 4329238c-efbf-4be4-be15-ccf622753b59 on n-h2-858383-13 Oct 18 13:24:55.510684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6a729516-8798-4dd5-ac64-48ecea9fe3fc req-819472d9-3d94-453e-ab6b-f85891332e3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Oct 18 13:24:55.511311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 132/275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:55.516481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97df611d-afdd-4c62-b33e-10f563d6b102 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97df611d-afdd-4c62-b33e-10f563d6b102 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 283 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:55.526758 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.537710 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:24:55.538681 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:55.539342 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.540499 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.541469 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:24:55.541469 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:24:55.541469 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:24:55.541469 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.541469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97df611d-afdd-4c62-b33e-10f563d6b102 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:55.541827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97df611d-afdd-4c62-b33e-10f563d6b102 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.015526 Oct 18 13:24:55.541827 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 133/276] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:24:55.546933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78b9ddf8-c288-465c-b654-8340eeb606a5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78b9ddf8-c288-465c-b654-8340eeb606a5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 27 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:55.550551 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: {"aggregate": {"name": ""}} Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:55.551732 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:55.552505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:24:55.553962 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.557741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78b9ddf8-c288-465c-b654-8340eeb606a5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:55.557741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78b9ddf8-c288-465c-b654-8340eeb606a5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008870 Oct 18 13:24:55.557741 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 134/277] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:24:55.566851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63281cea-0760-4142-a77c-9a9f438c8fff tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1275500265"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.571400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-63281cea-0760-4142-a77c-9a9f438c8fff tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63281cea-0760-4142-a77c-9a9f438c8fff tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 60 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:55.573170 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: {"aggregate": {"name": "tempest-test_aggregate-1275500265"}} Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:55.574569 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1275500265'}}} Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:55.575410 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:55.576649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:24:55.577840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:55.579646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63281cea-0760-4142-a77c-9a9f438c8fff tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:55.581356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63281cea-0760-4142-a77c-9a9f438c8fff tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018352 Oct 18 13:24:55.582088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 135/278] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:24:55.591035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c67b245-0321-417d-9437-0661c0ffd11a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-695344321"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.594582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-9c67b245-0321-417d-9437-0661c0ffd11a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 4b5c599a-5507-4073-a5fa-530d779b1513 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:55.710416 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c67b245-0321-417d-9437-0661c0ffd11a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120885 Oct 18 13:24:55.713077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 136/279] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:55.718354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:55.719392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:55.726205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.726727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.727202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.728005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:55.728374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:55.728808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:55.961249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:55.972254 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e7e099c-0f4c-480a-b4d9-1b90edf51c6c tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.257968 Oct 18 13:24:55.984235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 137/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:55 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:55.984235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-695344321"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:55.984235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid cdd868c8-b102-4628-8d08-f39570005025 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:55.997967 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-695344321 already exists. Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 59 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:55.999240 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: {"aggregate": {"name": "tempest-test_aggregate-695344321"}} Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:56.000630 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate tempest-test_aggregate-695344321 already exists. Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-695344321'}}} Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 18 13:24:56.005202 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-695344321 already exists. Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:56.006503 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-695344321 already exists. Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-695344321 already exists. Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-695344321 already exists. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:56.007974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6b108f3-0b90-44ba-afad-6f5bc1b68a3e tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.026704 Oct 18 13:24:56.009517 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 138/281] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:55 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:56.015826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8330425-0eaf-4c3f-980e-aed6c310a129 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.130982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8330425-0eaf-4c3f-980e-aed6c310a129 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.123669 Oct 18 13:24:56.131589 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 139/282] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:56 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:56.139124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.139756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.148928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.151084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.151697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.152895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.153576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.154271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.447024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.454716 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-890dd9d8-c45a-4166-8d0e-2e03b30c0a53 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.322068 Oct 18 13:24:56.455300 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 140/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:56.475483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c909b91d-6b97-41e4-a5c9-834848b0f259 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1692243679"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:56.479190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.aggregate [None req-c909b91d-6b97-41e4-a5c9-834848b0f259 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 5b2afb7b-791c-4020-a4bb-5c9b411dda10 for aggregate {{(pid=121010) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:56.493900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:56.570111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c909b91d-6b97-41e4-a5c9-834848b0f259 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.107464 Oct 18 13:24:56.577485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 141/284] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:56.577485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.577695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.586798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.586798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.586798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.587043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.587475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.587911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.794117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.802962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1990c0a4-6791-4ec3-aef5-931af8a3a06b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1469 microversion: 2.1 time: 0.230270 Oct 18 13:24:56.803723 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 142/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:56.808401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f524ba0-0ba1-4e11-ba62-6dc81ba22f1c tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.809933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7f524ba0-0ba1-4e11-ba62-6dc81ba22f1c tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f524ba0-0ba1-4e11-ba62-6dc81ba22f1c tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:56.811529 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:24:56.812711 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '15'} Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:56.813379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:56.814415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f524ba0-0ba1-4e11-ba62-6dc81ba22f1c tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:56.815408 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f524ba0-0ba1-4e11-ba62-6dc81ba22f1c tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.008430 Oct 18 13:24:56.815408 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 143/286] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:56.935027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331b925e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.938563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.939092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.939632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.940918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.941370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.941792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.969296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4505118-500e-43e1-b583-8c37bf4f4dd2 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.154986 Oct 18 13:24:56.969886 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 144/287] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:57.160318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a27d7b45-a218-453a-be51-db91a42c22e0 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.491360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8298bea-43a9-4d42-8dc1-cf2df5bfeb60 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae/action" status: 202 len: 0 microversion: 2.25 time: 5.231254 Oct 18 13:24:57.492472 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a27d7b45-a218-453a-be51-db91a42c22e0 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.521107 Oct 18 13:24:57.498549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 145/288] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:57.498714 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 144/289] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:24:52 2022] POST /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae/action => generated 0 bytes in 5238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:57.498804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:57.500541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.504217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb3319699d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.507963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.508100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.508385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.508572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.508837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.509004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.509579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.510204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.510546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.510972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.511128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.511734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.547197 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-469a4321-b460-4677-85da-7b5d77583024 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.047853 Oct 18 13:24:57.548086 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 145/290] 10.222.0.27 () {58 vars in 1139 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:57.553052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.553931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.560990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.561484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.562177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.563052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.563673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.564270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.578220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:57.714044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.722707 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1cc4fa39-7e83-4e71-bd50-d6bf20c3fc12 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.173409 Oct 18 13:24:57.723280 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 146/291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:57.728081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.728691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.734730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.739013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.739013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.739013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.739013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.739377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.920361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.928253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bebc6e84-0924-416d-b2ef-d87454435493 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.203998 Oct 18 13:24:57.928816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 147/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:57.933724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.934950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.941453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.946206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.946206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.946206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.946206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.946759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.998376 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccf51411-fa52-4e1f-8b7d-1f359eb57337 tempest-DeleteServersAdminTestJSON-2059008651 tempest-DeleteServersAdminTestJSON-2059008651-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d/action" status: 202 len: 0 microversion: 2.1 time: 0.504108 Oct 18 13:24:58.001059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 146/293] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:57 2022] POST /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:58.004173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-415de7ed-3aea-4775-9499-b2ec0a6cedd5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.027216 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-415de7ed-3aea-4775-9499-b2ec0a6cedd5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-415de7ed-3aea-4775-9499-b2ec0a6cedd5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:24:58.029001 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: exception: Aggregate -1 could not be found. Oct 18 13:24:58.030821 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '-1'} Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:58.031682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.033114 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-415de7ed-3aea-4775-9499-b2ec0a6cedd5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-415de7ed-3aea-4775-9499-b2ec0a6cedd5 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037555 Oct 18 13:24:58.039080 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 147/294] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:58.053979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331b088b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.065391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.067422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.068643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.072469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.074649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.075288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.118039 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-571a6b91-a307-41d9-b077-fbeb02d43086 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.072398 Oct 18 13:24:58.125293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 148/295] 10.222.0.27 () {58 vars in 1145 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:24:58.125293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.125293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.137023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.137023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.137023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.137023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.137276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.137276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.179989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.180656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.181237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.181858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lazy-loading 'fault' on Instance uuid d7b01846-9fb8-4278-99f7-ec2bddb4532d {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:58.249720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.263105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.270090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.272271 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1af58f0-b1af-4b85-bac7-a656e50eb203 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.342320 Oct 18 13:24:58.274559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 148/296] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:58.302769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-091aadb6-a7d7-40ce-b7c2-4dee3e2c5c34 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-88964390"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:58.306443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-091aadb6-a7d7-40ce-b7c2-4dee3e2c5c34 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 8e232e33-4bc5-45bd-97f2-0244f4eec16c for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:58.367083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.374839 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0f0a393-efba-4a45-bcd4-7019bf1f0827 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1452 microversion: 2.1 time: 0.254598 Oct 18 13:24:58.375472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 149/297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1452 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:58.380844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331cb0430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.384919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.385430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.385908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.386662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.387117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.387541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.415012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea5819b2-ce14-4522-bd91-d78a0340b51c tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036486 Oct 18 13:24:58.418402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.423155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d74fea-1d0c-47dd-8bd7-7a74658cd0cb", "name": "network-vif-plugged", "status": "completed", "tag": "20a10dfc-3310-4caf-b21d-b4de7f2fd29e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:58.430218 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-091aadb6-a7d7-40ce-b7c2-4dee3e2c5c34 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.142072 Oct 18 13:24:58.430218 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 149/299] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.439413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.440744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.445412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.445909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.446366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.455591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.456494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.456868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.457589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.458250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.458834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.470680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] Creating event network-vif-plugged:20a10dfc-3310-4caf-b21d-b4de7f2fd29e for instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb on n-h1-858383-13 Oct 18 13:24:58.476342 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dc8981c5-dfec-43c2-ad8d-0ce6b6b306e7 req-9afbf70d-5cce-467e-8ea0-0dbe5ea45ee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059159 Oct 18 13:24:58.478225 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 151/300] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.492646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:58.493164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331aa23a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.497171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.497773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.498376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.499348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.503265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.504313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.537758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:58.539153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70102df3-55bd-4316-a13a-03360c544286 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.056869 Oct 18 13:24:58.540583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 152/301] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.548366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a80857ad-b8fe-4ccb-9347-58a5841bed3d tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.551543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a80857ad-b8fe-4ccb-9347-58a5841bed3d tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a80857ad-b8fe-4ccb-9347-58a5841bed3d tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:58.553682 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:24:58.554932 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '16'} Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:58.555795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:24:58.558010 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.560874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a80857ad-b8fe-4ccb-9347-58a5841bed3d tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.561777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a80857ad-b8fe-4ccb-9347-58a5841bed3d tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.019921 Oct 18 13:24:58.562702 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 153/302] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:58.568265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331aa2b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.571531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.572022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.572465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.573195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.573752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.574230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.601137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a737c553-f838-438a-bb45-e371a979157e tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036646 Oct 18 13:24:58.607771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 154/303] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.607771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-464ae163-ee54-46e8-a690-fdc093816305 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.744151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-464ae163-ee54-46e8-a690-fdc093816305 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.140707 Oct 18 13:24:58.749521 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 155/304] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:24:58 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:24:58.756583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb331adc5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.764709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.765217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.765739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.779613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.780130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.780710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.812495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f654aef-9577-4bc4-9a72-a5e4381eb078 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-858383-13" status: 200 len: 603 microversion: 2.1 time: 0.061753 Oct 18 13:24:58.813311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 156/305] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts/n-h1-858383-13 => generated 603 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.822081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.822813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.828674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.829157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.829603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.830347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.830804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.831233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.884361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5d7ebf8-9d5a-4036-afaf-5bf3e897a2c2 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 204 len: 0 microversion: 2.1 time: 0.454846 Oct 18 13:24:58.885117 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 150/306] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:58 2022] DELETE /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:58.890747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd9ce4cf-fa8b-44ac-afc6-946122999630 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.898181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-bd9ce4cf-fa8b-44ac-afc6-946122999630 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd9ce4cf-fa8b-44ac-afc6-946122999630 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:24:58.899934 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: exception: Aggregate -1 could not be found. Oct 18 13:24:58.904294 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '-1'} Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.905669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 13:24:58.907199 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.908247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd9ce4cf-fa8b-44ac-afc6-946122999630 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.908247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd9ce4cf-fa8b-44ac-afc6-946122999630 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015246 Oct 18 13:24:58.908959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 151/307] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:24:58.913707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Calling method '.version_select at 0x7fb3317f2040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.922129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.922627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.923069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.936901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.937595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.937595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.974439 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4265aaa3-540e-4d3d-a4e8-3a2e42ac6da4 tempest-HostsAdminTestJSON-655638369 tempest-HostsAdminTestJSON-655638369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-858383-13" status: 200 len: 735 microversion: 2.1 time: 0.064319 Oct 18 13:24:58.975337 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 152/308] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-hosts/n-h2-858383-13 => generated 735 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:58.982471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.984692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.985494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.991870 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a9d0f8b-8d03-4dff-8f49-e3937996e01b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.173464 Oct 18 13:24:58.992374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.992866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.993312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.994016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.994505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.994934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.006461 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 157/309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.013611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bde1018a-d823-4e08-a5fe-fbfc5e4d4fb9 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.015107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bde1018a-d823-4e08-a5fe-fbfc5e4d4fb9 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bde1018a-d823-4e08-a5fe-fbfc5e4d4fb9 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:59.016686 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:24:59.018382 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:59.019137 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.020171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bde1018a-d823-4e08-a5fe-fbfc5e4d4fb9 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:59.023934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bde1018a-d823-4e08-a5fe-fbfc5e4d4fb9 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011883 Oct 18 13:24:59.024998 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:59.030049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.030675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.031042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.031157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.031608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.032066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lazy-loading 'fault' on Instance uuid d7b01846-9fb8-4278-99f7-ec2bddb4532d {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:59.038845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.039542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.040144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.041006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.041636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.042288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.154888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.167863 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a4e7ee9-3499-417f-b248-2e764e89503b tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1458 microversion: 2.1 time: 0.191374 Oct 18 13:24:59.168443 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 153/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1458 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.175939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8003fee7-5fcb-4822-8d53-a1bd26da72ba tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1156787318"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.179852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-8003fee7-5fcb-4822-8d53-a1bd26da72ba tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid 2f79e0c5-a2c3-4702-a1d5-d11309b86345 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:24:59.185293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.195984 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e18c3bef-4f8c-4c87-b6f4-72ae92385cfb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1307 microversion: 2.1 time: 0.167203 Oct 18 13:24:59.195984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 159/312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.287216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8003fee7-5fcb-4822-8d53-a1bd26da72ba tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116647 Oct 18 13:24:59.295118 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 154/313] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:59.300155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a45e2b9-03f5-4c52-a539-af2cdf496c39 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.302389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.303261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.305922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=44 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:59.313847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a45e2b9-03f5-4c52-a539-af2cdf496c39 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.314675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a45e2b9-03f5-4c52-a539-af2cdf496c39 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.315057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.315407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a45e2b9-03f5-4c52-a539-af2cdf496c39 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.315563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.316334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.317242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.322099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.322563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.519619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.530425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.531977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.533244 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa3464cf-42ee-4cbb-b4b0-95402d47b0e1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.236750 Oct 18 13:24:59.534116 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 155/314] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:59.620920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a45e2b9-03f5-4c52-a539-af2cdf496c39 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.324779 Oct 18 13:24:59.621649 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 160/315] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:24:59.635544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-724a08a0-cb1d-44d7-9725-9bb7604c5c45 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.640678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-724a08a0-cb1d-44d7-9725-9bb7604c5c45 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'fd0b7dc4bfe34473a0ed4d8af2677692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8aa3924a629405ca8d4940315576ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-724a08a0-cb1d-44d7-9725-9bb7604c5c45 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Request method failure captured: Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 43 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjisPL4LObhvBgbqIVXSGHf18_lebBkP-RhDsmKu2NdznF-zWDaNMWyPB3GJZZv0Hv5JKZtogQQzzSn_JT0Phk0MJNSwLMO-j6X-8Zu8fMv4ABbF4QPdOqwzsV08K0GB_3rRgbCOJrBDTVPmkyzQ5euR1BOmBysf3YN-8L2XY1uf2E Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:24:59.644886 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8aa3924a629405ca8d4940315576ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e8aa3924a629405ca8d4940315576ba1 Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-104102509 Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fd0b7dc4bfe34473a0ed4d8af2677692 Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-104102509-project Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: {"remove_host": {"host": "n-h1-858383-13"}} Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:24:59.647474 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858383-13'}}} Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:24:59.648527 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:24:59.649941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:24:59.651148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-724a08a0-cb1d-44d7-9725-9bb7604c5c45 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:59.652294 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-724a08a0-cb1d-44d7-9725-9bb7604c5c45 tempest-AggregatesAdminNegativeTestJSON-104102509 tempest-AggregatesAdminNegativeTestJSON-104102509-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.022148 Oct 18 13:24:59.656424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 161/316] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:59.661462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23412219-73a5-46a3-8ae7-4b1d2464825a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.680618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23412219-73a5-46a3-8ae7-4b1d2464825a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.680618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23412219-73a5-46a3-8ae7-4b1d2464825a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.680618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23412219-73a5-46a3-8ae7-4b1d2464825a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.811471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea53708f-8772-4864-bc01-3bfb527d4c6d tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1956455036", "id": 1859239316, "os-flavor-access:is_public": "False"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.915225 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea53708f-8772-4864-bc01-3bfb527d4c6d tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.380033 Oct 18 13:24:59.922986 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 156/317] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/flavors => generated 431 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:59.932600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f311cde4-1811-4b0c-99ed-0dd734c27d74 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "80b5300549ff4e7c991dccae8a42a33d"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:00.001203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23412219-73a5-46a3-8ae7-4b1d2464825a tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.342941 Oct 18 13:25:00.006686 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 162/318] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:00.015079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b15c9f6-2913-4c89-9bb3-26d0bd5e2532 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.109191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f311cde4-1811-4b0c-99ed-0dd734c27d74 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1859239316/action" status: 200 len: 97 microversion: 2.1 time: 0.183009 Oct 18 13:25:00.111434 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 157/319] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/flavors/1859239316/action => generated 97 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:25:00.119558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.131148 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b15c9f6-2913-4c89-9bb3-26d0bd5e2532 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.120375 Oct 18 13:25:00.132165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.134486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:25:00 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 13:25:00.149792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.150681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.152025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.152973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.154228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.155057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.422260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90c41138-cae6-4206-ad22-388baae4d622 tempest-FlavorsAccessTestJSON-1344586801 tempest-FlavorsAccessTestJSON-1344586801-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.430018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.438397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad96c1b9-efa2-4814-bf89-6e9434295c38 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.324154 Oct 18 13:25:00.438982 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 158/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:00.476471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b584c02-cbec-4a9e-ad11-17f77356e5f4 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-871513083"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:00.480067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-9b584c02-cbec-4a9e-ad11-17f77356e5f4 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Generated uuid c365e944-d2b8-4831-8ff9-fff9f63465b0 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:25:00.490832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90c41138-cae6-4206-ad22-388baae4d622 tempest-FlavorsAccessTestJSON-1344586801 tempest-FlavorsAccessTestJSON-1344586801-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.350284 Oct 18 13:25:00.497413 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 164/322] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:00.512393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.515561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.527622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.529473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.534021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.535750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.536143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.537305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.590301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.593481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.594140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.594778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lazy-loading 'fault' on Instance uuid d7b01846-9fb8-4278-99f7-ec2bddb4532d {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:00.621493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b584c02-cbec-4a9e-ad11-17f77356e5f4 tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.148553 Oct 18 13:25:00.624043 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 159/323] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 13:25:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:00.640580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.642025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.646549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:00.651780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.653600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.653600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.654229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.656857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.658037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.813341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.822433 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-766f202f-8321-40a4-8ac4-dcfe7adc9a4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1488 microversion: 2.1 time: 0.197117 Oct 18 13:25:00.825971 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 160/324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1488 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:00.839051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eeb6c50b-d494-480b-aee9-c58f9a5c809e tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "80b5300549ff4e7c991dccae8a42a33d"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:00.943119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.954080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3ad4aaa-6854-479d-a784-605b7db38e00 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1458 microversion: 2.1 time: 0.455000 Oct 18 13:25:00.954860 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 165/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1458 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:00.960487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.961587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.975061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.975800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.976425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.977436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.978243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.979118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.180970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.188977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.190964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.192099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14c825dd-38a7-4ff5-bb16-377f897f066e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.235588 Oct 18 13:25:01.192641 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 166/326] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:01.197009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:01.208032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.208517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.208959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.211496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eeb6c50b-d494-480b-aee9-c58f9a5c809e tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1859239316/action" status: 200 len: 21 microversion: 2.1 time: 0.384330 Oct 18 13:25:01.212349 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 161/327] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Oct 18 13:25:00 2022] POST /compute/v2.1/flavors/1859239316/action => generated 21 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:25:01.214424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.214914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.215334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.219743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa60c9d-d83f-4f3f-8974-69ceb98836ae", "name": "network-vif-unplugged", "status": "completed", "tag": "369422a0-3597-4d1c-9a37-b27b2052317e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:01.223193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.compute.aggregates [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 13:25:01.223703 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Request method failure captured: Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 42 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjlPZOqFZwrAivfNgWjlfKr6-0e96Qsf2hphH7fj-a-5EM0fdEbE-kGp3by2IUkaMvUrYAJ_ZiurfctfBHL7HXxT9m5ULg4G7cqzGh7DdNRBdhl8eimQzTD7l437t-sCRPpFdKnCSJ1leEO6zaBp-TIGTJDKuXuNG2w8QDgFLDd_J0 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:01.225571 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4293f61372d04f46807f3062c7e192c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4293f61372d04f46807f3062c7e192c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4293f61372d04f46807f3062c7e192c6 Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-240237493 Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ae2e7efa9ee249ea9d14f124fac8235c Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: {"remove_host": {"host": "nonexist_host"}} Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:01.230983 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 13:25:01.232511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 18 13:25:01.233785 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.235071 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54f5c22f-c586-471a-a12c-827cad69995f tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.034177 Oct 18 13:25:01.236348 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 167/328] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 13:25:01 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:25:01.236976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.236976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.237141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.242066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:01.243410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.251469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.252721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.253306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.254205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.254807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.255401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.280113 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] Creating event network-vif-unplugged:369422a0-3597-4d1c-9a37-b27b2052317e for instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae on n-h1-858383-13 Oct 18 13:25:01.291349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f6e75002-5d7e-48b9-9403-85194e946544 req-5ac9a188-987a-4ca0-af3b-e17b9a827eb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077604 Oct 18 13:25:01.291959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 162/329] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:01.301448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d13f97f0-efbe-45d0-a958-f453a7cd45e3 tempest-FlavorsAccessTestJSON-1344586801 tempest-FlavorsAccessTestJSON-1344586801-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.343900 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d13f97f0-efbe-45d0-a958-f453a7cd45e3 tempest-FlavorsAccessTestJSON-1344586801 tempest-FlavorsAccessTestJSON-1344586801-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.047504 Oct 18 13:25:01.345240 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 163/330] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.363494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3d6a1e7-e4a5-48e3-bc5e-04399fc8ceec tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.456811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70710802-8c4f-47ab-8394-6f833ac151a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.218556 Oct 18 13:25:01.457636 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 168/331] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:01 2022] POST /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:01.479405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71d44076-86c3-4ae4-bc53-9bead3dc2004 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.500273 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3d6a1e7-e4a5-48e3-bc5e-04399fc8ceec tempest-AggregatesAdminNegativeTestJSON-240237493 tempest-AggregatesAdminNegativeTestJSON-240237493-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.153380 Oct 18 13:25:01.500885 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 164/332] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:25:01 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:25:01.507163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b01846-9fb8-4278-99f7-ec2bddb4532d", "name": "network-vif-deleted", "tag": "3c498e3c-a41a-4ca4-b639-3a6c1757e95c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:01.521355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.522249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.522917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.539115 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] Creating event network-vif-deleted:3c498e3c-a41a-4ca4-b639-3a6c1757e95c for instance d7b01846-9fb8-4278-99f7-ec2bddb4532d on n-h2-858383-13 Oct 18 13:25:01.543134 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8cb4192b-1167-4eb7-815b-f6f7722315e1 req-b1de8ba0-6593-45b6-8897-ab9875b9e042 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040680 Oct 18 13:25:01.543733 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 165/333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:01.550119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.551197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.558030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.558714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.559444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.560654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.561199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.562034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.613888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71d44076-86c3-4ae4-bc53-9bead3dc2004 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1859239316" status: 202 len: 0 microversion: 2.1 time: 0.153592 Oct 18 13:25:01.614847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 169/334] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:01 2022] DELETE /compute/v2.1/flavors/1859239316 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:01.620771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.621803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.631445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.636832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.636832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.636832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.636832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.637170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.776288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.784775 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64cfab2e-31c5-4b45-958d-4369e9c8b70b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.239672 Oct 18 13:25:01.785391 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 166/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.789807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8294f166-6639-4969-9232-8df8dbf2db86 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.815406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8294f166-6639-4969-9232-8df8dbf2db86 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028491 Oct 18 13:25:01.816486 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.839759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3949a947-9fc8-479b-8da9-c9cd7fecda21 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1381235687", "id": 783200080, "os-flavor-access:is_public": "False"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:01.890975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.901909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-146cd40e-25e2-4762-90c7-d19387cd6536 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1493 microversion: 2.1 time: 0.284050 Oct 18 13:25:01.903761 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 170/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1493 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.941905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3949a947-9fc8-479b-8da9-c9cd7fecda21 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.105769 Oct 18 13:25:01.942539 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 168/338] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:01 2022] POST /compute/v2.1/flavors => generated 428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:01.955560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-424e0148-f444-47ef-8317-8881b537403b tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.973740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-424e0148-f444-47ef-8317-8881b537403b tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/783200080/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022540 Oct 18 13:25:01.979587 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 171/339] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/flavors/783200080/os-flavor-access => generated 21 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:25:01.984532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.985206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.985350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04b884ac-eeff-459f-9683-369937283239 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.993311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.994204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.000499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.000499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.000499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.000499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.000829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=12,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:02.039025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.039523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.042276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.043021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lazy-loading 'fault' on Instance uuid d7b01846-9fb8-4278-99f7-ec2bddb4532d {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:02.120098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04b884ac-eeff-459f-9683-369937283239 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/783200080" status: 202 len: 0 microversion: 2.1 time: 0.139205 Oct 18 13:25:02.120698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 172/340] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:25:01 2022] DELETE /compute/v2.1/flavors/783200080 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:02.125509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4329238c-efbf-4be4-be15-ccf622753b59", "name": "network-vif-plugged", "status": "completed", "tag": "5a5148ca-b2be-4282-b1ca-0391d4af22e5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:02.135434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f765d197374f1cb5bdfa5890d74f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a90038712264f0a852d014124619cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.138797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.139227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.139664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.145064 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b091fd14-6be4-4f81-9cdb-89a6a07f73d8 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 200 len: 1309 microversion: 2.1 time: 0.170589 Oct 18 13:25:02.145641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 169/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:02.151248 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] Creating event network-vif-plugged:5a5148ca-b2be-4282-b1ca-0391d4af22e5 for instance 4329238c-efbf-4be4-be15-ccf622753b59 on n-h2-858383-13 Oct 18 13:25:02.151801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ad8c118-e71c-481d-8f32-c7dc085c44ae tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.159842 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-90366555-782c-4ceb-8549-459c6415339b req-57ef6621-34c8-4dd9-b258-5224d3b25eb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037776 Oct 18 13:25:02.161001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 173/342] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:02.182006 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ad8c118-e71c-481d-8f32-c7dc085c44ae tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035237 Oct 18 13:25:02.183096 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 170/343] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:02.217349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.218304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.229434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.229936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.232928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.234697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.235561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.236539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.386916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.396972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.398357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.399624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38f5a356-7f82-48a7-8cfe-96233a343edc tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.186719 Oct 18 13:25:02.400183 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 174/344] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:02.809843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.810662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.821445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.821954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.822443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.823410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.823888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.824322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.927739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.928490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.946940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.949568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.950030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.950800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.951268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.956001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.003468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.012093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d58158c4-42c7-4459-9a86-4bcc03d3e9bd tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1312 microversion: 2.1 time: 0.206003 Oct 18 13:25:03.012738 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 171/345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:03.024083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:03.161871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.172689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d63ff1f-59e6-4dc3-98b8-56f9593b77bf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 200 len: 1473 microversion: 2.1 time: 0.249871 Oct 18 13:25:03.173824 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:03.182291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.183173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.196408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1193306739"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:03.196651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.197458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.199103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.199263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.200372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.201756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.202370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.205319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.206295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.207661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.208638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.209246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.209821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.221863 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d HTTP/1.1 Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:03.223665 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.225167 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd7b01846-9fb8-4278-99f7-ec2bddb4532d'} Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:03.226105 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.227689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.229357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:03.229629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f954e72d-da88-4f87-b0d8-8959e72dc2fd tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 404 len: 111 microversion: 2.1 time: 0.061258 Oct 18 13:25:03.236037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 172/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:03.242654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.243952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.250315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.254250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.254250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.254250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.254250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.255643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.280122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d HTTP/1.1 Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:03.281711 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.284900 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd7b01846-9fb8-4278-99f7-ec2bddb4532d'} Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:03.285625 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.286719 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.287790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:03.287790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afbd662e-a4ee-4864-a8ca-18c027b5afba tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 404 len: 111 microversion: 2.1 time: 0.045759 Oct 18 13:25:03.288981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 173/348] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:03 2022] DELETE /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:03.294480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.295071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: d7b01846-9fb8-4278-99f7-ec2bddb4532d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.305685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.306230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.308249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.308249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.308698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.309188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.328001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d HTTP/1.1 Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:03.330370 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.331569 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd7b01846-9fb8-4278-99f7-ec2bddb4532d'} Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:03.332226 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. Oct 18 13:25:03.333259 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.334304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance d7b01846-9fb8-4278-99f7-ec2bddb4532d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:03.334304 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ed2bca5-e356-4364-bb89-a07545d324ab tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d" status: 404 len: 111 microversion: 2.1 time: 0.042196 Oct 18 13:25:03.336983 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 174/349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/d7b01846-9fb8-4278-99f7-ec2bddb4532d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:03.342997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa60c9d-d83f-4f3f-8974-69ceb98836ae", "tag": "369422a0-3597-4d1c-9a37-b27b2052317e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:03.354595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.355081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.355526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.373025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] Creating event network-changed:369422a0-3597-4d1c-9a37-b27b2052317e for instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae on n-h1-858383-13 Oct 18 13:25:03.378681 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6dc9ed30-02a5-4322-8982-5b20f02343d0 req-8f92fadb-e51e-4304-b1a0-70fc013dbdff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040270 Oct 18 13:25:03.379513 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 175/350] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:03.387673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.388604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.397978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.399745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.400210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.401295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.401965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.402799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.435200 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b HTTP/1.1 Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:03.440058 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.441281 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '97e38598-f622-45e7-928c-dc94f8e6bf5b'} Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:03.442003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.443152 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.449226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:03.450347 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9474c71-303b-4f0e-82f4-909c8ffc3d61 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 404 len: 111 microversion: 2.1 time: 0.068738 Oct 18 13:25:03.452152 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 176/351] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:03 2022] DELETE /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:03.467089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.468125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.483044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.483754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.484206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.484916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.488392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.489804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.670427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.676638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.678212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.679390 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9d65663-4a86-4c2d-bccb-94a4fba1af33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.221982 Oct 18 13:25:03.679950 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 177/352] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:03.684770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.685408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] [instance: 97e38598-f622-45e7-928c-dc94f8e6bf5b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.703708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.704220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.704672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.706088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.706618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.707210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.740335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] HTTP exception thrown: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Request method failure captured: Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b HTTP/1.1 Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjoaowvLnRZA-NoudUf2towSCduzxPs9Dk1IegEp4bYa8UOjg_ZD0KaQskyWyt-NrXrz_V4MVVp022Clskcd7A5WpiyalDKN7gd61UoBHmR5kEOrZ4oscQ_9NPbFpUG3_AJaaROIQNw_6DoPf4OhhTAzMN4wwc0I3ZzgGw6GQcKF8Q Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:03.743505 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a90038712264f0a852d014124619cfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a90038712264f0a852d014124619cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a90038712264f0a852d014124619cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3a90038712264f0a852d014124619cfc Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2084292764 Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31f765d197374f1cb5bdfa5890d74f7d Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersAdminTestJSON-2084292764-project Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.744814 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '97e38598-f622-45e7-928c-dc94f8e6bf5b'} Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:03.745457 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. Oct 18 13:25:03.746538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:03.747489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] Returning 404 to user: Instance 97e38598-f622-45e7-928c-dc94f8e6bf5b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:03.748355 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8254f88-c6d9-4a55-b14c-4d59c18eb765 tempest-DeleteServersAdminTestJSON-2084292764 tempest-DeleteServersAdminTestJSON-2084292764-project] 10.222.0.27 "GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b" status: 404 len: 111 microversion: 2.1 time: 0.067325 Oct 18 13:25:03.754372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 178/353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/97e38598-f622-45e7-928c-dc94f8e6bf5b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:03.760363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc4cdab5-f67a-4827-b42a-ff544d89b629 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.567849 Oct 18 13:25:03.761066 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 176/354] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:03 2022] POST /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 13:25:03.776151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9867b8e-2b7a-474c-b0dd-ed6a55650ba7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3317eeca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.825236 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9867b8e-2b7a-474c-b0dd-ed6a55650ba7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.053566 Oct 18 13:25:03.826795 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 179/355] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:04.044899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.048152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:04.065345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.065841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.066311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.076014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.076750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.077184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.419511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:04.428277 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3729cf5b-c143-4440-ba65-a93ccfb37bf6 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1462 microversion: 2.1 time: 0.396284 Oct 18 13:25:04.439354 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 177/356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1462 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:04.708709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.710483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:04.738458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.739136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.739611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.740342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.740814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.741251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.760320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Calling method '.version_select at 0x7fb33179fc10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.773609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.774322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.774915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.825491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.827262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.827262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.866156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91ee36af-59e3-4482-b70c-bb0b94f26ab3 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/585e27ca2dd143b9bb193fbebb8400e5?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958" status: 200 len: 693 microversion: 2.1 time: 0.411776 Oct 18 13:25:04.872939 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 180/357] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/os-simple-tenant-usage/585e27ca2dd143b9bb193fbebb8400e5?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958 => generated 693 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:04.891562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d46b71f6-e6f9-44c2-8f97-14b24de3dfb4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331796160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.922091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:04.932682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:04.934240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:04.935402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb49f375-81b1-4071-ba6e-1852eb6216a9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.234071 Oct 18 13:25:04.936237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 178/358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:04.940783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '.version_select at 0x7fb331a74af0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.945702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d46b71f6-e6f9-44c2-8f97-14b24de3dfb4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.068469 Oct 18 13:25:04.946581 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 181/359] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:04.949857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.957944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.957944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.972694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.973178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.973613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.992372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29ed0f93-3948-4eac-ae38-e81622bea7be tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/585e27ca2dd143b9bb193fbebb8400e5?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958" status: 200 len: 693 microversion: 2.1 time: 0.055104 Oct 18 13:25:05.000342 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 179/360] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/os-simple-tenant-usage/585e27ca2dd143b9bb193fbebb8400e5?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958 => generated 693 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:05.008944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Calling method '.version_select at 0x7fb3317f2ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.025419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.025938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.029826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.050220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.050220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.050220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.078635 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95bad7f1-b181-43ff-a6f3-9b95479514c2 tempest-TenantUsagesTestJSON-341587048 tempest-TenantUsagesTestJSON-341587048-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958&detailed=1" status: 200 len: 4581 microversion: 2.1 time: 0.073430 Oct 18 13:25:05.079224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 182/361] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A25%3A04.448958&end=2022-10-19T13%3A25%3A04.448958&detailed=1 => generated 4581 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:05.100542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.101462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:05.107974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.109118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.109745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.110668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.113197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.113197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.164274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:05.467371 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-188087bc-af67-431c-87d1-c723e05c3c1b tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 204 len: 0 microversion: 2.1 time: 0.368016 Oct 18 13:25:05.467371 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 180/362] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:05 2022] DELETE /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:05.478564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.479182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:05.487561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.488683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.489735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.496376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.496376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.496376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.632086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.640207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42e0953e-0f52-4007-8797-7326884aa9fb tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1468 microversion: 2.1 time: 0.169708 Oct 18 13:25:05.640787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 183/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:05.906202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Calling method '.version_select at 0x7fb331b96a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.909833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.910396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.912426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.913225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.913691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.914171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.942781 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1b8b9b0-ee3c-48d9-8797-881b54358b85 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.466780 Oct 18 13:25:05.943365 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 181/364] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:05.961302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.962102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:05.968372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.968872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.969319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.971282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.971282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.971282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.115521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.129837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.132502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.134691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8ace6cc-b717-469f-a2da-8eb06318a830 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.177413 Oct 18 13:25:06.147870 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 182/365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:06.153895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c4b72a0-a38f-4ce9-b759-dfdb278f2eea tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3319c6940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.201282 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c4b72a0-a38f-4ce9-b759-dfdb278f2eea tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.051646 Oct 18 13:25:06.202025 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 183/366] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:06.271473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17a30ac9-7bcc-4b12-91f5-b0b61170b7aa tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Calling method '.version_select at 0x7fb33176ef70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.275014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17a30ac9-7bcc-4b12-91f5-b0b61170b7aa tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17a30ac9-7bcc-4b12-91f5-b0b61170b7aa tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:06.276840 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:25:06.285647 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.286424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:25:06.288122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.289109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17a30ac9-7bcc-4b12-91f5-b0b61170b7aa tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.289109 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17a30ac9-7bcc-4b12-91f5-b0b61170b7aa tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.327195 Oct 18 13:25:06.289109 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 184/367] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:25:06.295631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d8ab46f-0d22-42a8-a382-9b514cb597de tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Calling method '.version_select at 0x7fb331a34670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.298489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d8ab46f-0d22-42a8-a382-9b514cb597de tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d8ab46f-0d22-42a8-a382-9b514cb597de tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hosts/n-d-858383-13/reboot HTTP/1.1 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:06.302427 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13'} Oct 18 13:25:06.303684 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.304379 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:25:06.305369 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.308715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d8ab46f-0d22-42a8-a382-9b514cb597de tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.309834 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d8ab46f-0d22-42a8-a382-9b514cb597de tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018509 Oct 18 13:25:06.317057 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 184/368] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/n-d-858383-13/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:06.320924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d29bfaf1-c507-4f1b-a1f0-0a9a07d75f52 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Calling method '.version_select at 0x7fb3317244c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.336228 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d29bfaf1-c507-4f1b-a1f0-0a9a07d75f52 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d29bfaf1-c507-4f1b-a1f0-0a9a07d75f52 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.338240 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:25:06.339502 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:06.340596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:25:06.341619 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d29bfaf1-c507-4f1b-a1f0-0a9a07d75f52 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d29bfaf1-c507-4f1b-a1f0-0a9a07d75f52 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.022559 Oct 18 13:25:06.348703 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 185/369] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:25:06.351783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3363af27-50d8-434d-8a5a-e67a6fad168a tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Calling method '.version_select at 0x7fb331a74e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.355585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3363af27-50d8-434d-8a5a-e67a6fad168a tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3363af27-50d8-434d-8a5a-e67a6fad168a tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hosts/n-d-858383-13 HTTP/1.1 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:06.360068 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13'} Oct 18 13:25:06.364265 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.370216 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:25:06.371405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.372440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3363af27-50d8-434d-8a5a-e67a6fad168a tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.372440 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3363af27-50d8-434d-8a5a-e67a6fad168a tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-13" status: 403 len: 109 microversion: 2.1 time: 0.016338 Oct 18 13:25:06.372440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 185/370] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/n-d-858383-13 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:06.375737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ae91433-1955-4686-8530-37c23cafd953 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Calling method '.version_select at 0x7fb3317f2160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.382435 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1ae91433-1955-4686-8530-37c23cafd953 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ae91433-1955-4686-8530-37c23cafd953 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.384520 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:25:06.385859 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.386830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.388011 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.389275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ae91433-1955-4686-8530-37c23cafd953 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.389275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ae91433-1955-4686-8530-37c23cafd953 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015196 Oct 18 13:25:06.389275 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 186/371] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:25:06.399235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71889cf9-919e-4f9d-aae6-21f06dba1284 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Calling method '.version_select at 0x7fb331a744c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.401229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71889cf9-919e-4f9d-aae6-21f06dba1284 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71889cf9-919e-4f9d-aae6-21f06dba1284 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hosts/n-d-858383-13/shutdown HTTP/1.1 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:06.402849 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13'} Oct 18 13:25:06.404176 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.404990 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:25:06.406440 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.407361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71889cf9-919e-4f9d-aae6-21f06dba1284 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.407361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71889cf9-919e-4f9d-aae6-21f06dba1284 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010090 Oct 18 13:25:06.407361 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 186/372] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/n-d-858383-13/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:06.416924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b821760-de41-4f97-a44a-179ac224b98b tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Calling method '.version_select at 0x7fb33176e820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.429436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-5b821760-de41-4f97-a44a-179ac224b98b tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b821760-de41-4f97-a44a-179ac224b98b tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.431236 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:25:06.432770 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:06.433908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:25:06.435327 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.436596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.450158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b821760-de41-4f97-a44a-179ac224b98b tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.450158 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b821760-de41-4f97-a44a-179ac224b98b tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.036390 Oct 18 13:25:06.450158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 187/373] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:25:06.461906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35d6ad20-20b4-4cfc-810e-f725803ca1db tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Calling method '.version_select at 0x7fb331b08ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.463870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35d6ad20-20b4-4cfc-810e-f725803ca1db tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35d6ad20-20b4-4cfc-810e-f725803ca1db tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hosts/n-d-858383-13/startup HTTP/1.1 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:06.465684 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13'} Oct 18 13:25:06.467189 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.468061 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:25:06.469259 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.477391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35d6ad20-20b4-4cfc-810e-f725803ca1db tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.477391 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35d6ad20-20b4-4cfc-810e-f725803ca1db tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.016595 Oct 18 13:25:06.477391 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 187/374] 10.222.0.27 () {58 vars in 1194 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/n-d-858383-13/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:06.482686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76e7f26c-b0a4-4e68-8505-d4635654925f tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Calling method '.version_select at 0x7fb3317f2e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.493685 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-76e7f26c-b0a4-4e68-8505-d4635654925f tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76e7f26c-b0a4-4e68-8505-d4635654925f tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.495906 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:25:06.497401 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:06.498350 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:25:06.500241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76e7f26c-b0a4-4e68-8505-d4635654925f tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.501496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76e7f26c-b0a4-4e68-8505-d4635654925f tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018435 Oct 18 13:25:06.502417 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 188/375] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:25:06.522718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a7d1539-61fe-4da0-8431-73df965be2a4 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Action: 'update', calling method: .version_select at 0x7fb331aa2820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a7d1539-61fe-4da0-8431-73df965be2a4 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/os-hosts/n-d-858383-13 HTTP/1.1 Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 51 Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:06.527588 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: {"status": "enable", "maintenance_mode": "invalid"} Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.528807 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.529558 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.531104 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a7d1539-61fe-4da0-8431-73df965be2a4 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.532119 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a7d1539-61fe-4da0-8431-73df965be2a4 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-13" status: 400 len: 199 microversion: 2.1 time: 0.018171 Oct 18 13:25:06.538292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 188/376] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:25:06 2022] PUT /compute/v2.1/os-hosts/n-d-858383-13 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:06.543162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8a4d38d-3242-4371-b321-032301321b80 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Action: 'update', calling method: .version_select at 0x7fb33176e670>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8a4d38d-3242-4371-b321-032301321b80 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-hosts/n-d-858383-13 HTTP/1.1 Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 51 Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.554721 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: {"status": "invalid", "maintenance_mode": "enable"} Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.556026 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'n-d-858383-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.556731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.558154 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8a4d38d-3242-4371-b321-032301321b80 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.559217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8a4d38d-3242-4371-b321-032301321b80 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-13" status: 400 len: 189 microversion: 2.1 time: 0.023286 Oct 18 13:25:06.562181 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 189/377] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:25:06 2022] PUT /compute/v2.1/os-hosts/n-d-858383-13 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:06.571309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2aa9162-3bdd-46c9-939d-c58f1083ea62 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Action: 'update', calling method: .version_select at 0x7fb331a74700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:06.575660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2aa9162-3bdd-46c9-939d-c58f1083ea62 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '31cb47723a564ec4804151531e91509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bac90d929784944bcd6154168cfca34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2aa9162-3bdd-46c9-939d-c58f1083ea62 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Request method failure captured: Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/os-hosts/n-d-858383-13 HTTP/1.1 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 50 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkvXwJmd_g9rIRHSviHNU9NEKGsD-HOGEo1AOfE-rxnv-E_7zRi7-6pB3K6p859H-0oLJagO_EtrIhNGInrkquPecoDBnYvHWMPQ9wHoxy5mI6lSy69po7wsejLVTxxj_78hXiJ67JhN5AViCAwbyvqCEYsxOzwJx6Psqxh67i7peA Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:06.577683 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bac90d929784944bcd6154168cfca34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bac90d929784944bcd6154168cfca34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bac90d929784944bcd6154168cfca34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9bac90d929784944bcd6154168cfca34 Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1963612296 Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31cb47723a564ec4804151531e91509d Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1963612296-project Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:25:06.579173 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-d-858383-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.580653 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:25:06.582178 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.583416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2aa9162-3bdd-46c9-939d-c58f1083ea62 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.583881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2aa9162-3bdd-46c9-939d-c58f1083ea62 tempest-HostsAdminNegativeTestJSON-1963612296 tempest-HostsAdminNegativeTestJSON-1963612296-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-13" status: 403 len: 111 microversion: 2.1 time: 0.018986 Oct 18 13:25:06.585790 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 189/378] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:25:06 2022] PUT /compute/v2.1/os-hosts/n-d-858383-13 => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:06.598903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-380ac23e-f53e-482a-a5e3-adb4feb36ed0 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Action: 'update', calling method: .version_select at 0x7fb33176edc0>, body: {"status": null, "maintenance_mode": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-380ac23e-f53e-482a-a5e3-adb4feb36ed0 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-hosts/n-d-858383-13 HTTP/1.1 Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 42 Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:06.603405 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: {"status": null, "maintenance_mode": null} Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:25:06.604647 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'n-d-858383-13', 'body': {'status': None, 'maintenance_mode': None}} Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi None Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.605574 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.606941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.607937 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:25:06.607937 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:25:06.607937 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:25:06.607937 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.607937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-380ac23e-f53e-482a-a5e3-adb4feb36ed0 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.610987 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-380ac23e-f53e-482a-a5e3-adb4feb36ed0 tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-13" status: 400 len: 127 microversion: 2.1 time: 0.014377 Oct 18 13:25:06.612567 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 190/379] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 18 13:25:06 2022] PUT /compute/v2.1/os-hosts/n-d-858383-13 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:25:06.624649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Action: 'update', calling method: .version_select at 0x7fb3319ac3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:06.628871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.hosts [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Enabling host nonexistent_hostname. Oct 18 13:25:06.647845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Request method failure captured: Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 50 Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkxkN7fpuKWd5sEUx2s9INphsp5txzW1R7sv05k_mPeNT9OitC6vOhn7rlKcpWeqJ7mBWRLBtB9g2blfW4vjeevSM_wPTED4IxBBvQ6Kp4RkJD20znO0Hr3CkwMu4nrkeDABJufxTem_v_tzbFnPOtQwk_9K9zYEVDFoUMjSTP5Byg Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:06.650799 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b191d72d6de46fabafb1e3a18588e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6b191d72d6de46fabafb1e3a18588e4e Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086694759 Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: e71ec1619af54eea87ab3c3d9c063dc2 Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086694759-project-admin Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.652218 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:25:06.653139 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:06.654340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:25:06.655664 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:06.657530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:06.657530 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-241bedde-6b8a-4a86-be9d-174256d3f4fc tempest-HostsAdminNegativeTestJSON-1086694759 tempest-HostsAdminNegativeTestJSON-1086694759-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037867 Oct 18 13:25:06.669112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 190/380] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Oct 18 13:25:06 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:25:06.677714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.678370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:06.690181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.690834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.692736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.693488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.694018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.694487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.878178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.889667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ff65227-c598-48d1-a641-ca66473daf18 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1468 microversion: 2.1 time: 0.226351 Oct 18 13:25:06.899044 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 191/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:07.161983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:07.162885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:07.171365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.172132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.172589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:07.173455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.173927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.174423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:07.216964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-438c7eed-70c4-493f-b30d-b2eb50d33b92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33176e5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:07.272102 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-438c7eed-70c4-493f-b30d-b2eb50d33b92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.058753 Oct 18 13:25:07.273247 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 192/382] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:07 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:07.547722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.556778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.558660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.560055 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c21c6d5d-7b9d-4705-b3a1-ef8561aa652a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.402570 Oct 18 13:25:07.560834 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 191/383] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:07 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:07.913907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:07.914788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:07.931212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.931714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.932226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:07.936742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.937301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.937748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.020941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4329238c-efbf-4be4-be15-ccf622753b59", "name": "network-vif-deleted", "tag": "5a5148ca-b2be-4282-b1ca-0391d4af22e5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:08.035019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.035500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.035933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.054880 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] Creating event network-vif-deleted:5a5148ca-b2be-4282-b1ca-0391d4af22e5 for instance 4329238c-efbf-4be4-be15-ccf622753b59 on n-h2-858383-13 Oct 18 13:25:08.062295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-85dab302-47b6-4cb2-b181-5fa4eb1ac617 req-d51408e7-825a-48e5-bb1f-fb78f2d36065 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043473 Oct 18 13:25:08.064991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 192/384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:08.142227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:08.146334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:08.154080 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8c572aa-7ad6-40be-b699-3e9403de4f75 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1426 microversion: 2.1 time: 0.244099 Oct 18 13:25:08.157869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 193/385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:07 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1426 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:08.291656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61ec668b-c654-4e81-b016-217dd37fcac1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331b08ee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:08.356415 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61ec668b-c654-4e81-b016-217dd37fcac1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.070330 Oct 18 13:25:08.364997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 193/386] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:08 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:08.588531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:08.589274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:08.598365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.598974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.599505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.600810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.601422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.602770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.615337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d74fea-1d0c-47dd-8bd7-7a74658cd0cb", "name": "network-vif-plugged", "status": "completed", "tag": "20a10dfc-3310-4caf-b21d-b4de7f2fd29e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:08.662227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.664340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.665530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.700223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] Creating event network-vif-plugged:20a10dfc-3310-4caf-b21d-b4de7f2fd29e for instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb on n-h1-858383-13 Oct 18 13:25:08.713193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9f573362-4fea-43c0-ad59-66a7ba0189e6 req-8b893e2f-0e79-416a-87e9-cc49e89fd4d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107064 Oct 18 13:25:08.721313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 194/387] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:08.981021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:08.991216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:08.992921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:08.994222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ca61c18-0a4f-406e-a66e-cbe3cc7d944c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.410425 Oct 18 13:25:08.994782 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 194/388] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:08 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:09.183163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.185415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:09.199654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.201945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.204511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.205535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.208725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.209525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.277908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Calling method '.version_select at 0x7fb3319c6dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.279847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.280552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.281076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.281776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.282349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.282849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.283770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lazy-loading 'fault' on Instance uuid 4329238c-efbf-4be4-be15-ccf622753b59 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:09.319618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.320165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.322850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.350990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.352689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.353420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.355508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f04d39830d04cf99527919cbccf46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585e27ca2dd143b9bb193fbebb8400e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.365362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15fe5ccf-ab73-40bd-9da1-d5d30627c161 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 200 len: 1302 microversion: 2.1 time: 0.187679 Oct 18 13:25:09.376387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 195/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:09.380667 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccddade3-93c9-4e78-a8ec-a19d99c9a18d tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.649106 Oct 18 13:25:09.381303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 195/390] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:09.388408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a96da5fe-710c-4a6b-a8a4-e0f5ddb7f927 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316da430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.503426 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a96da5fe-710c-4a6b-a8a4-e0f5ddb7f927 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.129511 Oct 18 13:25:09.504007 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 196/391] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:09.749876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cc227cd-1b4f-414e-9190-4c63193ddd5b tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Calling method '.version_select at 0x7fb3319c6820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.753553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cc227cd-1b4f-414e-9190-4c63193ddd5b tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '203747b0aac14d62ac5fc0bea5a97df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022f553b903d498381fe3344f594cbe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cc227cd-1b4f-414e-9190-4c63193ddd5b tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Request method failure captured: Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors/n-h1-858383-13/search HTTP/1.1 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkyZERphk03ZoshpG3eXdydU2RbDCqmyk43atflGaRGZwn6a7zte_oNeLRcvWfzUXbocGHHGapo6buqP-QWW0tDFxQDMmS2RjdqF3tZ1TaoK6Ca420C41rY48yI6pasHROjvlGW_ZYXswaVnb1pp5itd002DFgm7czlYAO4i1lEa6w Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 022f553b903d498381fe3344f594cbe0 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:09.761766 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/022f553b903d498381fe3344f594cbe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/022f553b903d498381fe3344f594cbe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/022f553b903d498381fe3344f594cbe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_022f553b903d498381fe3344f594cbe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 022f553b903d498381fe3344f594cbe0 Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 203747b0aac14d62ac5fc0bea5a97df9 Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:25:09.763426 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'n-h1-858383-13'} Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:09.764299 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:25:09.765461 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.766684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cc227cd-1b4f-414e-9190-4c63193ddd5b tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:09.766684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cc227cd-1b4f-414e-9190-4c63193ddd5b tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-858383-13/search" status: 403 len: 117 microversion: 2.1 time: 0.371684 Oct 18 13:25:09.766684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 196/392] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-13/search => generated 117 bytes in 374 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:09.775833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Calling method '.version_select at 0x7fb3316ef0d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.777647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.778281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.778850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.803038 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Request method failure captured: Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqk0BL2E6wSwzhGNPybfTVdOGr3IxLZDje1v1E7fDyYYPetunbxriBucfrGLVanK8YoL9gwDtEN0dw8RV2PIS_Zi6L9nw30qJAY0u3GE3L_z-VIwuYePLs1kbMpc-S7OXrNn-Krsv7ftPf8rzx1GpUTqzbPGL9EKHhGR_-cqmFlCSqo Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5dd65effabff48d2b449eefb2fc24e93 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:25:09.804721 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5dd65effabff48d2b449eefb2fc24e93 Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 31e90bd7e03d4db38ba01eff1556d223 Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:25:09.806566 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.807424 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.809058 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.809058 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:09.809058 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:09.809058 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:25:09.809058 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.810659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:09.811670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-957d6038-d5bf-47bf-bc8e-7f61d95d7043 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.041322 Oct 18 13:25:09.812728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 197/393] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:09.823427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Calling method '.version_select at 0x7fb331b96310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.825775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.826493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.826936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.848958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.849451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.849893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.860539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.861811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.862544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.870885 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6dd36f1f-e227-4479-a751-108f3c28178e tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051739 Oct 18 13:25:09.872136 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 197/394] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:09.883119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5d03932-0ef5-428d-995b-fda16a6b330c tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Calling method '.version_select at 0x7fb3316fbd30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.885792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5d03932-0ef5-428d-995b-fda16a6b330c tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '203747b0aac14d62ac5fc0bea5a97df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022f553b903d498381fe3344f594cbe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5d03932-0ef5-428d-995b-fda16a6b330c tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Request method failure captured: Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkyZERphk03ZoshpG3eXdydU2RbDCqmyk43atflGaRGZwn6a7zte_oNeLRcvWfzUXbocGHHGapo6buqP-QWW0tDFxQDMmS2RjdqF3tZ1TaoK6Ca420C41rY48yI6pasHROjvlGW_ZYXswaVnb1pp5itd002DFgm7czlYAO4i1lEa6w Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 022f553b903d498381fe3344f594cbe0 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:09.887020 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/022f553b903d498381fe3344f594cbe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/022f553b903d498381fe3344f594cbe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/022f553b903d498381fe3344f594cbe0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_022f553b903d498381fe3344f594cbe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 022f553b903d498381fe3344f594cbe0 Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538 Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 203747b0aac14d62ac5fc0bea5a97df9 Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:25:09.888456 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1'} Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:09.893759 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:25:09.894998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.896039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5d03932-0ef5-428d-995b-fda16a6b330c tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:09.896039 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5d03932-0ef5-428d-995b-fda16a6b330c tempest-HypervisorAdminNegativeUnderV252Test-1315792538 tempest-HypervisorAdminNegativeUnderV252Test-1315792538-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009220 Oct 18 13:25:09.896039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 198/395] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:09.898640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Calling method '.version_select at 0x7fb331aa2c10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.900987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.901794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.902545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.941091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] HTTP exception thrown: No hypervisor matching '5851ee7b-599d-419b-9f86-0faf51b0b7dd' could be found. Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Request method failure captured: Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-hypervisors/5851ee7b-599d-419b-9f86-0faf51b0b7dd/servers HTTP/1.1 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk0BL2E6wSwzhGNPybfTVdOGr3IxLZDje1v1E7fDyYYPetunbxriBucfrGLVanK8YoL9gwDtEN0dw8RV2PIS_Zi6L9nw30qJAY0u3GE3L_z-VIwuYePLs1kbMpc-S7OXrNn-Krsv7ftPf8rzx1GpUTqzbPGL9EKHhGR_-cqmFlCSqo Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 5dd65effabff48d2b449eefb2fc24e93 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:09.943252 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dd65effabff48d2b449eefb2fc24e93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 5dd65effabff48d2b449eefb2fc24e93 Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059 Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 31e90bd7e03d4db38ba01eff1556d223 Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: exception: No hypervisor matching '5851ee7b-599d-419b-9f86-0faf51b0b7dd' could be found. Oct 18 13:25:09.948413 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5851ee7b-599d-419b-9f86-0faf51b0b7dd'} Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5851ee7b-599d-419b-9f86-0faf51b0b7dd' could be found. Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.949144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5851ee7b-599d-419b-9f86-0faf51b0b7dd' could be found. Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] Returning 404 to user: No hypervisor matching '5851ee7b-599d-419b-9f86-0faf51b0b7dd' could be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39859b86-242f-4714-8d39-9546d86a05a3 tempest-HypervisorAdminNegativeUnderV252Test-27505059 tempest-HypervisorAdminNegativeUnderV252Test-27505059-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/5851ee7b-599d-419b-9f86-0faf51b0b7dd/servers" status: 404 len: 123 microversion: 2.1 time: 0.049255 Oct 18 13:25:09.950197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 198/396] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/os-hypervisors/5851ee7b-599d-419b-9f86-0faf51b0b7dd/servers => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:10.031375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:10.032263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:10.038788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.039333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.040099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.041029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.041556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.042096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.205888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.217384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.219657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.221929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-767bb7e2-5887-46b2-95b1-12d27adeed7a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1566 microversion: 2.25 time: 0.195662 Oct 18 13:25:10.222511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 199/397] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:10.400640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:10.401333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] [instance: 4329238c-efbf-4be4-be15-ccf622753b59] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:10.411162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdf4dbe4-6a13-432b-82f1-2f9d133a4b5a tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-615997408", "ram": 512, "vcpus": 1, "disk": 10, "id": 817143997, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:10.411275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.411275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.411705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.412703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.416094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.418382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.454722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] HTTP exception thrown: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Request method failure captured: Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 HTTP/1.1 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkeFozKaqaPAtCkcbrSUhXDkzkYMvE6xYqGlDHoSCVi0In1ZqWlVfaP92zc6JaL_iQXqMw62mDtW4AyDylt_IFakRa8heyC8AxvgIqYkuXjI6lHaCHpZGE8DL4Tm6CPbAahKIZ-aDGKbLCMxO5MVoyHr59VRNaE6L_NCUJyao349eE Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 585e27ca2dd143b9bb193fbebb8400e5 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TenantUsagesTestJSON-266461940 Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:10.457642 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/585e27ca2dd143b9bb193fbebb8400e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/585e27ca2dd143b9bb193fbebb8400e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/585e27ca2dd143b9bb193fbebb8400e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_585e27ca2dd143b9bb193fbebb8400e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TenantUsagesTestJSON-266461940 Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 585e27ca2dd143b9bb193fbebb8400e5 Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TenantUsagesTestJSON-266461940 Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TenantUsagesTestJSON-266461940-project Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8f04d39830d04cf99527919cbccf46e7 Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TenantUsagesTestJSON-266461940-project Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. Oct 18 13:25:10.464125 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4329238c-efbf-4be4-be15-ccf622753b59'} Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:10.464878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. Oct 18 13:25:10.466002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:10.467028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] Returning 404 to user: Instance 4329238c-efbf-4be4-be15-ccf622753b59 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:10.467028 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1906add2-4706-47cf-a6cf-71d1c68caa01 tempest-TenantUsagesTestJSON-266461940 tempest-TenantUsagesTestJSON-266461940-project] 10.222.0.27 "GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59" status: 404 len: 111 microversion: 2.1 time: 0.064499 Oct 18 13:25:10.467028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 200/398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/servers/4329238c-efbf-4be4-be15-ccf622753b59 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:10.525407 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdf4dbe4-6a13-432b-82f1-2f9d133a4b5a tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.593574 Oct 18 13:25:10.533873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 199/399] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:09 2022] POST /compute/v2.1/flavors => generated 412 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:10.538038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-182e6a1b-41f3-40b5-8149-89d2abc9254b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3319ac040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:10.588389 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-182e6a1b-41f3-40b5-8149-89d2abc9254b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.072596 Oct 18 13:25:10.589435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 201/400] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:11.254288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.255141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:11.277179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.277179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.277179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.277179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.277479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.281494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.311151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393d0024-9fc3-4960-b71c-996658665576 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.333186 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-393d0024-9fc3-4960-b71c-996658665576 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] HTTP exception thrown: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393d0024-9fc3-4960-b71c-996658665576 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Request method failure captured: Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkzlT5SAJUKZs8MKBm43EgOp-cVU_ZbHDDXDJT8h1Kn3Bx7jIB1ZxkyWPrPsoiEaDlDPc1jje_pGt5W_v1H9i_ehHQid9DH0BfYjBjJOTRuJqcGHtwUby0iy1tyYkl9pad9FTWWENTkRUSEIv9ZXsGibSRMGXzkvP5UQRo66bv6cFI Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:11.334983 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3b51f06c5844e30ace768840e1ad51a Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:11.336188 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'flavor_id': '817143997', 'id': 'hw:cpu_thread_policy'} Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.336834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393d0024-9fc3-4960-b71c-996658665576 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Returning 404 to user: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.338090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-393d0024-9fc3-4960-b71c-996658665576 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] 10.222.0.27 "GET /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.800998 Oct 18 13:25:11.344587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 200/401] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 810 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:25:11.358917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59f78bb8-7a15-4b0a-9b13-925358420b06 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.393993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59f78bb8-7a15-4b0a-9b13-925358420b06 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c3b51f06c5844e30ace768840e1ad51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aad7c28c1aa4a4295bd6f77766155a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59f78bb8-7a15-4b0a-9b13-925358420b06 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Request method failure captured: Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/flavors/817143997/os-extra_specs HTTP/1.1 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 66 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkzlT5SAJUKZs8MKBm43EgOp-cVU_ZbHDDXDJT8h1Kn3Bx7jIB1ZxkyWPrPsoiEaDlDPc1jje_pGt5W_v1H9i_ehHQid9DH0BfYjBjJOTRuJqcGHtwUby0iy1tyYkl9pad9FTWWENTkRUSEIv9ZXsGibSRMGXzkvP5UQRo66bv6cFI Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:11.396752 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3b51f06c5844e30ace768840e1ad51a Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 18 13:25:11.397966 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'flavor_id': '817143997', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:11.398664 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:25:11.399707 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.402405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59f78bb8-7a15-4b0a-9b13-925358420b06 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.403506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59f78bb8-7a15-4b0a-9b13-925358420b06 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] 10.222.0.27 "POST /compute/v2.1/flavors/817143997/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.057813 Oct 18 13:25:11.406231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 201/402] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Oct 18 13:25:11 2022] POST /compute/v2.1/flavors/817143997/os-extra_specs => generated 124 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:11.428106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e21d0fa-9ff8-4f85-82a3-71248e760181 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.559667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e21d0fa-9ff8-4f85-82a3-71248e760181 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/817143997/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.139635 Oct 18 13:25:11.562385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 202/403] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Oct 18 13:25:11 2022] POST /compute/v2.1/flavors/817143997/os-extra_specs => generated 66 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:25:11.577398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a1b9c9d-a127-46f0-b114-884f96cd3b19 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.584687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5a1b9c9d-a127-46f0-b114-884f96cd3b19 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c3b51f06c5844e30ace768840e1ad51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aad7c28c1aa4a4295bd6f77766155a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a1b9c9d-a127-46f0-b114-884f96cd3b19 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Request method failure captured: Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkzlT5SAJUKZs8MKBm43EgOp-cVU_ZbHDDXDJT8h1Kn3Bx7jIB1ZxkyWPrPsoiEaDlDPc1jje_pGt5W_v1H9i_ehHQid9DH0BfYjBjJOTRuJqcGHtwUby0iy1tyYkl9pad9FTWWENTkRUSEIv9ZXsGibSRMGXzkvP5UQRo66bv6cFI Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:11.590299 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3b51f06c5844e30ace768840e1ad51a Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:11.591672 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'flavor_id': '817143997', 'id': 'hw:numa_nodes'} Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:11.592356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:25:11.593502 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.596009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a1b9c9d-a127-46f0-b114-884f96cd3b19 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.600695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a1b9c9d-a127-46f0-b114-884f96cd3b19 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032666 Oct 18 13:25:11.601308 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 203/404] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:25:11 2022] DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:11.611922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf7e4157-7253-45f0-b0b3-6fb4f07057af tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316efc10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.643268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.656960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.662352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.665557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65fed4ca-746b-4d12-ad08-b20962bda57c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1556 microversion: 2.25 time: 0.415993 Oct 18 13:25:11.666146 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 202/405] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1556 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:11.679871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6be9407b-4cac-4615-8ada-6845390925ed tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.690302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf7e4157-7253-45f0-b0b3-6fb4f07057af tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.081755 Oct 18 13:25:11.690884 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 204/406] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:11.700038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe1c49cd-bb1e-40ea-878f-b0e8916fa1b9 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '.version_select at 0x7fb33185c4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.707627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe1c49cd-bb1e-40ea-878f-b0e8916fa1b9 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.708378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe1c49cd-bb1e-40ea-878f-b0e8916fa1b9 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.709334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe1c49cd-bb1e-40ea-878f-b0e8916fa1b9 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.723277 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6be9407b-4cac-4615-8ada-6845390925ed tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/817143997/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054258 Oct 18 13:25:11.724014 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 203/407] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Oct 18 13:25:11 2022] POST /compute/v2.1/flavors/817143997/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:25:11.727811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe1c49cd-bb1e-40ea-878f-b0e8916fa1b9 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.032049 Oct 18 13:25:11.742646 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 205/408] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:11.742776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85e01059-b955-4f47-82b2-007afe26f03e tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.743326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85e01059-b955-4f47-82b2-007afe26f03e tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c3b51f06c5844e30ace768840e1ad51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aad7c28c1aa4a4295bd6f77766155a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85e01059-b955-4f47-82b2-007afe26f03e tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Request method failure captured: Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 22 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkzlT5SAJUKZs8MKBm43EgOp-cVU_ZbHDDXDJT8h1Kn3Bx7jIB1ZxkyWPrPsoiEaDlDPc1jje_pGt5W_v1H9i_ehHQid9DH0BfYjBjJOTRuJqcGHtwUby0iy1tyYkl9pad9FTWWENTkRUSEIv9ZXsGibSRMGXzkvP5UQRo66bv6cFI Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:11.745615 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aad7c28c1aa4a4295bd6f77766155a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 5aad7c28c1aa4a4295bd6f77766155a2 Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3b51f06c5844e30ace768840e1ad51a Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: {"hw:numa_nodes": "1"} Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:11.746937 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'flavor_id': '817143997', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:11.747649 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:25:11.748729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.750022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.751433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85e01059-b955-4f47-82b2-007afe26f03e tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.752888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85e01059-b955-4f47-82b2-007afe26f03e tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940 tempest-FlavorsExtraSpecsNegativeTestJSON-1439234940-project] 10.222.0.27 "PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021396 Oct 18 13:25:11.755479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:11.760706 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 204/409] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:25:11 2022] PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:11.766361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c0075af-0888-48d9-8599-0c30e0f5e2a7 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.778109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.778683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.779279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.780453 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2c0075af-0888-48d9-8599-0c30e0f5e2a7 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] HTTP exception thrown: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.780582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.781277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.781817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c0075af-0888-48d9-8599-0c30e0f5e2a7 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Request method failure captured: Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk1vBgEt_-0kImNXR1owJWBx04N91lIflJ8SonMfSRXGW3W43My0MwX4ntzUZnVAFwEsBinsUelVO7Bhz9BJgxOSvVLs5IpchdhCi_O2HeOqp7y5326hr6aDRDXdjLXNxdAIOoGnBG1IXzpQSb-tbJdl0s7EZPRZ_3dq11i-DfT4TU Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:11.783264 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79e4766e145e433487f95a83f4de3891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79e4766e145e433487f95a83f4de3891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f1346367474a47bc8bcaebcf6cfa1476 Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:11.784469 n-d-858383-13 devstack@n-api.service[121010]: exception: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'flavor_id': '817143997', 'id': 'hw:cpu_thread_policy'} Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.785174 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:25:11.790072 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.792317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c0075af-0888-48d9-8599-0c30e0f5e2a7 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Returning 404 to user: Flavor 817143997 has no extra specs with key hw:cpu_thread_policy. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.793925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c0075af-0888-48d9-8599-0c30e0f5e2a7 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.031621 Oct 18 13:25:11.796251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 205/410] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:25:11 2022] DELETE /compute/v2.1/flavors/817143997/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:11.814754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-580e2d1f-aa96-48ca-a026-d75dacd96546 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.820091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-580e2d1f-aa96-48ca-a026-d75dacd96546 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-580e2d1f-aa96-48ca-a026-d75dacd96546 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Request method failure captured: Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 27 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk1vBgEt_-0kImNXR1owJWBx04N91lIflJ8SonMfSRXGW3W43My0MwX4ntzUZnVAFwEsBinsUelVO7Bhz9BJgxOSvVLs5IpchdhCi_O2HeOqp7y5326hr6aDRDXdjLXNxdAIOoGnBG1IXzpQSb-tbJdl0s7EZPRZ_3dq11i-DfT4TU Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:11.825402 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79e4766e145e433487f95a83f4de3891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79e4766e145e433487f95a83f4de3891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f1346367474a47bc8bcaebcf6cfa1476 Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: {"hw:cpu_policy": "shared"} Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:11.826650 n-d-858383-13 devstack@n-api.service[121010]: exception: Request body and URI mismatch Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'flavor_id': '817143997', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.827408 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-580e2d1f-aa96-48ca-a026-d75dacd96546 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.828943 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-580e2d1f-aa96-48ca-a026-d75dacd96546 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015204 Oct 18 13:25:11.830636 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 206/411] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:25:11 2022] PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:11.836416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22b468dc-6f83-43b8-bb80-123f5d06ee44 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22b468dc-6f83-43b8-bb80-123f5d06ee44 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Request method failure captured: Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 49 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk1vBgEt_-0kImNXR1owJWBx04N91lIflJ8SonMfSRXGW3W43My0MwX4ntzUZnVAFwEsBinsUelVO7Bhz9BJgxOSvVLs5IpchdhCi_O2HeOqp7y5326hr6aDRDXdjLXNxdAIOoGnBG1IXzpQSb-tbJdl0s7EZPRZ_3dq11i-DfT4TU Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:11.840866 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79e4766e145e433487f95a83f4de3891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79e4766e145e433487f95a83f4de3891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79e4766e145e433487f95a83f4de3891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 79e4766e145e433487f95a83f4de3891 Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f1346367474a47bc8bcaebcf6cfa1476 Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 18 13:25:11.842585 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'flavor_id': '817143997', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 18 13:25:11.843363 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.844899 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:25:11.847278 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:11.848699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22b468dc-6f83-43b8-bb80-123f5d06ee44 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:11.849690 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22b468dc-6f83-43b8-bb80-123f5d06ee44 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017970 Oct 18 13:25:11.858392 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 207/412] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:25:11 2022] PUT /compute/v2.1/flavors/817143997/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:11.865388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b6b233b-ff0d-4469-901b-a7c54055f7e9 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.966326 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b6b233b-ff0d-4469-901b-a7c54055f7e9 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/817143997" status: 202 len: 0 microversion: 2.1 time: 0.105190 Oct 18 13:25:11.966954 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 208/413] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:25:11 2022] DELETE /compute/v2.1/flavors/817143997 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:11.982287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60370bc9-c4ad-4bcc-9e59-35baafc3eebe tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:12.019924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60370bc9-c4ad-4bcc-9e59-35baafc3eebe tempest-FlavorsExtraSpecsNegativeTestJSON-46483728 tempest-FlavorsExtraSpecsNegativeTestJSON-46483728-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.047910 Oct 18 13:25:12.037022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 209/414] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:12.044331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 7aa60c9d-d83f-4f3f-8974-69ceb98836ae {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:12.060943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de8c9305-60c0-4ba5-9b91-63634bd97de3 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 2050 microversion: 2.25 time: 0.321270 Oct 18 13:25:12.061679 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 206/415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 2050 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:12.417793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1053952096", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6d7b5541-416a-4285-abcb-d7b8dba55d22"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:12.521044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] validate_networks() for [('6d7b5541-416a-4285-abcb-d7b8dba55d22', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:12.706865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0e8a548-311a-43d6-95b8-704acd2b475c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3317eedc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:12.807622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0e8a548-311a-43d6-95b8-704acd2b475c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.103670 Oct 18 13:25:12.814242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 207/416] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:12 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:13.136844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:13.137352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:13.137810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:13.138253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:13.138669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:13.148373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:13.156014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:13.156014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:13.156014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:13.156014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:13.156340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:13.167939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:13.172157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for user fa4ca05a0c6a405f8fa014ee06dbcef4 and project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:13.198276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:13.200825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:13.233073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:13.358533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e2c5a03-0646-4cbb-9a3f-7b0d0cb2ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.949346 Oct 18 13:25:13.359182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 210/417] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:25:13.372107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:13.373125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:13.461612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:13.476229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:13.482663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:13.484375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d2951fbf-2a66-46c7-b5d0-26eb71e2e409 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1262 microversion: 2.25 time: 0.116951 Oct 18 13:25:13.485629 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 208/418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:13 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:13.824199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ee1506f-b075-4a95-89cc-594fbc387b93 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33169dca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:13.875940 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ee1506f-b075-4a95-89cc-594fbc387b93 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.055451 Oct 18 13:25:13.880286 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 209/419] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:13 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:14.293036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3edbef9a-1215-4f0e-8865-b5bb27989f5d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-235101667", "id": 508023746, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:14.421259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3edbef9a-1215-4f0e-8865-b5bb27989f5d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.873214 Oct 18 13:25:14.421997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 211/420] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:13 2022] POST /compute/v2.1/flavors => generated 426 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:14.455468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fdea5bcc-cf45-4046-b812-63df8332802b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.463283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:14.514558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.515591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:14.579317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.584794 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fdea5bcc-cf45-4046-b812-63df8332802b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/508023746" status: 202 len: 0 microversion: 2.1 time: 0.153841 Oct 18 13:25:14.590148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 210/421] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:25:14 2022] DELETE /compute/v2.1/flavors/508023746 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:14.593309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.600416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb56c164-e260-4179-a857-48c9962686fd tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.600591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.603538 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35d650c5-eec0-4cdf-b433-932b9c671a15 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1262 microversion: 2.25 time: 0.092840 Oct 18 13:25:14.604540 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 212/422] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:14.646781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb56c164-e260-4179-a857-48c9962686fd tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.056963 Oct 18 13:25:14.647380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 211/423] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:14.668871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9852736-7fd7-4e12-81f2-2a864c17564d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-328704098", "id": 1241615203, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:14.765355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9852736-7fd7-4e12-81f2-2a864c17564d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.100332 Oct 18 13:25:14.765952 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 213/424] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:14 2022] POST /compute/v2.1/flavors => generated 416 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:14.778721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd0ff564-a3f1-4964-b2d0-4f7a12521590 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.804950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd0ff564-a3f1-4964-b2d0-4f7a12521590 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.029823 Oct 18 13:25:14.822364 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 212/425] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:14.826840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7a8b2da-4a97-4d99-ac72-3f052c09c997 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.891798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63146691-6996-4b63-bfda-f63cfac703da tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316daa60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.932938 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7a8b2da-4a97-4d99-ac72-3f052c09c997 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1241615203" status: 202 len: 0 microversion: 2.1 time: 0.110682 Oct 18 13:25:14.933632 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 214/426] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:14 2022] DELETE /compute/v2.1/flavors/1241615203 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:14.945804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-543e434b-4b0e-4942-a981-ee6fc3fb071b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.996467 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63146691-6996-4b63-bfda-f63cfac703da tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.108525 Oct 18 13:25:15.005718 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 213/427] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:15.020770 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-543e434b-4b0e-4942-a981-ee6fc3fb071b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.081604 Oct 18 13:25:15.022162 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 215/428] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:15.044257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e43d3b4-3fcd-467b-91f8-9bde57f74dc6 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-108672868", "id": 1332402667, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:15.053807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:15.110188 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e43d3b4-3fcd-467b-91f8-9bde57f74dc6 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.070450 Oct 18 13:25:15.113243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 214/429] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:15 2022] POST /compute/v2.1/flavors => generated 428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:15.127646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-877b0bb5-ff8f-4ad2-b3ce-7efc1d552e91 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.234306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-877b0bb5-ff8f-4ad2-b3ce-7efc1d552e91 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1332402667" status: 202 len: 0 microversion: 2.1 time: 0.112318 Oct 18 13:25:15.235792 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 216/430] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:15 2022] DELETE /compute/v2.1/flavors/1332402667 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:15.244312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b9e294d-7750-407c-bf09-3cb1d6a78809 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.272744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b9e294d-7750-407c-bf09-3cb1d6a78809 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032112 Oct 18 13:25:15.295749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d1ddd0e-fb79-4bee-8dd3-c10da1c5b191 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-621726470", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:15.302838 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 215/431] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:15.397631 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d1ddd0e-fb79-4bee-8dd3-c10da1c5b191 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.103715 Oct 18 13:25:15.405250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 217/432] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:15 2022] POST /compute/v2.1/flavors => generated 506 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:15.421877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c1237b6-40f4-4bba-a142-c3e8d4838906 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.497543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c1237b6-40f4-4bba-a142-c3e8d4838906 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/7be5c597-3134-404b-98b3-a4bbd5711868" status: 202 len: 0 microversion: 2.1 time: 0.086434 Oct 18 13:25:15.498282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 216/433] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:15 2022] DELETE /compute/v2.1/flavors/7be5c597-3134-404b-98b3-a4bbd5711868 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:15.510648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b953031-8f28-41be-bb8a-f99a7e85e4c5 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.630963 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b953031-8f28-41be-bb8a-f99a7e85e4c5 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.119277 Oct 18 13:25:15.633325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.633808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 218/434] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:15.633943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:15.642164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.646659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.647118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.647908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.650461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.651122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.665812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-562b953e-b594-4540-90af-b32ba7c6b5dd tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1734396555", "id": "128c984e-73a2-4ead-9062-9f671eb36682", "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:15.750754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.760691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.765150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.768134 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca37addc-018b-4479-b103-da933005b7b0 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1314 microversion: 2.25 time: 0.139096 Oct 18 13:25:15.769234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 217/435] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:15.810722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-562b953e-b594-4540-90af-b32ba7c6b5dd tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.158277 Oct 18 13:25:15.812027 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 219/436] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:15.835166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8cc5df5-7299-4ed7-b582-0c043edf6e1e tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.956161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8cc5df5-7299-4ed7-b582-0c043edf6e1e tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/128c984e-73a2-4ead-9062-9f671eb36682" status: 202 len: 0 microversion: 2.1 time: 0.124042 Oct 18 13:25:15.957709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 218/437] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:15 2022] DELETE /compute/v2.1/flavors/128c984e-73a2-4ead-9062-9f671eb36682 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:15.967541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61424787-894d-416f-94f7-213b82d44843 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.014454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2aede76e-fed0-4da8-bc95-978785d6ef5e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316da1f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.051610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61424787-894d-416f-94f7-213b82d44843 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.089722 Oct 18 13:25:16.052517 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 220/438] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:16.084077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8ddd277-164b-415c-b491-c22be9c943c8 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-166143592", "id": 1263290912, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:16.135792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2aede76e-fed0-4da8-bc95-978785d6ef5e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.126861 Oct 18 13:25:16.136644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 219/439] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:16.228940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8ddd277-164b-415c-b491-c22be9c943c8 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.150712 Oct 18 13:25:16.230008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 221/440] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:16.245120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ed6a3215-b840-42ea-9a55-b7c6d657222b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.254914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ed6a3215-b840-42ea-9a55-b7c6d657222b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1263290912" status: 200 len: 413 microversion: 2.1 time: 0.013403 Oct 18 13:25:16.255721 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 220/441] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/flavors/1263290912 => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:16.795643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.796274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:16.806820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.809203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.809975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.810884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.815741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.816892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.903684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb74fc72-c06b-4954-a4e2-1c8184ae627e tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.954652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:16.956271 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb74fc72-c06b-4954-a4e2-1c8184ae627e tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.684263 Oct 18 13:25:16.972779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 222/442] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:16.977512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:16.980396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c63b6799-36a6-4876-97c9-bbc9412bd9c3 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.988550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:16.994920 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01468a5e-8154-419e-bcc5-00f876173668 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1332 microversion: 2.25 time: 0.201858 Oct 18 13:25:16.997519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 221/443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:17.097484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c63b6799-36a6-4876-97c9-bbc9412bd9c3 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1263290912" status: 202 len: 0 microversion: 2.1 time: 0.122101 Oct 18 13:25:17.098102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 223/444] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:16 2022] DELETE /compute/v2.1/flavors/1263290912 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:25:17.106449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-318b1a45-7871-412e-9491-822b90eaeb65 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.135669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-318b1a45-7871-412e-9491-822b90eaeb65 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032848 Oct 18 13:25:17.144630 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 222/445] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:17.153095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81f71749-647d-4e86-bb81-e508eb5a4166 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331b088b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.168162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b75c700-4774-42f3-9562-5ba32483285f tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-365990534", "id": 81502412, "os-flavor-access:is_public": "False"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:17.229186 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81f71749-647d-4e86-bb81-e508eb5a4166 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.080320 Oct 18 13:25:17.229617 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 224/446] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:17 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:17.276197 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b75c700-4774-42f3-9562-5ba32483285f tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.112544 Oct 18 13:25:17.277055 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 223/447] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:17 2022] POST /compute/v2.1/flavors => generated 423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:17.289821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa42a14b-fcdd-4699-80d8-8f86328c98a9 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "81502412"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:17.307194 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-aa42a14b-fcdd-4699-80d8-8f86328c98a9 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] HTTP exception thrown: Flavor 81502412 could not be found. Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa42a14b-fcdd-4699-80d8-8f86328c98a9 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Request method failure captured: Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 105 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk2XAcYRkhFMDYLfHE9ylGpXqRkKoRiRv7qD1NiAxFHSyjbf5kIZtFfYRLgTVwGT274D8tZ1-GKALwSDEATk0PW-FX0C-BeQhOkgpjRTZ0Jl8biVx1PrKS4mbP4rYBr7YdrA2Ix6DbnV2gCYppd6k0znij3TyVN5auOh_IalRIHf4U Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c4f48cdf69404af3abe024e41fc47658 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FlavorsAdminTestJSON-340467269 Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:25:17.309748 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4f48cdf69404af3abe024e41fc47658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4f48cdf69404af3abe024e41fc47658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4f48cdf69404af3abe024e41fc47658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4f48cdf69404af3abe024e41fc47658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FlavorsAdminTestJSON-340467269 Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c4f48cdf69404af3abe024e41fc47658 Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-340467269 Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FlavorsAdminTestJSON-340467269-project Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ec8eeb514304488eb80bcaae352b2a03 Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FlavorsAdminTestJSON-340467269-project Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "test", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "81502412"}} Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:17.311403 n-d-858383-13 devstack@n-api.service[121010]: exception: Flavor 81502412 could not be found. Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '81502412'}}} Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 81502412 could not be found. Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:17.312236 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 81502412 could not be found. Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:17.313493 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 81502412 could not be found. Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa42a14b-fcdd-4699-80d8-8f86328c98a9 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Returning 400 to user: Flavor 81502412 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa42a14b-fcdd-4699-80d8-8f86328c98a9 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.025540 Oct 18 13:25:17.315382 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 225/448] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:17 2022] POST /compute/v2.1/servers => generated 79 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:17.320344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8bfbc0f-af70-41fd-a0eb-3b742fe70600 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.477204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8bfbc0f-af70-41fd-a0eb-3b742fe70600 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/81502412" status: 202 len: 0 microversion: 2.1 time: 0.159206 Oct 18 13:25:17.477204 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 224/449] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:25:17 2022] DELETE /compute/v2.1/flavors/81502412 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:17.493908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c3fdc56-29fd-4bb6-8695-669ea8a09118 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.540411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c3fdc56-29fd-4bb6-8695-669ea8a09118 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.053992 Oct 18 13:25:17.541022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 226/450] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:17.589791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d62e4db6-01f9-4093-8b6f-04edfd381c62 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1961196537", "id": 1506420997, "os-flavor-access:is_public": "False"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:18.021489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.022337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:18.029055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:18.029610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:18.030093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:18.030802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:18.031264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:18.031725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:18.149842 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d62e4db6-01f9-4093-8b6f-04edfd381c62 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.574050 Oct 18 13:25:18.150889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 225/451] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:17 2022] POST /compute/v2.1/flavors => generated 415 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:18.169220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5d15cec-160a-41b0-babb-37304fca525d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1257704497", "id": 1137998791, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:18.209895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:18.223760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:18.236247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:18.239315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:18.240691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-011e8f5f-e235-418f-9a48-5fb7bf526b4c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.223942 Oct 18 13:25:18.241817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 227/452] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:18.254562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a2bd15d-cc5e-4a73-8bab-af80cb610d22 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331a74f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.268630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5d15cec-160a-41b0-babb-37304fca525d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.107267 Oct 18 13:25:18.269892 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 226/453] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:18.289943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1b2ec0c-56a4-4aeb-8478-34f87a74ef29 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.336765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1b2ec0c-56a4-4aeb-8478-34f87a74ef29 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.059105 Oct 18 13:25:18.339639 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a2bd15d-cc5e-4a73-8bab-af80cb610d22 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.095613 Oct 18 13:25:18.344879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 228/454] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.346432 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 227/455] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:18.350448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-973da515-fbef-4868-9f1f-a557ad79c7bb tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.402323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-973da515-fbef-4868-9f1f-a557ad79c7bb tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.055659 Oct 18 13:25:18.403521 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 229/456] 10.222.0.27 () {58 vars in 1177 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:18.426718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad07e65e-ebed-4311-8856-abfc7d527fe9 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.443821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad07e65e-ebed-4311-8856-abfc7d527fe9 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.020792 Oct 18 13:25:18.454640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:18.460397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83983da2-b1bd-4ed9-81e0-e382e7849b44 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.499608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83983da2-b1bd-4ed9-81e0-e382e7849b44 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.044909 Oct 18 13:25:18.504292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 230/458] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:18.519073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59db0fa5-8272-47d9-b77b-13674cd25f1d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.574364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59db0fa5-8272-47d9-b77b-13674cd25f1d tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.038673 Oct 18 13:25:18.576470 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 229/459] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.581405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d346406d-fbc2-4abe-b2ae-49a395ddf934 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.634877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d346406d-fbc2-4abe-b2ae-49a395ddf934 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.052051 Oct 18 13:25:18.635853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 231/460] 10.222.0.27 () {58 vars in 1175 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:18.656338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d1e393e-cfe7-4328-982f-cd7fdd74d139 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.696703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d1e393e-cfe7-4328-982f-cd7fdd74d139 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.044022 Oct 18 13:25:18.708426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 230/461] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.719932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96e67022-f355-47d5-8389-edf031be1b79 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.750595 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96e67022-f355-47d5-8389-edf031be1b79 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.035302 Oct 18 13:25:18.766293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 232/462] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.772802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-190fa8b3-4bbc-47fc-a716-d4996dacb1ee tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.867757 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-190fa8b3-4bbc-47fc-a716-d4996dacb1ee tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1137998791" status: 202 len: 0 microversion: 2.1 time: 0.098609 Oct 18 13:25:18.868355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 231/463] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:18 2022] DELETE /compute/v2.1/flavors/1137998791 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:18.879576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc3d14bf-3dbf-4159-9ff7-ce226c37e686 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.930814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc3d14bf-3dbf-4159-9ff7-ce226c37e686 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.056304 Oct 18 13:25:18.947199 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 233/464] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.954224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e8af60a-2d4c-4df8-8190-e9e93a5d034b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.085832 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e8af60a-2d4c-4df8-8190-e9e93a5d034b tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1506420997" status: 202 len: 0 microversion: 2.1 time: 0.136492 Oct 18 13:25:19.086924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 232/465] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:18 2022] DELETE /compute/v2.1/flavors/1506420997 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:19.103536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ea3ee62-36c5-4055-bb5d-e5e3ad73ece6 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.150791 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ea3ee62-36c5-4055-bb5d-e5e3ad73ece6 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.058106 Oct 18 13:25:19.166629 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 234/466] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:19.184081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a9bb42e9-9ff1-4f1b-b9a4-a755cbffbcc2 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-458525400", "id": 1192803800, "os-flavor-access:is_public": "False"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:19.286629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a9bb42e9-9ff1-4f1b-b9a4-a755cbffbcc2 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.116945 Oct 18 13:25:19.287606 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 235/467] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:19 2022] POST /compute/v2.1/flavors => generated 414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:25:19.296407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.297048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:19.315129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.315636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.330780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.330780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.330780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.330780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.648747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.665998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.671399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.677280 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40c74acf-b286-4286-af1c-00ebc165cede tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.389033 Oct 18 13:25:19.679267 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 236/468] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:19.691856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e2146e8-3e17-4e70-9576-7a1661d93011 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.748609 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e2146e8-3e17-4e70-9576-7a1661d93011 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.066502 Oct 18 13:25:19.749990 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 237/469] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:19.757223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-306723ae-d82d-4759-a118-691ff35b51a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331b96820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.838773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-306723ae-d82d-4759-a118-691ff35b51a5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.085474 Oct 18 13:25:19.839530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 238/470] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:19.857861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54a755a6-af28-47b1-8fbd-bf5d67b6027e tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.880007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Calling method '.version_select at 0x7fb3317ee160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.884755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.884755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.884755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.897316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54a755a6-af28-47b1-8fbd-bf5d67b6027e tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.047235 Oct 18 13:25:19.898462 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 239/471] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:19.918278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdb93c52-fc3f-41cb-8956-f5c0d9e85002 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.919336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.920050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.921001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.947976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.948622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.953630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.960929 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4af5d270-0782-4abd-9bb6-69e6624c7e42 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.829841 Oct 18 13:25:19.962028 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 233/472] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:19.975588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Calling method '.version_select at 0x7fb3317ee3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.978135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.978255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.978646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.023578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.024398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.025226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.040785 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdb93c52-fc3f-41cb-8956-f5c0d9e85002 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1192803800" status: 202 len: 0 microversion: 2.1 time: 0.126063 Oct 18 13:25:20.042177 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 240/473] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:25:19 2022] DELETE /compute/v2.1/flavors/1192803800 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:25:20.049692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6115940-280d-4e29-81ec-47dc4c07ebe3", "tag": "2b5e1c6c-c6b7-4eea-82f3-3f426accebd2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:20.073616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.085111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.086740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.087379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.088589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.089241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.106504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47c47972-9efd-4644-a096-579b3cc72262 tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-858383-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.136006 Oct 18 13:25:20.107592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 234/474] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-13/servers => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:20.118900 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] Creating event network-changed:2b5e1c6c-c6b7-4eea-82f3-3f426accebd2 for instance d6115940-280d-4e29-81ec-47dc4c07ebe3 on n-h2-858383-13 Oct 18 13:25:20.129407 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-393a1c7f-bd7e-4e07-a3a8-de4ed99a1c41 req-1877da4e-9968-4727-839c-ec401d69fa25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085653 Oct 18 13:25:20.130348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85aa30b1-b062-4653-8c4f-aba72f17dfcb tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.132997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 241/475] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:20.147334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Calling method '.version_select at 0x7fb331b968b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.152249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.155047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.155735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.194463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85aa30b1-b062-4653-8c4f-aba72f17dfcb tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.084501 Oct 18 13:25:20.197450 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 235/476] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:20.223096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.226245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.226831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.227001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17038b4b-434d-4303-9a24-e3e172732a46 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-46969204", "id": 960096875, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:20.254140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.255345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.256991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.266566 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4b57271-5455-4ec9-9495-862cbee5084c tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.130828 Oct 18 13:25:20.267493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 242/477] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:20.283355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Calling method '.version_select at 0x7fb331b963a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.289741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.289741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.292513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.326774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.327776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.328467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.336800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3655cbfd-5932-46db-baae-4eab4c973f1b tempest-HypervisorAdminUnderV252Test-736157081 tempest-HypervisorAdminUnderV252Test-736157081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-858383-13/search" status: 200 len: 105 microversion: 2.1 time: 0.062060 Oct 18 13:25:20.337687 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 243/478] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-13/search => generated 105 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:20.351141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17038b4b-434d-4303-9a24-e3e172732a46 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.129272 Oct 18 13:25:20.352139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 236/479] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:20.367330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-759a8fac-9498-4a8a-a572-e7362e537798 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.416847 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-759a8fac-9498-4a8a-a572-e7362e537798 tempest-FlavorsAdminTestJSON-340467269 tempest-FlavorsAdminTestJSON-340467269-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6213 microversion: 2.1 time: 0.056149 Oct 18 13:25:20.418865 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 244/480] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/flavors/detail => generated 6213 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:20.441938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ec06044-a418-48e5-8322-7e234b8a30f3 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.460332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=21,nova_api:INSERT=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.528736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ec06044-a418-48e5-8322-7e234b8a30f3 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/960096875" status: 202 len: 0 microversion: 2.1 time: 0.090536 Oct 18 13:25:20.529528 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 237/481] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:25:20 2022] DELETE /compute/v2.1/flavors/960096875 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:20.539816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-814f392e-5280-474f-910f-dfaf265c2b80 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.550933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.603550 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-814f392e-5280-474f-910f-dfaf265c2b80 tempest-FlavorsAdminTestJSON-1541369972 tempest-FlavorsAdminTestJSON-1541369972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.068168 Oct 18 13:25:20.605140 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 245/482] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:20.706578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.707271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:20.717319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.718113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.718805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.721107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.721754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.722985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.856741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b56c0525-9a0b-4d37-bcd2-04c657a3049e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331bedee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.969124 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b56c0525-9a0b-4d37-bcd2-04c657a3049e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.115837 Oct 18 13:25:20.981211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 246/483] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:20.986505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:21.000887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:21.002554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:21.003702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c7d3723-3460-43ae-b072-26e725555899 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.301486 Oct 18 13:25:21.004258 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 238/484] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:21.520501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:21.521202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:21.535058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.535644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.538115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.539015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.540251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.540743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.604547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:21.990530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98d1be1e-8a57-4482-a47e-5ed84c35615d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3317eec10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.011281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-491cbe87-7ef7-41fb-9a04-3582c2ba7d1c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 204 len: 0 microversion: 2.1 time: 0.496853 Oct 18 13:25:22.014441 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 247/485] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:21 2022] DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:22.038697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.039993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.077395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.082226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.083406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.085384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.085875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.087569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.117673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98d1be1e-8a57-4482-a47e-5ed84c35615d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.137304 Oct 18 13:25:22.118394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 239/486] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:21 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:22.286626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-302082251", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "803507013", "adminPass": "***", "networks": [{"uuid": "aadff68e-aca1-4085-8674-6bcf1f9b4b33"}], "security_groups": [{"name": "tempest-securitygroup--2006672599"}], "key_name": "tempest-keypair-1153960216", "user_data": "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:22.543319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] validate_networks() for [('aadff68e-aca1-4085-8674-6bcf1f9b4b33', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:22.694928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.717071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.722384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.724806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f40af6f-8ae3-43ee-8450-830431ecaefe tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.695128 Oct 18 13:25:22.746183 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 248/487] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:23.144613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87a22d82-281c-4d46-9dd4-8225ad4328a2 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-708134902", "id": 1361638683, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:23.161831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=21 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:23.254511 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87a22d82-281c-4d46-9dd4-8225ad4328a2 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.504952 Oct 18 13:25:23.264734 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 249/488] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:25:22 2022] POST /compute/v2.1/flavors => generated 467 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:23.469918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:23.536613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:23.537880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:23.539823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:23.540365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:23.540869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:23.559833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.561590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.562273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:23.574824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.575589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.576375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:23.618472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:23.627432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Getting quotas for user d75623286dda46cfb4d8d70608655b9c and project 2a89fd93a0d843e1ad91d158b7be21fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:23.649325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:23.652841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:23.695076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1474304981", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:23.765466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:24.088640 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9f35001-e995-4212-b988-ce507fa59790 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.798841 Oct 18 13:25:24.088640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 240/489] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:24.095936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c4480bc-c63e-4ea7-804d-613a816753e2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316ac5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.218845 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c4480bc-c63e-4ea7-804d-613a816753e2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.127508 Oct 18 13:25:24.222356 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 241/490] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:24.429367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db5c7062-e7ce-4b97-9d19-a088678bdca8 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.442515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db5c7062-e7ce-4b97-9d19-a088678bdca8 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] 10.222.0.27 "GET /compute/v2.1/flavors/1361638683" status: 200 len: 467 microversion: 2.61 time: 0.218883 Oct 18 13:25:24.443597 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 242/491] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/flavors/1361638683 => generated 467 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:24.448113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.448870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:24.458044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.464478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.464478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.464478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.464478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.464840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.585597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:24.633891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:24.634517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:24.635188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:24.635761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:24.636333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:24.655191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.656538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.658683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.662350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.665946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.666592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.725947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:24.749930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:24.795475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:24.797793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:24.987423 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6ff93a9-00a8-41b1-a49d-fbf2f106e9f7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717950 Oct 18 13:25:24.995338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 250/492] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:25.004619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fae5ec43-aae5-4c01-b045-eda9c018935b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.005674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fae5ec43-aae5-4c01-b045-eda9c018935b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.226920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.260256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.261832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.275498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-461e558f-e2ea-4ec5-87b9-eb18d290a7a6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.830700 Oct 18 13:25:25.297095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 243/493] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:25.311535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-efc3291f-1f8e-4934-8622-3f06113bd5eb tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] Action: 'update', calling method: .version_select at 0x7fb332f56b80>, body: {"flavor": {"description": "new"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:25.524319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fae5ec43-aae5-4c01-b045-eda9c018935b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.539273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fae5ec43-aae5-4c01-b045-eda9c018935b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1262 microversion: 2.1 time: 0.535158 Oct 18 13:25:25.545548 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-efc3291f-1f8e-4934-8622-3f06113bd5eb tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1361638683" status: 200 len: 468 microversion: 2.61 time: 0.246242 Oct 18 13:25:25.547869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 244/495] 10.222.0.27 () {62 vars in 1219 bytes} [Tue Oct 18 13:25:25 2022] PUT /compute/v2.1/flavors/1361638683 => generated 468 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:25.549850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 251/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1262 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.562982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b115cec-7887-4914-b497-ea63d7b0e570 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331b08940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.568827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea2e9b57-52bd-4df9-9449-d2ff4698922c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.569503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea2e9b57-52bd-4df9-9449-d2ff4698922c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.641613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b115cec-7887-4914-b497-ea63d7b0e570 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1412 microversion: 2.1 time: 0.085513 Oct 18 13:25:25.649617 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 252/496] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.655471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3e41021-a07a-409f-8083-05dd5a04e418 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.699978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3e41021-a07a-409f-8083-05dd5a04e418 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.048965 Oct 18 13:25:25.701678 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 253/497] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:25.744372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01bb8706-6767-4de9-8793-21af50c4ed43 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.816964 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01bb8706-6767-4de9-8793-21af50c4ed43 tempest-FlavorsV261TestJSON-1691903052 tempest-FlavorsV261TestJSON-1691903052-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.085423 Oct 18 13:25:25.825120 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 254/498] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:25.842152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98cdba4c-ddac-4291-9647-847889359719 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.847459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea2e9b57-52bd-4df9-9449-d2ff4698922c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.859737 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea2e9b57-52bd-4df9-9449-d2ff4698922c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1213 microversion: 2.1 time: 0.306260 Oct 18 13:25:25.862334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 245/499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1213 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.921294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5de646-635f-47ff-b877-9e2a5f6d2bbb", "name": "network-vif-deleted", "tag": "eefd0227-bb30-402f-917b-f10e5871999a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:25.954020 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98cdba4c-ddac-4291-9647-847889359719 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1361638683" status: 202 len: 0 microversion: 2.61 time: 0.115740 Oct 18 13:25:25.954665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 255/500] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Oct 18 13:25:25 2022] DELETE /compute/v2.1/flavors/1361638683 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:25.975887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c3ab48e-861b-4c4d-b29f-5905559ebee8 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.000366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.000913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.001401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.038841 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c3ab48e-861b-4c4d-b29f-5905559ebee8 tempest-FlavorsV261TestJSON-589207009 tempest-FlavorsV261TestJSON-589207009-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.069480 Oct 18 13:25:26.039232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] Creating event network-vif-deleted:eefd0227-bb30-402f-917b-f10e5871999a for instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb on n-h2-858383-13 Oct 18 13:25:26.040312 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 256/501] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:26.087449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0fb0802b-187f-4105-8a0c-f3708c1ff563 req-c6ff126f-7861-4af9-9390-1e5e49e81ab1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173985 Oct 18 13:25:26.088632 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 246/502] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:26.306235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.307623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:26.320289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.334104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.334104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.334520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.334991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.338524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.562435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.563166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:26.580582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.581102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.585893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.585893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.585893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.586515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.698038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:26.708660 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45e29972-3927-4fec-9722-b709ea22cecd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1266 microversion: 2.1 time: 0.151277 Oct 18 13:25:26.731499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 247/503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:26.747645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99b164fc-7ed7-4aa4-a804-2b5284cc2dc9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316ac820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.859681 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99b164fc-7ed7-4aa4-a804-2b5284cc2dc9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1421 microversion: 2.1 time: 0.120733 Oct 18 13:25:26.860410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 248/504] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:26.884579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2df4673-3836-4196-91f6-e9ee99bede2d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316bc0d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.971260 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2df4673-3836-4196-91f6-e9ee99bede2d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 200 len: 1421 microversion: 2.1 time: 0.098747 Oct 18 13:25:26.975528 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 249/505] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:26.984853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.984853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:27.015126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.015633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.016081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.016804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.031786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.034033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.162568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.172281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7a5bb348-ab10-4c11-888f-5ec337d611bc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1217 microversion: 2.1 time: 0.198841 Oct 18 13:25:27.191758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 250/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:27.201744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43d35c01-ca43-4b8f-bbcf-c0f9ae9e2b1d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3316acaf0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:27.347489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.379915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.384012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.385523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-726511d7-3a0a-4a58-9abe-ed2f19a69872 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 1.084733 Oct 18 13:25:27.389427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 257/507] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:27.399201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6115940-280d-4e29-81ec-47dc4c07ebe3", "name": "network-vif-plugged", "status": "completed", "tag": "2b5e1c6c-c6b7-4eea-82f3-3f426accebd2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:27.429542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.430990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.435803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.463098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] Creating event network-vif-plugged:2b5e1c6c-c6b7-4eea-82f3-3f426accebd2 for instance d6115940-280d-4e29-81ec-47dc4c07ebe3 on n-h2-858383-13 Oct 18 13:25:27.476091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-24643df4-7b4a-498b-bd7f-1fc06e48582e req-03b44345-cafb-4377-b610-e0f8689149df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084370 Oct 18 13:25:27.477360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 258/508] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:27.736595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:27.738708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:27.748344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.751982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.751982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.753450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.757604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.759520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.198278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.210120 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22474dd4-da07-47c7-8daa-2247e9f3045f tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1314 microversion: 2.1 time: 0.478575 Oct 18 13:25:28.211030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 259/509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:27 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:28.237738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:28.239518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:28.253108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.256277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.257277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.258622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.259250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.260157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.585267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.601219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-425241f9-8798-4ad9-8152-4770b9071316 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1209 microversion: 2.1 time: 0.386191 Oct 18 13:25:28.601841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 260/510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:28 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1209 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:28.650209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:28.658535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:28.670752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.671257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.671705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.672416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.684005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.685777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.057592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.066136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.067585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.068764 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0483f96d-47e1-4db3-a7e0-6f7f6a3caaaf tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1362 microversion: 2.25 time: 0.464613 Oct 18 13:25:29.079072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 261/511] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:28 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:29.241061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.241916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.254218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.255317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.256937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.258648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.260130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.261250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.379317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.393387 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-674f7dad-ce62-44b6-87fc-c127f44f9e86 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1332 microversion: 2.1 time: 0.156331 Oct 18 13:25:29.395326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 262/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:29 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:29.491884 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43d35c01-ca43-4b8f-bbcf-c0f9ae9e2b1d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 204 len: 0 microversion: 2.1 time: 2.298942 Oct 18 13:25:29.493612 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 251/513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:27 2022] DELETE /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 0 bytes in 2301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:29.502355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.503560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.512681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.515754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.517985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.518910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.520856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.522970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.557354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:29.637848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.638595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.654314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.654591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.655105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.659332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.659332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.659332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.826696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.839310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba4da34c-496d-428b-9273-e293ce1efe5b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1273 microversion: 2.1 time: 0.206349 Oct 18 13:25:29.845124 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 252/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:29 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:29.960424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08ffaf9b-f99f-4dfb-9176-f38c341c2f0d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 204 len: 0 microversion: 2.1 time: 0.461154 Oct 18 13:25:29.973056 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 263/515] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:29 2022] DELETE /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:30.111478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:30.112709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:30.121344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.122076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.122869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.123884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.124561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.125173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.313514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:30.322992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:30.324744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:30.326173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdf8bacb-6708-42c0-a53b-f8182129e550 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1558 microversion: 2.25 time: 0.220062 Oct 18 13:25:30.327386 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 253/516] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:30 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:30.351748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:30.352355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:30.364264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.364770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.365212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.365924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.366409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.366827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.418433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:30.419179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:30.433300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.439007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.439007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.440270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.441952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.443587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.972459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:30.990962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8406b621-8fd7-4f1c-aaaa-cd9a3c9ee77f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 2053 microversion: 2.25 time: 0.643266 Oct 18 13:25:30.992159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 264/517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:30 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 2053 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:30.997857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-410443497", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:31.105244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:31.187702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:31.200457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a888f093-09b0-4de1-91fd-d6b2ca9aaf83 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.786096 Oct 18 13:25:31.216964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 254/518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:30 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:31.216964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d74fea-1d0c-47dd-8bd7-7a74658cd0cb", "name": "network-vif-unplugged", "status": "completed", "tag": "20a10dfc-3310-4caf-b21d-b4de7f2fd29e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:31.222015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.230212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.230212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.249334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:31.255535 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] Creating event network-vif-unplugged:20a10dfc-3310-4caf-b21d-b4de7f2fd29e for instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb on n-h1-858383-13 Oct 18 13:25:31.276443 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3db152f9-8941-4ce5-9c84-6986ede4a2ae req-4fc6b397-a255-4536-a6ce-11299a4177ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064369 Oct 18 13:25:31.285843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 255/519] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:31.301898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:31.306639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:31.328618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.330086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.331438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.336714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.338508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.339250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.449401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:31.471041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d33a02b1-3d90-4781-a5a1-f5bf2eb3fc75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1271 microversion: 2.1 time: 0.170468 Oct 18 13:25:31.471041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 256/520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:31 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:31.847503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43aa8eb8-8f30-405c-8d4c-28b603d01804 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1307005676", "id": 126801975, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:31.947405 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43aa8eb8-8f30-405c-8d4c-28b603d01804 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.485044 Oct 18 13:25:31.951424 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 257/521] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:25:31 2022] POST /compute/v2.1/flavors => generated 468 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:31.956114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:31.959784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:31.981940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.982515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.984841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.998561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.000935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.001763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.109455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:32.110724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:32.111414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:32.112031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:32.114092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:32.175971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.180161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.182460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.187698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.194245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.194245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.231242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:32.265939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:32.276972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:32.321553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:32.327156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:32.549309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01cda37e-c13f-408d-bfc0-4d5adac8dd03 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555671 Oct 18 13:25:32.552481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 265/522] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:32.564242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-466e6839-13ce-46be-81ca-4b2caa43ac17 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:32.907812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:32.962380 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-567b77da-9cd2-4a20-b921-eb32d8906f6a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 2053 microversion: 2.25 time: 1.009825 Oct 18 13:25:32.968027 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 258/523] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:31 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 2053 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:32.980770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:32.982428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.011630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.013018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.013687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.017314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.023793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.031653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.245436 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-466e6839-13ce-46be-81ca-4b2caa43ac17 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/126801975/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.691408 Oct 18 13:25:33.248298 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 266/524] 10.222.0.27 () {62 vars in 1262 bytes} [Tue Oct 18 13:25:32 2022] POST /compute/v2.1/flavors/126801975/os-extra_specs => generated 62 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.390352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:33.402492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ef2f152-23da-4f15-b11a-a9c204279e78 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.432449 Oct 18 13:25:33.415702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 259/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:32 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.437842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.439707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.452927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.453718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.454373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.455246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.455913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.457089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.537292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-620f0ace-dc47-418b-ab24-af61236090ca tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] Calling method '.version_select at 0x7fb331b963a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.567936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-620f0ace-dc47-418b-ab24-af61236090ca tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.319552 Oct 18 13:25:33.568517 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 267/526] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:33.580191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0592c9d6-8850-4bd4-b611-ad5911c03622 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.580812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0592c9d6-8850-4bd4-b611-ad5911c03622 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.582712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:33.590427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:33.694327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0592c9d6-8850-4bd4-b611-ad5911c03622 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:33.702193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0592c9d6-8850-4bd4-b611-ad5911c03622 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1207 microversion: 2.1 time: 0.126269 Oct 18 13:25:33.707146 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 268/527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1207 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.718047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.723628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.733752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.733752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.733752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.733752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.738769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.796644 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4d3fd5b-f397-4d94-b868-e226ae6abb7d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088224 Oct 18 13:25:33.797266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 269/528] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:33.917794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:33.931295 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea7ab651-e908-42c0-bac8-d7a1b87fab5c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.513385 Oct 18 13:25:33.931565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 260/529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.936229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ec65bad-a8ac-4761-91f0-771c539543a9 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:34.096714 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ec65bad-a8ac-4761-91f0-771c539543a9 tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/126801975" status: 202 len: 0 microversion: 2.86 time: 0.163899 Oct 18 13:25:34.097307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 261/530] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Oct 18 13:25:33 2022] DELETE /compute/v2.1/flavors/126801975 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:34.105936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e49abd6-e0a7-473b-aeb5-8874521fabd2 tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] Action: 'update', calling method: .version_select at 0x7fb3316ac670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:34.210194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdc5dc7b-7be3-4f16-af4d-0690dad99a3d tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Action: 'create', calling method: .version_select at 0x7fb3319c6790>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:34.881492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:UPDATE=8,nova_api:DELETE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:34.969678 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e49abd6-e0a7-473b-aeb5-8874521fabd2 tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.867667 Oct 18 13:25:34.972365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 262/531] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Oct 18 13:25:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:34.977643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:34.978639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:34.986688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.987499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.997024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.999382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.002038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.002950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.301417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7cbcf228-36c0-4c99-bf70-f56b16c0714f tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3/action" status: 202 len: 0 microversion: 2.25 time: 0.324787 Oct 18 13:25:35.306209 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 263/532] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:25:34 2022] POST /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:35.313038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d74fea-1d0c-47dd-8bd7-7a74658cd0cb", "name": "network-vif-deleted", "tag": "20a10dfc-3310-4caf-b21d-b4de7f2fd29e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:35.328599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.329558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.330306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.345200 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] Creating event network-vif-deleted:20a10dfc-3310-4caf-b21d-b4de7f2fd29e for instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb on n-h1-858383-13 Oct 18 13:25:35.352243 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bdf00c55-e4be-40aa-81f0-08e624cb51fc req-ba833076-dad5-42ad-ae45-a7cedef05543 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042449 Oct 18 13:25:35.353271 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 264/533] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:35.361506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ffa74b-13a7-4f51-994f-a02ea0da085c", "tag": "5a5bdbbe-0a96-4fec-a972-30017965b640"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:35.376112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.377241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.377683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.391427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] Creating event network-changed:5a5bdbbe-0a96-4fec-a972-30017965b640 for instance e4ffa74b-13a7-4f51-994f-a02ea0da085c on n-h1-858383-13 Oct 18 13:25:35.397227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-57f12992-1e9e-44ba-baa8-bac67830e40a req-9572959c-d5b6-430d-9f77-e17c33f7483d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041983 Oct 18 13:25:35.398307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 265/534] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:35.405922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bba4728f-dd1d-4db7-8e6d-7ad3614a042c tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.433580 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bba4728f-dd1d-4db7-8e6d-7ad3614a042c tempest-FlavorMetadataValidation-125825111 tempest-FlavorMetadataValidation-125825111-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.033774 Oct 18 13:25:35.438581 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 266/535] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:35.445605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.445605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:35.480095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.480715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.481236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.482082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.484155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.484619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.681557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:35.691723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.251891 Oct 18 13:25:35.692881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 267/536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:35.696371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.697349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2513dbe-0e51-48ee-aa77-4f662934146d tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003520 Oct 18 13:25:35.697744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 268/537] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:25:35.708329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.709089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:35.715600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.716242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.716749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.717568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.718147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.718700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.825763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:35.842897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac711f0b-1284-447f-a82e-91a3f88d212c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1267 microversion: 2.1 time: 0.143567 Oct 18 13:25:35.864068 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 269/538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:35.869935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.870912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:35.877519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.878291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.885815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.885815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.885815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.885815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.111930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:36.126722 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c4356e6-9dd9-4c6d-a1c2-817c3d31c800 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.258994 Oct 18 13:25:36.141682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 270/539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:36.141682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7de2b9c0-6f7c-4086-be7e-2d9e5674113c tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] Calling method '.version_select at 0x7fb331616160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:36.162382 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7de2b9c0-6f7c-4086-be7e-2d9e5674113c tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.029404 Oct 18 13:25:36.163178 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 271/540] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Oct 18 13:25:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:36.174113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:36.174679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:36.187790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.188287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.188775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.198027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.198592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.199053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.636607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:36.650217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c95a6526-90cc-406f-8f80-58224ffdf056 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 2038 microversion: 2.25 time: 0.486170 Oct 18 13:25:36.654289 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 272/541] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:36 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 2038 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:36.679269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9a0caad-63d1-455b-bd4b-f65139cff663 tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] Action: 'update', calling method: .version_select at 0x7fb3317eedc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:36.699790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdc5dc7b-7be3-4f16-af4d-0690dad99a3d tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.901248 Oct 18 13:25:36.701269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 270/542] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:25:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:36.707886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": "auto"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:36.712619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:36.720981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.722474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.723113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.724302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.725557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.727083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.823159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'flavor' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:36.893844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Going to try to live migrate instance to n-h1-858383-13 {{(pid=121010) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:25:37.229557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9a0caad-63d1-455b-bd4b-f65139cff663 tempest-QuotaClassesAdmin257Test-1861316242 tempest-QuotaClassesAdmin257Test-1861316242-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.558040 Oct 18 13:25:37.250503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 273/543] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Oct 18 13:25:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:37.267773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5d32aae-0f26-49a4-9815-64ca8baa5ef5 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb33169d670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:37.675624 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5d32aae-0f26-49a4-9815-64ca8baa5ef5 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/87624565-3a98-44c3-ac84-4aca71eb7964" status: 200 len: 142 microversion: 2.1 time: 0.423905 Oct 18 13:25:37.676569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 274/544] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:25:37 2022] GET /compute/v2.1/os-floating-ips/87624565-3a98-44c3-ac84-4aca71eb7964 => generated 142 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:37.681253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:37.681870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:37.689802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.690591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.691241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.692137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.696964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.697696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.997836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:38.006327 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-124f447b-4a0f-4607-bb6f-29f5492bc488 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.328634 Oct 18 13:25:38.012884 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 275/545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:37 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:38.018517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:38.029294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:38.037060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:38.037409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:38.037848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:38.042233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:38.046269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:38.046269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:38.432170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:38.446820 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb171b95-f1fa-4d40-bd5c-b450f6f7960f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.432594 Oct 18 13:25:38.458408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 276/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:38 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:38.463936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:38.464813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:38.479585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:38.482873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:38.483530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:38.484260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:38.484832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:38.485270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:38.897404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:38.907159 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4364d2b0-4faf-4dea-bbb2-30ee19644f26 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.447337 Oct 18 13:25:38.909589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 277/547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:38 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:38.917087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:38.930258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:38.931161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:38.931850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:38.949736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] Creating event network-changed:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h1-858383-13 Oct 18 13:25:38.955205 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7f52ffa2-f46c-4fca-88e8-e7957c18e27d req-393f4cdc-43c9-40b9-b6b0-9dfba6d4e110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043246 Oct 18 13:25:38.956524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 278/548] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:38.969331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2e76568-0668-417a-b891-9a7a5fdcdbcb tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb3316ef8b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:39.437250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2e76568-0668-417a-b891-9a7a5fdcdbcb tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.478607 Oct 18 13:25:39.437825 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 279/549] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:25:38 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:39.444400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:39.445348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:39.465088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.466370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.467578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:39.471410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.471907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.472352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:39.871373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:39.882667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45d2240b-addf-4f94-8ff3-bb249ca87761 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.443625 Oct 18 13:25:39.884275 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 280/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:39 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:39.913902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b149a76d-9c83-4b31-8cf8-ebd6c93e1d3e tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb3316a2430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.234753 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b149a76d-9c83-4b31-8cf8-ebd6c93e1d3e tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/87624565-3a98-44c3-ac84-4aca71eb7964" status: 202 len: 0 microversion: 2.1 time: 1.348872 Oct 18 13:25:41.236318 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 281/551] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:25:39 2022] DELETE /compute/v2.1/os-floating-ips/87624565-3a98-44c3-ac84-4aca71eb7964 => generated 0 bytes in 1351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:41.243545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.251038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:41.255684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.256296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.256887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.257702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.258324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.258871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.402914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:41.406696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:41.414107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-446ff83f-2b2f-4b11-ab24-19622f93d67e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.176435 Oct 18 13:25:41.431237 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 282/552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:41 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:41.438084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.438734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:41.446421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.452683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.452683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.459840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.459840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.459840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.648039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:41.682256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b66538ae-9ba8-4056-a832-0ac24dc6afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.249783 Oct 18 13:25:41.685024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 283/553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:41 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:41.690333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.690952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:41.708618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.709115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.710662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.711603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.712066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.712673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.872278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:41.880597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d16448c6-be40-44e7-9913-4875f98753b8 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.193910 Oct 18 13:25:41.881186 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 284/554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:41 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:41.885955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3fdd130-7ec2-4d75-b7a5-2088436f6bbd", "tag": "5d524f5b-0038-4b20-a9df-09a7295437dd"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:41.896747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.897240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.897681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.909584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] Creating event network-changed:5d524f5b-0038-4b20-a9df-09a7295437dd for instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd on n-h2-858383-13 Oct 18 13:25:41.917315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8381c588-0a2b-4688-b034-9935a20a32af req-f9a736ae-b891-4754-b016-a8458c4586b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033369 Oct 18 13:25:41.930611 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 285/555] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:41.931263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33ec8506-f9e5-4e0b-b10a-cde2acfbc16b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3/action" status: 202 len: 0 microversion: 2.25 time: 5.216221 Oct 18 13:25:41.931263 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 271/556] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:25:36 2022] POST /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3/action => generated 0 bytes in 5217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:41.932069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd081563-d1d2-4bb9-a190-88502ae6ec5d tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Action: 'create', calling method: .version_select at 0x7fb3316a21f0>, body: {"pool": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:41.939363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.940290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:41.960459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.961187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.961915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.962901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.964161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.964810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.275149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.306285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.312729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.313363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c7c9fb8-6072-451e-ace0-dc777ec4ba51 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.378926 Oct 18 13:25:42.356272 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 272/557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:41 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:42.440238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:42.441346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.463234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.466250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.466250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.466250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.466250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.467266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.804742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.836516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3622b303-88b1-49df-b42c-e2eb9be1c125 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.402295 Oct 18 13:25:42.838506 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 273/558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:42 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:42.856726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "name": "network-vif-plugged", "status": "completed", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:42.891682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.893748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.895548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.925077 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] Creating event network-vif-plugged:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h1-858383-13 Oct 18 13:25:42.932375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3b8b86d8-5a74-4b9c-bd58-9080bbdf092b req-f0f7c9bd-dbfc-475f-8a25-e85855e9eb0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091531 Oct 18 13:25:42.934112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 274/559] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:42.941568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:42.944253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.957061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.958862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.959471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.961416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.962082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.962685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.307408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:43.316672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99fb714e-3028-4af4-b2da-36d8fe4d5f4f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.380931 Oct 18 13:25:43.318165 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 275/560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:42 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:43.336552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.342203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:43.344442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.345702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.346304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.347424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.348046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.348655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.536628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:43.545214 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2872be23-3446-4ec9-93ba-0b8b67e3d84b tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.225767 Oct 18 13:25:43.545864 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 276/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:43 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:43.699724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=18 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:43.746165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:43.800002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb3318e2790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.801830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.802606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.803112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.818003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.818779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.819114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.830502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.830986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.831430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.837500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb6b1ade-a097-4046-a223-34d3e9a43065 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.290553 Oct 18 13:25:43.838239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 277/562] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:43.843009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.843601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:43.850934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.851435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.851907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.852577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.853035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.867120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.021525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.028733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.030802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.047682 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-93c4aac4-9e20-41ac-a9b2-cb3b82c99119 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.193113 Oct 18 13:25:44.063323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 278/563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:43 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:44.309382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Calling method '.version_select at 0x7fb33180f0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.312427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.312982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.314007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.329839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.330609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.332644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.343042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.343766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.344215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.352520 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1da40852-8223-41eb-9a60-694a24a6e7f9 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.287203 Oct 18 13:25:44.353819 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 279/564] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:44.363542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb33180f820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.365298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.365787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.366258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.380988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.381564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.382012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.392710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.393198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.393641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.400096 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f9f320c-d6d0-4961-b622-67d34afdfa01 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.045235 Oct 18 13:25:44.400909 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 280/565] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:44.405647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.406385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.413256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.413755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.414232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.415112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.415581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.416019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.594358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.604349 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a030ac5-0dd3-4fcf-99f9-4f5a8fc7d5c1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.202389 Oct 18 13:25:44.605106 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 281/566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:44.624174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.624174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.628149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.628647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.629228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.629942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.630506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.630941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.803841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.809345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-262e5d12-a24e-400b-8b5d-98c1ca8d5b6d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1313 microversion: 2.1 time: 0.192154 Oct 18 13:25:44.815047 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 282/567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:44.822339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Calling method '.version_select at 0x7fb3319ac3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.825436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.825954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.826437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.849526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.850117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.850568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.857141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7202263-dbef-4aba-ac90-b513aa61a998 tempest-HypervisorAdminV228Test-937544350 tempest-HypervisorAdminV228Test-937544350-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.040818 Oct 18 13:25:44.857732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 283/568] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:44.865008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb3319acf70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.868081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.872845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.872845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.884008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.884504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.884941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.898037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.898414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.898861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.908811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd081563-d1d2-4bb9-a190-88502ae6ec5d tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.986555 Oct 18 13:25:44.915063 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 286/569] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:25:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:44.919952 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6c07c44-8967-4a60-9c5a-c8c1e768d824 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.061126 Oct 18 13:25:44.922567 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 284/570] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:44.927230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57480426-94af-46a9-8278-3eddd86a76d4 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb3318e2160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.933195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.934950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.950329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.951679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.952774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.955864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.957148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.957908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.133640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:45.144833 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bae5e178-7567-4a1c-9719-d501e3648528 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.227886 Oct 18 13:25:45.147789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 287/571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:45.156540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb3315ee3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.163510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.166736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.166736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.199449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.199947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.200390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.211778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0305e5be-f593-4d69-a662-94e8e6608576 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.062903 Oct 18 13:25:45.213630 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 288/572] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.221414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ffa74b-13a7-4f51-994f-a02ea0da085c", "name": "network-vif-plugged", "status": "completed", "tag": "5a5bdbbe-0a96-4fec-a972-30017965b640"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:45.249051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.249576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.250015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.286401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] Creating event network-vif-plugged:5a5bdbbe-0a96-4fec-a972-30017965b640 for instance e4ffa74b-13a7-4f51-994f-a02ea0da085c on n-h1-858383-13 Oct 18 13:25:45.293136 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bac65337-42d6-4595-ba47-ccbad909d213 req-7b8e4d4a-aafd-42a4-89e2-40084fe7d0df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078011 Oct 18 13:25:45.294837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 289/573] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.301693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6115940-280d-4e29-81ec-47dc4c07ebe3", "name": "network-vif-unplugged", "status": "completed", "tag": "2b5e1c6c-c6b7-4eea-82f3-3f426accebd2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:45.312377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.314950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.315582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.331779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] Creating event network-vif-unplugged:2b5e1c6c-c6b7-4eea-82f3-3f426accebd2 for instance d6115940-280d-4e29-81ec-47dc4c07ebe3 on n-h2-858383-13 Oct 18 13:25:45.338048 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9f7e77e0-cc12-4917-8a5b-938ff76dfadd req-7a16b939-d30d-4b8a-b29f-d89df5885a93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041993 Oct 18 13:25:45.339889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 290/574] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.346020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.347065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:45.353743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.354618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.355269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.356147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.356907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.357515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.526386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:45.535496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:45.537318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:45.539217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53cb39cd-55d0-40f1-9157-e38e47f05e8e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.198264 Oct 18 13:25:45.540562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 291/575] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:45.545169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bca97639-834c-4be4-87ab-c47c6db181bd tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb33162f820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.547454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bca97639-834c-4be4-87ab-c47c6db181bd tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.548700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bca97639-834c-4be4-87ab-c47c6db181bd tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.549410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bca97639-834c-4be4-87ab-c47c6db181bd tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.574522 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bca97639-834c-4be4-87ab-c47c6db181bd tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029265 Oct 18 13:25:45.574522 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 292/576] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.776107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7cd29014-37be-4bd3-9fc3-4e44a9508617 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] Calling method '.version_select at 0x7fb3316ef4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.788270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7cd29014-37be-4bd3-9fc3-4e44a9508617 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.215258 Oct 18 13:25:45.788840 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 293/577] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.793207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb3316ef0d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.794995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.795498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.795926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.811782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.812283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.812876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.823403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.823818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.824262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.830160 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-87aff0a2-cf19-454c-9e4f-d68d29b787ad tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.040287 Oct 18 13:25:45.831064 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 294/578] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.835596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:45.836205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:45.842390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.842879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.843573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.844277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.844774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.845210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.931934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57480426-94af-46a9-8278-3eddd86a76d4 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef" status: 202 len: 0 microversion: 2.1 time: 1.008062 Oct 18 13:25:45.932590 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 285/579] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:25:44 2022] DELETE /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:45.937428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf1a0ef6-d3bf-4f33-9265-5b6b222f4434 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] Action: 'update', calling method: .version_select at 0x7fb331947940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:46.055124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.063199 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d1f82ce-ec9a-4f70-8f38-8fb452309101 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.231120 Oct 18 13:25:46.064130 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 295/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:45 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:46.069442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.074237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.083351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.083858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.084306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.085019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.085549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.085996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.225783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.253465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f0a1c12-1357-48e7-9245-d62ed594f25c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1462 microversion: 2.1 time: 0.168586 Oct 18 13:25:46.253465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 296/581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1462 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:46.253465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb33176edc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.253465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.253465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.253915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.256730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.257272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.257789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.265872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51912df6-128b-47ef-807d-0225fe879fd5 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.028928 Oct 18 13:25:46.267015 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 297/582] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:46.285251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb3316ac9d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.335329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4e23b063-6f66-41b4-be20-0799533376ef could not be found", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:25:46.336022 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] HTTP exception thrown: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Request method failure captured: Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef HTTP/1.1 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlN4PEotfpKamSM-sSeliRJOp1AXA0Yb8h-dNxMkm8RSp4mCLPdm_phMSCH7J9N53v6krJTlEIy7wdUrcmS-8TBeWT7D22CT6wZuikIMOluR5TFMEh1FULOh8efHl5UGElCFpa5NE6zbLKGLQuw7gDdQBYIpSS1zMalgNHT0YHU0Jk Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9bfb3b3d56c842739d5dfa14d1067a69 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:46.349746 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9bfb3b3d56c842739d5dfa14d1067a69 Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsTestJSON-447753380-project Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c4ea23677e724670ad407d00c39fdd0b Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsTestJSON-447753380-project Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: exception: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4e23b063-6f66-41b4-be20-0799533376ef'} Oct 18 13:25:46.351817 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:25:46.352667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4e23b063-6f66-41b4-be20-0799533376ef could not be found Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c754f0-7f71-44c2-93fe-179de1ce9d19'] Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef. Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:46.353772 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:46.355352 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:46.356767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:46.356767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:46.356767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Returning 404 to user: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:46.356767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c378b9f6-8e32-4b61-9e08-9448bc3ff975 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef" status: 404 len: 111 microversion: 2.1 time: 0.083323 Oct 18 13:25:46.356767 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 298/583] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:46.357280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.357884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.364860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.365348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.365790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.366516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.366976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.367509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.504393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.513030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7e926e8-1e77-44f1-8cb7-3f8935c534dd tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1388 microversion: 2.1 time: 0.159996 Oct 18 13:25:46.513772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 299/584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:46.695376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.695993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.702150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.702668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.703091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.703769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.704309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.704738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.008365 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f8ec1b6-17c4-457d-a936-5d1e5b4d3711 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1615 microversion: 2.1 time: 0.493518 Oct 18 13:25:47.008946 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 300/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1615 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.016973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb33169d430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.018878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.019357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.019834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.044172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.044172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.044172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.047023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ab983e0e-7eba-40af-b1eb-2d1499244120 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.036845 Oct 18 13:25:47.047585 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 301/586] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.051956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Calling method '.version_select at 0x7fb3316ac3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.096418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4e23b063-6f66-41b4-be20-0799533376ef could not be found", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:25:47.098187 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] HTTP exception thrown: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Request method failure captured: Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef HTTP/1.1 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlN4PEotfpKamSM-sSeliRJOp1AXA0Yb8h-dNxMkm8RSp4mCLPdm_phMSCH7J9N53v6krJTlEIy7wdUrcmS-8TBeWT7D22CT6wZuikIMOluR5TFMEh1FULOh8efHl5UGElCFpa5NE6zbLKGLQuw7gDdQBYIpSS1zMalgNHT0YHU0Jk Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9bfb3b3d56c842739d5dfa14d1067a69 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:47.099069 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bfb3b3d56c842739d5dfa14d1067a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9bfb3b3d56c842739d5dfa14d1067a69 Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsTestJSON-447753380 Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsTestJSON-447753380-project Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c4ea23677e724670ad407d00c39fdd0b Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsTestJSON-447753380-project Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: exception: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4e23b063-6f66-41b4-be20-0799533376ef'} Oct 18 13:25:47.100556 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:25:47.101450 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4e23b063-6f66-41b4-be20-0799533376ef could not be found Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f92160df-f5af-4fca-bb9f-f0af1d6d2e3d'] Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef. Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:47.102652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:47.103989 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:47.105576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef Oct 18 13:25:47.105576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:47.105576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] Returning 404 to user: Floating IP not found for ID 4e23b063-6f66-41b4-be20-0799533376ef {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:47.105576 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15a569fb-9e82-443f-a65e-e65d56031039 tempest-FloatingIPsTestJSON-447753380 tempest-FloatingIPsTestJSON-447753380-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef" status: 404 len: 111 microversion: 2.1 time: 0.052134 Oct 18 13:25:47.105576 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 302/587] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:25:47 2022] DELETE /compute/v2.1/os-floating-ips/4e23b063-6f66-41b4-be20-0799533376ef => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:47.106595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.107157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.115999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.116496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.117129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.118121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.118743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.119333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.120865 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf1a0ef6-d3bf-4f33-9265-5b6b222f4434 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.187202 Oct 18 13:25:47.121522 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 286/588] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Oct 18 13:25:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.134079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:47.134731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.142177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.142905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.143510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.144420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.145021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.145603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.232716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8ff684c96ea4fc9beee82ff1c825ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3aea217bc34d51b6816c2f220d1c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.233360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] flavor_id is None. Assuming migration. {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:25:47.233797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:25:47.286624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:47.351047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.363937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.367621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.369170 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2cbc766f-7839-4376-8351-afd8024b94c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.266207 Oct 18 13:25:47.370039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 303/589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:47.375989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Calling method '.version_select at 0x7fb3314d75e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.377893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.378614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.379342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.394882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.400240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.400240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.417770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.418315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.418870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.449941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65aca009-870b-4276-b353-e89cac77b0e2 tempest-HypervisorAdminTestJSON-1621268977 tempest-HypervisorAdminTestJSON-1621268977-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.077808 Oct 18 13:25:47.458232 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 304/590] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.463680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.464569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.472338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.472840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.473487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.475517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.476289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.476891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.586394 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22f801ca-1f89-4348-800e-bc18cbcfc37e tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95/action" status: 202 len: 0 microversion: 2.1 time: 0.463777 Oct 18 13:25:47.590748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 287/591] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:47 2022] POST /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:47.596171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15b06d71-6d6c-4cb2-926c-a04300aa5ec7 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] Calling method '.version_select at 0x7fb331d8d9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.609722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15b06d71-6d6c-4cb2-926c-a04300aa5ec7 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017332 Oct 18 13:25:47.610848 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 288/592] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.616949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fdd130-7ec2-4d75-b7a5-2088436f6bbd", "name": "network-vif-plugged", "status": "completed", "tag": "5d524f5b-0038-4b20-a9df-09a7295437dd"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:47.623261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:47.627634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.628110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.628540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.639312 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] Creating event network-vif-plugged:5d524f5b-0038-4b20-a9df-09a7295437dd for instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd on n-h2-858383-13 Oct 18 13:25:47.645276 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-63467101-c678-41bf-8365-8da866b1e54f req-1beec369-f44c-46d2-aebf-faf3f9caa0d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032116 Oct 18 13:25:47.645861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 289/593] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.650758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6115940-280d-4e29-81ec-47dc4c07ebe3", "tag": "2b5e1c6c-c6b7-4eea-82f3-3f426accebd2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:47.660427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.660945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.661377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.674867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] Creating event network-changed:2b5e1c6c-c6b7-4eea-82f3-3f426accebd2 for instance d6115940-280d-4e29-81ec-47dc4c07ebe3 on n-h2-858383-13 Oct 18 13:25:47.681982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3b066fe8-9989-4f9c-9c57-572939d58c5d req-b311172a-0b47-4717-95be-9a3c6ecd0c7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Oct 18 13:25:47.683783 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 290/594] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:47.691103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.691989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.701097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.701097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.701478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.702550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.703539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.705173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.887700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.895519 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-550b9ada-ab78-4458-9143-f2e13970c1b5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.435935 Oct 18 13:25:47.896104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 305/595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.923554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.924300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.937691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.938226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.939243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.939951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.940411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.940840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.982835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.992858 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c74e6655-ff8c-4906-b09e-ac6b420faf4e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1588 microversion: 2.1 time: 0.307698 Oct 18 13:25:47.993971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 291/596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1588 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.998727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6922077-bc4e-4d74-9364-a5a44b00f522 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] Action: 'update', calling method: .version_select at 0x7fb3318e2ee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:48.562038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.577747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ebc270aa-9e16-4405-bc7e-a88c3563c7ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1471 microversion: 2.1 time: 0.661970 Oct 18 13:25:48.578354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 306/597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1471 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:48.584310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.585153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.591420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.591990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.592491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.593211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.593924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.594569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.599193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:48.712601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a7d6419-083f-4322-b61a-1b9a19ca0f73 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132016 Oct 18 13:25:48.713908 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 307/598] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:48.723421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.724055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.731187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.731892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.733510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.735907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.736547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.737185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.125089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.136371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.138933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.140509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0978049-6180-42d5-a373-07633e0b9fe4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.423988 Oct 18 13:25:49.148652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 308/599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:49.148652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.150492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.158021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=7 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:49.159593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.160258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.160779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.161561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.162102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.162548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.257826 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6922077-bc4e-4d74-9364-a5a44b00f522 tempest-QuotaClassesAdminTestJSON-162357282 tempest-QuotaClassesAdminTestJSON-162357282-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.262594 Oct 18 13:25:49.260613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 292/600] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Oct 18 13:25:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:49.572046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.585345 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-adc752d9-1ac6-4625-9560-a8c51a09606a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1307 microversion: 2.1 time: 0.441026 Oct 18 13:25:49.587171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 309/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:49.605889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.606814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.614342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.618343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.619026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.619945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.620571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.621182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.168620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.169511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.187637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.188252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.203257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.204435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.205511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.206256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.234679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.251484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6fb301f-3306-49ad-906d-3e2ca5431bea tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1471 microversion: 2.1 time: 0.646808 Oct 18 13:25:50.256435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 293/602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1471 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:50.612160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.612835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.632208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.632729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.633184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.634885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.634885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.643361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.945686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.959223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.961332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.966589 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b9853e9-e283-42a7-abdf-d8a5b9aa9149 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.802592 Oct 18 13:25:50.975448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.975858 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 310/603] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:50.983988 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad9ad34e-6408-46e6-b096-df55df340f64 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1488 microversion: 2.1 time: 0.379797 Oct 18 13:25:50.989738 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 294/604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1488 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:51.024156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:51.045768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.050586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.056682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.272604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:25:51.300841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Calling method '.version_select at 0x7fb3314ea430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.307105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.307871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.308560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.326397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.329755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.329755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.354625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.355666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.356942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.371134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.371812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.372772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.404233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.404911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.405666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.415126 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74326622-8061-45f3-b60f-65ab135df208 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1998 microversion: 2.53 time: 0.437786 Oct 18 13:25:51.428835 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 311/605] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1998 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:51.434823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.435558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.443027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.443662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.444434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.445380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.445984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.446555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.629029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9acba75f-91c9-4d8f-9305-2e5f929979dd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.604532 Oct 18 13:25:51.630692 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 295/606] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:51 2022] POST /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:51.639614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Calling method '.version_select at 0x7fb33180ff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.644448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.646398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.657756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.713534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.714093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.714543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.774737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.775248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.775698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.814274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.815094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.816204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.845055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.845915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.846649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.853891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-335290f0-89e7-4ce1-a823-1cfbd4db9965 tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 688 microversion: 2.53 time: 0.221690 Oct 18 13:25:51.855369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 296/607] 10.222.0.27 () {60 vars in 1222 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:51.861311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.868652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.871344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.872082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.872744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.873752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.874503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.877042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.082208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.095275 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4eb2a72-7b6d-41ad-964b-784ae0e5eb43 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.237051 Oct 18 13:25:52.096537 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 297/608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.110734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.114864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.128180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.128688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.129145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.129858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.130374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.130863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.335854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.347791 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96da08a2-2bb6-44b0-9e31-7fd02f7c0708 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1588 microversion: 2.1 time: 0.250086 Oct 18 13:25:52.366189 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 298/609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1588 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.371711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ffa74b-13a7-4f51-994f-a02ea0da085c", "tag": "5a5bdbbe-0a96-4fec-a972-30017965b640"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:52.383700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.384205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.385029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.400304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] Creating event network-changed:5a5bdbbe-0a96-4fec-a972-30017965b640 for instance e4ffa74b-13a7-4f51-994f-a02ea0da085c on n-h1-858383-13 Oct 18 13:25:52.412031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c7e165d4-bce8-41c2-b3bd-f7338b8093d6 req-e880ef1c-4e41-400e-a840-fb6896888686 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038964 Oct 18 13:25:52.417329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 299/610] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:52.423199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Calling method '.version_select at 0x7fb3316595e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.426727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.427237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.427661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.435402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.447735 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a8b5900-08c3-4e62-9a52-e4d01ee1f45c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1471 microversion: 2.1 time: 1.015756 Oct 18 13:25:52.448692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 312/611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1471 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.462826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.465829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.479223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.482667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.483314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.484210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.488351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.488976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.489494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.489735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.489945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.499868 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-458427eb-e063-4aac-bf1e-de30627c7eef tempest-HypervisorAdminV253TestBase-1682773027 tempest-HypervisorAdminV253TestBase-1682773027-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/53128a16-c1fe-483f-9cf3-8446f86ba5c0" status: 200 len: 794 microversion: 2.53 time: 0.081029 Oct 18 13:25:52.503792 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 300/612] 10.222.0.27 () {60 vars in 1298 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/os-hypervisors/53128a16-c1fe-483f-9cf3-8446f86ba5c0 => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:25:52.990749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.003514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.005017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.007201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9878316e-adee-4220-947b-fed221d0f496 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.556983 Oct 18 13:25:53.008139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 313/613] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:53.121854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.122715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.133592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.136377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.136860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.137870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.139690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.141888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.358865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.368432 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbef3179-1d00-43ff-9b3e-9283e0c26c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.250338 Oct 18 13:25:53.371038 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 301/614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:53.477224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.478495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.491659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.492580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.493492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.494851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.495527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.496136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.891975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.906417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-44b7003b-ee01-40f5-b1ff-ca85d9bb8eb7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1471 microversion: 2.1 time: 0.431820 Oct 18 13:25:53.940876 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 314/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:54.037110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.037729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.049600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.050154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.050599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.051292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.051926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.053866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.398743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.399660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.406146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.407693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.408393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.409284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.410445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.411092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.447768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.461500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.477659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.481299 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe7dd7fb-e2f9-4644-8b91-54c78d36d72d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.449696 Oct 18 13:25:54.483706 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 302/616] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:54.598908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.617322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c58caf1f-0057-4a47-b17d-74df96e0e75f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.223235 Oct 18 13:25:54.618447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 315/617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:54.823139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b67e3a-7f05-4bea-ab08-d095890659d2 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.829214 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-44b67e3a-7f05-4bea-ab08-d095890659d2 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b67e3a-7f05-4bea-ab08-d095890659d2 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin] Request method failure captured: Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqli7V_iGW9RrwT-yvH7zqCpzyYpj0k64n7uZXSBBcowyyYxMp-pghCh_yFKkaol55kxdxf4nfRI5bPfRmWkXtjUutGBTNj5EKT0NPZtOfwMVI4vWBe0zVLKbyZogkF4ss3XSvOz3yPsQJPDI1q-v5YwtYhV-ZaxLc7dQShJOXzBSzM Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6c63004901a04191afd52d03a34e64e8 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:25:54.833332 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c63004901a04191afd52d03a34e64e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c63004901a04191afd52d03a34e64e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c63004901a04191afd52d03a34e64e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c63004901a04191afd52d03a34e64e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6c63004901a04191afd52d03a34e64e8 Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: e648357a89244413bee18c4483a44202 Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:25:54.834691 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid timestamp for date invalid_time Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'invalid_time'} Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:54.835381 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b67e3a-7f05-4bea-ab08-d095890659d2 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:54.836650 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44b67e3a-7f05-4bea-ab08-d095890659d2 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729 tempest-InstanceUsageAuditLogNegativeTestJSON-863952729-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.347831 Oct 18 13:25:54.841237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 303/618] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:54.933729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.936266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.950182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.953545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.955872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.958324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.959292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.960064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.038922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75a9f63f-51d1-4eae-b709-22f374fa5238 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.040742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75a9f63f-51d1-4eae-b709-22f374fa5238 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '78ce866c78554f638f9f2976c3f7198b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb17fad956b42feb001a45797d841f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75a9f63f-51d1-4eae-b709-22f374fa5238 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Request method failure captured: Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlhpvPVmkQHNK2CGzzb4Qexuc2GIS4UONAkx65so4r19EXEW4hOaOYJnOsHy-97TXCfEnIOsIMLcJX1DPx1k3hUQElDsv63f1cSCXbJH_oDwffae0yrMGOH86eMpSr6oHP2c7zOBvuc5266b_fYYuHYGkhu7QjAGMuYlirGzA3vrXs Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: efb17fad956b42feb001a45797d841f0 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:55.043378 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efb17fad956b42feb001a45797d841f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efb17fad956b42feb001a45797d841f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efb17fad956b42feb001a45797d841f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efb17fad956b42feb001a45797d841f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: efb17fad956b42feb001a45797d841f0 Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 78ce866c78554f638f9f2976c3f7198b Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project Oct 18 13:25:55.044696 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:55.045293 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:25:55.046527 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.047536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75a9f63f-51d1-4eae-b709-22f374fa5238 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:55.047536 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75a9f63f-51d1-4eae-b709-22f374fa5238 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.202712 Oct 18 13:25:55.047536 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 316/619] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 204 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:55.059357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af2cbf45-2a3a-4672-968a-304949b9c0ea tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.061182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af2cbf45-2a3a-4672-968a-304949b9c0ea tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '78ce866c78554f638f9f2976c3f7198b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb17fad956b42feb001a45797d841f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af2cbf45-2a3a-4672-968a-304949b9c0ea tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Request method failure captured: Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013:25:55 HTTP/1.1 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlhpvPVmkQHNK2CGzzb4Qexuc2GIS4UONAkx65so4r19EXEW4hOaOYJnOsHy-97TXCfEnIOsIMLcJX1DPx1k3hUQElDsv63f1cSCXbJH_oDwffae0yrMGOH86eMpSr6oHP2c7zOBvuc5266b_fYYuHYGkhu7QjAGMuYlirGzA3vrXs Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: efb17fad956b42feb001a45797d841f0 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:25:55.068245 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efb17fad956b42feb001a45797d841f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/efb17fad956b42feb001a45797d841f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/efb17fad956b42feb001a45797d841f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_efb17fad956b42feb001a45797d841f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: efb17fad956b42feb001a45797d841f0 Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 78ce866c78554f638f9f2976c3f7198b Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project Oct 18 13:25:55.069780 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '2022-10-18 13:25:55'} Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:25:55.070493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:25:55.071667 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:25:55.073097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af2cbf45-2a3a-4672-968a-304949b9c0ea tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:55.073097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af2cbf45-2a3a-4672-968a-304949b9c0ea tempest-InstanceUsageAuditLogNegativeTestJSON-271585753 tempest-InstanceUsageAuditLogNegativeTestJSON-271585753-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 13:25:55" status: 403 len: 128 microversion: 2.1 time: 0.017452 Oct 18 13:25:55.074547 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 317/620] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013%3A25%3A55 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:55.331457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.348487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d59a314e-b695-41d2-b417-1474ac18fb34 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.420456 Oct 18 13:25:55.349022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 304/621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:55.515159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.515971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.523640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.527045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.527045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.527045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.527045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.527357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.641062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.641940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.649145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.655058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.655581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.656341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.657351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.657814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.753150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.764996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.767960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.769586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05b6846b-66b5-4484-8967-e765c46d143b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1568 microversion: 2.25 time: 0.262482 Oct 18 13:25:55.770813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 318/622] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:56.075737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.086169 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bd82181-5cf7-408c-b7f9-329289c16817 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.449157 Oct 18 13:25:56.105447 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 305/623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:56.373430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.374063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.377509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.382012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.382801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.382993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.383929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.390232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.391514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.588307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.596989 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e367359-e136-4793-ad7d-ed9b6678cd5e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.227343 Oct 18 13:25:56.598162 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 319/624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:56.798843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.799617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.810684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.811177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.811619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.812324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.813104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.818815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.823477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.984086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.993865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.995333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.003188 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d636ae96-7aea-4e6f-990f-f11237081256 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1543 microversion: 2.25 time: 0.209914 Oct 18 13:25:57.010164 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 306/625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:57.028600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a013813-b519-4970-a7e0-c56fa064cc4b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '.version_select at 0x7fb3314fc5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.037183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a013813-b519-4970-a7e0-c56fa064cc4b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.037860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a013813-b519-4970-a7e0-c56fa064cc4b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.038349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a013813-b519-4970-a7e0-c56fa064cc4b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.048528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a013813-b519-4970-a7e0-c56fa064cc4b tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1536 microversion: 2.25 time: 0.023782 Oct 18 13:25:57.050085 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 320/626] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/os-migrations => generated 1536 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:57.065012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.065628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.071704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.072199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.072696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.073394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.073857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.074329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.114264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.114881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.134197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.134197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.134197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.134197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.134519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.134519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.247775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:57.265850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-942c4987-09d2-4597-821c-cfad5df78a24 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 2038 microversion: 2.25 time: 0.205642 Oct 18 13:25:57.267211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 307/627] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 2038 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:57.288733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.298713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06b1c3a5-9583-4bc2-8a5c-0d8bbfe678c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: .version_select at 0x7fb33162baf0>, body: {"keypair": {"name": "tempest-keypair-1963644730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzfPswWJ48rImIjtpttAZwBtaMhwEDZ0X4KCZu8NEwvRBB5AX9u28laoWG6FSHzGyzWKrJZxw32r1IHXqFTmN4ukw6WT6UwZ/l7uQNvvltcuw2vJrtQb9oPWgTsrQ2bDA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:57.301122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a842b69f-a9b9-4ed7-9c08-b69aa05d7626 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.189432 Oct 18 13:25:57.301122 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 321/628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.337291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-06b1c3a5-9583-4bc2-8a5c-0d8bbfe678c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:57.342655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-06b1c3a5-9583-4bc2-8a5c-0d8bbfe678c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for user fa4ca05a0c6a405f8fa014ee06dbcef4 and project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:57.456307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06b1c3a5-9583-4bc2-8a5c-0d8bbfe678c3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.162217 Oct 18 13:25:57.457600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 308/629] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:25:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 13:25:57.620648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.621855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.629573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.630412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.630991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.631760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.632292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.632790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.777025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.785013 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7a102c5e-0040-4209-85d1-26b9203212d4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.168524 Oct 18 13:25:57.785591 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 322/630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:58.325365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:58.326138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:58.335885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.336386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.336832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.337548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.338017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.341942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.499170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:58.509808 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba9ee764-1a9f-4251-986e-d3a30072f958 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.188901 Oct 18 13:25:58.511995 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 309/631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:58.808884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:58.809638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:58.816011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.816636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.817178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.818102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.818671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.819198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.955606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4ed124b-42a0-44a4-b41f-06c94c909fd0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314eab80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:59.024669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.035840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33454281-760a-437f-b45a-98a941d9ac7c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.230638 Oct 18 13:25:59.036562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 310/632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:59.299758 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4ed124b-42a0-44a4-b41f-06c94c909fd0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be" status: 200 len: 371 microversion: 2.1 time: 0.806410 Oct 18 13:25:59.307170 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 323/633] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be => generated 371 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:59.311919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Action: 'update', calling method: .version_select at 0x7fb331659c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:59.535498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:59.536520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:59.545559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.546077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.546735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.547630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.548426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.549400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.707695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.717782 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89be84c7-7068-4ae3-ae69-165036c54dd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.187365 Oct 18 13:25:59.718998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 324/634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:59 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:59.838997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.838997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.842377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.843254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.843761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.844210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.033144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f8d8a17-3f6f-4676-91f7-38c587d40b12 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be" status: 200 len: 328 microversion: 2.1 time: 0.724789 Oct 18 13:26:00.036237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dad1313c-916b-4b91-a4db-580bf731aeea tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Action: 'create', calling method: .version_select at 0x7fb3314d7430>, body: {"keypair": {"name": "tempest-keypair-587219080", "type": "ssh", "user_id": "66210c012bc3404583b9e2acc5cb4014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc2URJwyB+okjx1MArW2ucFbtCau0Ckqq4d+wflxQtKp+M+4a3j9EtL6YrXkxWErPUG0eTeWSgsHq2veXVB3Lwb/E4XEQKZGOjh+QHJCoPEzj93XGCFDqe/8xVUmrqdZw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:00.040757 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 311/635] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:25:59 2022] PUT /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be => generated 328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:00.046241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f68d6248-077f-490a-9da9-3d4fb0849631 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.066643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dad1313c-916b-4b91-a4db-580bf731aeea tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:00.072497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dad1313c-916b-4b91-a4db-580bf731aeea tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for user a3eb2115e91e4dd0a8dd73b5c31d908b and project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:00.140319 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f68d6248-077f-490a-9da9-3d4fb0849631 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be" status: 202 len: 0 microversion: 2.1 time: 0.097746 Oct 18 13:26:00.141303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 312/636] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:26:00 2022] DELETE /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:00.148280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.148992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:00.155264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.156135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.157213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.157992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.158543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.159161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.201358 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dad1313c-916b-4b91-a4db-580bf731aeea tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.266509 Oct 18 13:26:00.210745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 325/637] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:25:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 272 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 13:26:00.214811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-453d9ed8-1918-4954-a8a1-74ad36591a82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314da5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.331634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:00.339879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c84e64b-3835-4dd1-ad75-f51c89e4430b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.197340 Oct 18 13:26:00.340926 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 313/638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:00.357656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6554de96-11dc-43d7-b52a-2748e48f377c tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Action: 'create', calling method: .version_select at 0x7fb331688af0>, body: {"keypair": {"name": "tempest-keypair-1740073739", "type": "ssh", "user_id": "66210c012bc3404583b9e2acc5cb4014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBSpkvkUq9aV+tNTHufYzYCmVXfPdLOIzYudK58MWIc5dC9UdtIBNChu2CHrBEGzPrJriar43cr/bN/BinMB6c6KuCi4GxcqHBPq7mDN+ot3BegUv7JYWng9fiKuYz+yA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:00.364983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=12,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:00.378322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6554de96-11dc-43d7-b52a-2748e48f377c tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:00.384986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6554de96-11dc-43d7-b52a-2748e48f377c tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for user a3eb2115e91e4dd0a8dd73b5c31d908b and project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:00.457114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6554de96-11dc-43d7-b52a-2748e48f377c tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.114682 Oct 18 13:26:00.457982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 314/639] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:26:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:26:00.470925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1897473977", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6d7b5541-416a-4285-abcb-d7b8dba55d22"}], "security_groups": [{"name": "tempest-securitygroup--863219992"}], "key_name": "tempest-keypair-1963644730", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:00.518811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-453d9ed8-1918-4954-a8a1-74ad36591a82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be" status: 200 len: 371 microversion: 2.1 time: 0.310754 Oct 18 13:26:00.520492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 326/640] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/os-quota-sets/0091fb2495fa441a83a4fb57049457be => generated 371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:00.526610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f38f0c2-75e5-4913-9aed-633b10d26601 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Calling method '.version_select at 0x7fb3317ee820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.549152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f38f0c2-75e5-4913-9aed-633b10d26601 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-587219080?user_id=66210c012bc3404583b9e2acc5cb4014" status: 200 len: 511 microversion: 2.10 time: 0.026520 Oct 18 13:26:00.549751 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 327/641] 10.222.0.27 () {60 vars in 1337 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-587219080?user_id=66210c012bc3404583b9e2acc5cb4014 => generated 511 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:26:00.565658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c00143d4-c79c-48bd-bdc4-fae0992e1f38 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Action: 'create', calling method: .version_select at 0x7fb3317ee9d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1068871488", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8i8LtXDN8EZt1lzzPulYuUeFNmXEUF9w0waAN7Buy9khjBNfYpcddWmnKLNzgV426R40PHEcK3GYttbJNVqTiSgQadVBlVU/ZgPckk/dUNvDJu/rga54iSqcVQ3ix8CA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:00.586777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c00143d4-c79c-48bd-bdc4-fae0992e1f38 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:00.597115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c00143d4-c79c-48bd-bdc4-fae0992e1f38 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Getting quotas for user a3eb2115e91e4dd0a8dd73b5c31d908b and project c0db162b992a445aa39fa0be90db1666. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:00.622954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] validate_networks() for [('6d7b5541-416a-4285-abcb-d7b8dba55d22', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:00.719841 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c00143d4-c79c-48bd-bdc4-fae0992e1f38 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.159956 Oct 18 13:26:00.720448 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 328/642] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:26:00 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:26:00.741725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f219f293-0127-4cb7-b56e-cb747038897f tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Calling method '.version_select at 0x7fb3314da940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.748258 n-d-858383-13 devstack@n-api.service[121009]: WARNING oslo_db.sqlalchemy.utils [None req-f219f293-0127-4cb7-b56e-cb747038897f tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:26:00.757442 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f219f293-0127-4cb7-b56e-cb747038897f tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=66210c012bc3404583b9e2acc5cb4014" status: 200 len: 725 microversion: 2.10 time: 0.024203 Oct 18 13:26:00.765725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 329/643] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/os-keypairs?user_id=66210c012bc3404583b9e2acc5cb4014 => generated 725 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:26:00.771202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.771836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:00.778517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.779298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.779992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.780876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.781508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.782165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.952826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:00.962429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ba17565-427e-4e2b-a7e5-8fa15edbbaec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.193769 Oct 18 13:26:00.963571 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 330/644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:00.969009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de106248-1a3b-4928-a666-ea3b8cd015c7 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Calling method '.version_select at 0x7fb3314da670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.056452 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de106248-1a3b-4928-a666-ea3b8cd015c7 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1068871488" status: 204 len: 0 microversion: 2.10 time: 0.091507 Oct 18 13:26:01.057158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 331/645] 10.222.0.27 () {60 vars in 1325 bytes} [Tue Oct 18 13:26:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1068871488 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:26:01.062962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7873b684-9367-439f-83d0-f740dc23b802 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314a0430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.071805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:01.072254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:01.072576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:01.072998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:01.073417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:01.083333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.083832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.084297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.085040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.085505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.085942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.103318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:01.108420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for user fa4ca05a0c6a405f8fa014ee06dbcef4 and project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:01.127234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:01.131280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:01.233135 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-92899fb8-d987-43ba-8a95-0ad18dff9b1c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.768286 Oct 18 13:26:01.241168 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 315/646] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:26:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:26:01.246971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5190bc2-fd06-4aba-a2f5-49ed04a6eacf tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Calling method '.version_select at 0x7fb331618310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.265429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7873b684-9367-439f-83d0-f740dc23b802 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.206188 Oct 18 13:26:01.266712 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 332/647] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd/defaults => generated 371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:01.272990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.275410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:01.349157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:01.360082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:01.361867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:01.363528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d80dc28-c85d-4eb8-8874-9950516745e2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1286 microversion: 2.25 time: 0.094896 Oct 18 13:26:01.364442 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 333/648] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:01.369227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.369983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:01.382375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.382877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.383323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.384025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.384489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.384924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.417601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:01.427522 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5190bc2-fd06-4aba-a2f5-49ed04a6eacf tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740073739?user_id=66210c012bc3404583b9e2acc5cb4014" status: 204 len: 0 microversion: 2.10 time: 0.180589 Oct 18 13:26:01.427522 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 316/649] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740073739?user_id=66210c012bc3404583b9e2acc5cb4014 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:26:01.432151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8afb78ca-bfac-4584-976d-3a36000cfc61 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb3315de4c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.504974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8afb78ca-bfac-4584-976d-3a36000cfc61 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e" status: 200 len: 636 microversion: 2.1 time: 0.076864 Oct 18 13:26:01.505531 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 317/650] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e => generated 636 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:01.515506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c00f3c6c-0c66-4975-9630-efe8204abe82 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] Calling method '.version_select at 0x7fb33162baf0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.565992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:01.573769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7fcb7df7-7709-4c7a-82f2-45dddf5834c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.208172 Oct 18 13:26:01.574394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 334/651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:01.579910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-451e17d9-4b8f-4e55-8f82-ba3ea6b75270 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb3314da700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:01.617092 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c00f3c6c-0c66-4975-9630-efe8204abe82 tempest-KeyPairsV210TestJSON-1972730443 tempest-KeyPairsV210TestJSON-1972730443-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587219080?user_id=66210c012bc3404583b9e2acc5cb4014" status: 204 len: 0 microversion: 2.10 time: 0.110511 Oct 18 13:26:01.618213 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 318/652] 10.222.0.27 () {60 vars in 1340 bytes} [Tue Oct 18 13:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587219080?user_id=66210c012bc3404583b9e2acc5cb4014 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:26:01.637223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-451e17d9-4b8f-4e55-8f82-ba3ea6b75270 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:01.643117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-451e17d9-4b8f-4e55-8f82-ba3ea6b75270 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:01.688814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Action: 'update', calling method: .version_select at 0x7fb3316181f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:01.853950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.854823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.855266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.856018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.856454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.856882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.015691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fa83792-69fb-41d5-a733-221dd77f18d1 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710" status: 200 len: 328 microversion: 2.1 time: 0.330062 Oct 18 13:26:02.017414 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 319/653] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:26:01 2022] PUT /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710 => generated 328 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:02.048976 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-451e17d9-4b8f-4e55-8f82-ba3ea6b75270 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.473302 Oct 18 13:26:02.049564 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 335/654] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:01 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:02.054502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.055133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.061274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.061839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.062221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.063536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.064096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.064523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.078841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-833786714", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:02.137060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:02.209194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.219742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb25c859-4909-47a8-a2e1-76fcd0c3bfad tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.169040 Oct 18 13:26:02.220607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 336/655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:02.227191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314a98b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.369990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:02.370525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:02.371079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:02.371634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:02.372141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:02.383503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.384029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.385033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.385787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.386681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.387126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.413122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Getting quotas for project e374527f6eda4730aa116c71d01dfd4b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:02.418850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Getting quotas for user 5c053ac77b3c479da2f3145adb4dfc21 and project e374527f6eda4730aa116c71d01dfd4b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:02.433340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:02.435559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:02.465456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.466302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.466964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.467949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.468652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.470014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.496520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de403502-a1bd-40c4-bd44-c05e305b593d tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710/detail" status: 200 len: 916 microversion: 2.1 time: 0.274520 Oct 18 13:26:02.497127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 337/656] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710/detail => generated 916 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:02.501617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4936b76-d340-4143-9704-86a752dbe6c8 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb3314ffee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.584727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7830a8dd-14ce-405f-8b9b-d070ef709f3b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564649 Oct 18 13:26:02.584727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 320/657] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:02.607053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.607692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.615189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.615776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.616224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.616930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.617564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.617969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.749732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.789371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.791061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.796741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-928433de-b63c-4fd0-856f-e3dc24bdc8d3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1282 microversion: 2.25 time: 0.209540 Oct 18 13:26:02.802795 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 321/658] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:02.805270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a5bbe9b-78d5-4241-a1f9-8e4a27757dea tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.806132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a5bbe9b-78d5-4241-a1f9-8e4a27757dea tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.869438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a5bbe9b-78d5-4241-a1f9-8e4a27757dea tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.876576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a5bbe9b-78d5-4241-a1f9-8e4a27757dea tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1218 microversion: 2.1 time: 0.077640 Oct 18 13:26:02.877137 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 322/659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:02.881659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.882307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.888014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.888499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.888938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.889628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.890110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.890546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.955607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4936b76-d340-4143-9704-86a752dbe6c8 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "DELETE /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.457250 Oct 18 13:26:02.956462 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 338/660] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:26:02 2022] DELETE /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_version => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:02.964946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Action: 'update', calling method: .version_select at 0x7fb33151ec10>, body: {"quota_set": {"ram": "2048"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:03.030108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.032843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.032843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.032843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.033382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.033827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.049951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:03.059522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.068131 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e9eee67-ebd3-4b9b-9123-3da002838468 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.189849 Oct 18 13:26:03.068707 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 323/661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:03.072029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.072508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.072949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.073683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.074169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.074655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.074972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76c6dba1-4c78-49b6-aa7c-fa32a405b852 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb33162bf70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.120882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76c6dba1-4c78-49b6-aa7c-fa32a405b852 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.050831 Oct 18 13:26:03.122439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 324/662] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 37 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:03.133429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a19e5a7f-d3ad-4cdc-b678-8920bac3d1ab tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb33162bee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:03.185031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a19e5a7f-d3ad-4cdc-b678-8920bac3d1ab tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:03.191625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a19e5a7f-d3ad-4cdc-b678-8920bac3d1ab tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:03.210198 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d2fc7e43-cd8c-4f21-aa6b-02c066863844 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710?user_id=ec5034e8553647b5bd6317123a7bc3d2" status: 200 len: 328 microversion: 2.1 time: 0.252087 Oct 18 13:26:03.211295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 339/663] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:26:02 2022] PUT /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710?user_id=ec5034e8553647b5bd6317123a7bc3d2 => generated 328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:03.225462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d004853-831e-4458-971f-2738d71d897f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314a9dc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.462384 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d004853-831e-4458-971f-2738d71d897f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710?user_id=ec5034e8553647b5bd6317123a7bc3d2" status: 200 len: 370 microversion: 2.1 time: 0.241796 Oct 18 13:26:03.466527 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 340/664] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/os-quota-sets/762964e997d24582933fdaa95c234710?user_id=ec5034e8553647b5bd6317123a7bc3d2 => generated 370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:03.483622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.484512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:03.492854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.493484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.494002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.494805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.495560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.496191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.658046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a19e5a7f-d3ad-4cdc-b678-8920bac3d1ab tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.529356 Oct 18 13:26:03.658809 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 325/665] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:03 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:03.668211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-603bf571-1128-4e12-a31c-5cd3f5258c66 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb331639ee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.696299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.704118 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1e330af-0975-4aea-a4ab-6012b7334eaa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.236208 Oct 18 13:26:03.704686 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 341/666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:03.715936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-603bf571-1128-4e12-a31c-5cd3f5258c66 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.050819 Oct 18 13:26:03.723120 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 326/667] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_distro => generated 33 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:03.728298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e77842b-8c1d-4d6f-8530-234e9543ccda tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb3314da8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:03.801155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7e77842b-8c1d-4d6f-8530-234e9543ccda tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:03.807355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7e77842b-8c1d-4d6f-8530-234e9543ccda tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:03.823331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.824288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:03.832201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.832378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.833171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.834090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.834739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.835353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.976376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.989489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.991030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.994257 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23bf5084-b8f9-4d5f-823c-333d77fea2f8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1346 microversion: 2.25 time: 0.173249 Oct 18 13:26:03.994257 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 327/668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:03.999488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.000412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.028998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.029506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.029965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.031063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.032303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.032980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.039308 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e77842b-8c1d-4d6f-8530-234e9543ccda tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.315038 Oct 18 13:26:04.039746 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 342/669] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:03 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:04.056504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05675b64-d417-46f0-8b33-5ee5466ae5a5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb3314da280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.124215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.126550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05675b64-d417-46f0-8b33-5ee5466ae5a5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081418 Oct 18 13:26:04.127113 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 343/670] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:04.132008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.133150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.138700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06848290-1e94-4cc5-8abb-c9e66e4a3110 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1222 microversion: 2.1 time: 0.143464 Oct 18 13:26:04.139905 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 328/671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:04.140026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.152722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.152722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.152722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.152722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.164960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.165055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3662ed77-bf7f-4acf-8a48-68f71a15e633 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb3316399d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:04.226357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3662ed77-bf7f-4acf-8a48-68f71a15e633 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:04.236771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3662ed77-bf7f-4acf-8a48-68f71a15e633 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:04.360330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.371408 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af9a3b51-99c3-4c23-b22b-11eb9c02236a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.242683 Oct 18 13:26:04.372207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 344/672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:04.496445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2847613-3ee4-4086-a493-31d752fd363c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Calling method '.version_select at 0x7fb3314ea9d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.499537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3662ed77-bf7f-4acf-8a48-68f71a15e633 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.339981 Oct 18 13:26:04.499537 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 329/673] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:04 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:04.513289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60335adf-990e-415d-802f-2c47e594e75f tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb331807ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:04.576057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-60335adf-990e-415d-802f-2c47e594e75f tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:04.582827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-60335adf-990e-415d-802f-2c47e594e75f tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:04.585229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:04.816130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2847613-3ee4-4086-a493-31d752fd363c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.332267 Oct 18 13:26:04.824898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 345/674] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd/defaults => generated 371 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:04.830418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.831042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.839062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.839905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.840372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.841255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.842509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.842980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.038923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60335adf-990e-415d-802f-2c47e594e75f tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.533705 Oct 18 13:26:05.043701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 330/675] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:04 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 64 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:05.044600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Action: 'update', calling method: .version_select at 0x7fb3317ea700>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:05.057161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.067668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d7adb4a-5820-4f27-9523-649b7f637a07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.241619 Oct 18 13:26:05.068422 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 346/676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:05.073601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.074306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.081831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.082601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.083649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.085382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.085915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.086855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.308665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.310542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.311031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.311623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.312431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.313458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.313889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.320690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.322850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.324462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5d8dd19-a300-4bb9-836a-738b806bcd11 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.254549 Oct 18 13:26:05.325532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 347/677] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:05.330522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02284e1c-343c-43d4-b191-1d0bdb28dfa3 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb331473040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.385875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02284e1c-343c-43d4-b191-1d0bdb28dfa3 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.057756 Oct 18 13:26:05.386864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 348/678] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 64 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:05.405525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.405525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.407804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.408668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.409118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.409820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.410307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.410734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.502317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.511753 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ff524b1-dd6e-42fc-b260-b3990ed9cf10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1270 microversion: 2.1 time: 0.122100 Oct 18 13:26:05.512344 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 349/679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:05.517064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.517730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.523592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.524160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.524606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.525335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.525800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.526260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.760210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.775984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-52557163-ea01-4262-9c10-9986e603e7db tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.262568 Oct 18 13:26:05.776638 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 350/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:05.782594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0c404472-736d-44ab-85b9-18a6d41ff320 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb3314739d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:05.834756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:05.847677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0c404472-736d-44ab-85b9-18a6d41ff320 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:05.853994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0c404472-736d-44ab-85b9-18a6d41ff320 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:06.323227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0c404472-736d-44ab-85b9-18a6d41ff320 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.544807 Oct 18 13:26:06.324468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 351/681] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:05 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:06.334841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:06.335472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:06.342423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.343371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.344079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.345775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.346681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.347336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.654994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b661825e-fd9c-46e2-bdaf-0b3060dd43f5 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd" status: 200 len: 329 microversion: 2.1 time: 1.613946 Oct 18 13:26:06.655639 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 331/682] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Oct 18 13:26:05 2022] PUT /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd => generated 329 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:06.669677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:06.686585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.687115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.692037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.707171 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] Creating event network-changed:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h2-858383-13 Oct 18 13:26:06.712427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3f454b74-a15d-455f-8456-ac999e1258e2 req-21eb85a7-4a5d-414b-9fa3-fd8d5a0db01e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055636 Oct 18 13:26:06.713539 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 332/683] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:06.721611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1979f339-c393-432a-962d-178d55704ae5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update', calling method: .version_select at 0x7fb3317ea820>, body: {"meta": {"os_version": "alt"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:06.790420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1979f339-c393-432a-962d-178d55704ae5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:06.799238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1979f339-c393-432a-962d-178d55704ae5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:06.891884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:06.900213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82a52daf-9e99-4502-875b-b8dc3ee3a2f9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.569356 Oct 18 13:26:06.903490 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 352/684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:06 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:06.909538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:06.910453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:06.923158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.923657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.924096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.924811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.927089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.928364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.158716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.165854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.167805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.169203 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4f1137f-0c30-4eab-9565-2e5d9d1c922a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.264244 Oct 18 13:26:07.179307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1979f339-c393-432a-962d-178d55704ae5 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.464247 Oct 18 13:26:07.182341 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 333/685] 10.222.0.27 () {60 vars in 1313 bytes} [Tue Oct 18 13:26:06 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata/os_version => generated 31 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:07.185723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:07.186228 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 353/686] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:06 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:07.186608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.191432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Action: 'update', calling method: .version_select at 0x7fb3314a0280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:07.193684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.200360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.200360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.200360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.200360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.200687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.386937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.387467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.387879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.388621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.389113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.389594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.402102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.414509 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-becfaab2-3d3b-49cf-b270-079338d3cf51 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.232858 Oct 18 13:26:07.418178 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 334/687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:07 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:07.423926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:07.425066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.432155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.432651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.433098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.433800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.434289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.434718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.636836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.644579 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b792ce2-9867-48bc-bfa1-24ea1d48a022 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.227311 Oct 18 13:26:07.645143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 335/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:07 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:07.699174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2016250449", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:07.750999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:08.235679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:08.236107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:08.236602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:08.237003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:08.237438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:08.246506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.246997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.247434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.248162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.248619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.249050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.265526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:08.271359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:08.284530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:08.286845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:08.432691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e97c6d6-5a23-4da8-93f3-2b2cdcd92fd3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786501 Oct 18 13:26:08.433522 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 336/689] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:08.444247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-deecaca1-8bbb-4ffe-9841-71907108dd06 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb3315de280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:08.531452 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-deecaca1-8bbb-4ffe-9841-71907108dd06 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.092412 Oct 18 13:26:08.537329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 337/690] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:26:08 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 58 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:08.537329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7a1173-4636-44fa-b442-42c7ba2e5ba0", "tag": "5dbd27d0-ee43-4485-8828-e8fa1b25376f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:08.546809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:UPDATE=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:08.596526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.596526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.596526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.596526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] Creating event network-changed:5dbd27d0-ee43-4485-8828-e8fa1b25376f for instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 on n-h2-858383-13 Oct 18 13:26:08.596526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-05a8d161-17e3-4b2b-8b5c-2d3fcaf81976 req-a1a85fe9-20b5-4b16-999f-63b7eba74f48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053917 Oct 18 13:26:08.598294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 338/691] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:08.598294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:08.598294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:08.600698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.601199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.601650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.602392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.602854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.603392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.842037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:08.850357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd4d6099-cb5b-4a94-8cb8-120a16f9334e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.261190 Oct 18 13:26:08.851289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 339/692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:08 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:08.856391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:08.857269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:08.864300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.865138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.865860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.866787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.867473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.867999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.086545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.095589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.097029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.098189 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e24ddc3-b355-4f5f-8261-01278368c472 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.245629 Oct 18 13:26:09.098745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 340/693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:08 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:09.102986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:09.103613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:09.109214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.110367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.110851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.111531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.111984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.112408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.242441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.247665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:09.253449 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9245481a-691c-40dc-a2e4-030e86206003 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.152513 Oct 18 13:26:09.254248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 341/694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:09.259288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98b048bd-e9db-4562-b0da-baf98709d149 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:09.259950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98b048bd-e9db-4562-b0da-baf98709d149 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:09.293183 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b6e8af5-409c-4e9a-b52a-135bf6097d8c tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd" status: 200 len: 329 microversion: 2.1 time: 2.105759 Oct 18 13:26:09.294372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 354/695] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Oct 18 13:26:07 2022] PUT /compute/v2.1/os-quota-sets/c2ebe6bccec0417c8e57d59162dad1cd => generated 329 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:09.299951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-490e8251-072d-43ca-a494-b8612657ceb2 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'update_all', calling method: .version_select at 0x7fb331490e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:09.322956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-98b048bd-e9db-4562-b0da-baf98709d149 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.330134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98b048bd-e9db-4562-b0da-baf98709d149 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1217 microversion: 2.1 time: 0.074641 Oct 18 13:26:09.330705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 342/696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:09.338542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:09.338542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:09.344877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.345362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.345793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.346504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.347114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.347544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.386286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-490e8251-072d-43ca-a494-b8612657ceb2 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:09.392253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-490e8251-072d-43ca-a494-b8612657ceb2 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:09.499440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.507420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2988fb9b-bd04-48c6-8f3f-d7faaa13dd2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.175606 Oct 18 13:26:09.507985 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 343/697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:09.727999 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-490e8251-072d-43ca-a494-b8612657ceb2 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.430954 Oct 18 13:26:09.727999 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 355/698] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:09 2022] PUT /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 61 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:09.737045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27bec666-29ba-454a-9dd7-7a80763e5b1d tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Action: 'create', calling method: .version_select at 0x7fb331807ca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:09.793183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27bec666-29ba-454a-9dd7-7a80763e5b1d tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:09.798582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27bec666-29ba-454a-9dd7-7a80763e5b1d tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Getting quotas for user 19343438b3424ea0afd623dfab43f5d5 and project 66130c964c634dab874f3cacc09c5db6. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:09.877529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:09.877529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:09.884909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.885408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.886030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.887283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.888437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.889142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.090756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.110265 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-288c4b1f-0e61-4c17-91c3-da8824e1d40a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.238620 Oct 18 13:26:10.110854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 356/699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:10.128544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.129228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.135808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.136980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.137514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.138385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.138936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.139436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.237975 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27bec666-29ba-454a-9dd7-7a80763e5b1d tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "POST /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.505375 Oct 18 13:26:10.239561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 344/700] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 18 13:26:09 2022] POST /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 85 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:10.248963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4c7d5a1-2265-48c1-b0d5-ac7b1bf75953 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] Calling method '.version_select at 0x7fb3316394c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.327451 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4c7d5a1-2265-48c1-b0d5-ac7b1bf75953 tempest-ImagesMetadataTestJSON-520673167 tempest-ImagesMetadataTestJSON-520673167-project] 10.222.0.27 "GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.082658 Oct 18 13:26:10.328605 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 345/701] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/images/d92c2ecd-cded-4c0b-888f-d8756e38294e/metadata => generated 85 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:10.342460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.343314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.365758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.369162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.371949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.372996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.373139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.377190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.378443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.385683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.387510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.388763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1f4e2c0-70f0-4f5a-9348-bf524732b80c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.265594 Oct 18 13:26:10.389357 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 357/702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:10.395906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.396518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.404511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.405000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.405886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.408139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.408613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.409047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.500107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.509204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-56a6bb0e-8339-41a2-a169-373f997a1d9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1269 microversion: 2.1 time: 0.118560 Oct 18 13:26:10.509971 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 358/703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:10.532297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.532935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.539779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.541887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.541887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.541887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.543035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.543525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.699646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.708470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0781885f-d1a4-4b06-8c73-bb3c64726ad1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.180898 Oct 18 13:26:10.709079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 359/704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:10.779595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.789701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e167f194-382c-4e59-9f14-6941cb05ecda tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.459586 Oct 18 13:26:10.790665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 346/705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:11.378293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.378293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.378293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.378293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.380459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.380459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.380459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.380459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.381235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.381235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15687125-101d-4520-ba7d-29f45bd82e8b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.147275 Oct 18 13:26:11.381235 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 360/706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:11.413927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.414601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.421299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.421787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.422260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.422954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.423412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.423886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.533229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.534431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.542910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.543701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.545723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.547322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.548036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.548551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.616809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.619061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:11.631709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e47d1011-69da-4ca6-acc9-b6a0f6d04db3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1277 microversion: 2.1 time: 0.096570 Oct 18 13:26:11.631709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 361/707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:11.664133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.674881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.676699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.678036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58b4561f-7e45-4b38-b751-2386a3f48a16 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.267769 Oct 18 13:26:11.678934 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 347/708] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:11.735480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.736397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.745774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.746295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.746913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.747773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.748384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.748963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.812784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.817253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.817253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=17 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:11.820837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.821583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.822263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.823174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.824047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.824671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.910120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.918383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3358df24-6a03-4556-897a-6ae16d9a4664 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.186646 Oct 18 13:26:11.919459 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 362/709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:12.024615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:12.034838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6bf4ede-3946-4275-8afc-ad4c088984e1 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.225846 Oct 18 13:26:12.037506 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 348/710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:12.386915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:12.388977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:12.396742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.398784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.399429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.400705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.401708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.402446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.577290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "name": "network-vif-plugged", "status": "completed", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:12.595255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.596108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.596803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.610411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] Creating event network-vif-plugged:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h2-858383-13 Oct 18 13:26:12.616027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9233ff16-d746-453e-820a-358ba21b0f69 req-4f8abc0d-0eba-4a78-8f3d-a351a0ee6d41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052322 Oct 18 13:26:12.616714 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 349/711] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:12.655506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:12.656657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:12.665464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.670007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.670007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.670007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.670007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.670527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.682148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:12.693155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-928eb5b3-b7fe-48f4-b8df-ab6b2e2e863a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.312246 Oct 18 13:26:12.694330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 363/712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:12 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:12.714632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:12.715542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:12.722462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.723199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.723938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.724947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.725528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.726176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.004751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.010710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b50e818a-22d2-4a47-ae8a-e4af467457fb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.361200 Oct 18 13:26:13.029459 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 350/713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:12 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:13.036983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:13.037856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.042487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.046263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.047018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.047650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.048853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.049478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.050105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.051209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.052667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.074413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf072ea7-ca4b-472b-bd3f-f64f593fab62 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.348866 Oct 18 13:26:13.074413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 364/714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:12 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:13.074413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:13.074413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.074413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.074947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.074947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.074947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.074947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.075347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.270473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.281104 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4774c018-cdcf-4104-8ba3-3c46a0ad80b9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.221409 Oct 18 13:26:13.281685 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 365/715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:13 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:13.338892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.351502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24aabb2d-466e-4d68-b98b-f0592088a605 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.323090 Oct 18 13:26:13.352270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 351/716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:13 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:13.722288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:13.723185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.729037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.729528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.729963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.730680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.731122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.731542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.928308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.938924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9253e789-5096-48a6-9c5e-158525f7b490 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.221701 Oct 18 13:26:13.940197 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 366/717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:13 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.043269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.043900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.053851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.054688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.055153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.055887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.056362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.056930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.085452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.089898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.093133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.093802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.094433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.095959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.096758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.097186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.277569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.287415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.288881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.290009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ff0ca69-deaf-474c-b662-7c9c0e3a5e41 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1411 microversion: 2.25 time: 0.208585 Oct 18 13:26:14.290704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 367/718] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1411 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:14.298049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d14076-e2e9-4374-b7c3-81beb54bdf78", "tag": "ce5b1d38-c9c4-4e93-b768-2534aa44c142"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:14.303205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.312677 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ee53fbb-b69c-4d75-b5bf-56b1e96da5b0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.272904 Oct 18 13:26:14.316125 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 352/719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.319465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.319465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.319465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.332441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] Creating event network-changed:ce5b1d38-c9c4-4e93-b768-2534aa44c142 for instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 on n-h1-858383-13 Oct 18 13:26:14.336092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.337155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.340107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6c5fdec8-5430-41a3-89da-c2ee7b266932 req-a1cc455b-8106-4d14-90f5-e6ecbca106ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047777 Oct 18 13:26:14.340770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 368/720] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:14.346750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.347468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.348221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.351875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.352359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.352796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.380024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.383512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.393289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.397883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.398594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.399527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.400152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.400829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.580074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.590337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35edc0b3-fe79-4f53-a83c-d1893f0bd926 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.272845 Oct 18 13:26:14.590928 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 353/721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.621761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.631426 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21847299-a782-4d81-90d7-389311e45a04 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.256069 Oct 18 13:26:14.632450 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 369/722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.643896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7a1173-4636-44fa-b442-42c7ba2e5ba0", "name": "network-vif-plugged", "status": "completed", "tag": "5dbd27d0-ee43-4485-8828-e8fa1b25376f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:14.660322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.666708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.666708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.683053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] Creating event network-vif-plugged:5dbd27d0-ee43-4485-8828-e8fa1b25376f for instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 on n-h2-858383-13 Oct 18 13:26:14.690443 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-26fb7582-20e7-4761-9b78-cde60e8f6077 req-090f5b45-c6da-465a-ad55-3f04b0641a95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051307 Oct 18 13:26:14.691444 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 354/723] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:14.961816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.962549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.969908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.970564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.971096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.971974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.972503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.972948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.113857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.121638 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63320663-9e09-4655-9e0e-132a121d143f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.163593 Oct 18 13:26:15.122243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 370/724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:15.254667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Action: 'update', calling method: .version_select at 0x7fb331688ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:15.258186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.258691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.259126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.266471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.266940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.267380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.274019 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] HTTP exception thrown: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Request method failure captured: Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 HTTP/1.1 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 56 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTql3b3Lie-O7d4GZynlETp-7xvXYqDEze726C7S7hCKicaKklgsIXWxmR99FHfatfzOXdUXjSWIcNF3V5NVkk9JhWixnMrr7aWRqxDZZTd2Er2XZaf1nWbvsu5McLgVArxPRHpy1DVm43uLvazXM_lB3M5wAt_J6LfS_SKOU8gwtWR0 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:26:15.276070 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 17445340347f40cda0fe8d704a0a4b7c Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:26:15.277757 n-d-858383-13 devstack@n-api.service[121010]: exception: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e50179b1-93b4-4a9b-925a-a6a4d70e6789', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.278841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.280509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Returning 404 to user: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae1d4055-1278-4cee-b98b-a5abe0414c26 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789" status: 404 len: 110 microversion: 2.53 time: 0.137212 Oct 18 13:26:15.282573 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 355/725] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 18 13:26:15 2022] PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 => generated 110 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:26:15.287835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Action: 'update', calling method: .version_select at 0x7fb3316bce50>, body: {"status": "disabled"} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:15.291308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.291806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.292369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.300328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.300804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] HTTP exception thrown: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Request method failure captured: Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 HTTP/1.1 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 22 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql3b3Lie-O7d4GZynlETp-7xvXYqDEze726C7S7hCKicaKklgsIXWxmR99FHfatfzOXdUXjSWIcNF3V5NVkk9JhWixnMrr7aWRqxDZZTd2Er2XZaf1nWbvsu5McLgVArxPRHpy1DVm43uLvazXM_lB3M5wAt_J6LfS_SKOU8gwtWR0 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:26:15.313253 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 17445340347f40cda0fe8d704a0a4b7c Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: {"status": "disabled"} Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: exception: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.314893 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e50179b1-93b4-4a9b-925a-a6a4d70e6789', 'body': {'status': 'disabled'}} Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.315767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:15.316942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:15.318140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.318140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.318140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Returning 404 to user: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:15.318140 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61c6c9eb-42cc-4687-8d80-8af59adc6dd3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789" status: 404 len: 110 microversion: 2.53 time: 0.030385 Oct 18 13:26:15.318140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 371/726] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 18 13:26:15 2022] PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:26:15.322564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.323300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.324135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Action: 'update', calling method: .version_select at 0x7fb3314da040>, body: {"status": "enabled"} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:15.327553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.328083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.328535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.329607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.330148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.330601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.331505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.331782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.332213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.334183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.338894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.338894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.339963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] HTTP exception thrown: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Request method failure captured: Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 HTTP/1.1 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 21 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql3b3Lie-O7d4GZynlETp-7xvXYqDEze726C7S7hCKicaKklgsIXWxmR99FHfatfzOXdUXjSWIcNF3V5NVkk9JhWixnMrr7aWRqxDZZTd2Er2XZaf1nWbvsu5McLgVArxPRHpy1DVm43uLvazXM_lB3M5wAt_J6LfS_SKOU8gwtWR0 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:26:15.341562 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c969d0d64484e6a84a392b374a6af57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 7c969d0d64484e6a84a392b374a6af57 Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668 Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 17445340347f40cda0fe8d704a0a4b7c Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: {"status": "enabled"} Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: exception: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.343154 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e50179b1-93b4-4a9b-925a-a6a4d70e6789', 'body': {'status': 'enabled'}} Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.348702 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:15.350160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:15.351554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. Oct 18 13:26:15.351554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:15.351554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Returning 404 to user: Service e50179b1-93b4-4a9b-925a-a6a4d70e6789 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:15.351554 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d024957-b17a-4c70-8560-8752da10359b tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789" status: 404 len: 110 microversion: 2.53 time: 0.022362 Oct 18 13:26:15.351554 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 372/727] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Oct 18 13:26:15 2022] PUT /compute/v2.1/os-services/e50179b1-93b4-4a9b-925a-a6a4d70e6789 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:26:15.352320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.352940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.359441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.361663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.361663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.362007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.362392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.362822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.468034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.477362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.478857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.480017 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52d6fc60-82e1-40b6-8503-1046e4b2dbb3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1606 microversion: 2.25 time: 0.163241 Oct 18 13:26:15.480654 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 356/728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1606 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:15.486594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.491327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.491327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.491327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.492353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.492818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.493251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.496940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.505917 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bce86efd-75dd-41ec-ad73-631b80417c3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.161397 Oct 18 13:26:15.506823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 373/729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:15.512085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.512580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.517743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2882101-b8b3-4c52-bd16-ccfd645f24de tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035187 Oct 18 13:26:15.518577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 357/730] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:15.519319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.519781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.520348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.521056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.521623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.521986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.531058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.535629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.536333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.536783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.537524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.538027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.538527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.563014 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cae6fc2a-291e-4729-be82-b7cb48774473 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035645 Oct 18 13:26:15.563651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 358/731] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:15.576531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.580581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.581076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.581521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.582293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.582760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.583193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.602553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7aa3a684-2fc6-429e-a1df-0305a3779fba tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.094170 Oct 18 13:26:15.603152 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 374/732] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:26:15.610699 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26aad2f5-d2aa-4ea0-8b43-204b9a578f98 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037096 Oct 18 13:26:15.610954 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 359/733] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:15.623473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.624927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.625220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.627165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.627652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.628426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.628832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.629332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.629784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.631468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.632128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.632574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.633259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.633772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.634164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.654019 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f73e678d-3395-4dfe-b9f5-443a2125a438 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034055 Oct 18 13:26:15.654665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 360/734] 10.222.0.27 () {60 vars in 1237 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services?host=n-d-858383-13&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:15.663352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.665707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.671320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.671815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.672288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.673132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.673596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.674027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.803670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.818019 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1eb63f8-bbe0-4552-ab82-8a808b74531a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1318 microversion: 2.1 time: 0.203104 Oct 18 13:26:15.830324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 375/735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:15.838036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.843818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.844465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.845745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.846764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.847344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.848097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.874263 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2398d75d-7e78-4244-b64e-e1f42ee229e3 tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.042228 Oct 18 13:26:15.874747 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 376/736] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:15.888140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.892484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.892975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.893425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.894189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.894651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.895086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.919716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb97a24e-1645-4cd7-aab2-788902036adb tempest-ServicesAdminNegativeV253TestJSON-1570225668 tempest-ServicesAdminNegativeV253TestJSON-1570225668-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.035227 Oct 18 13:26:15.920316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 377/737] 10.222.0.27 () {60 vars in 1239 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:16.041370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.041785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cac89f78-005f-463c-95dd-7a8042b5f155 tempest-ServicesAdminNegativeV253TestJSON-178002052 tempest-ServicesAdminNegativeV253TestJSON-178002052-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.046469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cac89f78-005f-463c-95dd-7a8042b5f155 tempest-ServicesAdminNegativeV253TestJSON-178002052 tempest-ServicesAdminNegativeV253TestJSON-178002052-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f5af5f9215be43d1a820d28dfb777b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d37b5e72d4311a49f6ef5c0746f17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cac89f78-005f-463c-95dd-7a8042b5f155 tempest-ServicesAdminNegativeV253TestJSON-178002052 tempest-ServicesAdminNegativeV253TestJSON-178002052-project] Request method failure captured: Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql2SYN6i55m2bXvsKJjTeuxwDpq76uIlcln9zjkyvCFMvtK8SWvYUA44DGLlmbmB9BkcOPDqAFXaStpKNYV3Tv13lChFRKHltkACYOEJFFgb76FIjnnU2xPc-cngJsedn6I6ZjrVlprVqoB2TCfDXvQv14QsP9quB28ZNSIt7aPnPU Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2c6d37b5e72d4311a49f6ef5c0746f17 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-178002052 Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:16.048485 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2c6d37b5e72d4311a49f6ef5c0746f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2c6d37b5e72d4311a49f6ef5c0746f17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2c6d37b5e72d4311a49f6ef5c0746f17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2c6d37b5e72d4311a49f6ef5c0746f17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-178002052 Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2c6d37b5e72d4311a49f6ef5c0746f17 Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-178002052 Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServicesAdminNegativeV253TestJSON-178002052-project Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: f5af5f9215be43d1a820d28dfb777b2d Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-178002052-project Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:26:16.050163 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:26:16.051787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:26:16.053122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:16.055321 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9363062a-4474-4d7a-badd-0e06168198e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1476 microversion: 2.1 time: 0.392964 Oct 18 13:26:16.055321 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 361/738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:16.065956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cac89f78-005f-463c-95dd-7a8042b5f155 tempest-ServicesAdminNegativeV253TestJSON-178002052 tempest-ServicesAdminNegativeV253TestJSON-178002052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:16.067092 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cac89f78-005f-463c-95dd-7a8042b5f155 tempest-ServicesAdminNegativeV253TestJSON-178002052 tempest-ServicesAdminNegativeV253TestJSON-178002052-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.138464 Oct 18 13:26:16.070495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 378/739] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 140 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:26:16.145695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.146403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:16.153313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.153874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.154399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.155346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.155926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.156422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.529624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.530272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:16.537668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.538209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.538657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.539365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.539827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.540262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.718295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.728642 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b479a3c5-0670-465f-b43f-1a082cdd8732 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.202839 Oct 18 13:26:16.729874 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 379/740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:16.810833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.822301 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bb4821e-2c7c-4a83-afbe-20ac93209199 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1498 microversion: 2.1 time: 0.681083 Oct 18 13:26:16.824355 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 362/741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1498 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:16.846711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.847147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:16.854402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.854901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.855346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.859415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.860116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.861475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e837d1b9-8f8b-4b15-a269-9c441a877d75 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33167b820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.861799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.919246 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e837d1b9-8f8b-4b15-a269-9c441a877d75 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63" status: 200 len: 661 microversion: 2.1 time: 0.062237 Oct 18 13:26:16.926786 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 363/742] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:16.937879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3432f376-4bbe-4518-9fe0-00536a41f2c1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3315edc10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.986381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3432f376-4bbe-4518-9fe0-00536a41f2c1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63" status: 200 len: 661 microversion: 2.1 time: 0.052860 Oct 18 13:26:17.004175 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 364/743] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63 => generated 661 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:17.080269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.081176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.089514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.098803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.103133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.113828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.118369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.118496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-deafd671-c8bf-4540-ba21-fe857af2ce79 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1468 microversion: 2.1 time: 0.276078 Oct 18 13:26:17.119273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.120399 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 380/744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:17.122476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.379912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-715006868", "block_migration": true, "disk_over_commit": false}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:17.385125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.394135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.394778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.395518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.396487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.397246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.398571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.418825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.426105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lazy-loading 'flavor' on Instance uuid de7a1173-4636-44fa-b442-42c7ba2e5ba0 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:17.430879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9bb4a616-1b8d-4e99-898d-e437eaff56a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1475 microversion: 2.1 time: 0.356510 Oct 18 13:26:17.431740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 365/745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1475 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:17.447098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Going to try to live migrate instance to tempest-host-715006868 {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:26:17.455584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] HTTP exception thrown: Compute host tempest-host-715006868 could not be found. Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Request method failure captured: Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0/action HTTP/1.1 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 106 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlpa399tgXUUqpr_LCYG8p5pzw5fQiPWb_XJM_PgqiuPTBvn8QjlHvidm8GDes-_J1mtHyPdnEc-BIZWzBN07YeywZvKUEG0p0K90APNjP8GVdZNXEkvi1UtP6DQo0EeRe2wWkfo4f0vSSZHAHuYRNsrN4JieWVQ4VinYDE4BYZe0w Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b25d3a45355e49bbad1b29ce5ffe0200 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:26:17.459609 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b25d3a45355e49bbad1b29ce5ffe0200 Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveMigrationNegativeTest-1587692244-project-admin Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 77e60de7885e4927bffa684043f7d19c Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveMigrationNegativeTest-1587692244-project-admin Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: {"os-migrateLive": {"host": "tempest-host-715006868", "block_migration": true, "disk_over_commit": false}} Oct 18 13:26:17.461165 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: exception: Compute host tempest-host-715006868 could not be found. Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'de7a1173-4636-44fa-b442-42c7ba2e5ba0', 'body': {'os-migrateLive': {'host': 'tempest-host-715006868', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:17.462126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-715006868 could not be found. Oct 18 13:26:17.463561 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-715006868 could not be found. Oct 18 13:26:17.465427 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-715006868 could not be found. Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Returning 400 to user: Compute host tempest-host-715006868 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5c2cb6f-b379-4a48-bde0-9cead9eb597d tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0/action" status: 400 len: 99 microversion: 2.1 time: 0.320973 Oct 18 13:26:17.468604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 381/746] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 18 13:26:17 2022] POST /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0/action => generated 99 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:17.474511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.474511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.480247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.481669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.481669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.481921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.482357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.482788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.512723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "name": "network-vif-unplugged", "status": "completed", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:17.527736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.528524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.528985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.542488 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Creating event network-vif-unplugged:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h2-858383-13 Oct 18 13:26:17.552806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] Instance 7278cff0-11bf-476d-834c-be5d3089da95 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:26:17.565945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e722c7ea-6816-420b-ae8b-3ad9f04ad829 req-538d2a4c-8abd-4a02-9161-311d1eb432af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056896 Oct 18 13:26:17.567184 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 382/747] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:17.756831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.757535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.767429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.769766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.770333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.773407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.774227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.774877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.775632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.780002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38c69b60-0dd3-43eb-9d56-bc06eb1d9243 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1468 microversion: 2.1 time: 0.310889 Oct 18 13:26:17.781237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:17.782620 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 366/748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:17.852939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.855569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.866747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.867225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.868382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.869214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.869778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.870399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.059879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.076407 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6953130-ff07-45d6-bf94-2807e5d0e853 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.324059 Oct 18 13:26:18.093245 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 383/749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:18.102760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2112990158", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:18.183491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:18.259837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.299493 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e7a9771-2c48-402b-8b8b-bc27a15d878d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 200 len: 1475 microversion: 2.1 time: 0.453835 Oct 18 13:26:18.300097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 367/750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 1475 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:18.323628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2087957810"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:18.328942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.346217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.346826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.347996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.349002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.351899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.355627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.366043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.534241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:18.538387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:18.538387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:18.538387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:18.538387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:18.568641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.569142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.569587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.570353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.570818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.571252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.614592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Getting quotas for project e374527f6eda4730aa116c71d01dfd4b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:18.624752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Getting quotas for user 5c053ac77b3c479da2f3145adb4dfc21 and project e374527f6eda4730aa116c71d01dfd4b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:18.644843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=6,nova_api:INSERT=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.654190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:18.657624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:18.887311 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f52c067-4ee4-4117-97db-24e661c31cd8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792494 Oct 18 13:26:18.891395 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 384/751] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:18.908638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.909698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.936522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.937028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.937644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.939050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.940767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.941412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.988078 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b983ccd-5b45-46d3-ac50-da57854a5961 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd/action" status: 202 len: 0 microversion: 2.1 time: 0.665537 Oct 18 13:26:18.990073 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 368/752] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:18 2022] POST /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:26:19.005988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba1c87c4-f0a8-4484-b785-fb4b97c0f61b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.009475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba1c87c4-f0a8-4484-b785-fb4b97c0f61b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.185632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.192355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba1c87c4-f0a8-4484-b785-fb4b97c0f61b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.194100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b580b209-8476-4648-bc69-41f3b13b6b2e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1475 microversion: 2.1 time: 0.299160 Oct 18 13:26:19.194669 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 385/753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.208007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da9daf64-0056-4d8c-aa05-fe15f380458f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3313f60d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.217140 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba1c87c4-f0a8-4484-b785-fb4b97c0f61b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1219 microversion: 2.1 time: 0.225176 Oct 18 13:26:19.242831 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 369/754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.263391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.265701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.276132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.278345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.279049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.294197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.301275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.301275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.319295 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da9daf64-0056-4d8c-aa05-fe15f380458f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.122018 Oct 18 13:26:19.327743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 386/755] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.377087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7bc90c84-1a72-455b-80b6-e3734d271fde tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3313f6670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.436347 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7bc90c84-1a72-455b-80b6-e3734d271fde tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8" status: 200 len: 662 microversion: 2.1 time: 0.062918 Oct 18 13:26:19.442694 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 387/756] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:19.478964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-84394ee5-5162-4880-b67f-3c9842e639fc tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3313f6790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.543524 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-84394ee5-5162-4880-b67f-3c9842e639fc tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8" status: 200 len: 662 microversion: 2.1 time: 0.082295 Oct 18 13:26:19.544319 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 388/757] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:19.833706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}, {"name": "network-changed", "server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:19.856674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.861026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.861737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.893154 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Creating event network-changed:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h2-858383-13 Oct 18 13:26:19.895977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Creating event network-changed:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h2-858383-13 Oct 18 13:26:19.909438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] Instance 7278cff0-11bf-476d-834c-be5d3089da95 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:26:19.952575 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1bd52cfb-3400-44f2-968b-89a816ff5a83 req-a647b35c-a064-4e5c-9cea-e06c0cecbfb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.129167 Oct 18 13:26:19.953373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 389/758] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:20.075542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:20.094289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-334460ac-79a2-476f-8420-37f7304dc5f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.842152 Oct 18 13:26:20.094289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 370/759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:20.221411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:20.222756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:20.229708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.230273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.231889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.232637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.233335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.233991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.248221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:20.249161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:20.259554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.271297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.271297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.271297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.271297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.271861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.329129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:20.337116 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb5b7753-17c7-4087-a882-1c644309d95b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1223 microversion: 2.1 time: 0.095987 Oct 18 13:26:20.337984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 371/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:20 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:20.342712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47c6c9bf-235f-44d5-91bf-b1612da2985c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3315b38b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:20.393391 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47c6c9bf-235f-44d5-91bf-b1612da2985c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.054105 Oct 18 13:26:20.402454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 372/761] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:20 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:20.638976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:20.652130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8641572-3fec-4c75-b45b-4a5e890040b1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1475 microversion: 2.1 time: 0.436225 Oct 18 13:26:20.653439 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 390/762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:20 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:20.982729 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af6f21a2-6207-4081-97c7-bc2052402c17 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.148404 Oct 18 13:26:20.983292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 373/763] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:26:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:26:20.992689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3546b9a0-a4b2-4b16-979b-733520c7aad8 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Calling method '.version_select at 0x7fb3313f6280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.026696 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3546b9a0-a4b2-4b16-979b-733520c7aad8 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] HTTP exception thrown: Image not found. Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3546b9a0-a4b2-4b16-979b-733520c7aad8 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Request method failure captured: Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql8oM4Axjvc2Pf1fA0r75kmMj6h_Th4h4NkwDp-bd8G4hVde7o4L1ZVNiiws3CnubmYScvKAO8FX1hoQathShCyfg9a-FrkLYesCodMOxD3cdrzvt82CMhozXVNjIM4vTkh-Dhtnxqv3Db0gyP4X2FvrEPEsEBQOUxL3ZAP9NNFFoE Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:21.037378 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5507f20b83274556b0a37641ef9e097b Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '-1'} Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:21.038915 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.039953 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:21.041322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3546b9a0-a4b2-4b16-979b-733520c7aad8 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3546b9a0-a4b2-4b16-979b-733520c7aad8 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.054085 Oct 18 13:26:21.048465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 391/764] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:26:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:21.054429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c163249-6916-475c-b604-4363b1c62900 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Calling method '.version_select at 0x7fb33167b0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.076494 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2c163249-6916-475c-b604-4363b1c62900 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] HTTP exception thrown: Image not found. Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c163249-6916-475c-b604-4363b1c62900 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Request method failure captured: Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/33b75ae2-4397-4081-9d10-51114b9b5b3j HTTP/1.1 Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTql8oM4Axjvc2Pf1fA0r75kmMj6h_Th4h4NkwDp-bd8G4hVde7o4L1ZVNiiws3CnubmYScvKAO8FX1hoQathShCyfg9a-FrkLYesCodMOxD3cdrzvt82CMhozXVNjIM4vTkh-Dhtnxqv3Db0gyP4X2FvrEPEsEBQOUxL3ZAP9NNFFoE Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:26:21.081621 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5507f20b83274556b0a37641ef9e097b Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '33b75ae2-4397-4081-9d10-51114b9b5b3j'} Oct 18 13:26:21.083181 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 33b75ae2-4397-4081-9d10-51114b9b5b3j to delete Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.084149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33b75ae2-4397-4081-9d10-51114b9b5b3j could not be found. Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:21.085517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c163249-6916-475c-b604-4363b1c62900 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:21.086853 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c163249-6916-475c-b604-4363b1c62900 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/33b75ae2-4397-4081-9d10-51114b9b5b3j" status: 404 len: 62 microversion: 2.1 time: 0.033116 Oct 18 13:26:21.088383 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 374/765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] DELETE /compute/v2.1/images/33b75ae2-4397-4081-9d10-51114b9b5b3j => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:21.093365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8f26c08-60a8-438b-9365-d08f7237df87 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Calling method '.version_select at 0x7fb331369430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.115866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.118333 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d8f26c08-60a8-438b-9365-d08f7237df87 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] HTTP exception thrown: Image not found. Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8f26c08-60a8-438b-9365-d08f7237df87 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Request method failure captured: Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/0fd07e84-9f86-4b52-a99a-e3e45c0a2c141 HTTP/1.1 Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql8oM4Axjvc2Pf1fA0r75kmMj6h_Th4h4NkwDp-bd8G4hVde7o4L1ZVNiiws3CnubmYScvKAO8FX1hoQathShCyfg9a-FrkLYesCodMOxD3cdrzvt82CMhozXVNjIM4vTkh-Dhtnxqv3Db0gyP4X2FvrEPEsEBQOUxL3ZAP9NNFFoE Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:21.120088 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5507f20b83274556b0a37641ef9e097b Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0fd07e84-9f86-4b52-a99a-e3e45c0a2c141'} Oct 18 13:26:21.121592 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0fd07e84-9f86-4b52-a99a-e3e45c0a2c141 to delete Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.127511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fd07e84-9f86-4b52-a99a-e3e45c0a2c141 could not be found. Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:21.128865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8f26c08-60a8-438b-9365-d08f7237df87 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:21.133921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8f26c08-60a8-438b-9365-d08f7237df87 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/0fd07e84-9f86-4b52-a99a-e3e45c0a2c141" status: 404 len: 62 microversion: 2.1 time: 0.032022 Oct 18 13:26:21.135050 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 392/766] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:21 2022] DELETE /compute/v2.1/images/0fd07e84-9f86-4b52-a99a-e3e45c0a2c141 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:21.135145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.135245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0b5bcb4-2e49-4f72-baf6-f6ad609e5525 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Calling method '.version_select at 0x7fb3313f6160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.137217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.137767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.138238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.138945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.139405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.139837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.166179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b0b5bcb4-2e49-4f72-baf6-f6ad609e5525 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] HTTP exception thrown: Image not found. Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0b5bcb4-2e49-4f72-baf6-f6ad609e5525 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Request method failure captured: Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/tempest-invalid-1910143241 HTTP/1.1 Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql8oM4Axjvc2Pf1fA0r75kmMj6h_Th4h4NkwDp-bd8G4hVde7o4L1ZVNiiws3CnubmYScvKAO8FX1hoQathShCyfg9a-FrkLYesCodMOxD3cdrzvt82CMhozXVNjIM4vTkh-Dhtnxqv3Db0gyP4X2FvrEPEsEBQOUxL3ZAP9NNFFoE Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:21.167954 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5507f20b83274556b0a37641ef9e097b Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'tempest-invalid-1910143241'} Oct 18 13:26:21.169226 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1910143241 to delete Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.169966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1910143241 could not be found. Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:21.171069 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0b5bcb4-2e49-4f72-baf6-f6ad609e5525 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:21.175338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b0b5bcb4-2e49-4f72-baf6-f6ad609e5525 tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-1910143241" status: 404 len: 62 microversion: 2.1 time: 0.038241 Oct 18 13:26:21.176766 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 393/767] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:26:21 2022] DELETE /compute/v2.1/images/tempest-invalid-1910143241 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:21.178744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3c99119-eefc-4ee3-8b5f-af33a1f56b9a tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Calling method '.version_select at 0x7fb3313693a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.203001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a3c99119-eefc-4ee3-8b5f-af33a1f56b9a tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] HTTP exception thrown: Image not found. Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3c99119-eefc-4ee3-8b5f-af33a1f56b9a tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Request method failure captured: Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/28e1f0e9-0c23-42fc-ad38-06d50d67043c HTTP/1.1 Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql8oM4Axjvc2Pf1fA0r75kmMj6h_Th4h4NkwDp-bd8G4hVde7o4L1ZVNiiws3CnubmYScvKAO8FX1hoQathShCyfg9a-FrkLYesCodMOxD3cdrzvt82CMhozXVNjIM4vTkh-Dhtnxqv3Db0gyP4X2FvrEPEsEBQOUxL3ZAP9NNFFoE Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:21.205355 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bb6d67967fa4a17a6f408db6b3703ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3bb6d67967fa4a17a6f408db6b3703ac Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-356037990 Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5507f20b83274556b0a37641ef9e097b Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-356037990-project Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '28e1f0e9-0c23-42fc-ad38-06d50d67043c'} Oct 18 13:26:21.206907 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28e1f0e9-0c23-42fc-ad38-06d50d67043c to delete Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.207804 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28e1f0e9-0c23-42fc-ad38-06d50d67043c could not be found. Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:21.209120 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3c99119-eefc-4ee3-8b5f-af33a1f56b9a tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:21.210640 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3c99119-eefc-4ee3-8b5f-af33a1f56b9a tempest-ImagesDeleteNegativeTestJSON-356037990 tempest-ImagesDeleteNegativeTestJSON-356037990-project] 10.222.0.27 "DELETE /compute/v2.1/images/28e1f0e9-0c23-42fc-ad38-06d50d67043c" status: 404 len: 62 microversion: 2.1 time: 0.031813 Oct 18 13:26:21.211763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 394/768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] DELETE /compute/v2.1/images/28e1f0e9-0c23-42fc-ad38-06d50d67043c => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:26:21.292172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.300958 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2568f179-d35f-4d2f-9824-0e68a755a1eb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.195357 Oct 18 13:26:21.301528 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 375/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:21.360338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.361095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.367642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.368130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.368572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.369268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.369732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.370305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.408542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42844dff-4127-4ce3-8028-969dfa2de9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3315ed9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.437084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.443298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2884a468-bd2b-460d-97e1-f4f5a5efb9ff tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1271 microversion: 2.1 time: 0.087363 Oct 18 13:26:21.443860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 395/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:21.457683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42844dff-4127-4ce3-8028-969dfa2de9ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.052077 Oct 18 13:26:21.457683 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 376/771] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:21.491080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-faf83d69-28c9-4317-9bba-0ec8787ed861 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33136bb80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.532179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-faf83d69-28c9-4317-9bba-0ec8787ed861 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365" status: 200 len: 660 microversion: 2.1 time: 0.045115 Oct 18 13:26:21.532744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 396/772] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365 => generated 660 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:21.546380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d85edc4f-5514-4263-8e1e-465ab969eb02 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33156b3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.588033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d85edc4f-5514-4263-8e1e-465ab969eb02 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365" status: 200 len: 660 microversion: 2.1 time: 0.045473 Oct 18 13:26:21.588690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 377/773] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365 => generated 660 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:21.678317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.678938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.685485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.685987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.686578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.687305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.687917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.689068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.693877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-965848263", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:21.751549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:21.867449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.876891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02b9777a-83f4-4571-a0ed-f42937053dff tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1473 microversion: 2.1 time: 0.202455 Oct 18 13:26:21.877477 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 397/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:21.964214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:21.964639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:21.965162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:21.965581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:21.966025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:21.976036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.976823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.977476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.978338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.978901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.979429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.998465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Getting quotas for project 5ede599ca0234feb928a00539d9aeb82. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:22.003758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Getting quotas for user 2dc31958aee54271985c85e5a569ceb0 and project 5ede599ca0234feb928a00539d9aeb82. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:22.016490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:22.018951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:22.119965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c07a2d5-fe44-45c0-8715-a3aad7017f48 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.430169 Oct 18 13:26:22.121273 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 378/775] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:22.180755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-104541138", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:22.250159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:22.325887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.326999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.338652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.340395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.340861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.341583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.344437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.346125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.522220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:22.533965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ff46ed98-193a-4b2a-9496-e31831683f9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.214100 Oct 18 13:26:22.551076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 379/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:22.556518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7315995-d7ad-4351-aaa7-8f701cd592c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331947d30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.612015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:22.613130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:22.613890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:22.614334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:22.614758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:22.619656 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7315995-d7ad-4351-aaa7-8f701cd592c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.067015 Oct 18 13:26:22.620446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 380/777] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:22.625094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.626163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.626751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.627493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.627960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.628443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.632338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.633190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.639572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.640069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.640617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.642146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.642978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.643434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.655859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Getting quotas for project 5ede599ca0234feb928a00539d9aeb82. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:22.661521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Getting quotas for user 2dc31958aee54271985c85e5a569ceb0 and project 5ede599ca0234feb928a00539d9aeb82. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:22.713985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:22.718687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:22.736341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:22.748007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f84fbacb-501e-4149-9f04-19274cb3ed4e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1271 microversion: 2.1 time: 0.126348 Oct 18 13:26:22.763608 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 381/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:22.885779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90053bca-a168-4bcf-ad54-f8801d6cd694 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709991 Oct 18 13:26:22.887075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 398/779] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:22.902614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8de4c9d-e4cf-4420-bc93-0550c1d16dca tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.904401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8de4c9d-e4cf-4420-bc93-0550c1d16dca tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.917566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.919004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.936432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.938903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.939470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.943307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.943877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.944404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.021610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8de4c9d-e4cf-4420-bc93-0550c1d16dca tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:23.032167 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8de4c9d-e4cf-4420-bc93-0550c1d16dca tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1217 microversion: 2.1 time: 0.135632 Oct 18 13:26:23.033157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 382/780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.041712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d14076-e2e9-4374-b7c3-81beb54bdf78", "name": "network-vif-plugged", "status": "completed", "tag": "ce5b1d38-c9c4-4e93-b768-2534aa44c142"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:23.054441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.055345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.055947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.090106 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] Creating event network-vif-plugged:ce5b1d38-c9c4-4e93-b768-2534aa44c142 for instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 on n-h1-858383-13 Oct 18 13:26:23.110969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0d2e9aa7-6c6a-4002-88e0-c78a047162a3 req-0809e985-448e-4ef1-8426-dc001f28f080 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071390 Oct 18 13:26:23.112887 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 383/781] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:23.562450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.562450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:23.571723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.572451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.573248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.574157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.574667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.575176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.664029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:23.676284 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f39b5899-466b-48e8-81f5-bae91102cc41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1473 microversion: 2.1 time: 0.772710 Oct 18 13:26:23.680460 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 399/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1473 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.690514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12fb24c2-ce78-4c06-baf9-b787dd87cce5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331432e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.765815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12fb24c2-ce78-4c06-baf9-b787dd87cce5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.084073 Oct 18 13:26:23.767167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 400/783] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.784271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.785189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:23.791550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.798002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.798644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.799591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.800228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.800716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.900017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:23.908550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24bc8ac9-f2f3-46e0-ac74-d62130887841 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1279 microversion: 2.1 time: 0.128705 Oct 18 13:26:23.910374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 401/784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:24.060844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5154ecc5-dbb5-4b7d-936d-af9ab1f60f20 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.061504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5154ecc5-dbb5-4b7d-936d-af9ab1f60f20 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:24.128992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.139290 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-753ba533-f2ac-4f65-bfdd-15d032c26050 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.586024 Oct 18 13:26:24.139859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 384/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:24.184718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5154ecc5-dbb5-4b7d-936d-af9ab1f60f20 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.192438 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5154ecc5-dbb5-4b7d-936d-af9ab1f60f20 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1217 microversion: 2.1 time: 0.137151 Oct 18 13:26:24.193394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 402/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:24.717999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.723380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:24.747181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.754614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.755335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.757480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.761190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.764777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.782411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-162cb569-f076-480e-b0f7-4dbc85ebf0d2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c9550>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.858261 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-162cb569-f076-480e-b0f7-4dbc85ebf0d2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.080410 Oct 18 13:26:24.861593 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 403/787] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:24.942019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.942733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:24.953565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.956907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.957990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.961679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.962727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.963353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.083392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.092716 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c2b96a7-6b74-4f7d-9950-0a7ef4da02ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1470 microversion: 2.1 time: 0.387471 Oct 18 13:26:25.097717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 385/788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.132963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:25.133803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.144021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.144860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.145529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.146452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.147070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.147708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.168527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.182038 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-219ec07b-a320-43fb-b089-9f967cf059c9 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1277 microversion: 2.1 time: 0.245123 Oct 18 13:26:25.192568 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 404/789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.197448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.208678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.213830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.214581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.215227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.215938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.216565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.217162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.415117 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43f81bbc-1293-456f-a0c2-1a1f6edb3bf7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95/action" status: 204 len: 0 microversion: 2.1 time: 0.286808 Oct 18 13:26:25.423847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 386/790] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:25 2022] POST /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95/action => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:25.447061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fdd130-7ec2-4d75-b7a5-2088436f6bbd", "name": "network-vif-plugged", "status": "completed", "tag": "5d524f5b-0038-4b20-a9df-09a7295437dd"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:25.481350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.483965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.488634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.539855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] Creating event network-vif-plugged:5d524f5b-0038-4b20-a9df-09a7295437dd for instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd on n-h2-858383-13 Oct 18 13:26:25.552077 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-88cf0ef4-e1e5-4cb8-9d48-b4cc41b41f53 req-d27c7595-c623-4ecb-977c-a404a5c5df26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132400 Oct 18 13:26:25.553831 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 387/791] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:25.567979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.567979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.575401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.576327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.576959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.577841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.578532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.579379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.714851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.729123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0ed0601-9b4f-4d69-bf17-99838c7595f8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1269 microversion: 2.1 time: 0.171768 Oct 18 13:26:25.730564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 388/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.751715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.752898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.776979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.778767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.780294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.782641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.787308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.795350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.964044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.979247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7542f6a2-0ef9-481a-a270-5dbb671f30f6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1317 microversion: 2.1 time: 0.781204 Oct 18 13:26:25.979883 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 405/793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.989172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-73380038-2e6e-4070-a82b-ef3a6c8188cb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c9820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.069397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-73380038-2e6e-4070-a82b-ef3a6c8188cb tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.088250 Oct 18 13:26:26.070089 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 406/794] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:26.080754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.081391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.092221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.092989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.093616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.096116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.096757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.097501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.131690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:26.278662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.295051 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8692e814-3854-4fd2-a647-5ded071eb13c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1470 microversion: 2.1 time: 0.563173 Oct 18 13:26:26.299441 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 389/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1470 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:26.318463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.320180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.337097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.339822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.340569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.342153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.348541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.349730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.494886 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-578f2bf2-19b1-4428-b2ac-0711a127d03c tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 204 len: 0 microversion: 2.1 time: 0.423124 Oct 18 13:26:26.495242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 407/796] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:26 2022] DELETE /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:26.505356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.506701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.521293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.524987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.525735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.526858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.528908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.530674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.852210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.865436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18d205c2-c4c3-4426-bf63-57b9534b2772 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1713 microversion: 2.1 time: 0.365390 Oct 18 13:26:26.869177 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 408/797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1713 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:26.887281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.888805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.898742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.904217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.905073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.905938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.907447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.908934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.974633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.987328 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a1171e6-2c6d-4983-b8e7-1cd6633c9c93 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.686547 Oct 18 13:26:26.989054 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 390/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:27.013325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.014534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.025137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.026611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.027325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.028353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.028984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.029916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.092604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.101125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4c3b13a-221d-475e-bfa9-c50f11d4150e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1287 microversion: 2.1 time: 0.230779 Oct 18 13:26:27.107194 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 409/799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1287 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:27.116210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93e81e26-a8d9-41df-88fc-a02a3a3d9461 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c9040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.186506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93e81e26-a8d9-41df-88fc-a02a3a3d9461 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.074423 Oct 18 13:26:27.192561 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 410/800] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:27.323006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.323626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.332877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.334692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.339933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.341078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.341731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.342397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.419288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.436587 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-038adff4-a5a5-44cd-be52-c2cf8be06ced tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1467 microversion: 2.1 time: 0.428504 Oct 18 13:26:27.446484 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 391/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1467 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:27.713523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.727910 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-56f9fd33-4a94-4538-833a-eb8ac907027a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1470 microversion: 2.1 time: 0.408514 Oct 18 13:26:27.728878 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 411/802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:27.735631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0087cf3e-7dcf-4ef9-b237-76b9ba289f78", "tag": "65c4207e-b169-47f9-bf4f-2a9f7928932e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:27.750648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.755509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.755509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.785877 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] Creating event network-changed:65c4207e-b169-47f9-bf4f-2a9f7928932e for instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 on n-h2-858383-13 Oct 18 13:26:27.791446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-087d4a9c-05bb-41cf-aa9f-2783c9311d3c req-d435bb35-3afc-46c8-989a-730be95269e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061117 Oct 18 13:26:27.792499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 412/803] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:27.799239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "name": "network-vif-plugged", "status": "completed", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:27.813180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.813723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.813912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.814568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.814716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.825824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.826363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.826824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.830006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.830538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.839051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.843386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Creating event network-vif-plugged:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h2-858383-13 Oct 18 13:26:27.851755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:27.853417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] Instance 7278cff0-11bf-476d-834c-be5d3089da95 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:26:27.882816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-66e0ce8f-4382-4a0b-87a0-137f6cad36ac req-f6ea0cbf-87bc-47b6-8354-7b9495c60107 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088757 Oct 18 13:26:27.884923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:27.888465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 413/804] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:27.901486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.912299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.921750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.922634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.923998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.927734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.929011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.930681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.039542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.050340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afd0a135-0f17-4f0c-ada4-e3b514c5eceb tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1713 microversion: 2.1 time: 1.153518 Oct 18 13:26:29.065588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-377a983d-a308-4e75-a823-ad4e80563eab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1620 microversion: 2.1 time: 1.589419 Oct 18 13:26:29.067207 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 392/805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1620 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.074273 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 414/806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1713 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.081895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.082998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:29.084137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.084789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:29.091969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.094997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.094997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.094997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.094997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.095869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.102710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.104783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.105263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.105991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.106519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.107007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.249118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.265079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97680552-d1e9-46c3-85c5-18b5bf631ce9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1275 microversion: 2.1 time: 0.193293 Oct 18 13:26:29.265671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 415/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.271174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c66f1791-d9ee-4dcf-96b2-edc8eb162751 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c9940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.322427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.333170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3bf264a-37d1-4d44-baa4-175f989d870b tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.264615 Oct 18 13:26:29.334114 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 393/808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.353885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.354878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:29.357718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c66f1791-d9ee-4dcf-96b2-edc8eb162751 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.090348 Oct 18 13:26:29.366600 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 416/809] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.369952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:29.371605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: .version_select at 0x7fb3314da670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-677265291", "policies": ["affinity"]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:29.371782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.372139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.372591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.373301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.373762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.374265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.390289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=97 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:29.396807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:29.411706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:29.636240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:29.661235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:29.683387 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c810b55e-9355-48fd-bfc6-bcb6198f8e8f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.315506 Oct 18 13:26:29.684614 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 417/810] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:26:29 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:29.773449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.792805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be523164-29ff-4e22-8d31-d1f29ff2a071 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1470 microversion: 2.1 time: 0.457390 Oct 18 13:26:29.798834 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 394/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.904706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1789377102", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "eea054df-817f-4a58-9d08-7f395055b92c"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:30.010632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:30.078454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.081685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.085624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.097691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.097691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.098822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.099193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.099634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.399844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:30.410397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0f3ebbb5-7a65-4c30-8639-d5046a965987 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1713 microversion: 2.1 time: 0.334851 Oct 18 13:26:30.411276 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 395/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1713 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:30.436527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.437525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.446011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.447201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.447808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.448845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.449492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.450298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.631428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:30.644730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e01d35f8-da95-4328-a7a3-024534eef259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1275 microversion: 2.1 time: 0.232304 Oct 18 13:26:30.651364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 396/813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:30.656469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.658242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.679877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.682293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.684017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.687266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.687992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.692706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.016630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.040909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20fd2ba8-41b5-4f54-9f9e-ade7c953d160 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.375829 Oct 18 13:26:31.041893 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 397/814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:31.048864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0814d345-2c89-46be-af42-49633b3fa762 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331639430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:31.125161 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0814d345-2c89-46be-af42-49633b3fa762 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.081947 Oct 18 13:26:31.130502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 398/815] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:31 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:31.150699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:31.151400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:31.188151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.188661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.189112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.189821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.190900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.191495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.515563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:31.516754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:31.517278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:31.517804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:31.518356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:31.571097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.577470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.579471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.580574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.581335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.581797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.605587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=22 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:31.634858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:31.644759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:31.668394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:31.716954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 2 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:31.719385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:31.866483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121009) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 13:26:31.905988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:31.919012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:31.982593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.990543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=24 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:31.996306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1dfa491-8c21-48c9-8cb0-6ae8b457f140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1462 microversion: 2.1 time: 0.861841 Oct 18 13:26:31.999257 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 399/816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:31 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1462 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:32.014006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.014988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.031391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.032333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.033053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.034155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.035165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.035826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.099885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:32.129830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:32.184857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=295bbcca-5871-4473-9014-e4ed61b8c61b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:32.216542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75623286dda46cfb4d8d70608655b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a89fd93a0d843e1ad91d158b7be21fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.227607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-136a2545-aeb3-4703-832c-9076363c0d32 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 200 len: 1645 microversion: 2.1 time: 0.226955 Oct 18 13:26:32.228643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 400/817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:31 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 1645 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:32.237619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.243974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.260985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.261714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.262352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.263454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.264072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.264827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.412159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:32.443619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:32.644496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:32.645847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.653774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6be22996-1b97-43f7-9cd2-6cd52ef09ad6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.420361 Oct 18 13:26:32.654289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:32.654426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 401/818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:32.687747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ffa74b-13a7-4f51-994f-a02ea0da085c", "name": "network-vif-deleted", "tag": "5a5bdbbe-0a96-4fec-a972-30017965b640"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:32.700546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.702022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.702657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.716885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c085097-9e69-446c-8a60-a5d59fc0b431 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.827752 Oct 18 13:26:32.717906 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] Creating event network-vif-deleted:5a5bdbbe-0a96-4fec-a972-30017965b640 for instance e4ffa74b-13a7-4f51-994f-a02ea0da085c on n-h1-858383-13 Oct 18 13:26:32.722746 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 418/819] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 2834 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:26:32.729984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.730656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.733563 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b355cc86-74c7-47bd-9e64-6a4f030216d1 req-1122a7f3-b7e3-4865-a409-4741ff0c27a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044680 Oct 18 13:26:32.734248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 402/820] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:32.740980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.741566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.742087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.744584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.745079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.745572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.759498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.761259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.800415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.801411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.801869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.802647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.803191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.803625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.034288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=44 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:33.150718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.170613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d7381f7-3d3a-45d0-a3a5-4d98d2d95a63 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.428796 Oct 18 13:26:33.170613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 403/821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.184717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b4e02d3-e69d-4e0a-83e0-8597801b33b3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3315ed280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.311855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b4e02d3-e69d-4e0a-83e0-8597801b33b3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.139347 Oct 18 13:26:33.315205 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 404/822] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.332452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.346703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.347546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Searching by: {'deleted': False, 'project_id': '9f5cd093b94c4161bed82c6495bc37be'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:26:33.372482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.373265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.373946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.374883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.376057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.376660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.446669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bdaed4e-ae8a-486b-b321-1d18e9fd2bc1 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1615 microversion: 2.1 time: 0.720310 Oct 18 13:26:33.458545 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 419/823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1615 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.478083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.478083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.486925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.486925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.486925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.486925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.487221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.487221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.517014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c HTTP/1.1 Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:33.521257 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:33.522788 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e4ffa74b-13a7-4f51-994f-a02ea0da085c'} Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:33.523539 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:33.524756 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.525909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:33.525909 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c0e1f4d-7f43-4dd2-8f87-ea504e1ea283 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 404 len: 111 microversion: 2.1 time: 0.072632 Oct 18 13:26:33.533314 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 420/824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:33.539476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40a875bc-5977-4441-a439-e7a5f40c2c5c tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '.version_select at 0x7fb3312b4430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.549213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a875bc-5977-4441-a439-e7a5f40c2c5c tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.549727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a875bc-5977-4441-a439-e7a5f40c2c5c tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.555931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a875bc-5977-4441-a439-e7a5f40c2c5c tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.559669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:26:33.567881 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40a875bc-5977-4441-a439-e7a5f40c2c5c tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.036533 Oct 18 13:26:33.582084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 421/825] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.582084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.590105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.602446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.602955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.606352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.607131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.607620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.608070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.651338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb HTTP/1.1 Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:33.653379 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.655100 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'ff5de646-635f-47ff-b877-9e2a5f6d2bbb'} Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:33.655828 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.659052 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.660266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:33.660266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b7a6137-d89e-4b53-900d-2c30d81d0016 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 404 len: 111 microversion: 2.1 time: 0.081962 Oct 18 13:26:33.660266 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 422/826] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:33 2022] DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:33.671518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.672162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.688247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.692909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.693474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.694273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.694752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.695415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.709175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d564d9be-46d0-42a3-9ff4-b4a18b9ece1f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.392379 Oct 18 13:26:33.721490 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 405/827] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers => generated 1004 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.728303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.728542 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.728948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb HTTP/1.1 Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:33.731187 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.732721 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'ff5de646-635f-47ff-b877-9e2a5f6d2bbb'} Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:33.733537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:33.735511 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.739172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.739864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.741141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:33.742196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.743646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.743891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6e9fbcc-47c4-4621-aabc-f13e08b11807 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 404 len: 111 microversion: 2.1 time: 0.078604 Oct 18 13:26:33.744142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.744588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.748855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 423/828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:33.761663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89dbe4e3-c7a2-46b9-8457-6f937077f9c8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.762862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89dbe4e3-c7a2-46b9-8457-6f937077f9c8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.957927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.971442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-329f438e-75e1-4d12-b70a-2c03d7a176f2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.248621 Oct 18 13:26:33.975752 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 406/829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.978432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b24f363-15d0-4304-86ee-6ccf1be8793e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '.version_select at 0x7fb331639040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:34.108156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b24f363-15d0-4304-86ee-6ccf1be8793e tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153960216" status: 202 len: 0 microversion: 2.1 time: 0.134568 Oct 18 13:26:34.109288 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 407/830] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153960216 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:34.129015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-115642739", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:34.242907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:34.281205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-89dbe4e3-c7a2-46b9-8457-6f937077f9c8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.300303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89dbe4e3-c7a2-46b9-8457-6f937077f9c8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1219 microversion: 2.1 time: 0.540375 Oct 18 13:26:34.301304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 424/831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1219 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:34.314183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:34.315224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:34.329814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.338211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.338763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.339523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.340011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.350556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.720002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:34.720565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:34.721100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:34.721618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:34.722527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:34.746525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.750118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.754468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.755431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.757085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.759015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.828266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:34.862179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:34.897403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:34.905042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:34.998417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.014649 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5155b6c7-43a5-4f14-b85d-4bfc357ae442 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.711974 Oct 18 13:26:35.031216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 425/832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:34 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.037159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4954c6d-53de-439d-b81a-7a371f3b7d93 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3314fc040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.106321 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4954c6d-53de-439d-b81a-7a371f3b7d93 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.073554 Oct 18 13:26:35.114442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdda8abd-92c3-40e8-ae23-7304468a61fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998016 Oct 18 13:26:35.115766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 408/834] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:35.115905 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 426/834] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.128196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18d6344c-9710-42e4-b1c1-6d564d39e8e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.128834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18d6344c-9710-42e4-b1c1-6d564d39e8e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.137772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.138616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.147599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.148520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.148520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.149791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.173959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.174548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.460594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18d6344c-9710-42e4-b1c1-6d564d39e8e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.477625 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18d6344c-9710-42e4-b1c1-6d564d39e8e1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1212 microversion: 2.1 time: 0.354819 Oct 18 13:26:35.498230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 427/835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1212 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:35.498230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.498230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.509417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.517295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.518096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.518976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.519579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.520286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.578518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.588607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20d29d74-9d42-4e29-a87c-f49f4978c15a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.467936 Oct 18 13:26:35.590723 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 409/836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.627669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.636409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd1dedc9-28c9-42b8-8a8a-5e43021b4741 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1223 microversion: 2.1 time: 0.152669 Oct 18 13:26:35.646806 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 428/837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.783952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:35.810261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.811423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.812271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.833600 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] Creating event network-changed:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:26:35.844963 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-17573559-5065-4ccc-b99a-afd9f2877302 req-a8ed4211-4079-4925-bace-fdfce54f4ba7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064825 Oct 18 13:26:35.846387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 410/838] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:35.953519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-851354f3-cf03-412f-971b-5ed4918f8d5a tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.043347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.044063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.061968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.062687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.063998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.064893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.065520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.066165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.089362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-851354f3-cf03-412f-971b-5ed4918f8d5a tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/303231382" status: 202 len: 0 microversion: 2.1 time: 0.139515 Oct 18 13:26:36.090886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 429/839] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:26:35 2022] DELETE /compute/v2.1/flavors/303231382 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:36.098827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0faff23a-76a7-47b6-9c97-f4f78dc65ca1 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.144812 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0faff23a-76a7-47b6-9c97-f4f78dc65ca1 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.049688 Oct 18 13:26:36.147313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 430/840] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:36.152339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4763d673-cf05-4fc1-ab8c-5ff8d400539d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3313f6670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.210628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4763d673-cf05-4fc1-ab8c-5ff8d400539d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.062023 Oct 18 13:26:36.212000 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 431/841] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:36.218776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb9ef1f5-17c7-4bfb-8eda-dfbbab929ba7 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.295297 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb9ef1f5-17c7-4bfb-8eda-dfbbab929ba7 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/803507013" status: 202 len: 0 microversion: 2.1 time: 0.081913 Oct 18 13:26:36.296450 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 432/842] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:26:36 2022] DELETE /compute/v2.1/flavors/803507013 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:36.307618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef24a3fc-ffa3-4ed4-b045-798884d60238 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.318671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:36.359976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.372506 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7b9bd18-cf9c-4538-9b68-60b06535310e tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.333523 Oct 18 13:26:36.387836 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef24a3fc-ffa3-4ed4-b045-798884d60238 tempest-ServersWithSpecificFlavorTestJSON-496145530 tempest-ServersWithSpecificFlavorTestJSON-496145530-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084143 Oct 18 13:26:36.393704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 433/844] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:36.395320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 411/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:36.430021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.431055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.442510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.443377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.444266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.445312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.446019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.446706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.468850 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c HTTP/1.1 Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:36.475509 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.477748 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e4ffa74b-13a7-4f51-994f-a02ea0da085c'} Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:36.478598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.479769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.485491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:36.486854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23d781bf-d5bf-48c5-a9d8-e4683260effe tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 404 len: 111 microversion: 2.1 time: 0.064129 Oct 18 13:26:36.494426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 434/845] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:36 2022] DELETE /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:36.500100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.501545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: e4ffa74b-13a7-4f51-994f-a02ea0da085c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.514211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.514720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.515190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.515885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.523314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.523554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.529843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.530498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.545664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.546190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.550128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.550128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.550128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.550128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.572170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c HTTP/1.1 Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:26:36.573849 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.575283 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e4ffa74b-13a7-4f51-994f-a02ea0da085c'} Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:36.576024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. Oct 18 13:26:36.577183 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.579088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance e4ffa74b-13a7-4f51-994f-a02ea0da085c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:36.579176 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5727e5bf-d6ec-47e1-a24c-b5e863b1de0a tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c" status: 404 len: 111 microversion: 2.1 time: 0.080268 Oct 18 13:26:36.582994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 412/846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/e4ffa74b-13a7-4f51-994f-a02ea0da085c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:36.592602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.593345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.600601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.601102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.601606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.602348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.602811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.603302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.621011 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb HTTP/1.1 Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:26:36.621386 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.622748 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ff5de646-635f-47ff-b877-9e2a5f6d2bbb'} Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:36.623521 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.624638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.626949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:36.628041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2cdc357-61fd-4963-bffa-67e167e225fc tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 404 len: 111 microversion: 2.1 time: 0.044003 Oct 18 13:26:36.628808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 413/847] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:36 2022] DELETE /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:36.636890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.637706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.645196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.645945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.646643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.647776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.648397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.655450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.789901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.805721 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-994b7255-9427-4417-b4db-7b89a6cb65cc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1216 microversion: 2.1 time: 0.297779 Oct 18 13:26:36.810979 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 435/848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1216 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:36.830317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.831687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] [instance: ff5de646-635f-47ff-b877-9e2a5f6d2bbb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.848502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.849312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.850698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.857071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.858043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.858744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.894018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] HTTP exception thrown: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Request method failure captured: Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb HTTP/1.1 Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqjrH37hM11ZvN_bctje-PMZsn77y213SxR26G_kRUoBAO785K4YKnb_6rOez6DD5kXjz9DcUEGBYA7xjM4CIHTANdPpOZHvKGo08ZgaXF8Mmd0sKcJenpswQrV1B9QAEMBwmeNEgz61JISE5XRXgquMo_IAljEGhvVGQef3x9Tu7Rs Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:36.899838 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a89fd93a0d843e1ad91d158b7be21fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2a89fd93a0d843e1ad91d158b7be21fb Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555 Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d75623286dda46cfb4d8d70608655b9c Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1917817555-project Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.901273 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'ff5de646-635f-47ff-b877-9e2a5f6d2bbb'} Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:36.903851 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. Oct 18 13:26:36.905036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:36.918021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] Returning 404 to user: Instance ff5de646-635f-47ff-b877-9e2a5f6d2bbb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:36.919533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-338fbdce-0226-4945-be74-b5f4d8d83fb1 tempest-ServersWithSpecificFlavorTestJSON-1917817555 tempest-ServersWithSpecificFlavorTestJSON-1917817555-project] 10.222.0.27 "GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb" status: 404 len: 111 microversion: 2.1 time: 0.107026 Oct 18 13:26:36.920360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 436/849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/ff5de646-635f-47ff-b877-9e2a5f6d2bbb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:36.930442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.930442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.940924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.942667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.944379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.946766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.947530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.949214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.028269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.041204 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-110e61e1-4efa-445c-bf2c-48c1b9e8f2f5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.407716 Oct 18 13:26:37.041798 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 414/850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:37.098826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.109710 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-725a9037-60cc-461d-960e-e67b12c0076e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1215 microversion: 2.1 time: 0.187929 Oct 18 13:26:37.130482 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 437/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:37.238812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-241b8981-bb70-45cb-b3d0-b930eaa55ef7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331659b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.313652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0087cf3e-7dcf-4ef9-b237-76b9ba289f78", "name": "network-vif-plugged", "status": "completed", "tag": "65c4207e-b169-47f9-bf4f-2a9f7928932e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:37.321216 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-241b8981-bb70-45cb-b3d0-b930eaa55ef7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.096805 Oct 18 13:26:37.323928 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 415/852] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:37.345344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.347013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.347622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.374621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] Creating event network-vif-plugged:65c4207e-b169-47f9-bf4f-2a9f7928932e for instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 on n-h2-858383-13 Oct 18 13:26:37.387430 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5c67ca6a-fc76-4a98-afd2-09e32ab64bee req-8c565af5-a480-43c3-bcac-3fb1f27c8bbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078297 Oct 18 13:26:37.393154 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 438/853] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:37.415653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.416580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.435078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.448115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.451486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.452320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.469740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.471744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.489164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:37.838914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.839634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.855955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.856503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.856957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.098710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.098710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.098710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.099605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.099605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-393ebe35-a545-407e-8c9e-d0dbfd7498d1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1208 microversion: 2.1 time: 0.173847 Oct 18 13:26:38.099605 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 439/854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1208 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.099605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455d57a6-5233-4642-86ee-c29b389fb027", "tag": "60d76e98-d8b4-4f1d-abd4-79511a55540e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:38.100744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.100744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.100744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.100744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] Creating event network-changed:60d76e98-d8b4-4f1d-abd4-79511a55540e for instance 455d57a6-5233-4642-86ee-c29b389fb027 on n-h1-858383-13 Oct 18 13:26:38.100744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0756d95b-1975-4976-b338-4eb47d066313 req-656f88c1-a716-4ee6-8e85-743be1fa934d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043929 Oct 18 13:26:38.101556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 440/855] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:38.101556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.101556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.101556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.101962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.101962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.101962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.101962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.103976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.120595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.128895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e0e196c-9caf-422e-9f15-d645d76937fa tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.720081 Oct 18 13:26:38.129685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 416/856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.150586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.151211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.164569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.165093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.165554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.166304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.166832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.167273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.287726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.296433 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6044b727-d2d8-45a5-b940-6a1aaa890b93 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1271 microversion: 2.1 time: 0.149529 Oct 18 13:26:38.297020 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 417/857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.348006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5035b101-55cb-4a93-83f0-c34a35226a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3319c6ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.368275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.382489 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c79c4a4-cbd3-424f-b7f4-46992b28abc9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.320672 Oct 18 13:26:38.383857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 441/858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.416348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5035b101-55cb-4a93-83f0-c34a35226a92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.073159 Oct 18 13:26:38.417164 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 418/859] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:39.033935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.034956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.042018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.042817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.043427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.044332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.044970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.045568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.156041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.157231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.169975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.170546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.171010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.171739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.172795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.173222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.264630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.281088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21077fdb-5c62-4371-bbdc-d3495f8af6c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1264 microversion: 2.1 time: 0.250368 Oct 18 13:26:39.285156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 442/860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:39.320806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.321715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.335915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.336477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.336945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.337698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.344602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.345208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.648741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.671212 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-746012b2-492b-425d-a37c-91005af4a56d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1279 microversion: 2.1 time: 0.354331 Oct 18 13:26:39.686160 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 443/861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1279 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:39.686160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.686160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.695304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.695824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.696280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.700226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.700226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.700226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.964019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.977326 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70cd9530-801b-4d50-9fd4-449f660f1391 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1319 microversion: 2.1 time: 0.827035 Oct 18 13:26:39.986030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 419/862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:40.004029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c8c174e-34d1-48d5-a2fc-1873a747d0b0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331b083a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:40.152161 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c8c174e-34d1-48d5-a2fc-1873a747d0b0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.164669 Oct 18 13:26:40.153851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 420/863] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:40.312082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:40.313443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:40.334364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.343163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.343163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.343163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.343163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.346503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.437231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:40.446912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9770f78-7450-4b5d-936e-49bdd12059bb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.772734 Oct 18 13:26:40.473311 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 444/864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:40.630914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:40.644891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c21df249-e3d2-4c15-9712-08efac72f343 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1264 microversion: 2.1 time: 0.337468 Oct 18 13:26:40.648297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 421/865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:40 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:40.702379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:40.704001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:40.712083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.712843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.713589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.714678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.716575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.717196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.006546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.007090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.016893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.017393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.017839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.039876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.048827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2dc7c0f2-5052-4597-bc7b-9879fd54e5a0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1277 microversion: 2.1 time: 0.351793 Oct 18 13:26:41.058324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 445/866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:40 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:41.070741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.071305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.071837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.169461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e08acde6-eb88-425f-a2c5-556e373ba757 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33128b4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.245115 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e08acde6-eb88-425f-a2c5-556e373ba757 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.080111 Oct 18 13:26:41.246002 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 446/867] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:41.493252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.494785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.518388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.519612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.520522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.542739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.543620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.549636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.608545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:41.806956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:41.869690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.890546 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3eebb85-679a-47c9-92c5-54435f57af62 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1469 microversion: 2.1 time: 0.888895 Oct 18 13:26:41.897146 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 422/868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:40 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1469 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:41.913503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.918378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.940458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.941319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.942931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.946284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.950865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.950865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.226416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:42.242608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ea7f052-fc3e-43c1-a6b2-67a013064ab8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1270 microversion: 2.1 time: 0.343827 Oct 18 13:26:42.244531 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 423/869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1270 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.252818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:42.254010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.261624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.264263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.265051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.267381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.271179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.271179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.285851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:42.302528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-00b1bc15-3397-443c-8016-133d1b3bf94a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.813195 Oct 18 13:26:42.303669 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 447/870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:42.308903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.309851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.319816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.320868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.322096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.323312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.324036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.324735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.389114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lazy-loading 'flavor' on Instance uuid 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:42.521321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:42.530484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74b80900-7bbc-4601-aa0c-8bafeed12af0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1277 microversion: 2.1 time: 0.225471 Oct 18 13:26:42.533309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 448/871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.541550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a55dac2a-2528-4976-86fa-d8f7d5a0ceab tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331271e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.616417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a55dac2a-2528-4976-86fa-d8f7d5a0ceab tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.081439 Oct 18 13:26:42.617157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 449/872] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.775080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cf225c5-3c5f-4f77-b359-e44b5635b638 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78/action" status: 202 len: 0 microversion: 2.1 time: 0.527897 Oct 18 13:26:42.778931 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 424/873] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:42 2022] POST /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:42.784341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.790999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.812445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.813816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.814868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.819440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.820222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.820897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.238404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.246797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8b67f49-f2ef-4d1f-a699-22e50c9eae87 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1477 microversion: 2.1 time: 0.466502 Oct 18 13:26:43.265569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 450/874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:43.274307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.274307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.280561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.285478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.286093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.288040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.289031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.290213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.332505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.333911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.343950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.345702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.346203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.346936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.347404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.347846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.671375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.687226 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ea8caff-fb30-4b3e-8a8c-98caab9f9224 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1270 microversion: 2.1 time: 0.418115 Oct 18 13:26:43.691851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 425/875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1270 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:43.707390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.709568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.749789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.752658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.756122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.759348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.759667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.760983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.992226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.008261 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08e297cb-6654-429b-9da1-7b8d8e13f2bd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1277 microversion: 2.1 time: 0.314036 Oct 18 13:26:44.008954 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 426/876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:44.017202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3dad6ab7-7641-4ffd-bcce-7c2683e88044 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331807d30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.145966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3dad6ab7-7641-4ffd-bcce-7c2683e88044 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.136032 Oct 18 13:26:44.146764 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 427/877] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:44.284383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.285805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.292404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.292786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.301848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.302112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81d2bbc7-a902-4031-b3d5-67df2d265748 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.973993 Oct 18 13:26:44.317625 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 451/878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:44.320758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.326593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.329098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.332515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.637586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295bbcca-5871-4473-9014-e4ed61b8c61b", "tag": "e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:44.673131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.673679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.674167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.685260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.704181 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1236ac9-550a-474a-9dbe-286b7bf02959 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1460 microversion: 2.1 time: 0.419354 Oct 18 13:26:44.704830 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 428/879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1460 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:44.717406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.718453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.727065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.727801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.728419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.729353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.729986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.730787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.744165 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] Creating event network-changed:e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3 for instance 295bbcca-5871-4473-9014-e4ed61b8c61b on n-h1-858383-13 Oct 18 13:26:44.773090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f5830b5c-247d-49bd-ab37-5a7e348c20c0 req-8eb9c460-5791-4b43-9296-af00183694fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137760 Oct 18 13:26:44.777195 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 452/880] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:44.784435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.799516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:44.801158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.835017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.836665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.839710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.842295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.844662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.850084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.855013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.872335 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f369e5bc-2ceb-4774-8f47-4dcdf0fc66dc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1270 microversion: 2.1 time: 0.159345 Oct 18 13:26:44.877679 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 429/881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:44.906204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:45.016161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-615743369", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "712ddb5e-612b-4594-9e50-5bb7e29ca2a0"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:45.141816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] validate_networks() for [('712ddb5e-612b-4594-9e50-5bb7e29ca2a0', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:45.477839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=33 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:45.868938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:45.868938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:45.868938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:45.868938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:45.868938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:45.878940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.879933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.880603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.882930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.883791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.884556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.029498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:46.067170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for user 3424ff1ac4404c4cb1b47907bf255b4b and project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:46.123385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:46.123385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:46.689265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd3efb04-a12d-4f8e-a02b-4b227a42b39e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778588 Oct 18 13:26:46.697402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 430/882] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:46.713936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.715032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.755384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.758005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.758805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.761639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.762415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.763080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.917133 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d93b22c-be18-4206-84cc-e23cbbb24a60 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1613 microversion: 2.1 time: 2.137115 Oct 18 13:26:46.927557 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 453/883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1613 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:46.943398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-704b5e89-7d65-4029-881d-29b7f08fc21b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c41f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.009505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.028208 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-182c613e-2044-46e6-ba49-ea689ea82e39 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.324195 Oct 18 13:26:47.031046 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 431/884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:46 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:47.041633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.042562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.055296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-704b5e89-7d65-4029-881d-29b7f08fc21b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.124361 Oct 18 13:26:47.055296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 454/885] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:46 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:47.063233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.063750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.064193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.067024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.068846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.069719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.074180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455d57a6-5233-4642-86ee-c29b389fb027", "name": "network-vif-plugged", "status": "completed", "tag": "60d76e98-d8b4-4f1d-abd4-79511a55540e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:47.099195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.099683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.100186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.133441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] Creating event network-vif-plugged:60d76e98-d8b4-4f1d-abd4-79511a55540e for instance 455d57a6-5233-4642-86ee-c29b389fb027 on n-h1-858383-13 Oct 18 13:26:47.154377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2c14d8b4-f515-40a7-80bf-dc480d22f8fb req-818022bd-2889-447c-bf9d-1f2807bfdb47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089825 Oct 18 13:26:47.157971 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 455/886] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:47.167754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.171598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.191266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.192652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.194488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.195498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.197116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.199131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.353217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.374205 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19f89e58-2497-4f48-9e69-1f6dd8bd08ce tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.341337 Oct 18 13:26:47.376979 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 432/887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:47.390366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51edcaa4-4901-4d83-9714-745497b036f2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.392032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51edcaa4-4901-4d83-9714-745497b036f2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.539334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51edcaa4-4901-4d83-9714-745497b036f2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.557294 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51edcaa4-4901-4d83-9714-745497b036f2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1224 microversion: 2.1 time: 0.175740 Oct 18 13:26:47.557890 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 433/888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1224 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:47.584343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.589316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.590115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.595453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.595453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.595453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.595453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.618264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:47.631424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d9eeb529-9ebb-4c69-9fbc-1386833bd9d6 tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053682 Oct 18 13:26:47.632577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 434/889] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:47.651729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": true, "disk_over_commit": false}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:47.659906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.679078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.680850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.686201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.692659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.694400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.697647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.784813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Lazy-loading 'flavor' on Instance uuid 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:47.843269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 while it is in vm_state suspended Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Request method failure captured: Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78/action HTTP/1.1 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 98 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlpa399tgXUUqpr_LCYG8p5pzw5fQiPWb_XJM_PgqiuPTBvn8QjlHvidm8GDes-_J1mtHyPdnEc-BIZWzBN07YeywZvKUEG0p0K90APNjP8GVdZNXEkvi1UtP6DQo0EeRe2wWkfo4f0vSSZHAHuYRNsrN4JieWVQ4VinYDE4BYZe0w Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b25d3a45355e49bbad1b29ce5ffe0200 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:26:47.849287 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b25d3a45355e49bbad1b29ce5ffe0200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b25d3a45355e49bbad1b29ce5ffe0200 Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1587692244 Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-LiveMigrationNegativeTest-1587692244-project-admin Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 77e60de7885e4927bffa684043f7d19c Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-LiveMigrationNegativeTest-1587692244-project-admin Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": true, "disk_over_commit": false}} Oct 18 13:26:47.850886 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'os-migrateLive' instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 while it is in vm_state suspended Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0087cf3e-7dcf-4ef9-b237-76b9ba289f78', 'body': {'os-migrateLive': {'host': 'n-h1-858383-13', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:26:47.851830 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:47.853135 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 while it is in vm_state suspended Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 while it is in vm_state suspended Oct 18 13:26:47.856647 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:26:47.857869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 while it is in vm_state suspended {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:47.857869 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c65ef418-3ef6-4ee8-ac74-3a2cc1c6757a tempest-LiveMigrationNegativeTest-1587692244 tempest-LiveMigrationNegativeTest-1587692244-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78/action" status: 409 len: 155 microversion: 2.1 time: 0.212254 Oct 18 13:26:47.857869 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 435/890] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:47 2022] POST /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78/action => generated 155 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:47.867888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.868376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.874866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.876382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.877055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.877999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.878693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.879342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.922770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:47.968618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:48.004113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:48.019622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c959c6f-0ffb-4dfd-be8a-fdf1de89472c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.860487 Oct 18 13:26:48.020757 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 456/891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:48.067377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.068198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:48.106019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.108597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.108597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.108597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.108597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.114377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.506239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa7c9fca-f769-4ede-9b49-e0e6e6025076 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 204 len: 0 microversion: 2.1 time: 0.642513 Oct 18 13:26:48.506855 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 436/892] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:47 2022] DELETE /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:48.512706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc70762f-53ab-46ca-9c67-fe4d6344244b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3317eadc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.579965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc70762f-53ab-46ca-9c67-fe4d6344244b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1412 microversion: 2.1 time: 0.064739 Oct 18 13:26:48.579965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 437/893] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:48.580178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.581080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:48.589083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.590448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.591075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.592373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.593448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.594921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.082910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.095920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fbf3d43-3b3b-450a-9373-6c53aa3aeb47 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.520500 Oct 18 13:26:49.097230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 438/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.111171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.112265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.123358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.123690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.124148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.125763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.125888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.126329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.296036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.309810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69546adf-b5b5-4321-a246-fa2f9912f0c6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 1.249948 Oct 18 13:26:49.314362 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 457/895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.320594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.322024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.332210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.336264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.336264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.336264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.336264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.336664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.358791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.370045 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b888332e-616a-4770-abb7-9ae9ee49f7fd tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1466 microversion: 2.1 time: 0.271477 Oct 18 13:26:49.371312 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 439/896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1466 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.377188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.378314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.400195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.400779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.401237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.401981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.405869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.406474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.448462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.463142 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af5c26ac-80d7-458a-89b2-dd52ff73d994 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1220 microversion: 2.1 time: 0.146888 Oct 18 13:26:49.467121 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 458/897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.482225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-plugged", "status": "completed", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:49.519275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.519913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.520230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.549946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] Creating event network-vif-plugged:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:26:49.566462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6233a2fb-e308-43c3-8e6a-135a6df5378d req-1683e840-ae47-4a44-b851-c2486696bc48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095757 Oct 18 13:26:49.571228 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 459/898] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:49.592134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a19ccf14-4a4b-4659-b249-8d9a9c3f3fc3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312c4820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.664443 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a19ccf14-4a4b-4659-b249-8d9a9c3f3fc3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1421 microversion: 2.1 time: 0.079168 Oct 18 13:26:49.674599 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 460/899] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.680581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80a31696-09ac-4c37-9e03-25072d9f7f0f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312e29d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.728461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80a31696-09ac-4c37-9e03-25072d9f7f0f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 200 len: 1421 microversion: 2.1 time: 0.051795 Oct 18 13:26:49.729384 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 461/900] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 1421 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:49.746077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e2dab88-a2cd-400f-b090-f3bda9038e69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312a5670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.991356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.006262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8b06756-a028-4fb8-999a-ce2d66915ec6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.633495 Oct 18 13:26:50.006865 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 440/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:50.029591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f197a8-adff-400a-85f0-5a61d9677006", "tag": "3b35b9d9-9128-4a86-8aad-a8366b499599"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:50.059287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.059287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.059287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.063618 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] Creating event network-changed:3b35b9d9-9128-4a86-8aad-a8366b499599 for instance 82f197a8-adff-400a-85f0-5a61d9677006 on n-h1-858383-13 Oct 18 13:26:50.069187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-be857f48-214d-41ea-bbe8-f24a292b10d1 req-79672bd0-447f-4af5-b240-44ba724eb4bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043198 Oct 18 13:26:50.070388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 441/902] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:26:50.121827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.123351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.130369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.131162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.132114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.133433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.135889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.135889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.416946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.432684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dcb588e4-00f8-4231-8a91-26cb9cbd38b6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1317 microversion: 2.1 time: 0.311159 Oct 18 13:26:50.435685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 442/903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:50.459218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.460415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.468005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.468916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.469620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.470707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.471473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.472176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.728850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.737730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9affcded-abd2-4e6d-a325-2b36a6ff3d3e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.287879 Oct 18 13:26:50.740951 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 443/904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:50.747327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.748171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.768629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.775746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.776492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.777602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.778091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.778609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.942128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.950462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9db35a77-299c-48cb-9acc-411de3803e44 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1466 microversion: 2.1 time: 0.208056 Oct 18 13:26:50.951269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 444/905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1466 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:50.956663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.957279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.963144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.963841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.964463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.965321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.965935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.966566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.087256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.102183 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2027f65e-24ab-4c27-8945-2ab7d66872e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1276 microversion: 2.1 time: 0.149628 Oct 18 13:26:51.102779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 445/906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:51.107518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.108138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.114818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.115307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.115766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.116656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.117131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.117686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.254083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e2dab88-a2cd-400f-b090-f3bda9038e69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 204 len: 0 microversion: 2.1 time: 1.512567 Oct 18 13:26:51.254864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 462/907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] DELETE /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 0 bytes in 1514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:26:51.265271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.265961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.272722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.273397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.274251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.274978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.275428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.281704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.281955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.292233 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef9aa0fa-93fe-4c8f-b969-c0c20663d1af tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.188361 Oct 18 13:26:51.292970 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 446/908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:51.304895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:51.460955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.461583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.468098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.469225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.469862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.470766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.471370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.471805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.563334 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b2166db-3f52-4ad9-99d6-93d867c900b2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 204 len: 0 microversion: 2.1 time: 0.302991 Oct 18 13:26:51.569127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 463/909] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:51.608524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295bbcca-5871-4473-9014-e4ed61b8c61b", "name": "network-vif-plugged", "status": "completed", "tag": "e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:51.618870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.619352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.619785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.635253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] Creating event network-vif-plugged:e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3 for instance 295bbcca-5871-4473-9014-e4ed61b8c61b on n-h1-858383-13 Oct 18 13:26:51.641593 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-52dbb8c0-d8b7-4ccf-ab97-8afd239c46e9 req-9c0705dc-3370-4c63-9433-0da63c427e33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036365 Oct 18 13:26:51.642803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 464/910] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:51.657916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.667537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00f19c6b-f6a1-42dd-9125-c72779f54bf0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1466 microversion: 2.1 time: 0.212000 Oct 18 13:26:51.668289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 447/911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1466 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:51.693530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.694546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.703814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.704241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.704684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.705620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.706121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.706570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.747052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-442675271", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:51.805547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:52.204338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:52.204891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:52.205228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:52.205642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:52.206394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:52.216526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.217027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.217454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.218225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.218744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.219389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.236517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:52.242391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:52.256779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:52.270377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:52.360238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97673eb2-eebb-4121-ad9d-3bd8cd5fc3c0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616312 Oct 18 13:26:52.367440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 448/912] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:52.373022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.373778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.380926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.381551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.382125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.382937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.383499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.384042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.568116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.581405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9461672-d2be-4357-9055-476e9c2dc1a3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.210673 Oct 18 13:26:52.582665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 449/913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:52.587429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.588165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.595054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.595740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.606126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.606126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.606126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.606126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.622318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.636812 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-527b8605-fc3e-4703-b02c-e61ef4834f28 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1317 microversion: 2.1 time: 0.949483 Oct 18 13:26:52.642233 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 465/914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1317 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:52.667520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.677533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-baabd727-0595-4778-afe2-458b263c4e7a tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1424 microversion: 2.1 time: 0.093733 Oct 18 13:26:52.679212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.680924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.687157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 450/915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:52.700358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.704147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.704147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.704147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.704147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.705045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.705240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:52.716756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.717512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.717958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.733401 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] Creating event network-changed:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h1-858383-13 Oct 18 13:26:52.739625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-17d64180-87d1-4fa7-92d1-a3f23c86d3b5 req-1fb5dbf1-8d36-42f4-9ea4-31631fe093cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050807 Oct 18 13:26:52.741210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 451/916] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:52.746745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.747808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.754592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.755379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.756051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.756929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.757560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.758898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.966811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.979734 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a040abf8-7f56-4da7-8833-d4d6110fcff5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.236105 Oct 18 13:26:52.981292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 452/917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:52.987046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f5e321b-87d5-48e1-9941-a9b12287f4c3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.987652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f5e321b-87d5-48e1-9941-a9b12287f4c3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.046377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f5e321b-87d5-48e1-9941-a9b12287f4c3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.054382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f5e321b-87d5-48e1-9941-a9b12287f4c3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1207 microversion: 2.1 time: 0.071950 Oct 18 13:26:53.055115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 453/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1207 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:53.129153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.136786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a68dc47-f7ac-45f0-a114-cee409351dfe tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1282 microversion: 2.1 time: 0.480821 Oct 18 13:26:53.137357 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 466/919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1282 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:53.609951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.610805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.619391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.619890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.620686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.621577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.622295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.622940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.672872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.674321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.682469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.683459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.684334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.685430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.686257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.686924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.774519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.792863 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f224a56-4c18-46a3-98ab-4c9bbe09be2e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.188648 Oct 18 13:26:53.795652 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 454/920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:53.801419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.817304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.823810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.824318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.824765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.825477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.825945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.826426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.842038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:53.894872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.903925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8adc52d-665a-4859-9a0f-df82f2eb5d10 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1295 microversion: 2.1 time: 0.106868 Oct 18 13:26:53.905035 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 455/921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.004907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.005538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.013537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.014411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.015120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.016751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.017468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.019688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.224111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.237886 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9f21266-48db-4aaf-98fd-1a98d742f065 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.237643 Oct 18 13:26:54.238956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 456/922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:54.245223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.246420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.262296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.263124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.263935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.265094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.266154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.266735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.269017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.278648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2b223bcd-8e86-4d65-8c70-b3404cdae88e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1317 microversion: 2.1 time: 0.613261 Oct 18 13:26:54.279896 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 467/923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.307330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.307961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.330741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.332811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.334867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.341689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.341689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.341689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.368573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.379722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-388f74fc-667e-4aa2-8efe-0085335ee205 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1203 microversion: 2.1 time: 0.139218 Oct 18 13:26:54.381453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 457/924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1203 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.824231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.825241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.831759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.832250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.832692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.833402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.833861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.834308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.008713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.026817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.028505 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8e4786e-ad89-458c-b482-b63a8b624f79 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.207151 Oct 18 13:26:55.037153 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d2431970-a695-4428-be21-04d5fe9eadb5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.738907 Oct 18 13:26:55.042354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 468/925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:55.046387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 458/926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:55.052143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.052897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.059851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.060330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0087cf3e-7dcf-4ef9-b237-76b9ba289f78", "name": "network-vif-deleted", "tag": "65c4207e-b169-47f9-bf4f-2a9f7928932e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:55.060458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.060771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.061822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.066621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.067186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.071379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.072255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.072918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.093252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] Creating event network-vif-deleted:65c4207e-b169-47f9-bf4f-2a9f7928932e for instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 on n-h2-858383-13 Oct 18 13:26:55.101667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0143180b-bfe5-40e4-ba67-d4813eb74635 req-42f9adce-944d-4195-ba4e-17f9e817fab6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055292 Oct 18 13:26:55.102590 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 469/927] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:55.121326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.121816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.122305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.122762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lazy-loading 'fault' on Instance uuid 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:55.178294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.187396 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7bab476-9e39-4e9b-932e-caa6d3052523 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 200 len: 1309 microversion: 2.1 time: 0.138072 Oct 18 13:26:55.188021 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:55.266623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.267336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.276110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.276606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.277217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.278116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.278733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.279327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.309049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.312564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.336681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.337557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.339605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.340515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.348443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.352597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.609907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.612514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:55.627844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bb6d3e4-7281-4942-aa33-857136415628 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.365928 Oct 18 13:26:55.632417 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 470/929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:55.639111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.649532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.661873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.662406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.662854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.663787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.664359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.664787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.717998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.734944 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36806c57-44e9-4dfd-b22f-d83a0171ae1a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1466 microversion: 2.1 time: 0.431541 Oct 18 13:26:55.735772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 460/930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:55.760796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-15463124"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:55.764061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.788896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.789548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.790073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.793145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.793257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.793358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.796548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.799778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea7b3e45-d1ba-4ad1-8f8b-53f83061f077 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1259 microversion: 2.1 time: 0.166042 Oct 18 13:26:55.800365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 471/931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:56.054929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.055602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.068139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.068682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.069133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.069856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.070352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.070789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.418300 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b13c2fd-5612-4507-ba25-12ec00d24a21 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "POST /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.662932 Oct 18 13:26:56.419023 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 461/932] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:55 2022] POST /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 13:26:56.425883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.426708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.433434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.434429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.434884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.435604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.436069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.436598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.575658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.579793 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35eda14e-ff21-48c3-a4be-13f4144d4b89 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.529310 Oct 18 13:26:56.580385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 472/933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:56.602109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.602109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: 0087cf3e-7dcf-4ef9-b237-76b9ba289f78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.608767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.612774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.613820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.614923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.615544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.616159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.632509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] HTTP exception thrown: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Request method failure captured: Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 HTTP/1.1 Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlodLnWlwaiSllKVnw0uvwPrs7xq7z11jlHdLIivZRnfAw3BUoRnVqk5uaLjh9cW3yvmfmE7b94AtKMsXHF56uFKNKPr95f5yzcMBiM9wP5gK5j4tR4lU5Ygcecg-X6-chcscK59W1pSP6ew-lHqUVfOTRVZ6CAAHz3q_p9p0yTPpw Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e374527f6eda4730aa116c71d01dfd4b Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:26:56.634420 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e374527f6eda4730aa116c71d01dfd4b Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveMigrationNegativeTest-1452858684-project Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5c053ac77b3c479da2f3145adb4dfc21 Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveMigrationNegativeTest-1452858684-project Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. Oct 18 13:26:56.635798 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0087cf3e-7dcf-4ef9-b237-76b9ba289f78'} Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:56.636535 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. Oct 18 13:26:56.638731 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:26:56.640811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Returning 404 to user: Instance 0087cf3e-7dcf-4ef9-b237-76b9ba289f78 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:56.640811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc95ea8e-ad0c-4d2b-9858-01eef64bbda5 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78" status: 404 len: 111 microversion: 2.1 time: 0.051095 Oct 18 13:26:56.640811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 473/934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/0087cf3e-7dcf-4ef9-b237-76b9ba289f78 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:56.649181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ffa8af96-6e86-4943-aa9c-452be6486259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312c9d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.713578 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ffa8af96-6e86-4943-aa9c-452be6486259 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.076105 Oct 18 13:26:56.722397 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 474/935] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:56.727503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.727503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.738342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.739427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.739876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.740657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.742009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.742498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.779779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:57.075746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.076431 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ea4a032-3f67-47ce-8a3b-45a25838498c tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 204 len: 0 microversion: 2.1 time: 0.359913 Oct 18 13:26:57.077559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 475/936] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:56 2022] DELETE /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:57.088142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.089016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.089235 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78e3752e-fe5f-4422-8232-2005369a3971 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.668474 Oct 18 13:26:57.090137 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 462/937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:57.096521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.098463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.099066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.099522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.100166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.101101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.101745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.102578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.106491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.106988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.107441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.108135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.114715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.117790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.275492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.285761 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-806c5dc9-5703-4940-995a-4165322044aa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1265 microversion: 2.1 time: 0.194439 Oct 18 13:26:57.287121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 463/938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:57.294575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.295501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.306302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.309353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.310441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.312087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.314119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.314876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.533734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.543553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31b44ce6-698e-403a-8120-6f993064cb8b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.463001 Oct 18 13:26:57.557724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 476/939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:57.558201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.563562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fdd130-7ec2-4d75-b7a5-2088436f6bbd", "name": "network-vif-deleted", "tag": "5d524f5b-0038-4b20-a9df-09a7295437dd"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:57.571448 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a8b4d6e-e75e-47c0-a1e7-3b205a497035 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1474 microversion: 2.1 time: 0.282021 Oct 18 13:26:57.573564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 464/940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:57.576981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.576981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.576981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.588661 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] Creating event network-vif-deleted:5d524f5b-0038-4b20-a9df-09a7295437dd for instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd on n-h2-858383-13 Oct 18 13:26:57.593511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-04212335-101b-4b7a-9bbe-e66eb0ec1854 req-3464f817-b598-43b2-a20b-d1dc9fdf133f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034260 Oct 18 13:26:57.594074 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 477/941] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:57.604704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.605581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.612240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.612739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.613187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.614672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.615479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.616193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.735460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20fc1643-2260-4531-8474-3f9337ed6ff2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33128b280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.825213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20fc1643-2260-4531-8474-3f9337ed6ff2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.098680 Oct 18 13:26:57.826491 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 478/942] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:57.875538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.891104 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec3f3bb7-a160-43ef-80c6-4c3f51bbe70b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.290136 Oct 18 13:26:57.892312 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 465/943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:58.114223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.118190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.134532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.135390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.140200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.140200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.140200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.140200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.312888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.313759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.321025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.321773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.322486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.323630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.324314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.324967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.480261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.491159 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-864bb31d-9c16-49df-b318-29ae7ecc1365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.382089 Oct 18 13:26:58.496960 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 479/944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:58.543943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.552209 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98ee15ca-6bce-4a82-ab38-5dcc70a21d25 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.243306 Oct 18 13:26:58.554211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 466/945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:58.567274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.567905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.574211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.577842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.577842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.577842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.577842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.578698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.596073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.597373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.609782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.609782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.609782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.609782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.610148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.610148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.913414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.927001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a852b415-257d-449c-b992-ebfc597defe3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.358263 Oct 18 13:26:58.927001 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 480/946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:58.932132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ccb943dc-2573-4629-b101-ee6062ffa95b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312a5b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.961115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.969819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cbc8f36-5052-4e09-b868-21adb33dc0a8 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1474 microversion: 2.1 time: 0.379039 Oct 18 13:26:58.975334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 467/947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:58.981770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.988999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.994922 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ccb943dc-2573-4629-b101-ee6062ffa95b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.071709 Oct 18 13:26:58.995528 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 481/948] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:59.006924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.007439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.007889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.008605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.009236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.009847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.307474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:59.316101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69f4d0d9-dca6-447c-bc0f-a3bb3d313301 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.339505 Oct 18 13:26:59.319971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 468/949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:59.416011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f197a8-adff-400a-85f0-5a61d9677006", "name": "network-vif-plugged", "status": "completed", "tag": "3b35b9d9-9128-4a86-8aad-a8366b499599"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:59.451205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.452059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.452676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.473047 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] Creating event network-vif-plugged:3b35b9d9-9128-4a86-8aad-a8366b499599 for instance 82f197a8-adff-400a-85f0-5a61d9677006 on n-h1-858383-13 Oct 18 13:26:59.478421 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-997d7a8c-f3d6-488c-ad2d-24f1170b11e2 req-de17b79e-8943-4233-a810-88d1f44c439c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067594 Oct 18 13:26:59.481325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 482/950] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:59.537436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:59.543390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:59.563348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.564136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.564755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.566464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.567096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.567834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.578363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:59.582676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:59.590294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.594662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.597630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.604737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.605233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.605767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.844670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:59.857689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bf3e539-b247-4eaa-9ef7-53e35efb5394 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.284210 Oct 18 13:26:59.879032 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 483/951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:59 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:59.884386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e653014b-28e0-4001-a2f6-bbef221b2243", "tag": "87bf4ee1-68c1-4ec1-a65d-ceab21f912b8"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:59.909515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.910393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.911227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.930594 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] Creating event network-changed:87bf4ee1-68c1-4ec1-a65d-ceab21f912b8 for instance e653014b-28e0-4001-a2f6-bbef221b2243 on n-h1-858383-13 Oct 18 13:26:59.936162 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ff743885-a8d2-4c99-9aa8-f554b112f82c req-944d28f5-2d33-4d5d-8318-1ce51dd9188a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055357 Oct 18 13:26:59.939265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 484/952] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:59.947589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7a1173-4636-44fa-b442-42c7ba2e5ba0", "name": "network-vif-deleted", "tag": "5dbd27d0-ee43-4485-8828-e8fa1b25376f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:59.959967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.960691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.961400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.980322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] Creating event network-vif-deleted:5dbd27d0-ee43-4485-8828-e8fa1b25376f for instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 on n-h2-858383-13 Oct 18 13:26:59.988937 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8c8eb76c-1e65-4792-953b-6e94afdc5eb7 req-92fd89df-c190-4b87-8862-76874fe02b97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047729 Oct 18 13:26:59.993549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 485/953] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:00.003104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.004150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.012451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:00.019942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.021138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.021834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.023259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.023951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.024631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.051004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.059981 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2eb386a-c034-473b-8b54-1ab2aba9b046 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.544656 Oct 18 13:27:00.081358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 469/954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:59 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.088307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.088943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.104487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.111473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.111473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.111473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.111473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.112373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.163201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:00.229659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.244344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc1e002c-f4e5-44e3-b3f6-781926b96171 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1303 microversion: 2.1 time: 0.157369 Oct 18 13:27:00.245085 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 470/955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.256039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8f61a21-0cc9-4c95-b1fd-c2fcc3798087 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3315de820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.312010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8f61a21-0cc9-4c95-b1fd-c2fcc3798087 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.065221 Oct 18 13:27:00.322778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 471/956] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.343020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.344186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.357214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.357839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.359418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.361326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.361940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.362962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.671468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.680898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b8d1bae-0893-4b1b-b5ef-13015f05c07e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.342589 Oct 18 13:27:00.697498 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 472/957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.754273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.762734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-33d0b91f-ceab-4c4f-a3e0-90a8133262d3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.766789 Oct 18 13:27:00.774458 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 486/958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:59 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.884885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.885549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.888029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:00.892902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.893407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.893857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.894591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.895057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.895578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.044712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.053112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71285ffa-6f65-4371-ade8-be24807ba540 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.172105 Oct 18 13:27:01.053717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 473/959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:01.083710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.084446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.091214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.091772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.092364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.093104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.094161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.094603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.275877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.276732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.285625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.286161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.287278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.288645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.289403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.289843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.309400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.318190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fcb7dc87-dad1-4dfa-9517-5995c4588d77 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.238754 Oct 18 13:27:01.331164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.331848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.332629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.333092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lazy-loading 'fault' on Instance uuid de7a1173-4636-44fa-b442-42c7ba2e5ba0 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:01.338074 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 487/960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:01.343228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b5220ed-fe80-4ec2-bc75-80be943ac724 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331473940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.378182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c053ac77b3c479da2f3145adb4dfc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e374527f6eda4730aa116c71d01dfd4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.386866 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f763453-9a22-47f0-b2df-76a958cc5d73 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 200 len: 1308 microversion: 2.1 time: 0.117449 Oct 18 13:27:01.387982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 474/961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:01.399977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b5220ed-fe80-4ec2-bc75-80be943ac724 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.060428 Oct 18 13:27:01.401542 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 488/962] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:01.495824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "name": "network-vif-plugged", "status": "completed", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:01.509374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.509953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.510396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.523646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] Creating event network-vif-plugged:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h1-858383-13 Oct 18 13:27:01.528974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ae91583a-ade0-413e-830c-a146ddb8505b req-7997f557-3ee6-4deb-ba95-3a14b6587a2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037181 Oct 18 13:27:01.530037 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 475/963] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:01.707085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.707983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.715676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.716691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.717308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.718420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.719207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.719874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.786561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.787315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.794937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.795884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.796583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.798380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.799273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.799812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.989097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.009125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c0d6525-5fab-465d-9ed9-518c0fee6c2a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1319 microversion: 2.1 time: 0.307714 Oct 18 13:27:02.016272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 489/964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:02.028390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb", "tag": "39bc19b7-6e12-4670-bad8-fddd214378ab"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:02.044694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.045191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.045687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.046491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.054983 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99d0616b-30b3-4675-b6f0-4acc28519484 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.273660 Oct 18 13:27:02.055555 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 476/965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:02.057995 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] Creating event network-changed:39bc19b7-6e12-4670-bad8-fddd214378ab for instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb on n-h2-858383-13 Oct 18 13:27:02.064995 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7b37b51d-1fd1-4c85-b37a-3dbadf05f405 req-f774eb73-8b77-4fe7-9b47-85125e9a13dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047509 Oct 18 13:27:02.065963 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 490/966] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:02.076234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.077000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.083209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.083796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.084308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.085099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.085977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.086506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.227699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:02.317338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.332268 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0aaa0c0d-83bf-4348-a04c-420fed781ccd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.259578 Oct 18 13:27:02.346259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.350970 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 477/967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:02.368265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.371784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.372384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.372838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.373554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.374019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.374475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.413354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.413974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] [instance: de7a1173-4636-44fa-b442-42c7ba2e5ba0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.425429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.426571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.427114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.428353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.429358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.430130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.455885 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] HTTP exception thrown: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Request method failure captured: Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 HTTP/1.1 Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlodLnWlwaiSllKVnw0uvwPrs7xq7z11jlHdLIivZRnfAw3BUoRnVqk5uaLjh9cW3yvmfmE7b94AtKMsXHF56uFKNKPr95f5yzcMBiM9wP5gK5j4tR4lU5Ygcecg-X6-chcscK59W1pSP6ew-lHqUVfOTRVZ6CAAHz3q_p9p0yTPpw Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e374527f6eda4730aa116c71d01dfd4b Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:02.457782 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e374527f6eda4730aa116c71d01dfd4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e374527f6eda4730aa116c71d01dfd4b Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1452858684 Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-LiveMigrationNegativeTest-1452858684-project Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5c053ac77b3c479da2f3145adb4dfc21 Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-LiveMigrationNegativeTest-1452858684-project Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. Oct 18 13:27:02.459253 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'de7a1173-4636-44fa-b442-42c7ba2e5ba0'} Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:02.460123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. Oct 18 13:27:02.461526 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:02.462853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] Returning 404 to user: Instance de7a1173-4636-44fa-b442-42c7ba2e5ba0 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:02.462853 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9aaf5574-543c-4540-baa3-219ed2b98d13 tempest-LiveMigrationNegativeTest-1452858684 tempest-LiveMigrationNegativeTest-1452858684-project] 10.222.0.27 "GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0" status: 404 len: 111 microversion: 2.1 time: 0.054532 Oct 18 13:27:02.462853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 478/968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/de7a1173-4636-44fa-b442-42c7ba2e5ba0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:27:02.477150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4b3be94-4fc4-4e7c-ac73-82696889f5e9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331639e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.551495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4b3be94-4fc4-4e7c-ac73-82696889f5e9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.087312 Oct 18 13:27:02.554279 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 479/969] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:02.596703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.597323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.602526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.608544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.609823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.610465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.612255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.612363 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dba69b6b-1a11-4f16-8047-86716a6ddaf8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.270046 Oct 18 13:27:02.612540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.612540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.627161 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 491/970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:02.833286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:02.858645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-247889ef-38e7-4da6-ace1-a558905075ce tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 2345 microversion: 2.25 time: 0.266210 Oct 18 13:27:02.863062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 480/971] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 2345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:02.897164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.900972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.901479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.901932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.902707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.903219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.903661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.930040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62e80802-afff-452c-bbf7-f2fb545f5149 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037752 Oct 18 13:27:02.930670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 492/972] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:27:03.033493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.034332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.041277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.043907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.044483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.045427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.046164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.047086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.053368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:03.080389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.082259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.098778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.099286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.099856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.100447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.105050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.105548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.214103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.225030 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c26c454-3456-4014-b9f7-83541bc15514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1469 microversion: 2.1 time: 0.196114 Oct 18 13:27:03.229739 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 481/973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.253666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.254520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.262604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.267390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.267390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.267390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.267390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.267784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.458405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.470393 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0bd1967c-fa69-4821-9608-63a668dc1852 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1312 microversion: 2.1 time: 0.394736 Oct 18 13:27:03.472374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 493/974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:03.482593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.483459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.497095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.498635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.501811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.510209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.510209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.510209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.550939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:03.621243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.630575 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e046f96-65c7-4829-bcd3-74e66149111e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1469 microversion: 2.1 time: 0.384041 Oct 18 13:27:03.632102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 482/975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.637868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c8193af-b994-4a01-9dfc-7946ec37a1cf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33180f430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.735200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c8193af-b994-4a01-9dfc-7946ec37a1cf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.100518 Oct 18 13:27:03.738260 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 483/976] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.744712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-plugged", "status": "completed", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:03.764747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.765771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.767384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.785491 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] Creating event network-vif-plugged:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:27:03.798504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-655a24aa-595f-430b-a4f8-e43af7c886f4 req-f93e1f6e-1515-409a-85fb-a3fd81c45599 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055845 Oct 18 13:27:03.800000 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 484/977] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:03.813946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.815961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.826470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.827069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.827621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.828880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.829549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.830271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.890564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.900007 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46c4142c-2c28-49bc-ad3f-26d49d0301f6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.424614 Oct 18 13:27:03.900601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 494/978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.916370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.947208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.950560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Searching by: {'reservation_id': 'r-hwtpu9f3', 'deleted': False, 'project_id': '9f5cd093b94c4161bed82c6495bc37be'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:27:03.974922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.975890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.977027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.978852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.979710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.980840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.236740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.239834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:27:04.249534 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9f3a3b6-54d5-4e32-bfee-20dc80a806ac tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.447094 Oct 18 13:27:04.254741 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 485/979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:04.418973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.428076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.428076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.429106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.496928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.497464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:04.507936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.510616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.510857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.512714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.513195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.514928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.651573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b58dda4-4e53-4c3f-8c2a-3c8d83602f83 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-hwtpu9f3" status: 200 len: 2931 microversion: 2.1 time: 0.749898 Oct 18 13:27:04.666704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 495/980] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-hwtpu9f3 => generated 2931 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:04.676728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.701833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_groups [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Querying cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) for 2 instances {{(pid=121009) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:27:04.702575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.712572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.712572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.737562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b2ee18b-99d3-487b-9c7f-2c886b3a3dab tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/eea054df-817f-4a58-9d08-7f395055b92c" status: 200 len: 265 microversion: 2.1 time: 0.065569 Oct 18 13:27:04.738597 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 496/981] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/os-server-groups/eea054df-817f-4a58-9d08-7f395055b92c => generated 265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:04.752887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.753838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:04.760491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.761189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.761791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.763095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.763826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.764525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.803829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.816689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42c84b54-2473-4370-a87f-5a2e0ac7314e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1462 microversion: 2.1 time: 0.321140 Oct 18 13:27:04.817998 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 486/982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1462 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:04.829282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39906237-b01a-42b1-b528-10dca6174919 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3315b3280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.905472 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39906237-b01a-42b1-b528-10dca6174919 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.086084 Oct 18 13:27:04.907083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 487/983] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:04.930879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:04.944083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:04.966275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.968665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.969220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.971128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.973498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.974091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.010887 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-357f6c54-e096-4d61-ade5-fa5cefca5d77 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 200 len: 1622 microversion: 2.1 time: 0.264252 Oct 18 13:27:05.034304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 497/984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 1622 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:05.041492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.043781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.060139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.061386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.062140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.063600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.064270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.064909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.239312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.241423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.249118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:27:05.263070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-061b9656-e7f7-460f-81c4-919df6a58d92 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.226851 Oct 18 13:27:05.265661 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 498/985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:05.272215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.272915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.276662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:05.277067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:05.277544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:05.278139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:05.278560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:05.292847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.297980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.297980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.297980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.297980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.298396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.561971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3a88920-8981-4e3b-b5b4-cadb310b97ab tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1622 microversion: 2.1 time: 0.294766 Oct 18 13:27:05.563056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 499/986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1622 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:05.574922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.574922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.576050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.576574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.577044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.582108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.582108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.582108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.719469 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99e511bd-8dbd-4242-ad5d-047bb38c545b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb/action" status: 202 len: 0 microversion: 2.1 time: 0.809037 Oct 18 13:27:05.722034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 488/987] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:04 2022] POST /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:05.738524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: .version_select at 0x7fb3329eb9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1037991689", "policies": ["anti-affinity"]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:05.802895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:05.813950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:05.831865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.842270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14d954eb-3ee6-4a34-86bf-8f648edeffaf tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.277657 Oct 18 13:27:05.844310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 500/988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:05.849710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.850861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.858180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.859434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.860114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.861233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.861866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.862568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.060074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:06.068657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:06.085164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ef8d6e0-9f5a-4fb8-bbe5-b08715b05e08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.361479 Oct 18 13:27:06.097811 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 489/989] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:27:05 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:06.104671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e653014b-28e0-4001-a2f6-bbef221b2243", "name": "network-vif-plugged", "status": "completed", "tag": "87bf4ee1-68c1-4ec1-a65d-ceab21f912b8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:06.120244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.120848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.121404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.151086 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] Creating event network-vif-plugged:87bf4ee1-68c1-4ec1-a65d-ceab21f912b8 for instance e653014b-28e0-4001-a2f6-bbef221b2243 on n-h1-858383-13 Oct 18 13:27:06.171198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e907da60-028b-4cd2-b8a7-f0085e3dca09 req-73a74d03-f114-4f4f-b524-e9fe79f48e72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082014 Oct 18 13:27:06.172113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 490/990] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:06.185042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-217d0366-e2a2-47b4-b7a6-32ff2a1c5a09 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3314d3dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.230573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.240945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb3b2d58-6dbd-4fb9-99a1-878ee29ec8aa tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1471 microversion: 2.1 time: 0.395183 Oct 18 13:27:06.241408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 501/991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:06.294863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.294863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:06.300555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.310677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.310677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.310677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.310677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.319571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.348636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-217d0366-e2a2-47b4-b7a6-32ff2a1c5a09 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.172840 Oct 18 13:27:06.348636 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 491/992] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:06.365416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1454620123", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9e4c7ddd-ff07-4303-a5c2-608e6e12d7a0"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:06.559043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:07.147114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.162863 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3ed891b-0bd7-418c-b295-867f45a62505 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.874137 Oct 18 13:27:07.177112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 502/993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:07.195503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:07.196306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:07.203264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.203895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.204453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.205285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.205969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:07.206131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.206552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:07.206755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.207020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:07.207433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:07.207850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:07.303818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.306154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.306731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.316998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.322207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.322207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.407308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:07.432963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:07.517126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 2 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:07.522170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:07.699913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.719248 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a874e29-7195-4f47-948b-f8678e67cded tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1324 microversion: 2.1 time: 0.540436 Oct 18 13:27:07.722202 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 503/994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:07 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:07.736495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:07.739103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:07.757839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.760365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.762773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.763558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.764043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.764483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.814353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121010) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 13:27:07.866367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:07.872270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:08.027024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:08.029452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:08.055773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:08.086820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=19022241-d0a1-4ac8-b104-5001819f0e58,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:08.158162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.177010 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fdce125-865d-40ce-bd87-d146e0b0d965 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1471 microversion: 2.1 time: 0.450474 Oct 18 13:27:08.177671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 504/995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:07 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:08.241947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38f35f79-e2f0-49e7-8008-9acf850cf44b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331482310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.276971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:08.293268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:08.335662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38f35f79-e2f0-49e7-8008-9acf850cf44b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.132672 Oct 18 13:27:08.337036 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 505/996] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:08.350825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.353412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.364523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.365037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.365483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.372287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.372849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.373325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.461726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:08.473583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:08.553814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b69a495d-5ad5-4f69-a9e3-3b3becb9c9d6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.204464 Oct 18 13:27:08.555450 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 492/997] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 2207 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:27:08.562990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.569342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.570354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Searching by: {'deleted': False, 'project_id': '9f5cd093b94c4161bed82c6495bc37be'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:27:08.594621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.602827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.604036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.606364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.607170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.608019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.676845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:27:08.750643 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a75f4bd3-f78d-48cc-9e53-f997b570ae09 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.191266 Oct 18 13:27:08.760925 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 493/998] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers => generated 1666 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:08.767783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.768069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.775045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.775897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.776525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.777408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.778025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.778636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.785723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:08.848144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.871093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-830b10ea-e2e3-4644-b9be-d4e64df32cba tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.532053 Oct 18 13:27:08.876789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 506/999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:08.883172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6fa3a68-e548-401e-885d-2849ca142fd1", "device": "/dev/xvdb"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:08.893753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.915452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.918095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.918722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.919648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.922171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.925363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.244318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.255632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1833677c-8b05-461a-97a6-538c955a0dc8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.490729 Oct 18 13:27:09.277200 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 494/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:09.286425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-749cc9b2-5d84-454c-a32c-6ee7d75a61d0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:09.294462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-749cc9b2-5d84-454c-a32c-6ee7d75a61d0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:09.431029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-749cc9b2-5d84-454c-a32c-6ee7d75a61d0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.440882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-749cc9b2-5d84-454c-a32c-6ee7d75a61d0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1219 microversion: 2.1 time: 0.162492 Oct 18 13:27:09.446175 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 495/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:09 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:09.465538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:09.465538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:09.498401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.500317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.504928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.511110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.511110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.511307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.856618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.868757 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28879e67-91f8-489f-88d5-cf977a64cdc4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1471 microversion: 2.1 time: 0.419773 Oct 18 13:27:09.869476 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 496/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:09 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1471 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:09.875315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:09.875952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:09.892619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.893150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.900950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.900950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.900950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.900950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.248958 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e257cc3a-1cac-49e8-ac70-17c559f92174 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.373321 Oct 18 13:27:10.251114 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 507/1003] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 18 13:27:08 2022] POST /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 194 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:27:10.270528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db5927ae-0fed-4a05-8716-2d9905b560b3 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33125fa60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:10.282875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.298372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9862d498-2d38-431e-8abd-d8aa02cbf987 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.427356 Oct 18 13:27:10.300223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 497/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:09 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:10.397700 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db5927ae-0fed-4a05-8716-2d9905b560b3 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.145126 Oct 18 13:27:10.399700 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 508/1005] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:10 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:10.418864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb", "name": "network-vif-plugged", "status": "completed", "tag": "39bc19b7-6e12-4670-bad8-fddd214378ab"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:10.460304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.460811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.467737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.512240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3cb4881-8ac5-496b-8ca2-a70c2d000fa9 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] Calling method '.version_select at 0x7fb33136c160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:10.532841 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] Creating event network-vif-plugged:39bc19b7-6e12-4670-bad8-fddd214378ab for instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb on n-h2-858383-13 Oct 18 13:27:10.543714 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-119024af-4a40-4f4f-ad07-38a3face4e23 req-a42287e3-8216-4087-a05e-cc22b8fe0793 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142769 Oct 18 13:27:10.548824 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 509/1006] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:10.562998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:10.564534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:10.579448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.579954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.580396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.581115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.581576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.582007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.089395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.108244 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d42a7a97-ef6b-465e-ae31-5fa5a0201379 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.557853 Oct 18 13:27:11.111224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 510/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:10 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.154502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a865290-7fe5-4396-a1a7-1c89c05af180 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1897594109", "metadata": {"": ""}}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a865290-7fe5-4396-a1a7-1c89c05af180 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action HTTP/1.1 Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 107 Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:27:11.176203 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1897594109", "metadata": {"": ""}}} Oct 18 13:27:11.177742 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1897594109', 'metadata': {'': ''}}}} Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'': ''} Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:11.178568 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.180557 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:11.181811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:11.193849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a865290-7fe5-4396-a1a7-1c89c05af180 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:11.195100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a865290-7fe5-4396-a1a7-1c89c05af180 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action" status: 400 len: 170 microversion: 2.1 time: 0.082566 Oct 18 13:27:11.200755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 511/1008] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 18 13:27:11 2022] POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action => generated 170 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:11.208304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4d13efa-705d-40c9-8678-e2c87bf68f08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.209608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4d13efa-705d-40c9-8678-e2c87bf68f08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.307123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3cb4881-8ac5-496b-8ca2-a70c2d000fa9 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 5383 microversion: 2.1 time: 1.004189 Oct 18 13:27:11.307803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 498/1009] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:10 2022] GET /compute/v2.1/os-networks => generated 5383 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.312519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.341889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.342806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4d13efa-705d-40c9-8678-e2c87bf68f08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.344201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.344201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.344201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.344201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.344634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4d13efa-705d-40c9-8678-e2c87bf68f08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1219 microversion: 2.1 time: 0.127838 Oct 18 13:27:11.344731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.344830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 512/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.344917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.347541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.348359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.355901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.356862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.357471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.358411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.359192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.359857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.598907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.617144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-45c6c64f-1e23-4057-b945-c92b10171a70 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1471 microversion: 2.1 time: 0.308145 Oct 18 13:27:11.617753 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 499/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.636582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae0d56c2-1987-46ee-85e5-e5ddfa2679a1 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] Calling method '.version_select at 0x7fb3317a6b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.870143 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae0d56c2-1987-46ee-85e5-e5ddfa2679a1 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/74b8a990-fa9c-47ba-9c41-ee366d84010c" status: 200 len: 652 microversion: 2.1 time: 0.251174 Oct 18 13:27:11.881171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 500/1012] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/os-networks/74b8a990-fa9c-47ba-9c41-ee366d84010c => generated 652 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:11.889792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7565ea1-7afd-4a18-b2b8-45a0e8a039bf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33135d3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.984803 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7565ea1-7afd-4a18-b2b8-45a0e8a039bf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.097652 Oct 18 13:27:11.984803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 501/1013] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.996145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dee04bf-b4ee-4761-be1e-d88c1827b692 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] Calling method '.version_select at 0x7fb331639c10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:12.318915 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dee04bf-b4ee-4761-be1e-d88c1827b692 tempest-NetworksTest-1148876055 tempest-NetworksTest-1148876055-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 5383 microversion: 2.1 time: 0.336340 Oct 18 13:27:12.320290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 502/1014] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/os-networks => generated 5383 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:12.326282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:12.327476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.374505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.375506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.375506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.376243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.376744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.377135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.755831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:12.771295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-300014b1-2c93-4928-a14d-93730e748e0a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1307 microversion: 2.1 time: 0.447438 Oct 18 13:27:12.789354 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 503/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:12 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:12.794748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:12.802213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:12.804309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.806578 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7471dd2-6e8b-44f9-8963-8b53bf1632b8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 1.471151 Oct 18 13:27:12.807153 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 513/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:12.815112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:12.815747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.829729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.834373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.837665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.837665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.837665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.837665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.844322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.844825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.845357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.848176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.852934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.853616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.866173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:13.039003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.048653 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a9630752-2bda-4a0e-b03f-70cdcfb5ad08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1271 microversion: 2.1 time: 0.253563 Oct 18 13:27:13.049053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 504/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:12 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:13.070752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.076691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.083781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.087937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.091091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.092024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.092651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.096000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.291186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.317148 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b320ee4-e8c3-4db7-9f95-b036805065fe tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1471 microversion: 2.1 time: 0.508774 Oct 18 13:27:13.319636 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 514/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:12 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1471 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:13.350340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d540dca-344c-4a59-a2f7-ad39658ac4ea tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.439075 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d540dca-344c-4a59-a2f7-ad39658ac4ea tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.115594 Oct 18 13:27:13.439821 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 515/1019] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:13.489033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.501672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a44258d1-b075-4511-999d-7d1f77e10eeb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.451431 Oct 18 13:27:13.513128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 505/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:13.539526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50d8c032-40d9-4dac-9622-cea034891007 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1280943091", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50d8c032-40d9-4dac-9622-cea034891007 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action HTTP/1.1 Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 619 Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:27:13.545655 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:13.547719 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:27:13.548361 n-d-858383-13 devstack@n-api.service[121009]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1280943091", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 18 13:27:13.548361 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:27:13.548361 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1280943091', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 13:27:13.548570 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:13.549244 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.550258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:27:13.550994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.554313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50d8c032-40d9-4dac-9622-cea034891007 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:13.556453 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-50d8c032-40d9-4dac-9622-cea034891007 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action" status: 400 len: 938 microversion: 2.1 time: 0.021349 Oct 18 13:27:13.562849 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 516/1021] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 18 13:27:13 2022] POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action => generated 938 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:13.568375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.569057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.579517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.581914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.583982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.586218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.588360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.590490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.801461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.802143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.829347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.833018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.837660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.845856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.849965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.850635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.963808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.975097 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0faa2052-5810-4893-a0fb-13b313715af5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.410557 Oct 18 13:27:13.980591 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 506/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:14.007621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.012069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:14.025751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.032498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.032498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.035562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.036188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.049292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.059350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:14.415356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:14.427889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4eb15e7-7c60-443f-8717-8f4dc6414dff tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.423512 Oct 18 13:27:14.430249 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 507/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:14 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:14.436553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.438318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:14.482647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.504749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.506086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:14.506209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.506209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.506209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.507013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.516398 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dee1d2e9-28ad-4677-a160-1710eeb4141d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1488 microversion: 2.1 time: 0.722803 Oct 18 13:27:14.518421 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 517/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1488 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:14.533931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.534960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:14.549061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.549816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.550458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.551319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.552545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.553136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.682790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:14.695689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29ce5d8e-546c-49a5-a7f3-2d8751a46e32 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1289 microversion: 2.1 time: 0.264007 Oct 18 13:27:14.699848 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 508/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:14 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1289 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:14.716725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7128950f-4108-4c1e-bacd-40639fcb4108 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7128950f-4108-4c1e-bacd-40639fcb4108 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action HTTP/1.1 Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 285 Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:14.729635 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:27:14.731270 n-d-858383-13 devstack@n-api.service[121010]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:27:14.732166 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:27:14.732937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:27:14.734467 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:27:14.735514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:27:14.735514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:14.740183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7128950f-4108-4c1e-bacd-40639fcb4108 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:14.741214 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7128950f-4108-4c1e-bacd-40639fcb4108 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action" status: 400 len: 619 microversion: 2.1 time: 0.040369 Oct 18 13:27:14.748275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 509/1026] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 18 13:27:14 2022] POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:14.764493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a81f2f2-4a01-471c-9383-09e3c3d274dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3316398b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.845582 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a81f2f2-4a01-471c-9383-09e3c3d274dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.095860 Oct 18 13:27:14.846395 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 510/1027] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:14 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:14.861619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:14.862243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:14.877112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.879699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.884205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.884205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.884205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.884205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.945012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lazy-loading 'flavor' on Instance uuid afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:15.075479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.084858 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41274ee2-93bc-410d-a3ff-6a5682703baf tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.560857 Oct 18 13:27:15.090692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 518/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:14 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:15.128843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.132286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.160168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.162585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.164044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.168714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.170987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.175117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.387450 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bff8d18a-8fab-4581-baeb-b215a1787124 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb/action" status: 202 len: 0 microversion: 2.1 time: 0.537867 Oct 18 13:27:15.389026 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 511/1029] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:14 2022] POST /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:15.415021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.419568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.478205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.481737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.484950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.492761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.494365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.494987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.902889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.915755 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e1772b2-5f0e-4514-8d3a-a1a404dd122b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1496 microversion: 2.1 time: 0.521069 Oct 18 13:27:15.927504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 512/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1496 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:15.936121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.936755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.945521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.957398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.958250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.958852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.959727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.963328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.963987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.980924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca0cf561-0b0c-4847-a735-d07919dec577 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.867766 Oct 18 13:27:15.988284 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 519/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:16.001589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23f7b37d-528f-4d30-a0ac-04e206d6ac53 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3314ff820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.138746 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23f7b37d-528f-4d30-a0ac-04e206d6ac53 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.148499 Oct 18 13:27:16.146330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 520/1032] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:16.155164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.160400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.181984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.182792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.185010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.188555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.189773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.190520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.484648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.494711 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2184e4fd-4146-4976-ae04-42735251ab3f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1277 microversion: 2.1 time: 0.565477 Oct 18 13:27:16.500872 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 513/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1277 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:16.514377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.515632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.548482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.556588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.556588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.556588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.556588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.556975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.719717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.733267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e7fed3d-1f09-4187-83f5-ff77423b5e09 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.588727 Oct 18 13:27:16.737304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 521/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:16.768695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-417734409"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:16.773835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.783569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.784426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.785579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.787096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.787837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.788903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.997811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:17.011597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-897a20f8-f124-451c-ae03-5992b2b2efbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.508196 Oct 18 13:27:17.020116 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 514/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:17.037898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.042426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.066917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.066917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.066917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.066917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.067201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.067201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.461758 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c318796a-2ea1-49fb-b377-4e0644204687 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action" status: 202 len: 0 microversion: 2.1 time: 0.691435 Oct 18 13:27:17.463324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 522/1036] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:16 2022] POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:27:17.476252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cfd91c96-2031-447c-98ee-410ea2cfae05 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.566599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cfd91c96-2031-447c-98ee-410ea2cfae05 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.096687 Oct 18 13:27:17.570364 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 523/1037] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:17.575866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:17.591827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e05214e-313e-4026-924e-a31e863a625e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 200 len: 1479 microversion: 2.1 time: 0.562660 Oct 18 13:27:17.618448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 515/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 1479 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:17.618594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1781730462"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:17.625474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.626968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.636541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.643582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.646961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.655494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.656759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.658248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.658860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.659418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.660024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.665420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.666153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.666741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.673634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.743289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:17.761971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Cannot 'createImage' instance e653014b-28e0-4001-a2f6-bbef221b2243 while it is in task_state image_snapshot_pending Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action HTTP/1.1 Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 85 Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:27:17.763955 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1781730462"}} Oct 18 13:27:17.765369 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'createImage' instance e653014b-28e0-4001-a2f6-bbef221b2243 while it is in task_state image_snapshot_pending Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1781730462'}}} Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e653014b-28e0-4001-a2f6-bbef221b2243 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:17.766193 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e653014b-28e0-4001-a2f6-bbef221b2243 while it is in task_state image_snapshot_pending Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e653014b-28e0-4001-a2f6-bbef221b2243 while it is in task_state image_snapshot_pending Oct 18 13:27:17.768003 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.770214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 409 to user: Cannot 'createImage' instance e653014b-28e0-4001-a2f6-bbef221b2243 while it is in task_state image_snapshot_pending {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:17.771256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9badcec6-7b50-4320-a9ff-1e545bae3404 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action" status: 409 len: 167 microversion: 2.1 time: 0.199703 Oct 18 13:27:17.772296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 524/1039] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:17 2022] POST /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243/action => generated 167 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:27:17.777646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-233213575"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:17.780173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.786844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.787697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.788299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.789201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.789807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.790473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.996543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:18.005897 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eda9c480-2ffc-439e-bfd0-30a7d568e5cb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.396445 Oct 18 13:27:18.011109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 516/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:18.024124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e79e29b5-cfd8-43b4-99de-493266962688 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb3329eb9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.519781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-292b9c70-db66-4b98-ad88-d75b2b6597d3 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb/action" status: 202 len: 0 microversion: 2.1 time: 0.745929 Oct 18 13:27:18.537552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 525/1041] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:17 2022] POST /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:27:18.562207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.571649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:18.598675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.608530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.609216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.614515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.615022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.620978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.633531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:18.697355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e79e29b5-cfd8-43b4-99de-493266962688 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/images/ed8e93e2-3605-4715-bf37-50c71e61f294" status: 204 len: 0 microversion: 2.1 time: 0.678827 Oct 18 13:27:18.699097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 517/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/images/ed8e93e2-3605-4715-bf37-50c71e61f294 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:18.715407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-253035e0-2ce5-4fe5-8725-bb61ce57c88f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312cc310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.868979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-253035e0-2ce5-4fe5-8725-bb61ce57c88f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.168735 Oct 18 13:27:18.869562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 518/1043] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:18.885676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57a4dd0e-d2ea-4275-84f4-4b71bc0811f4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33136cd30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.073524 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57a4dd0e-d2ea-4275-84f4-4b71bc0811f4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.202270 Oct 18 13:27:19.079130 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 519/1044] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:19.088256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.089152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.123338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.123338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.123338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.123338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.123798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.123798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.437987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=32 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:19.550609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.570815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2246385a-da97-4e37-afc2-e69fb09c233e tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1539 microversion: 2.1 time: 0.485413 Oct 18 13:27:19.571957 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 520/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1539 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:19.591880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.592535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.619866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.620512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.622148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.622324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.622805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.623251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.055639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:20.068426 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d635759-ff17-450d-9716-8a6df24e5457 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.492649 Oct 18 13:27:20.087497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 521/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:20.103379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19022241-d0a1-4ac8-b104-5001819f0e58", "tag": "4f6c48f2-9cf2-40af-9d84-ddd167b98910"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:20.120891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.126755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.127551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.160274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] Creating event network-changed:4f6c48f2-9cf2-40af-9d84-ddd167b98910 for instance 19022241-d0a1-4ac8-b104-5001819f0e58 on n-h2-858383-13 Oct 18 13:27:20.161140 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cf96138d-28df-4a2f-8f57-6a750927b375 req-3a2a6362-45d6-43ea-bb09-ffd31ff25cac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068917 Oct 18 13:27:20.163337 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 522/1047] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:20.178998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-668f9ab2-1539-4664-b905-0041fbfe269e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312d8c10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.206644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:20.216950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88d1d614-63e8-4185-9cc6-f980e542ba58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 1.674996 Oct 18 13:27:20.218379 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 526/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:20.257011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0491e227-ec81-4b15-af02-a16f3ebc45db tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331ad8940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.273351 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-668f9ab2-1539-4664-b905-0041fbfe269e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.108349 Oct 18 13:27:20.274181 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 523/1049] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:20.336919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0491e227-ec81-4b15-af02-a16f3ebc45db tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.098808 Oct 18 13:27:20.345544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 527/1050] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:20.596058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.596948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:20.612245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.612918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.617362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.618292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.618966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.621467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.080945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.095535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.096502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:21.105923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36c169f1-09c4-488a-8e1c-3aa7054e1528 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1539 microversion: 2.1 time: 0.515328 Oct 18 13:27:21.114596 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 524/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1539 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.118918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.120034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.120498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.122610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.126284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.127048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.243894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.244838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:21.253406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.255879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.256516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.267598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.268301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.269011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.330393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:21.476493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.488208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-372dfbc9-45b1-4983-9600-e160f37eb6d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.396765 Oct 18 13:27:21.490230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 528/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.495789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd4a0859-8856-4d54-835f-0b76d7a7063b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33194adc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.551111 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd4a0859-8856-4d54-835f-0b76d7a7063b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.051781 Oct 18 13:27:21.551111 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 529/1053] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.554195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaca6d1c-5e1d-41cd-8457-619186289384 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3353d8d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.557440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.573273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6877fcd0-018d-472e-8e54-e662f003b290 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.330268 Oct 18 13:27:21.574407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 525/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.609974 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eaca6d1c-5e1d-41cd-8457-619186289384 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.063403 Oct 18 13:27:21.610589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 530/1055] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.954408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ed0a4d-41f5-4638-9abb-2963f0d3c74b", "tag": "ca3fc47a-7b29-4791-b49f-c6eeae6a6614"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:21.996450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.998859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.001268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.051462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] Creating event network-changed:ca3fc47a-7b29-4791-b49f-c6eeae6a6614 for instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b on n-h1-858383-13 Oct 18 13:27:22.063799 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-162bca9f-2a6c-494c-9722-c86363373645 req-d605b386-0ff0-4f9a-b4a1-67909f6c62a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118711 Oct 18 13:27:22.086311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 526/1056] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:22.155588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.156682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.172507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.177632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.181029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.182438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.184537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.185234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.516579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.517528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.526550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.564885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.566715 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-203ef9a5-19c1-43ff-a2ed-bc0138b37a80 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1534 microversion: 2.1 time: 0.426499 Oct 18 13:27:22.589012 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 531/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1534 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:22.594805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.598742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2bc211a2-8ae7-47a0-a132-146c80733a9e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312e3f70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.599903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.600815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.602795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.612579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.726173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2bc211a2-8ae7-47a0-a132-146c80733a9e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.135311 Oct 18 13:27:22.728768 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:22.742789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.752756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.759967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.761951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.764220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.767201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.767891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.768927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.243968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:23.253469 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93fc0753-def0-447f-b3aa-02d2da068e5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.525676 Oct 18 13:27:23.269806 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 533/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:23.278313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c56d4e3-2f70-4192-a481-e9245d7b1584 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb335406a60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.315800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:23.329596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31fbd6d5-f55a-4d6b-af96-68a355a2582c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.818021 Oct 18 13:27:23.331940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 527/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:23.594961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.595767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:23.605029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.607921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.607921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.613753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.614557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.615007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.902213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c56d4e3-2f70-4192-a481-e9245d7b1584 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1453 microversion: 2.1 time: 0.629391 Oct 18 13:27:23.903337 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 534/1061] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1453 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:24.016417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.031989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ceed622c-bdfe-4ea8-bea5-108b76ae8e56 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1521 microversion: 2.1 time: 0.441214 Oct 18 13:27:24.032568 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 528/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:24.080739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cddbb337-60d8-4672-9975-e7ce3e819c81 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331aa2e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.289464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-157345b2-3c97-4221-af01-67ec075b2af1 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Calling method '.version_select at 0x7fb33539b940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.472292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-157345b2-3c97-4221-af01-67ec075b2af1 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 371 microversion: 2.1 time: 0.567612 Oct 18 13:27:24.474743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 535/1063] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:24.485108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb", "name": "network-vif-plugged", "status": "completed", "tag": "39bc19b7-6e12-4670-bad8-fddd214378ab"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:24.512458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.513381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.514207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.552071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] Creating event network-vif-plugged:39bc19b7-6e12-4670-bad8-fddd214378ab for instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb on n-h2-858383-13 Oct 18 13:27:24.565862 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-65f0da26-b9c6-468e-b9c8-b51a796b715a req-84cf05dd-64ea-4d0b-980a-7c8a2d331d77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084031 Oct 18 13:27:24.567341 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 536/1064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:24.579325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.581900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:24.601514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.602523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.603629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.604909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.606358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.607075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.687524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:24.768383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:25.167611 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4029bbc-fdc7-4d03-b885-2d7dbbdd2a4f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 204 len: 0 microversion: 2.1 time: 0.597427 Oct 18 13:27:25.169037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 537/1065] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:24 2022] DELETE /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:25.176431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.177381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.215741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.215741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.215741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.215741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.216233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.216233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.603328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:25.618471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-316e7e7f-3f51-4d27-bbe9-b4584c115d31 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.446099 Oct 18 13:27:25.626403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 538/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:25.633352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.634361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.641507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.642608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.648374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.648374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.648374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.648374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.087603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.102512 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-555e639b-3985-4c10-8eaf-0c624568ead3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.474275 Oct 18 13:27:26.110144 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 539/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:26.127199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb331ad8a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:26.269509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.274782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.275264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.276085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.281388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.287109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.333842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:26.517262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a750df5-39cb-4ce0-99c4-ef4ad6664796 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 328 microversion: 2.1 time: 0.405756 Oct 18 13:27:26.520018 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 540/1068] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:26 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 328 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:26.540425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24ad90b6-5833-44e3-9370-d897bb4b3e12 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331ad8dc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.799377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cddbb337-60d8-4672-9975-e7ce3e819c81 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 5.761231 Oct 18 13:27:29.801690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 529/1069] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:24 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 5764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:29.819711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.820492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.827652 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24ad90b6-5833-44e3-9370-d897bb4b3e12 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1462 microversion: 2.1 time: 3.306276 Oct 18 13:27:29.831743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 541/1070] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:26 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1462 bytes in 3311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:29.837667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.841094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.841650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.842455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.843579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.844250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.845390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.847624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.864659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.865170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.865683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.866458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.866929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.871000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.887146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.888399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.889131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.889803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lazy-loading 'fault' on Instance uuid e653014b-28e0-4001-a2f6-bbef221b2243 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:29.955102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.013665 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e8c916c-e49e-401e-85d5-0177d33be7cb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 200 len: 1314 microversion: 2.1 time: 0.209499 Oct 18 13:27:30.018719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 530/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:30.023566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e653014b-28e0-4001-a2f6-bbef221b2243", "name": "network-vif-plugged", "status": "completed", "tag": "87bf4ee1-68c1-4ec1-a65d-ceab21f912b8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:30.064845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.065342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.066158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.093061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] Creating event network-vif-plugged:87bf4ee1-68c1-4ec1-a65d-ceab21f912b8 for instance e653014b-28e0-4001-a2f6-bbef221b2243 on n-h1-858383-13 Oct 18 13:27:30.105478 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-eb18e4c4-e5e2-4867-a9eb-2302833c8592 req-1f9b19df-8f9a-496f-9158-6452b96c6bca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083471 Oct 18 13:27:30.109796 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 531/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:30.257659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.257659 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-598180e5-42ae-4278-8c5d-24c73dedd9c7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.410783 Oct 18 13:27:30.259851 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 542/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:30.287449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.288612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.300807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.302763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.303665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.305850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.307563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.308855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.324776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1973686360", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:30.412832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:30.503560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.515747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b77e452-2af5-493e-a511-8df43904e848 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.254663 Oct 18 13:27:30.516353 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 543/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:30.521961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e653014b-28e0-4001-a2f6-bbef221b2243", "name": "network-vif-deleted", "tag": "87bf4ee1-68c1-4ec1-a65d-ceab21f912b8"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:30.533213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.535641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.535641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.547074 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] Creating event network-vif-deleted:87bf4ee1-68c1-4ec1-a65d-ceab21f912b8 for instance e653014b-28e0-4001-a2f6-bbef221b2243 on n-h1-858383-13 Oct 18 13:27:30.552419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-87e41bad-10e0-43fb-9ec4-57eb536a5ec3 req-16d1182e-42c4-4a17-b62a-8d0e1bc4b804 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034529 Oct 18 13:27:30.553295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 544/1075] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:30.563278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-085ab4dd-e780-4fe5-8b9c-849d14305360 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.635084 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-085ab4dd-e780-4fe5-8b9c-849d14305360 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 200 len: 1462 microversion: 2.1 time: 0.075552 Oct 18 13:27:30.637365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 545/1076] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 1462 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:30.651471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.656113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.670827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.671381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.671836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.672554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.673018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.673455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.899448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.911188 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a862c3c-6099-4978-8c2d-2bcfc2cd1918 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1466 microversion: 2.1 time: 0.263485 Oct 18 13:27:30.912579 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 546/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:30.917830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3021bdd9-9302-41a4-a5ca-ca7322fdb2a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331ad8790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.996741 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3021bdd9-9302-41a4-a5ca-ca7322fdb2a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.082806 Oct 18 13:27:30.997448 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 547/1078] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:31.007698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2026874270"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:31.013499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.024177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.024682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.025127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.029918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.035280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.036074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.065712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:31.066209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:31.066637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:31.067043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:31.067517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:31.085526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.086024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.087612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.087612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.090666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.091395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.124783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:31.159565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:31.159565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for user 0bb4f887293049caa63d2e05fe937224 and project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:31.191327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.utils [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] cores quota exceeded for 3605ca5c82984d1fbefb1cfed86e9f20, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121010) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:27:31.192188 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Request method failure captured: Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 145 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqm5n9dUoZSKl1j0BBPE3WlbbaUTdxo7xNfbQ9l2ktnPHxW25HQ8eDx2bfG3F8NJKDo9_f8eC8_LxUcsmsXOuGPybmsA92U55VUNt8qDR6ns9ocnjPZYWbNUvTv1Xkom3bJ9v43WgPBLEK6PBs9aWu_SQRmKb5kSYlOfiCfLIhD8KYQ Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:31.212516 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 0bb4f887293049caa63d2e05fe937224 Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1973686360", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} Oct 18 13:27:31.214117 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1973686360', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452'}}} Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:27:31.214936 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:31.216074 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.217349 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:31.226889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b92031eb-fe42-451a-b13d-d2c327e93527 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.109561 Oct 18 13:27:31.232560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 532/1079] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:30 2022] POST /compute/v2.1/servers => generated 111 bytes in 1122 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:31.237785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:31.244042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.259843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.260751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.261422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.263357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.267324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.268133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.312998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 HTTP/1.1 Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:31.317058 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:27:31.321801 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243'} Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:31.322601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:27:31.323827 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:31.324905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:31.326218 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b17e4d8f-d404-49c3-a69b-c8ffffa19527 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 404 len: 111 microversion: 2.1 time: 0.091792 Oct 18 13:27:31.331350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 533/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:31 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:31.339499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb3312d7d30>, body: {"quota_set": {"cores": 20}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:31.466468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.470909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.471399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.472168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.472633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.473062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.709980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bebd3ccc-1dfa-4343-876d-fd759f75d04b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 329 microversion: 2.1 time: 0.377626 Oct 18 13:27:31.731497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 534/1081] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:31 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 329 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:31.735191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41f6fcf9-dc77-49b2-bc39-c094dc2695a6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "POST /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027/action" status: 202 len: 0 microversion: 2.1 time: 0.732819 Oct 18 13:27:31.736411 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 548/1082] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:30 2022] POST /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:27:31.744925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:31.748077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.751126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48b9cd60-115b-4a44-b6cb-01fd8a56cebb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'create', calling method: .version_select at 0x7fb331ad8a60>, body: {"keypair": {"name": "tempest-keypair-1015647442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoXpp0+W95g6FZWp0hfqpeVca2GhKnzlY9zO4kubB91kBooM3ylbTlQXNtAi0Z3Qh4Y47lbBa46PmbLjeC2nMw66LgTHaNtzCZ/stFJQ8Twy0Te0PXpuLFiIt4KeGWyVg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:31.768190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.768893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.771076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.772070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.773969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.775007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.787374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-48b9cd60-115b-4a44-b6cb-01fd8a56cebb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for project e3669621720549bba2466676e40d638a. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:31.795479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-48b9cd60-115b-4a44-b6cb-01fd8a56cebb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for user 3424ff1ac4404c4cb1b47907bf255b4b and project e3669621720549bba2466676e40d638a. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:31.909346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48b9cd60-115b-4a44-b6cb-01fd8a56cebb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163592 Oct 18 13:27:31.913817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 549/1083] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:27:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:31.937367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:31.938172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.983425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.988762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.993203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.993940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.993940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.995772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.269526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.275095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4993904-3289-4f6d-baaf-e13f530ae970 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.539967 Oct 18 13:27:32.293177 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 535/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:31 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:32.293177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.293177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.311197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.312417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.313096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.316137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.316899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.318435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.398048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:32.420909 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1ab57d0-edd7-4abb-a148-5fa692d16d20 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 2423 microversion: 2.25 time: 0.504631 Oct 18 13:27:32.422431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 550/1085] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:31 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 2423 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:32.426835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5302c042-400b-4af5-802d-0939a3909e36 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Calling method '.version_select at 0x7fb33539b8b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.527848 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5302c042-400b-4af5-802d-0939a3909e36 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 371 microversion: 2.1 time: 0.104318 Oct 18 13:27:32.529038 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 551/1086] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:32.537648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c23e943-ab1b-4c48-8404-12ec19fdae2b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3353f4b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.615132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c23e943-ab1b-4c48-8404-12ec19fdae2b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.082740 Oct 18 13:27:32.616633 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 552/1087] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:32.628932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-67eb29fa-f588-4d4f-bea6-6d788aac3eae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312e35e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.703979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-67eb29fa-f588-4d4f-bea6-6d788aac3eae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.086675 Oct 18 13:27:32.704898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 553/1088] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:32.709408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19022241-d0a1-4ac8-b104-5001819f0e58", "name": "network-vif-plugged", "status": "completed", "tag": "4f6c48f2-9cf2-40af-9d84-ddd167b98910"}, {"server_uuid": "95ed0a4d-41f5-4638-9abb-2963f0d3c74b", "name": "network-vif-plugged", "status": "completed", "tag": "ca3fc47a-7b29-4791-b49f-c6eeae6a6614"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:32.744193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.749641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.749641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.770805 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Creating event network-vif-plugged:4f6c48f2-9cf2-40af-9d84-ddd167b98910 for instance 19022241-d0a1-4ac8-b104-5001819f0e58 on n-h2-858383-13 Oct 18 13:27:32.771322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] Creating event network-vif-plugged:ca3fc47a-7b29-4791-b49f-c6eeae6a6614 for instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b on n-h1-858383-13 Oct 18 13:27:32.795132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4c060b63-80ab-4254-ba08-d79a0a4da11a req-e1278e3c-a018-402f-9bd8-5999842c3abb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086780 Oct 18 13:27:32.799375 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 554/1089] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:32.811104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": "auto"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:32.813686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.832274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.832795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.833243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.833970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.836505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.845498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.860366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.869495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09b73ed8-ed16-4325-9da4-8f5157b5237f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.585828 Oct 18 13:27:32.879728 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 536/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:32.884721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb3312ccc10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:32.922763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'flavor' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:32.953763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Going to try to live migrate instance to n-h1-858383-13 {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:27:33.019552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.020231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.021116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.024455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.026085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.029241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.228219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b656d87a-1f25-4568-bd87-e1c4fb2c4448 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 328 microversion: 2.1 time: 0.347025 Oct 18 13:27:33.229501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 537/1091] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:32 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:33.298753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1336785940", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:33.429592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:33.990923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:33.991346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:33.992246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:33.992810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:33.993691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:34.011511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.012913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.014253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.015319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.019312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.019979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.058531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:34.065440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for user 0bb4f887293049caa63d2e05fe937224 and project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:34.086456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.utils [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] instances quota exceeded for 3605ca5c82984d1fbefb1cfed86e9f20, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121010) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:27:34.087705 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Request method failure captured: Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 145 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqm5n9dUoZSKl1j0BBPE3WlbbaUTdxo7xNfbQ9l2ktnPHxW25HQ8eDx2bfG3F8NJKDo9_f8eC8_LxUcsmsXOuGPybmsA92U55VUNt8qDR6ns9ocnjPZYWbNUvTv1Xkom3bJ9v43WgPBLEK6PBs9aWu_SQRmKb5kSYlOfiCfLIhD8KYQ Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:34.091735 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 0bb4f887293049caa63d2e05fe937224 Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1336785940", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} Oct 18 13:27:34.093965 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1336785940', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452'}}} Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:27:34.094917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:34.096952 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.099509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:27:34.101396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:34.103063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:34.104286 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6bbd058f-8a17-4eda-b0dc-f15a1d07442f tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.809777 Oct 18 13:27:34.106168 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 538/1092] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:33 2022] POST /compute/v2.1/servers => generated 119 bytes in 812 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:34.113311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.114491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:34.123546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.124264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.125074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.126253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.127108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.127875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.581397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:34.594940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bc75b01-5d5d-4395-8a41-7a9d591064a4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.487508 Oct 18 13:27:34.603032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 539/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:34.622573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0cab5f8-6f70-4532-8330-692dd3ce643b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312d7d30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.724061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0cab5f8-6f70-4532-8330-692dd3ce643b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.119529 Oct 18 13:27:34.734470 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 540/1094] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:34.747272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb6b88e6-6af2-417f-8fd6-2a239ff19274 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312cc310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.810859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb6b88e6-6af2-417f-8fd6-2a239ff19274 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.067531 Oct 18 13:27:34.815817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 541/1095] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:34.837977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.844878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:34.873136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.879203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.879203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.879203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.879203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.879540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.400816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:35.426038 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64fa180e-4a94-42ce-98f6-c30593760e56 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1319 microversion: 2.1 time: 0.594639 Oct 18 13:27:35.428299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 542/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:35.433934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb3312d7310>, body: {"quota_set": {"instances": 10}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:35.609564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.610165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.610532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.611282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.611770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.612179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.860623 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e88e88d-d603-4fb3-bb63-b75a46e3ec1b tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 329 microversion: 2.1 time: 0.430885 Oct 18 13:27:35.871221 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 543/1097] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:35 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 329 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:35.880289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:35.887423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:35.896852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.899387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.900034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.904100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.904794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.919154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.330825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:36.427562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:36.435995 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bb20b77-6e28-4939-a888-f14facbc5d59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1476 microversion: 2.1 time: 0.563547 Oct 18 13:27:36.437322 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 544/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:35 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1476 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:36.455264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e004a8a5-e927-4429-860e-8f7a662f4c69 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331f610d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.548649 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e004a8a5-e927-4429-860e-8f7a662f4c69 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.107638 Oct 18 13:27:36.549992 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 545/1099] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:36.557735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-879cda65-7c81-4b1b-8d68-c5fa042024c7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33122c5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.629076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-879cda65-7c81-4b1b-8d68-c5fa042024c7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1437 microversion: 2.1 time: 0.077412 Oct 18 13:27:36.630678 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 546/1100] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1437 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:36.636438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-unplugged", "status": "completed", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:36.647453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.648036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.653465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.666457 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] Creating event network-vif-unplugged:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:27:36.676240 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a81547c8-db3e-4e03-ac5b-bae7d768917b req-5e7361d6-a73f-4e3a-a435-438dced4036f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043810 Oct 18 13:27:36.677149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 547/1101] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:36.683745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7755ac90-0092-4fca-86c5-4a258c379bab tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Calling method '.version_select at 0x7fb3312a6700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.780004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7755ac90-0092-4fca-86c5-4a258c379bab tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 371 microversion: 2.1 time: 0.101726 Oct 18 13:27:36.782120 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 548/1102] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:36.785561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.786420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:36.793694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.794232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.794689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.795425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.796446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.796885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.801798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:37.267544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:37.267544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f74cd7e-f981-45bb-a65f-36c0cfc9f3a7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1468 microversion: 2.1 time: 0.456890 Oct 18 13:27:37.267544 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 549/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:37.267875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-119264676", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:37.318567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] validate_networks() for [('712ddb5e-612b-4594-9e50-5bb7e29ca2a0', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:37.691359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-691e2aeb-bc3e-45a5-9d9f-9bfdcacf0148 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/action" status: 202 len: 0 microversion: 2.25 time: 4.889930 Oct 18 13:27:37.697254 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 555/1104] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:27:32 2022] POST /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/action => generated 0 bytes in 4892 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:37.697715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb33539bdc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:37.831910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.832669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.834708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.836283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.838804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.841068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.047909 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f41b389-505c-4ee2-b5d5-573cc19e3d04 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 325 microversion: 2.1 time: 0.354844 Oct 18 13:27:38.062083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 556/1105] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:37 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:38.083746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:38.085179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:38.142032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.143622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.145764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.146729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.153286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.153788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.181243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:38.181777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:38.185005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:38.201521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:38.201521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:38.203612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.204284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.204907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.205819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.206476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.221665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.264481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:38.271970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for user 3424ff1ac4404c4cb1b47907bf255b4b and project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:38.316063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:38.320402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:38.509474 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-319571cc-94d0-4b0a-8513-c3e66c8c4e94 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.268821 Oct 18 13:27:38.521600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 550/1106] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:38.559304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:38.563018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:38.578671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:38.585534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.586396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.588733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.589647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.590352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.593125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.837378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:38.864320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6c8bdc4-c91e-40b7-b85e-6fcca7e59e8b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1468 microversion: 2.1 time: 0.801685 Oct 18 13:27:38.865140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 557/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1468 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:38.883014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f48a51b8-6a7c-4aa4-a272-d52face531a1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:39.270964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:39.280689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61b481a1-11d6-4348-a869-23b4077d20a8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1475 microversion: 2.1 time: 0.751660 Oct 18 13:27:39.289640 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 551/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1475 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:39.295388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e4ee614-2032-42ee-9409-d22ffb7ea569 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312a6e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:47.878111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:48.037876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=24 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:48.098624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:48.246102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:48.279072 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f48a51b8-6a7c-4aa4-a272-d52face531a1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 9.408345 Oct 18 13:27:48.280804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 558/1109] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 9411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:48.289857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:48.291811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:48.292790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e4ee614-2032-42ee-9409-d22ffb7ea569 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1446 microversion: 2.1 time: 9.001653 Oct 18 13:27:48.295305 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 552/1110] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:39 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1446 bytes in 9005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:48.298433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=44 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:48.311000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.312091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.312558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.314586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.315298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.315942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.336961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1130500877", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:48.473009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:48.645993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:48.656008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:48.663342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:48.664909 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9125cf8-8850-4d24-85ca-ac5ebfc5e61c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.383122 Oct 18 13:27:48.667283 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 559/1111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:48 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:48.673444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:48.674337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:48.691757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.692260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.693363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.699110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.699622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.705064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.001604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.004580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:49.012830 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-969d97d3-5f30-4c61-8707-08d4e6a8aecc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.343729 Oct 18 13:27:49.026688 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 560/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:48 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:49.026688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455d57a6-5233-4642-86ee-c29b389fb027", "name": "network-vif-plugged", "status": "completed", "tag": "60d76e98-d8b4-4f1d-abd4-79511a55540e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:49.044594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.045078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.047943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.063222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] Creating event network-vif-plugged:60d76e98-d8b4-4f1d-abd4-79511a55540e for instance 455d57a6-5233-4642-86ee-c29b389fb027 on n-h1-858383-13 Oct 18 13:27:49.076582 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-574551cc-5cbe-46e8-b697-3d06c2d6250c req-25c80d40-42aa-49fc-a422-289058bc240f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060677 Oct 18 13:27:49.077551 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 561/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:49.093104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.106307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.107477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Searching by: {'reservation_id': 'r-vs6d81ah', 'deleted': False, 'project_id': '9f5cd093b94c4161bed82c6495bc37be'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:27:49.120114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:49.120829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:49.120949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.121434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.122102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.123011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.123681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.123829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:49.125281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:49.127338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:49.137413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.145668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.146481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.147126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.148043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.148751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.149345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.183006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:49.195714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Getting quotas for user 0bb4f887293049caa63d2e05fe937224 and project 3605ca5c82984d1fbefb1cfed86e9f20. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:49.235859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.utils [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] ram quota exceeded for 3605ca5c82984d1fbefb1cfed86e9f20, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121010) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:27:49.236671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Request method failure captured: Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 145 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqm5n9dUoZSKl1j0BBPE3WlbbaUTdxo7xNfbQ9l2ktnPHxW25HQ8eDx2bfG3F8NJKDo9_f8eC8_LxUcsmsXOuGPybmsA92U55VUNt8qDR6ns9ocnjPZYWbNUvTv1Xkom3bJ9v43WgPBLEK6PBs9aWu_SQRmKb5kSYlOfiCfLIhD8KYQ Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:27:49.240011 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 0bb4f887293049caa63d2e05fe937224 Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1130500877", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} Oct 18 13:27:49.241692 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1130500877', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452'}}} Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:27:49.242667 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:49.243963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.245514 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:27:49.247501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.249029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:49.251571 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bdba8fa-ad9c-4bce-83cb-b165cb43d494 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.955219 Oct 18 13:27:49.258040 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 553/1114] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 962 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:49.263733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "name": "network-vif-unplugged", "status": "completed", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:49.291182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.294286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.295125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.325091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Creating event network-vif-unplugged:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h2-858383-13 Oct 18 13:27:49.338729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:27:49.367638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d73e9024-2c8c-4f4c-ace2-41f109e19638 req-94c55499-d865-4e92-9052-c06f3863ed7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107741 Oct 18 13:27:49.368630 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 554/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:49.375905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.377828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:49.385666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.386827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.387603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.388788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.390557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.391168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.397320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:27:49.549781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.563705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.567146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.567787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.691883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.707412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea9e0be8-3d93-4035-a47e-30991feea671 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1470 microversion: 2.1 time: 0.333609 Oct 18 13:27:49.724050 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 555/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:49 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:49.734092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a46c087-adba-4f13-942d-aa5a03e70979", "tag": "5651cdb5-da31-473e-96ff-851d8ffe5138"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:49.747832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.748195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.749358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.766689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] Creating event network-changed:5651cdb5-da31-473e-96ff-851d8ffe5138 for instance 8a46c087-adba-4f13-942d-aa5a03e70979 on n-h2-858383-13 Oct 18 13:27:49.778372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d9f97239-8690-4f2c-a620-ca60f9aede23 req-871c91e1-fed2-4ef1-8711-89843e8c4f54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051429 Oct 18 13:27:49.779248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 556/1117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:49.787973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d0dfa3b-4d95-465e-b0be-e78918178788 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312a6ee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.887066 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d0dfa3b-4d95-465e-b0be-e78918178788 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 200 len: 1446 microversion: 2.1 time: 0.105242 Oct 18 13:27:49.888053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 557/1118] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:49 2022] GET /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:49.898355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Action: 'update', calling method: .version_select at 0x7fb33121ee50>, body: {"quota_set": {"ram": 51200}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:50.055220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.059161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.059925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.062664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.063393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.064043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.177895 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4e28b4a-59c3-4672-9765-d2b86053e460 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-vs6d81ah" status: 200 len: 2929 microversion: 2.1 time: 1.098838 Oct 18 13:27:50.183834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 562/1119] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 18 13:27:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vs6d81ah => generated 2929 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:50.190891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3cb7317-5eb1-4ce1-90a3-4caa7633dae1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3353f45e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:50.268672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3cb7317-5eb1-4ce1-90a3-4caa7633dae1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.083515 Oct 18 13:27:50.269255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 563/1120] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:50 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:50.270088 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43b4966d-f599-48dc-af34-cc96bd157034 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 200 len: 329 microversion: 2.1 time: 0.378479 Oct 18 13:27:50.271239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 558/1121] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:49 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:50.283212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:50.283958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:50.286339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:50.287361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:50.304263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.305123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.305931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.306918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.308406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.315010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.319023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.319755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.320374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.322778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.324576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.325682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.632572 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aac4233f-2b4d-4837-910c-dfd31f7fb62d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb/action" status: 204 len: 0 microversion: 2.1 time: 0.359463 Oct 18 13:27:50.640985 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 559/1122] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:50 2022] POST /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb/action => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:50.647783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf97e753-6c11-4860-a2ca-5ca63bfc7e77 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33122c790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.157960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.169535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.171574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.173208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ed6fbe9-30ec-45de-922d-b654b81757a7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.903021 Oct 18 13:27:51.173753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 564/1123] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:50 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:51.179585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.183436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:51.192343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.193279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.193919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.194972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.195756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.196413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.546243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.568166 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1a3ecca-9ae1-4121-ac23-9398cc0faaf7 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.392813 Oct 18 13:27:51.569339 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 565/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:51.574384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.594542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_groups [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Querying cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) for 2 instances {{(pid=121009) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:27:51.596312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.597134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.597740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.623006 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54aec171-679f-4c27-b38f-d6155f3e938b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/9e4c7ddd-ff07-4303-a5c2-608e6e12d7a0" status: 200 len: 271 microversion: 2.1 time: 0.052319 Oct 18 13:27:51.624873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 566/1125] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/os-server-groups/9e4c7ddd-ff07-4303-a5c2-608e6e12d7a0 => generated 271 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:51.630853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22c379fe-55e6-4773-b994-6f5ab8594d01 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Action: 'update', calling method: .version_select at 0x7fb3353f2040>, body: {"quota_set": {"ram": 0}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:51.636635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22c379fe-55e6-4773-b994-6f5ab8594d01 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '0bb4f887293049caa63d2e05fe937224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605ca5c82984d1fbefb1cfed86e9f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22c379fe-55e6-4773-b994-6f5ab8594d01 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Request method failure captured: Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 HTTP/1.1 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 25 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqm5n9dUoZSKl1j0BBPE3WlbbaUTdxo7xNfbQ9l2ktnPHxW25HQ8eDx2bfG3F8NJKDo9_f8eC8_LxUcsmsXOuGPybmsA92U55VUNt8qDR6ns9ocnjPZYWbNUvTv1Xkom3bJ9v43WgPBLEK6PBs9aWu_SQRmKb5kSYlOfiCfLIhD8KYQ Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:27:51.647724 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3605ca5c82984d1fbefb1cfed86e9f20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3605ca5c82984d1fbefb1cfed86e9f20 Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1656047507 Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 0bb4f887293049caa63d2e05fe937224 Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-QuotasAdminNegativeTest-1656047507-project Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: {"quota_set": {"ram": 0}} Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:27:51.660738 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3605ca5c82984d1fbefb1cfed86e9f20', 'body': {'quota_set': {'ram': 0}}} Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:51.663016 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:51.664957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22c379fe-55e6-4773-b994-6f5ab8594d01 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22c379fe-55e6-4773-b994-6f5ab8594d01 tempest-QuotasAdminNegativeTest-1656047507 tempest-QuotasAdminNegativeTest-1656047507-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20" status: 403 len: 116 microversion: 2.1 time: 0.023576 Oct 18 13:27:51.666617 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 567/1126] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:27:51 2022] PUT /compute/v2.1/os-quota-sets/3605ca5c82984d1fbefb1cfed86e9f20 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:51.667785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.668720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:51.682716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.682716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.683850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.684810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.685991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.687197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.314139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.356921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fccb2ef-313d-4078-901d-39f3d966559b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1470 microversion: 2.1 time: 0.701654 Oct 18 13:27:52.385899 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 568/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.394992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "name": "network-vif-plugged", "status": "completed", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:52.417205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.418448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.422683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.458634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Creating event network-vif-plugged:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h2-858383-13 Oct 18 13:27:52.463680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf97e753-6c11-4860-a2ca-5ca63bfc7e77 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 204 len: 0 microversion: 2.1 time: 1.824248 Oct 18 13:27:52.469590 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 560/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:50 2022] DELETE /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 0 bytes in 1835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:52.484268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:27:52.486145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56ae6ad1-cd4b-46ce-aadf-ba8bd87110cc tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312cc3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.490620 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fc3af5fe-d203-49f7-bcd5-16af61f253ea req-5e4a8552-1c64-4273-90b8-5f164167f41f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101603 Oct 18 13:27:52.491754 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 569/1129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:52.499345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:52.510460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.511189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.511795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.566603 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Creating event network-changed:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h2-858383-13 Oct 18 13:27:52.574614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:27:52.586642 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56ae6ad1-cd4b-46ce-aadf-ba8bd87110cc tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.114418 Oct 18 13:27:52.587297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 561/1130] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.597092 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3480ce2d-434e-4ee8-94b0-9a85827a0d40 req-ce78d327-3c86-4fde-98e1-1090c2d24314 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094081 Oct 18 13:27:52.597092 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 570/1131] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:52.599903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.600763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.611042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.611537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.611981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.613437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.613605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.613896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.614614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.615047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.622291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.622986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.624208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.625154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.625945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.626681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.922642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.937223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.938702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.940567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f28d7f64-0ae8-441d-879f-9cb05634c0a5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.335455 Oct 18 13:27:52.941234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 562/1132] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:52.946565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.947450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.955004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.955729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.956308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.957129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.957684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.958240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.002897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:53.215332 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30d471e0-a16a-4235-affe-0ec95c202171 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1621 microversion: 2.1 time: 0.624403 Oct 18 13:27:53.217156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 571/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1621 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.250683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.251404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.279418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.280449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.286985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.288053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.296526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.297210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.361464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b77a300-7194-4af4-91dd-5ed98c1fb368 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 204 len: 0 microversion: 2.1 time: 0.414998 Oct 18 13:27:53.362454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 563/1134] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:52 2022] DELETE /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:53.396973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.400446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.421068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.422671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.423936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.432735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.463163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.465884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.598695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:53.614551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d4213fb-c8bd-4d05-a179-c03012533c42 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.394758 Oct 18 13:27:53.630467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 572/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.643247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.644169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.660020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.660807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.661444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.662773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.663613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.664400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.742884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4289576-221e-4442-aa1a-ba62c48ed96c tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1621 microversion: 2.1 time: 0.377235 Oct 18 13:27:53.743987 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 564/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1621 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.762884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2003445957", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:53.869573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:54.116144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:54.130155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3544317-cfb8-4f29-8005-7da3cfccce41 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1470 microversion: 2.1 time: 0.494215 Oct 18 13:27:54.130818 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 573/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:54.148715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9f935a3-a2ce-4c23-a369-31d212c63978 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:54.242729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9f935a3-a2ce-4c23-a369-31d212c63978 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.108923 Oct 18 13:27:54.244558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 574/1138] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:54 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:54.255479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:54.256328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:54.284221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.286501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.287190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.288501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.296606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.297114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.743515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:54.749610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:54.749610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:54.749610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:54.749610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:54.759589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:54.770382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.773785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.776053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.777133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.778030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:54.794278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.794780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:54.794780 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c150277-767d-4d2e-a912-d590a5d92139 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.535345 Oct 18 13:27:54.794982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.796700 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 575/1139] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:54 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:54.830648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-150824173", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b2d14076-e2e9-4374-b7c3-81beb54bdf78"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:54.831299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:54.864524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:54.923701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:54.940698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:54.956218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:55.123587 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f66c9bab-1e6a-465b-b39e-c23f2172b5ff tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378290 Oct 18 13:27:55.130771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 565/1140] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:55.146888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb", "name": "network-vif-unplugged", "status": "completed", "tag": "39bc19b7-6e12-4670-bad8-fddd214378ab"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:55.173394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.173887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.174352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.196159 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] Creating event network-vif-unplugged:39bc19b7-6e12-4670-bad8-fddd214378ab for instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb on n-h2-858383-13 Oct 18 13:27:55.212044 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-63878666-fd45-43fd-b2e0-505deb31f64f req-9d2ddfe1-703b-4dcc-8c2f-0edcdfc1ba56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078469 Oct 18 13:27:55.214853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 566/1141] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:55.225984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:55.232426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:55.250982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.251578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.253006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.253770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.254272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.259644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.575240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:55.589497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cc34b8d-8ece-4ad0-8b7a-4e14d48db41d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.373223 Oct 18 13:27:55.590113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 567/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:55 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:55.604641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d16fa45f-0214-4539-95fd-a75ae665a1e6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:55.607310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d16fa45f-0214-4539-95fd-a75ae665a1e6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:55.744814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d16fa45f-0214-4539-95fd-a75ae665a1e6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:55.749813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d16fa45f-0214-4539-95fd-a75ae665a1e6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1208 microversion: 2.1 time: 0.158457 Oct 18 13:27:55.750498 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 568/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:55 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:55.755058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:55.755676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:55.794801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.796945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.797836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.803020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.807417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.807917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.086844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:56.114927 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-edda12ba-7833-48c5-9539-df9b155eabd7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1462 microversion: 2.1 time: 0.346559 Oct 18 13:27:56.114927 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 569/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:55 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1462 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:56.114927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5144242-556f-40a7-adb6-f83b63faeeda tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33136cee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.139779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:56.141141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:56.142623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:56.145012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:56.145896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:56.193778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.198819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.201632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.208859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.209746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.212315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.216574 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5144242-556f-40a7-adb6-f83b63faeeda tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.116421 Oct 18 13:27:56.217449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 570/1145] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:56.227221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.227907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:56.256439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.264829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.265016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:56.265475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.266296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.266790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.267232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.281459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:56.311648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:56.320402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:56.558698 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-069b0bb6-512d-49ea-b453-77f13cf75fdb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759908 Oct 18 13:27:56.566224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 576/1146] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:56.571549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.572646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:56.597180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.597180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.597180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.597180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.597493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.597493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.001122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.020878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-919e7c6a-02f1-471b-a3fa-03dea3c8a639 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1462 microversion: 2.1 time: 0.452689 Oct 18 13:27:57.022558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 577/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1462 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:57.042287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb", "name": "network-vif-deleted", "tag": "39bc19b7-6e12-4670-bad8-fddd214378ab"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:57.061660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.062454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.062920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.079693 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] Creating event network-vif-deleted:39bc19b7-6e12-4670-bad8-fddd214378ab for instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb on n-h2-858383-13 Oct 18 13:27:57.101427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-476732d9-4c7f-496b-aea7-af59a4d24680 req-e5832838-8f32-4ec2-bfcf-d543ba2d81ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077099 Oct 18 13:27:57.102401 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 578/1148] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:57.114014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-627ce5e3-f255-403d-9313-f08d75bdf78e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.114014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-627ce5e3-f255-403d-9313-f08d75bdf78e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.163932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.173057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.187020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.188583 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21b89e0c-1772-4483-bde9-d3ccb3106311 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.970194 Oct 18 13:27:57.189647 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 571/1149] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:57.195311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.195311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.210762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.213978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.218280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.219271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.219920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.220689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.258482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-627ce5e3-f255-403d-9313-f08d75bdf78e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.283816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-627ce5e3-f255-403d-9313-f08d75bdf78e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1216 microversion: 2.1 time: 0.175978 Oct 18 13:27:57.287740 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 579/1150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:57.292837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.293518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.306783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.307391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.307910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.308693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.309226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.309728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.430942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.432779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.441112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-135f2542-076c-49fc-a7da-b51db0bc49e9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.250194 Oct 18 13:27:57.441681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 572/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:57.446895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16c92a3a-05cc-4219-998d-b064f33ffcdb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'create', calling method: .version_select at 0x7fb3315de820>, body: {"keypair": {"name": "tempest-keypair-1647066205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqzHzm8s1bo05wjxWejm0XzkIBMmB2FB0V+JvE8R0APkHZRwJ1AdS7j+A4eepCHVV2noM2p6qj14S+UG6d0NJ0meYGuS45JxyYcnDwCnq2IU5MsNnidKzRDUlldlXSZ5Q=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:57.447058 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ddce830e-0f2d-498c-ba6f-fbe1ebafc7ae tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1212 microversion: 2.1 time: 0.157963 Oct 18 13:27:57.465257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-16c92a3a-05cc-4219-998d-b064f33ffcdb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:57.472484 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 580/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1212 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:57.473153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-16c92a3a-05cc-4219-998d-b064f33ffcdb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:57.483107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1e89ba6-cf3a-4f4e-a369-8c76d915bf9b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312e3dc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.540110 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1e89ba6-cf3a-4f4e-a369-8c76d915bf9b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.073396 Oct 18 13:27:57.552831 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 581/1153] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:57.569161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a46c087-adba-4f13-942d-aa5a03e70979", "name": "network-vif-plugged", "status": "completed", "tag": "5651cdb5-da31-473e-96ff-851d8ffe5138"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:57.597928 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16c92a3a-05cc-4219-998d-b064f33ffcdb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152169 Oct 18 13:27:57.598579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.600657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.601612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.601899 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 573/1154] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:27:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:57.673784 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] Creating event network-vif-plugged:5651cdb5-da31-473e-96ff-851d8ffe5138 for instance 8a46c087-adba-4f13-942d-aa5a03e70979 on n-h2-858383-13 Oct 18 13:27:57.714335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1f7269a6-9635-425a-a6f5-89d1372b2372 req-1ed822cc-8119-4eeb-a0aa-a9fea9184ef3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156331 Oct 18 13:27:57.722413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 582/1155] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:58.233678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.234486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.256126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.256126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.256126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.256126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.256483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.256483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.262514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:58.313642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.314391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.327122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.327624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.328071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.334141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.337598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.338269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.452664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.469244 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-04eb7837-cf59-4370-9231-4655f4575e42 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1220 microversion: 2.1 time: 0.160716 Oct 18 13:27:58.473094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 583/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:58.480571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.481522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.489554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.491259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.491259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.494164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.495237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.495917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.522149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.539013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.540993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.556895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-440a75f4-30e0-4b47-8250-6fa1e275ab5c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.336741 Oct 18 13:27:58.560562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 574/1157] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:58.578159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.579033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.587434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.591992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.600126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.602992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.606722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.619611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.727299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.736910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6e94713-9b1a-45aa-9e11-849ce0a51b62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1260 microversion: 2.1 time: 0.174678 Oct 18 13:27:58.738241 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 575/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:58.744566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49af53a8-0f09-4d82-bfe1-9defe447e682 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312a6f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.824814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49af53a8-0f09-4d82-bfe1-9defe447e682 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.085173 Oct 18 13:27:58.825501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 576/1159] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:58.868635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.877478 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-800c1b1f-3a98-45e7-abfc-a6bc3233f4c6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.402745 Oct 18 13:27:58.890915 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 584/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:59.543625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:59.543625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:59.543625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.543625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.544395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.544395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.544395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.544395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.572111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "name": "network-vif-unplugged", "status": "completed", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:59.590418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.666878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.666878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.666878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] Creating event network-vif-unplugged:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h2-858383-13 Oct 18 13:27:59.667333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.667760 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4921293a-85c2-4c64-bd13-de167138430e req-f405df4b-e0d9-4a0c-a906-8178c9352aa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052562 Oct 18 13:27:59.667760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 585/1161] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:59.667760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:59.667760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:59.668055 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80f2aef6-32d4-43c2-8ec1-5e3ceca0fb47 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1268 microversion: 2.1 time: 0.125166 Oct 18 13:27:59.668055 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 577/1162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:59 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:59.668219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.668219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.668219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.668219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.668573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.668573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.668573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:59.771465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:59.772358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:59.784561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.785077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.785528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.786282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.786749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.787180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.789149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.801478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.802980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.804353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-feed914c-5b28-4112-95d4-1912a86b8da1 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.192116 Oct 18 13:27:59.805241 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 586/1163] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:59 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:59.840842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16c9c5be-b7fe-478b-a1d2-cb30777ea350 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb335291e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:59.855065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.863927 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-659039cf-f0f1-4ad1-9ab7-51b0ea5a9168 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1260 microversion: 2.1 time: 0.096389 Oct 18 13:27:59.865019 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 578/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:59 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1260 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:59.888628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16c9c5be-b7fe-478b-a1d2-cb30777ea350 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.051649 Oct 18 13:27:59.889875 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 587/1165] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:59 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:59.905471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:59.906819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:59.911687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:59.916048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.916645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.917098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:59.917838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:59.918438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:59.918800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.066095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:00.082355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ff97d7a-488d-434a-a073-09c3f2003215 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1324 microversion: 2.1 time: 0.182240 Oct 18 13:28:00.082940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 579/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:59 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:00.689812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:00.690499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:00.710523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.711110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.711463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.712188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.712672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.713108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.851448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:00.852093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:00.885830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.886391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.891544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.900185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.909041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.911906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.951043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:00.966410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23e953e9-435f-4dc5-aa54-2b7ff9c01a08 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1268 microversion: 2.1 time: 0.281777 Oct 18 13:28:00.968729 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 588/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:00 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1268 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:00.994032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:00.997112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.023234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.025463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.029207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.035269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.035269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.035269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.307453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.347433 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6a57b09-1e34-4003-93cf-1938f981a956 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1278 microversion: 2.1 time: 0.369189 Oct 18 13:28:01.353936 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 589/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:00 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.370008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-03c0bafb-6de0-4d3a-bd3b-3a7260b8751b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb335291d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.506871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-03c0bafb-6de0-4d3a-bd3b-3a7260b8751b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1455 microversion: 2.1 time: 0.150757 Oct 18 13:28:01.516817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 590/1169] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.516817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.516817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.524801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.525502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.526172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.527060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.527685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.528337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.627312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.636164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.641186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.641186 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b0d475d-b946-4b2b-aca5-77b6f9bc3413 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.811706 Oct 18 13:28:01.654372 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 580/1170] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:00 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:01.922528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.929462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-647297027", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:01.930571 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93bf0025-fa1b-4235-a907-4834a62f2f31 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1521 microversion: 2.1 time: 0.420651 Oct 18 13:28:01.931161 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 591/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.961733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.962754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.970280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.971763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.972401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.973925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.974626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.975223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.028548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:02.033319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:02.033319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:02.033319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:02.033319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:02.048307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.054219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.054219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.054219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.054219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.058268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.115806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Getting quotas for project e25a068285474cdfa415f75774fab88f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:02.130991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Getting quotas for user 8c3878480453431484cbe05c5d2107ce and project e25a068285474cdfa415f75774fab88f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:02.158961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:02.161346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:02.308232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.321729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be40b238-e7be-4755-a03a-922ecacb4475 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1521 microversion: 2.1 time: 0.361749 Oct 18 13:28:02.322606 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 592/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:02.332072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:02.332231 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09f00b53-b635-45b6-851f-22e2c5c4d480 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.676498 Oct 18 13:28:02.344682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 581/1173] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:28:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:28:02.349811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:02.350466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.356547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.357061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.357506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.358799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.359279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.359696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.366790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.367291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.367739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.414392 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] Creating event network-changed:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h2-858383-13 Oct 18 13:28:02.431065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fe892aed-0031-42cc-acca-311230ed1e18 req-eaaaeb4c-017e-4d0d-bfde-f0313e7571f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105543 Oct 18 13:28:02.458762 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 593/1174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:02.481685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1336393241"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:02.488523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.508412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.509098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.509561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.510566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.511032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.514260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.796413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.804635 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94551cdf-8d5a-4b68-8ead-7546146707b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1274 microversion: 2.1 time: 0.458740 Oct 18 13:28:02.805547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 582/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:02 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1274 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:02.827638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:02.830676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.913293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.922016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.923568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.930586 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-581050bb-71fc-41ca-98d1-9e7494b89b32 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "PUT /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1358 microversion: 2.75 time: 0.107315 Oct 18 13:28:02.963828 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 583/1176] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Oct 18 13:28:02 2022] PUT /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:02.973527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:02.975251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.995780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.996507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.997473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.998575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.999411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.000116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.137367 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c9cc9e3-4e5d-4564-bd52-4bf3ac5579bb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979/action" status: 202 len: 0 microversion: 2.1 time: 0.673518 Oct 18 13:28:03.146499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 594/1177] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:02 2022] POST /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:28:03.161486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6867087-0f6d-412c-b9fa-7ffe453981ad tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331271310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.236012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6867087-0f6d-412c-b9fa-7ffe453981ad tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1464 microversion: 2.1 time: 0.087812 Oct 18 13:28:03.237668 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 595/1178] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1464 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.247536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.248819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.268896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.270450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.271890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.272895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.273486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.273939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.652666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.678695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8011b67-3822-4877-9ceb-daf0d1094cf4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.708019 Oct 18 13:28:03.681415 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 584/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:02 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.699263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.706442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.768517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.778550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.784558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.786400 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d63d31e-5386-4387-9eee-02b2eb93aa3d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.548336 Oct 18 13:28:03.802085 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 596/1180] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:03.802320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.805860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-027c3d64-ec66-457c-b865-c3fbc4563f45 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb335307ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.814884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.816331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.838569 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4857d1b9-5739-4658-aae0-7b4e66f6c235 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1358 microversion: 2.75 time: 0.145006 Oct 18 13:28:03.838569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 585/1181] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:03.846488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d63d906-69ee-43c3-ae7d-bb32478a8742 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312a69d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.933178 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d63d906-69ee-43c3-ae7d-bb32478a8742 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 200 len: 1464 microversion: 2.1 time: 0.099707 Oct 18 13:28:03.935150 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 586/1182] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 1464 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.947939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.949515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.993521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.995383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.995862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.996607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.997094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.997526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.184300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.194243 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3ff2bd7-5487-4997-bc01-404cd3f25e14 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.255126 Oct 18 13:28:04.196647 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 587/1183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:04.202119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.203176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.209728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.211047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.211758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.213150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.213829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.214370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.225107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-027c3d64-ec66-457c-b865-c3fbc4563f45 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674" status: 204 len: 0 microversion: 2.1 time: 0.435368 Oct 18 13:28:04.229305 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 597/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:03 2022] DELETE /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:04.235422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa00edc2-bdd5-42a5-a730-965a6f6b6a58 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '.version_select at 0x7fb335307af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.240028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa00edc2-bdd5-42a5-a730-965a6f6b6a58 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.240767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa00edc2-bdd5-42a5-a730-965a6f6b6a58 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.241456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa00edc2-bdd5-42a5-a730-965a6f6b6a58 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.254980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa00edc2-bdd5-42a5-a730-965a6f6b6a58 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.023889 Oct 18 13:28:04.256389 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 598/1185] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:04.265397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33c60e8c-89d4-435f-b73f-5184efbcd4b9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb331271040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.308105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-33c60e8c-89d4-435f-b73f-5184efbcd4b9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Image not found. Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33c60e8c-89d4-435f-b73f-5184efbcd4b9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674 HTTP/1.1 Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:28:04.312122 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e44dd23d-5f2e-4f4a-9352-2c3330962674'} Oct 18 13:28:04.316099 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:04.316980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e44dd23d-5f2e-4f4a-9352-2c3330962674 Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:04.319627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e44dd23d-5f2e-4f4a-9352-2c3330962674 could not be found. Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:04.323325 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.329109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33c60e8c-89d4-435f-b73f-5184efbcd4b9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:04.338960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-33c60e8c-89d4-435f-b73f-5184efbcd4b9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674" status: 404 len: 62 microversion: 2.1 time: 0.055658 Oct 18 13:28:04.338960 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 599/1186] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:04.338960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd5d5c21-539b-41fd-b401-deab5dea7efd tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.338960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd5d5c21-539b-41fd-b401-deab5dea7efd tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012255 Oct 18 13:28:04.341864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 600/1187] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:04.358913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.360254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.367001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.367528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.367975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.368689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.369380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.369978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.494011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.511528 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-926b4bfb-1ded-4a93-b19e-58125e7c80dd tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1466 microversion: 2.1 time: 0.315342 Oct 18 13:28:04.513354 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 588/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1466 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:04.518505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c225a928-fc7d-4e05-a6b1-bb91a2269548 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1358420424", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:04.656694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c225a928-fc7d-4e05-a6b1-bb91a2269548 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.141771 Oct 18 13:28:04.657900 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 589/1189] 10.222.0.27 () {60 vars in 1146 bytes} [Tue Oct 18 13:28:04 2022] POST /compute/v2.1/flavors => generated 499 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:04.663792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-109134207"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:04.667098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.676526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.677185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.678082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.679095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.680234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.680777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.769319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.780229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-931ae99e-aa3c-4e16-9596-4c8b1638ef5f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1533 microversion: 2.1 time: 0.436401 Oct 18 13:28:04.785725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 601/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1533 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:04.791420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ff13f82-c896-4c12-9c6a-e0e7f5ed1213 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.801003 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ff13f82-c896-4c12-9c6a-e0e7f5ed1213 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013249 Oct 18 13:28:04.802189 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 602/1191] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:28:04.807157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.810580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.817233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.818187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.819350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.820465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.825492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.826345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.145769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.159011 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5f5d707a-a4fc-4f43-af53-44b84fc4a3f2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.355514 Oct 18 13:28:05.159854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 603/1192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.164572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a488a5d6-e54e-4093-ad0f-59a7aa0b05d0", "tag": "d478c30a-0cc4-4b75-8005-ebbb46a05ca0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:05.174227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.174703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.175142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.191644 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] Creating event network-changed:d478c30a-0cc4-4b75-8005-ebbb46a05ca0 for instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 on n-h2-858383-13 Oct 18 13:28:05.192090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-34065af0-605f-4b85-a30a-6e7649d2461e req-919f2e0b-2896-4df3-8a8f-9149c9589431 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Oct 18 13:28:05.192886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 604/1193] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:05.198502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.199403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.206582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.207507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.208132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.209008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.209631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.210262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.231531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70493be4-5e2d-4e1d-9904-e0fe42783c8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "POST /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.571292 Oct 18 13:28:05.235496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 590/1194] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:04 2022] POST /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:28:05.251895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.252949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.262514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.263277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.264319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.265372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.266172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.266890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.421596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.430307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.431747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.437731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70e8a8b2-1292-4120-a62a-a179f3d9cb78 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1410 microversion: 2.75 time: 0.200215 Oct 18 13:28:05.438421 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 591/1195] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1410 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:05.469084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.485759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-11343461", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "49155e73-c29b-41c5-ba33-509576125f45"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:05.492047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.493530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.494767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f075f381-7cc1-468f-88b3-44d20e39aade tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.300624 Oct 18 13:28:05.495329 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 605/1196] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:05.507673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.515101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.515854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.516346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.516961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.517701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.518142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.518633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.562708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:05.745670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.756941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee394381-44ff-4640-80be-b45d235469a5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.255090 Oct 18 13:28:05.757678 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 606/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.776626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1686e07-eb08-4084-8a9e-134f378ee175 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33528f5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.829970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1686e07-eb08-4084-8a9e-134f378ee175 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.071021 Oct 18 13:28:05.830812 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 607/1198] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.838571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:05.838571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:05.838571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:05.838571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:05.838571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:05.843290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.843917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.844629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.845357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.845885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.846356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.858036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292d54fa-7599-4745-8e3a-b76fec8108ef", "tag": "f15d6adf-83de-4bb8-b539-52112470bdba"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:05.866796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:05.870958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.871675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.872269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.873348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:05.886720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:05.889724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:05.894766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] Creating event network-changed:f15d6adf-83de-4bb8-b539-52112470bdba for instance 292d54fa-7599-4745-8e3a-b76fec8108ef on n-h1-858383-13 Oct 18 13:28:05.902421 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9503c00d-ec7e-4215-bff7-32bec04396c6 req-1c14c66e-bd18-4a2a-8ae9-c3d7e90021f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051250 Oct 18 13:28:05.906548 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 608/1199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:05.911697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.912619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.919367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:05.921519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.922047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.922513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.923210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.923666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.924093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.048462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7867821c-d2d0-4520-a1e5-28ee887fb55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608759 Oct 18 13:28:06.049673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 592/1200] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:06.060217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4596372a-d460-4941-8f0b-31ab9221af96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.064754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4596372a-d460-4941-8f0b-31ab9221af96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.140489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.154041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-417b5136-22d0-41b9-b9e1-6ab56a1f2365 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1539 microversion: 2.1 time: 0.247289 Oct 18 13:28:06.157168 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 609/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:06.185387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.186979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.197997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.198759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.199845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.200678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.201914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.202494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.231459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:06.241551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4596372a-d460-4941-8f0b-31ab9221af96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.250852 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4596372a-d460-4941-8f0b-31ab9221af96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1277 microversion: 2.1 time: 0.193459 Oct 18 13:28:06.252187 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 593/1202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:06.397210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.405939 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8605932-3dff-4df1-a249-3be7b89163ec tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.225990 Oct 18 13:28:06.419253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 610/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:06.477452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.478192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.484419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.485168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.485611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.486340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.486797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.487221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.528675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.531011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.539117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.539583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.540183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.541175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.541820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.542451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.565235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.579144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.580631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.585722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1c349f0-eaf1-4e9e-90c3-015864dfa52a tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1416 microversion: 2.75 time: 0.112836 Oct 18 13:28:06.586582 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 594/1204] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1416 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:06.690828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.701979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.703464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.704664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f25c7b0e-ff8d-4d35-84d7-15d262f3ce53 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.186307 Oct 18 13:28:06.705226 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 611/1205] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:06.780536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.781204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.787462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.788215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.789501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.790696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.791364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.791953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.845203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-286b57eb-de13-4da4-9d9d-48ed0568e8ac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33528f790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.903310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-286b57eb-de13-4da4-9d9d-48ed0568e8ac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.061906 Oct 18 13:28:06.912556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 612/1206] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:07.058532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.077952 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76d47e8a-4257-4493-a3ea-2cf351d84aaa tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.301672 Oct 18 13:28:07.082329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 595/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.182349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.183104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.194696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.195199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.195644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.196348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.196806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.197235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.200086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:07.274173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:07.289096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5a23495-8a8e-47e4-b843-1c47af76d5ed tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.290396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5a23495-8a8e-47e4-b843-1c47af76d5ed tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.413465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.426897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9bc628da-cc1a-4154-8624-634213c0e983 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1539 microversion: 2.1 time: 0.247967 Oct 18 13:28:07.427564 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 613/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.436490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.437358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.452079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.452588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.453620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.454554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.455391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.455988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.619636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.630667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bc57973-d8e9-4943-9c12-ab6d95219da4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.201458 Oct 18 13:28:07.631311 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 614/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.636474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455d57a6-5233-4642-86ee-c29b389fb027", "name": "network-vif-unplugged", "status": "completed", "tag": "60d76e98-d8b4-4f1d-abd4-79511a55540e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:07.651662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.651662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.651662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.663500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] Creating event network-vif-unplugged:60d76e98-d8b4-4f1d-abd4-79511a55540e for instance 455d57a6-5233-4642-86ee-c29b389fb027 on n-h1-858383-13 Oct 18 13:28:07.669080 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-01fb52b1-b5ad-46c5-b6f1-b677e4588a36 req-ac693441-7336-42e6-ac29-76d5ee30c6f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036431 Oct 18 13:28:07.669682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 615/1210] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:07.675228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.677299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.683932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.684707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.685305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.686597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.687037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.687469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.755823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5a23495-8a8e-47e4-b843-1c47af76d5ed tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.763710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5a23495-8a8e-47e4-b843-1c47af76d5ed tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1277 microversion: 2.1 time: 0.491183 Oct 18 13:28:07.765167 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 596/1211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1277 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.770172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.770790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.783870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.784402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.784835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.786309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.786309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.786591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.830945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.840483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.842876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.850041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-78f126fe-91b8-4217-82b7-0ec62d209ed5 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1416 microversion: 2.75 time: 0.178934 Oct 18 13:28:07.850719 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 616/1212] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1416 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:07.920638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c03e6ebb-1176-4870-a4fe-3923d1c88246 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3353f24c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.982298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c03e6ebb-1176-4870-a4fe-3923d1c88246 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.065439 Oct 18 13:28:07.983332 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 617/1213] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:08.058956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.063282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:08.069043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.070539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.072029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8410899-bc75-4105-b44a-df8d0bfdd1db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.305843 Oct 18 13:28:08.072599 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 597/1214] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:08.109542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.110192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.117122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.117616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.118280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.118993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.119473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.119901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.296515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.305351 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34b025e7-4bc8-4de8-bfde-6d38c2d2c7cd tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.201252 Oct 18 13:28:08.305926 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 618/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:08.453605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.454932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.464476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.464476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.464476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.464476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.464823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.464823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.657913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.664105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.666138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.666636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.667081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.667841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.668256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.668684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.712789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.728265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b89cfaa3-79e9-48c8-96c8-f074cfec71e3 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1534 microversion: 2.1 time: 0.279638 Oct 18 13:28:08.732127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 598/1216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1534 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:08.789137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.790305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.802869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.803498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.806323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.807438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.807932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.808375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.907616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.909405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.921926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0dbe7a2-03f6-4161-8e31-4d70c32ab10f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1329 microversion: 2.1 time: 0.137559 Oct 18 13:28:08.924790 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 599/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:08.928417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d3941f9-ce88-40cf-9cc7-8f3ef5f2894c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.274773 Oct 18 13:28:08.929131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 619/1218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:08.930773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.931592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.937739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.938606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.939281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.939991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.940975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.941581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.000051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ce34b79-f980-425a-bfbd-fc98158a909e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3353f2280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.035755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.051471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.053581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.062420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6cc37bf0-1292-46f9-bb12-87af48fb7762 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1416 microversion: 2.75 time: 0.135699 Oct 18 13:28:09.064311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 600/1219] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1416 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:09.099002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.099895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.100537 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ce34b79-f980-425a-bfbd-fc98158a909e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.105093 Oct 18 13:28:09.109646 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 620/1220] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:09.114639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.114639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.114639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.114639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.115051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.115051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.336129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.337048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.350364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.353301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.353301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.356292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.357237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.359363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.384486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.394727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.396059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.397271 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-919c3655-c34a-4a89-a1f1-4fc124d34085 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.303180 Oct 18 13:28:09.417991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 601/1221] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:09.628703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.637483 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cfcca851-2b4f-4dd4-b167-d759cd2bf51b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.308015 Oct 18 13:28:09.638347 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 621/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:09.701151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a46c087-adba-4f13-942d-aa5a03e70979", "name": "network-vif-plugged", "status": "completed", "tag": "5651cdb5-da31-473e-96ff-851d8ffe5138"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:09.710471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.711047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.711554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.723634 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] Creating event network-vif-plugged:5651cdb5-da31-473e-96ff-851d8ffe5138 for instance 8a46c087-adba-4f13-942d-aa5a03e70979 on n-h2-858383-13 Oct 18 13:28:09.728898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a05cc6a4-4183-4c21-adbc-c164ae224393 req-49666ca2-e9e5-4c45-8ba4-a9dd77e96dba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034625 Oct 18 13:28:09.733299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 602/1223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:09.756305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.757676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.765894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.766415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.766863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.767708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.768176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.768799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.945746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.946478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.955976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.956850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.957841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.958828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.959726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.960323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.010544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.026277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f22995ce-e9a3-4d5f-9f55-539643b89b68 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1521 microversion: 2.1 time: 0.272311 Oct 18 13:28:10.037119 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 622/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.042786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.043269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.051275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.052643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.053242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.053858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.054349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.054812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.075713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.090540 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1861453-d48b-40ba-8b86-538de670d23c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1329 microversion: 2.1 time: 0.143088 Oct 18 13:28:10.090540 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 603/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1329 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:10.101745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.102606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.106358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:10.127755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.128259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.128705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.129446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.129941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.130432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.157955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:10.234303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.242392 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a2b9832-3b8e-4736-97e9-b62632d7f689 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.209546 Oct 18 13:28:10.242964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 623/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.247637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.249787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.254541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.255037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.255481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.256229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.256689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.257112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.326481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.335080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.337309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.345438 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afea28e9-6112-44ec-985a-11a5375e7499 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1416 microversion: 2.75 time: 0.100086 Oct 18 13:28:10.345438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 624/1227] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1416 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:10.350298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70750df4-1432-4120-9ba9-2771cabd6567 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312e3700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.404641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70750df4-1432-4120-9ba9-2771cabd6567 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.056894 Oct 18 13:28:10.404641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 625/1228] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.427245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.428101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.435092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.449195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.449913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.451342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.452294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.452954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.537751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbcea839-3496-41ef-840b-ce9bf7d47458 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 204 len: 0 microversion: 2.1 time: 0.446035 Oct 18 13:28:10.538868 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 604/1229] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:10 2022] DELETE /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:10.549713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.551004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.559284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.560017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.561592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.562965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.563793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.564464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.742763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.767363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.769704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.771507 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb3a7d88-f6ab-49e4-95de-fb4d52e4ad01 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.347944 Oct 18 13:28:10.793259 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 626/1230] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:10.802641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.804069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.818304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.819133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.819649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.820975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.821522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.822901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.098162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.113516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-085751c7-7290-43bc-9844-10a977e097f7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.313286 Oct 18 13:28:11.115305 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 627/1231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.120633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.123867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.131109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.132382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.133069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.135028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.135773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.136453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.241345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.253763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e5ecc97-7a63-4ea8-851e-bbf421e4afbb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1347 microversion: 2.1 time: 0.137001 Oct 18 13:28:11.254742 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 628/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1347 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.281166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.281166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.288124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.290216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.290806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.291921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.292527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.293076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.410071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.419608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0769c51-87a7-42b6-a805-b9557fbd260d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1527 microversion: 2.1 time: 0.875628 Oct 18 13:28:11.421320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 605/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1527 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:11.442787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.444352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.464264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.464779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.465223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.465941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.466430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.471048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.483428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.507420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29d7b05b-9428-4a4b-95d0-e5ba5d5ee9c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.225965 Oct 18 13:28:11.514987 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 629/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.520605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-03258fe5-d3d5-4e9b-a74d-41539e841741 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33528f940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.606226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.619042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-03258fe5-d3d5-4e9b-a74d-41539e841741 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.102536 Oct 18 13:28:11.619861 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 630/1235] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.625780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.627267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.632928 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a11f9175-a2c6-4df0-98e5-9a3939f3334f tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1437 microversion: 2.75 time: 0.210436 Oct 18 13:28:11.641532 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 606/1236] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1437 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:11.664335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:11.670603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.678569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.680766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.686574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.686574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.686574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.686574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.771211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a488a5d6-e54e-4093-ad0f-59a7aa0b05d0", "name": "network-vif-plugged", "status": "completed", "tag": "d478c30a-0cc4-4b75-8005-ebbb46a05ca0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:11.802016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.804092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.804773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.837076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] Creating event network-vif-plugged:d478c30a-0cc4-4b75-8005-ebbb46a05ca0 for instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 on n-h2-858383-13 Oct 18 13:28:11.844156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c594b5eb-faef-47aa-9863-634c82e6b3d0 req-2d606234-5e08-408f-bdd1-a0cbf926e546 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078552 Oct 18 13:28:11.845548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 607/1237] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:11.851720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:11.852196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:11.852771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:11.853255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:11.853483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.853797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:11.854845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.863509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.864547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.865195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.866177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.866845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.867480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.082400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.093384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.094440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.095682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.097163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.098200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.099062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.122659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.151182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.152824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.156406 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9fbf2c49-3e25-467b-8ed2-888702095dc9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.309332 Oct 18 13:28:12.157018 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 608/1238] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:12.172043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.172670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.191467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.195036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.195594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.201878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.201878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.201878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.201878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.207168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.209372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.217310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a9641a3-1622-4e00-bc6b-27f2b3849b00 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "POST /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2/action" status: 202 len: 1494 microversion: 2.75 time: 0.557001 Oct 18 13:28:12.237104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 631/1239] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:28:11 2022] POST /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2/action => generated 1494 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:28:12.258778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.260438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.274142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.274466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.274963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.276154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.276154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.276540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.281987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:12.416724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.427659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.430946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.446769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17caf599-8386-4e80-ba82-34014fa37c35 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.202178 Oct 18 13:28:12.448131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 632/1240] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:12.477726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.478558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.505898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.505898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.505898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.505898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.506546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.507631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.617175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.635910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aed7fdd0-c914-4525-9ab4-6a6219c76769 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.476799 Oct 18 13:28:12.636788 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 609/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:12.654657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.655279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.674525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.674757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.675300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.676114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.676699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.677238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.715089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.726885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e7411b9e-695a-469a-ac65-337a119939c2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1389 microversion: 2.1 time: 0.277213 Oct 18 13:28:12.727388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 633/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1389 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:12.739966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.740601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.752824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.754522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.755163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.756067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.756869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.757307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.079404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.094237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac70deb2-1ef3-4667-a524-ebeee7db5f27 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.362690 Oct 18 13:28:13.098911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 634/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:13.109537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7a59d24-50a0-4aa0-8535-cabec87d0bc6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33526edc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.175792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7a59d24-50a0-4aa0-8535-cabec87d0bc6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.075381 Oct 18 13:28:13.180324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 635/1244] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:13.191873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.192613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.200543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.201243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.202212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.203592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.204111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.204662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.271719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.282157 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d462cef-49f6-46ec-ba50-9b57f91a39f6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1527 microversion: 2.1 time: 0.643979 Oct 18 13:28:13.284440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 610/1245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1527 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:13.450998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.475265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.478722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.479438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.480060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.481663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2bd5b4eb-2cce-4cb5-8116-f579a866d000 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.298817 Oct 18 13:28:13.482823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 636/1246] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:13.498462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.499791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.500388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.501689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.503058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.503639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.662127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.662762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.669674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.670211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.670662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.671370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.671830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.672269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.716250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.735377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.743039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.758006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f089a1d-5bad-4151-a289-ae5593a414e1 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.281522 Oct 18 13:28:13.759091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 611/1247] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:13.777602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.778277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.784908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.785395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.785834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.786600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.787226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.787872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.862830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.875069 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06cf8175-d7d2-40ea-ba90-290691e82ebb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1316 microversion: 2.1 time: 0.219130 Oct 18 13:28:13.882526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 637/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.121318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.122672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.144501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.144501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.144501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.144501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.144864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.144864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.245911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.281689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ad4dbb7-ba60-4393-9e36-216ece46b1c9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.520021 Oct 18 13:28:14.284403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 612/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.299998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53b2a05e-a0b0-4142-b9f3-ae474e549f54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3311070d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.396721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53b2a05e-a0b0-4142-b9f3-ae474e549f54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.108791 Oct 18 13:28:14.397637 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 613/1250] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.423097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.431331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.435829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.436858 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14b9fb92-7594-46b7-8a2f-c6c0f4e316df tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.320680 Oct 18 13:28:14.461509 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 638/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:14.485503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.486011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.486489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.504837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.506142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.507266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.511077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.512041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.520718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.521494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.522205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.525082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.525796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.526512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.776688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.791502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e21b1c8-fe42-4848-9340-8301e32a2739 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1485 microversion: 2.1 time: 0.384347 Oct 18 13:28:14.797581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 614/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1485 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.816307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.817038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.817883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.827961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.829656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.831881 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e305ee11-6db1-40fb-bdd4-f2b6641bd4df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.325189 Oct 18 13:28:14.833100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.834942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 639/1253] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:14.835476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.835967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.836809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.838390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.840432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.866398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:14.899476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.900214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.929868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.934270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.943919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.944862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.949674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.952941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.160918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.189690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.193372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.222710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0de9ac9-91fe-495e-8dc4-5ab8965e1d97 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.418746 Oct 18 13:28:15.237201 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 615/1254] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:15.251774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a46c087-adba-4f13-942d-aa5a03e70979", "name": "network-vif-deleted", "tag": "5651cdb5-da31-473e-96ff-851d8ffe5138"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:15.296655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.296828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.302652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.326785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.340315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85ecc202-7257-4ea8-b75b-7bcdfeeac6c3 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1465 microversion: 2.1 time: 0.445104 Oct 18 13:28:15.341565 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] Creating event network-vif-deleted:5651cdb5-da31-473e-96ff-851d8ffe5138 for instance 8a46c087-adba-4f13-942d-aa5a03e70979 on n-h2-858383-13 Oct 18 13:28:15.346745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 640/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1465 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:15.347559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e069fce8-e4b3-4a5a-872d-9369eb990690 req-47fa2c47-40c4-47a3-88c2-9d003c28278d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108972 Oct 18 13:28:15.352578 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 616/1256] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:15.355567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:15.356284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:15.362918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.363416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.363865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.364825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.365766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.366631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.367531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d54fa-7599-4745-8e3a-b76fec8108ef", "name": "network-vif-plugged", "status": "completed", "tag": "f15d6adf-83de-4bb8-b539-52112470bdba"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:15.399542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.400179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.401261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.420403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] Creating event network-vif-plugged:f15d6adf-83de-4bb8-b539-52112470bdba for instance 292d54fa-7599-4745-8e3a-b76fec8108ef on n-h1-858383-13 Oct 18 13:28:15.427237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-55a7f4b5-c1c3-43ab-9fd4-edc6b2e55c81 req-ff76d0cb-ac91-4fa4-80a5-3754b828158b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076266 Oct 18 13:28:15.432832 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 641/1257] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:15.451072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:15.461668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:15.471092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.473283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.475044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.477556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.478410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.479263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.791878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.803844 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5773d4f-1b08-435d-b582-b89e670235e9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.452454 Oct 18 13:28:15.824237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 617/1258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:15 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:15.833940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0febd60-61c5-4db5-8666-32fae4782876 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33122c5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:15.856361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:15.922015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0febd60-61c5-4db5-8666-32fae4782876 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.092208 Oct 18 13:28:15.924628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 618/1259] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:15 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:15.936542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:15.937309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:15.962399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.965783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.968668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:15.969922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:15.970853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:15.971368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.233632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe58f4b2-53be-4fe6-be2e-10c4e10ba808 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1618 microversion: 2.1 time: 0.798376 Oct 18 13:28:16.234078 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 642/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:15 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1618 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:16.238791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.239663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.246172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.247064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.247686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.248633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.249260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.249857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.255661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.266582 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88aa2170-530e-4965-a61c-c97a27701721 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.337830 Oct 18 13:28:16.267459 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 619/1261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:15 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:16.289571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.290307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.314449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.314449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.314449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.314449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.315011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.315011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.366504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.367005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.369085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.370684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lazy-loading 'fault' on Instance uuid 8a46c087-adba-4f13-942d-aa5a03e70979 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:16.468615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.479235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-755ca88e-70ce-4e2c-a406-f1e83a156cf6 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 200 len: 1314 microversion: 2.1 time: 0.244048 Oct 18 13:28:16.480507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 643/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:16.485739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.486681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.493942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.494488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.494942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.495666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.496744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.497201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.571250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.581185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.584708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.594723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94ba5736-5393-44d9-8634-fc2828c35d6c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.112910 Oct 18 13:28:16.595896 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 644/1263] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:16.601174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1067742859", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b2d14076-e2e9-4374-b7c3-81beb54bdf78"]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:16.687282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:16.706231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.721902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.726090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:16.729253 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-580ca7bb-54c2-4e97-8e14-9418c6f55d4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.460595 Oct 18 13:28:16.730881 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 620/1264] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:16.838610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.844006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.857540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.863145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.863883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.866575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.867356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.870581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.082152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:17.082152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:17.082731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:17.082731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:17.083113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:17.101955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.102513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.103293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.104798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.105532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.106224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.132330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:17.140007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:17.157914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:17.161555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:17.330534 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4436b499-9542-402a-8034-50267432d617 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733148 Oct 18 13:28:17.331763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 645/1265] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:17.350421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46cce8f6-19dd-436b-a95a-17b331c36a86 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33521a160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:17.449043 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46cce8f6-19dd-436b-a95a-17b331c36a86 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.115715 Oct 18 13:28:17.453959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 646/1266] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:17 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:17.482387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:17.483171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:17.561048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.561771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.567216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.568260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.568928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.574323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.760204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=46 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:17.865230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:17.879756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8259bb39-3704-469a-8685-eb05e12b5706 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1308 microversion: 2.1 time: 0.420346 Oct 18 13:28:17.902955 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 647/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:17 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:17.911072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de4ca340-b83e-4819-9ab9-c8d0fce80100 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:17.926665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de4ca340-b83e-4819-9ab9-c8d0fce80100 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.011495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de4ca340-b83e-4819-9ab9-c8d0fce80100 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.019098 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de4ca340-b83e-4819-9ab9-c8d0fce80100 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1217 microversion: 2.1 time: 0.114912 Oct 18 13:28:18.019683 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 648/1268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:17 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:18.034662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:18.059312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.060068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.063299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.063619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.093015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03dcd45a-eacd-4772-9f78-db6cc8b118c8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 1.262435 Oct 18 13:28:18.094958 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 621/1269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:18.107938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.110908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.116455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] Creating event network-changed:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:28:18.131637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.132199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.134564 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c5d5ade5-c993-4a9d-a19a-eb3de1e13675 req-6e3fc417-2b63-48c7-9f92-ba1ebcb7c679 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113352 Oct 18 13:28:18.135183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.136886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 649/1270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:18.139016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.142256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.142256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.144988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-plugged", "status": "completed", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:18.157422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:18.163180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.163920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.164573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.168038 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 HTTP/1.1 Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:28:18.171109 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:18.172734 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8a46c087-adba-4f13-942d-aa5a03e70979'} Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:18.173638 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:18.175149 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:18.177865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:18.179131 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2ea1f80-ddfb-4f66-abbb-df3ec0650459 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 404 len: 111 microversion: 2.1 time: 0.081860 Oct 18 13:28:18.180020 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 622/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:18.184986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.185860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.199334 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] Creating event network-vif-plugged:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:28:18.206546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-177f896c-c60b-47d2-80ab-bba28d72a773 req-f8fb59ed-28c4-42fe-b283-ee145cc53b0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066930 Oct 18 13:28:18.212793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.213307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.213756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.214148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 650/1272] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:18.219004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.219494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.219940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.223428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.224086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.241150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.241674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.242171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.246959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.248696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.249168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.563561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.577481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.582098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.595892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e679b4b7-6521-4ad4-9032-e215b24516d4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.414514 Oct 18 13:28:18.610698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 623/1273] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:18.627447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1007959788", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:18.711235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] validate_networks() for [('712ddb5e-612b-4594-9e50-5bb7e29ca2a0', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:18.767106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.785525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.787429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.789140 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d679cac6-1a84-476c-b58e-c8ca63f42848 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.573719 Oct 18 13:28:18.790239 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 651/1274] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:18.795654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a714dbf4-d55d-4730-aa5d-8af33419b45b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33521f5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.863617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a714dbf4-d55d-4730-aa5d-8af33419b45b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.070945 Oct 18 13:28:18.864227 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 652/1275] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:18.907283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.911787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.924569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.925305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.925950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.926855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.928337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.928948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.152948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:19.166520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88c10cf6-561f-4f34-8978-293782fb723b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 200 len: 1488 microversion: 2.1 time: 0.265155 Oct 18 13:28:19.168833 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 653/1276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 1488 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:19.191036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:19.194273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:19.204855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.205736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.206360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.207083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.207544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.207974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.302492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:19.343687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10322efe-e752-4d8e-a7be-cab34a982db8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1221 microversion: 2.1 time: 0.173110 Oct 18 13:28:19.361570 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 654/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:19 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:19.361570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:19.361570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:19.379168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.379758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.384399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.385410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.389941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.389941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.399279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:19.713822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:19.714970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:19.715973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:19.717090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:19.717773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:19.727719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.728429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.729052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.730012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.730718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.731334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.760217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:19.772636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Getting quotas for user 3424ff1ac4404c4cb1b47907bf255b4b and project e3669621720549bba2466676e40d638a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:19.807171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:19.809102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:19.811835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:19.853202 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-466dc47e-defa-4562-a4e6-5aecd60a5a9f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.499271 Oct 18 13:28:19.861507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 655/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:19 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:19.884212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-401745370"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:19.887187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:19.900312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.902875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.903587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.905803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.906496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.907303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.991504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f13ed12-b135-4480-97ef-11c23a637cdc tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.370842 Oct 18 13:28:19.992602 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 624/1279] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:20.006086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.006898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:20.018880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.028196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.028196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.028196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.028196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.028553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.197673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.216157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.222252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.229979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c8c1b45d-4b1a-40ea-9bd6-0ea5eb083546 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.229768 Oct 18 13:28:20.231367 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 625/1280] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:19 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:20.252462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.253574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:20.275995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.276732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.277537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.278766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.287419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.287419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.583545 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cca8a898-cd36-43e6-8226-ad25ff5e331d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef/action" status: 202 len: 0 microversion: 2.1 time: 0.720183 Oct 18 13:28:20.611084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 656/1281] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:19 2022] POST /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:28:20.624232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9aaec4c4-f985-4d49-9098-0eda9a984d49 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb335291e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.656020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.672392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.675209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.676754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d81a765-bdcc-4fe1-b33a-0122c5199f93 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.444289 Oct 18 13:28:20.691977 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 626/1282] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:20.710239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ac1c930-bb6d-4a2b-96eb-92fe1cab1f90 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.711013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ac1c930-bb6d-4a2b-96eb-92fe1cab1f90 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:20.789786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9aaec4c4-f985-4d49-9098-0eda9a984d49 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.172169 Oct 18 13:28:20.796310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 657/1283] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:20.816181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ac1c930-bb6d-4a2b-96eb-92fe1cab1f90 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:20.827602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.828096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:20.830962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ac1c930-bb6d-4a2b-96eb-92fe1cab1f90 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1225 microversion: 2.1 time: 0.136100 Oct 18 13:28:20.834546 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 627/1284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:20.844087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-974e6bfa-e928-4590-999e-17e25af04c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312a60d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.926100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.926367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.927223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.927447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.927919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.928360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:20.997607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-974e6bfa-e928-4590-999e-17e25af04c62 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.161638 Oct 18 13:28:21.000616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 628/1285] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:21.017122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.017746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:21.051841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.052477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.052930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.058639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.059183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.059639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.242831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.264820 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-544875a9-ea02-4551-bc70-d08da455443d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1213 microversion: 2.1 time: 0.467062 Oct 18 13:28:21.265757 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 658/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1213 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:21.306865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.309335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:21.322520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.326178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.326884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.328563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.332205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.336257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.505882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.525845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fe6b2bb-ecf4-447e-a00b-632e4fa8cf4c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.523140 Oct 18 13:28:21.528204 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 629/1287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:21 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:21.667682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.683176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.684909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.699630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfaa2a59-f1f8-4af9-998c-a8a38a10d353 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.418544 Oct 18 13:28:21.700476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 659/1288] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:21 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:21.716210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.717446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:21.726042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.726695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.727456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.728540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.729326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.730827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.814268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-78f1c3c2-acce-4528-9c42-ac2f9d3932c9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330cf8e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.881629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-78f1c3c2-acce-4528-9c42-ac2f9d3932c9 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.072123 Oct 18 13:28:21.885368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 660/1289] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:21 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:21.901379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.902619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:21.927866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.928380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.928839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.929560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.930035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.936757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.076426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.092215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.094615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.098090 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-894351f5-c6ee-4158-9b77-9affe9c98526 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.396409 Oct 18 13:28:22.099242 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 630/1290] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:21 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:22.106294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5846a17-f1ca-4752-9020-8b86435de7c9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331107ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.145683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.167733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80aca116-3006-4886-8a67-2810713a17a5 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1229 microversion: 2.1 time: 0.280893 Oct 18 13:28:22.175858 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 661/1291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:21 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1229 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:22.196034 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5846a17-f1ca-4752-9020-8b86435de7c9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.095426 Oct 18 13:28:22.196928 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 631/1292] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:22.299794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.300864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.320031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.334553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.336017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.340184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.341432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.344066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.470854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.484641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad187020-3fae-4302-b841-4aebacba7d04 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1277 microversion: 2.1 time: 0.195041 Oct 18 13:28:22.498331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 662/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:22.559538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.564447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.581386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.586532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.590416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.594009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.595964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.599166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.733109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.733744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.752501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.752501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.752501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.752501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.752967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.753385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.970325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.010693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.021981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.039583 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a604e9d9-b7e7-4888-9251-cd69ae391476 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.311156 Oct 18 13:28:23.042261 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 663/1294] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:23.064908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dfa01fee-01c5-4085-a92e-bb1e31031214 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33521f430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.210481 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dfa01fee-01c5-4085-a92e-bb1e31031214 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.165559 Oct 18 13:28:23.222913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 664/1295] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:23.231174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.234758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:23.246008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.246755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.247423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.248577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.249128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.249566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.265666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.313125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee886b85-4351-4401-8f63-5c5e125abf16 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.722894 Oct 18 13:28:23.313125 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 632/1296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:23.313125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.313125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:23.313125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.314117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.314117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.314117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.314117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.314870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.433725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.444324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94ad95e1-29c9-4536-8ca3-91fde5e5976a tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1277 microversion: 2.1 time: 0.162794 Oct 18 13:28:23.455655 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 633/1297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:23.466328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ecb02bf-b4c3-4d52-abce-fda99f5d3013 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3311ab8b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.550148 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ecb02bf-b4c3-4d52-abce-fda99f5d3013 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.092615 Oct 18 13:28:23.558904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 634/1298] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:23.558904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.558904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:23.568036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.568673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.569169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.570183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.570734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.572529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.661486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.679570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.681769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.684214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.685795 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c7a10a8-1188-45f6-94b2-62922c4122d7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1812 microversion: 2.25 time: 0.461408 Oct 18 13:28:23.687983 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 665/1299] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1812 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:23.709673 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85c4c44d-108c-41e4-9382-8f5c30693496 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1287 microversion: 2.1 time: 0.156942 Oct 18 13:28:23.711393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 635/1300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:24.082942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.083627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:24.090423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.090910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.091343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.092671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.093135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.093564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.182938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:24.204844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:24.206672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:24.221191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ab9c61c-0197-4c0e-a8fe-a3aeae08291b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.142210 Oct 18 13:28:24.231676 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 666/1301] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:24.235340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b57d2bc1-9530-49f0-b094-9b1be16d52f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3311ab550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.309966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b57d2bc1-9530-49f0-b094-9b1be16d52f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1454 microversion: 2.1 time: 0.084337 Oct 18 13:28:24.311358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 636/1302] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:24.345546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.346091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:24.362693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.363211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.363664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.364388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.365106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.365638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.477527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.478592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:24.491309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.492208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.492840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.493874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.497045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.500586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.628806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:24.636861 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-430c8507-c857-47ae-b1c7-7ecef6fb1d33 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1285 microversion: 2.1 time: 0.163878 Oct 18 13:28:24.649255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 637/1303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:24.654212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-156224b5-ed81-45fc-838b-5ce7806b3474 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3311f2ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.708922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:24.720902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-976a823b-1ad7-4ff6-8a98-b76e04655c2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1377 microversion: 2.1 time: 0.377192 Oct 18 13:28:24.724850 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 667/1304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1377 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:24.729724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-plugged", "status": "completed", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:24.752668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.755976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.757222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.798782 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] Creating event network-vif-plugged:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:28:24.810172 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-29d94ca9-2237-452f-b41f-ac1b4946ab47 req-eada2b07-ed49-4631-8b9a-ba11c4ec15d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083987 Oct 18 13:28:24.822998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 668/1305] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:24.829584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.833658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:24.838021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.838835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.839521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.840457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.841129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.841806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.203679 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-156224b5-ed81-45fc-838b-5ce7806b3474 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.552928 Oct 18 13:28:25.209239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 638/1306] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:25.218306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:25.224609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:25.237355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:25.241304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:25.241972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.243379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:25.245480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:25.252328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.351468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:25.370728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:25.372876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:25.375661 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff37cf01-4fd3-42f1-a38d-0386fb13c3db tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1802 microversion: 2.25 time: 0.550956 Oct 18 13:28:25.377485 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 669/1307] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1802 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:25.395479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:25.396506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:25.404494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:25.409802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:25.409802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.412275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:25.412782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:25.413224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.992292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:26.004690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:26.008207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:26.020102 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fdc415c-52ac-49a2-b625-3543029f2952 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.637681 Oct 18 13:28:26.026503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 670/1308] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:25 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:26.032783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e5bec65-ffa3-41ef-94f5-c370c24d1a54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c9ba60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:26.069499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:26.077962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fae65828-7af0-46b3-b973-3a1649081016 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1317 microversion: 2.1 time: 0.867521 Oct 18 13:28:26.100625 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 639/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:25 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1317 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:26.113580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-830f3f16-b13e-4a8c-931e-a86bed6633e2 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '.version_select at 0x7fb3311eff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:26.130284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-830f3f16-b13e-4a8c-931e-a86bed6633e2 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.132979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-830f3f16-b13e-4a8c-931e-a86bed6633e2 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.135969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-830f3f16-b13e-4a8c-931e-a86bed6633e2 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.177406 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-830f3f16-b13e-4a8c-931e-a86bed6633e2 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2385 microversion: 2.25 time: 0.075292 Oct 18 13:28:26.180706 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 640/1310] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 18 13:28:26 2022] GET /compute/v2.1/os-migrations => generated 2385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:26.199844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:26.202795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:26.221411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.222890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.223599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.225807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.226508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.227750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.287574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:27.122298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:27.160204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:27.175140 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b826e34-84d4-42ca-a2f1-32c13a7b4dfa tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1325 microversion: 2.1 time: 0.989874 Oct 18 13:28:27.205410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 641/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:26 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1325 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:27.222713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:27.226239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:27.250894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:27.253432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:27.254141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:27.259733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:27.260414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:27.262557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:28.016553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:28.425590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:28.444667 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-074fbef0-cc8f-4968-b21a-176cf363d88f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1526 microversion: 2.1 time: 1.239326 Oct 18 13:28:28.445861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 642/1312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:27 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1526 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:28.470756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:28.475184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:28.483499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:28.487065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:28.487753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:28.488691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:28.493155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:28.493817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:29.443889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:29.487377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73ffb1bd-c9d0-4b6e-8bd3-b766e46350eb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 2423 microversion: 2.25 time: 1.040171 Oct 18 13:28:29.509682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 643/1313] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:28 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 2423 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:29.515225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8880b81d-8e23-44f8-ab43-72d82c5c1f7a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3311325e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:29.743076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:30.823825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:36.000604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:36.019845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=40 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:38.483446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:38.552061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8880b81d-8e23-44f8-ab43-72d82c5c1f7a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 9.040004 Oct 18 13:28:38.555929 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 644/1314] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:29 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 9043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:38.556574 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e5bec65-ffa3-41ef-94f5-c370c24d1a54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1463 microversion: 2.1 time: 12.527884 Oct 18 13:28:38.558544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 671/1315] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:26 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1463 bytes in 12531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:38.564333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.565060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.567841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.568588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.572340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.573156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.574020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.574984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.575688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.576962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.578491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.579059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.579568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.580337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.580998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.581491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.690108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.699897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.701735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.715181 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6ec80b1-119c-4d8d-8663-6db714e895fe tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.159733 Oct 18 13:28:38.726143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 645/1316] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:38.734753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d54fa-7599-4745-8e3a-b76fec8108ef", "name": "network-vif-plugged", "status": "completed", "tag": "f15d6adf-83de-4bb8-b539-52112470bdba"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:38.746047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.746555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.746993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.760921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] Creating event network-vif-plugged:f15d6adf-83de-4bb8-b539-52112470bdba for instance 292d54fa-7599-4745-8e3a-b76fec8108ef on n-h1-858383-13 Oct 18 13:28:38.768976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.772878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-eb0a6b46-5867-455f-ba82-475263d14b16 req-6d4c1851-7fc7-4edb-95b6-3797d50c8c38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045384 Oct 18 13:28:38.772878 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 646/1317] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:38.778049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.779452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.781201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88e18f61-c63d-4f31-b76b-7dd651b29abb tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1317 microversion: 2.1 time: 0.220656 Oct 18 13:28:38.782211 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 672/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:38.787444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.788319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.788764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.789626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.791201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.792068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.799203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.799726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.802517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.803342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.804526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.805435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.805997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.806551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.982425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.992080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37abe1f3-9ca9-43ee-bbf3-1545b71ed29f tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1325 microversion: 2.1 time: 0.218072 Oct 18 13:28:38.994698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 647/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:39.000329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:39.001378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:39.008571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.009436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.009601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:39.010324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.011413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.012166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.012905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.019756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4554864-4bdb-4bc2-9d0d-237e5a627fb3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1526 microversion: 2.1 time: 0.236249 Oct 18 13:28:39.022072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 673/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1526 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:39.027399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6daf44-144c-4ea3-9795-7266d8f687fa", "tag": "f85c6385-8655-43f5-82a5-d35041abf122"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:39.046708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.048849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.049488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.065357 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] Creating event network-changed:f85c6385-8655-43f5-82a5-d35041abf122 for instance 0c6daf44-144c-4ea3-9795-7266d8f687fa on n-h2-858383-13 Oct 18 13:28:39.072443 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7414c29a-3a23-445d-86e0-5d9a947ebc53 req-5f4cb7e4-f773-4413-9660-eb331f857477 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048156 Oct 18 13:28:39.074265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 674/1321] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:39.286794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1885347357", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1d39c162-1076-4759-b728-c0f93d172f89"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:39.295386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:39.314004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21c0979c-b89e-474a-831f-f09538260c41 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 2423 microversion: 2.25 time: 0.316236 Oct 18 13:28:39.331097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 648/1322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 2423 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:39.340953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cef8b98-45c4-4a72-8ab5-131f86820bdf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3311321f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:39.411432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] validate_networks() for [('1d39c162-1076-4759-b728-c0f93d172f89', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:39.430030 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5cef8b98-45c4-4a72-8ab5-131f86820bdf tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 200 len: 1463 microversion: 2.1 time: 0.097692 Oct 18 13:28:39.430703 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 649/1323] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:39 2022] GET /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 1463 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:39.440624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ccf9d54-b1e4-4109-ad66-86a6a75811f7 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:39.556036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ccf9d54-b1e4-4109-ad66-86a6a75811f7 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/49155e73-c29b-41c5-ba33-509576125f45" status: 202 len: 0 microversion: 2.1 time: 0.124015 Oct 18 13:28:39.559591 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 650/1324] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:39 2022] DELETE /compute/v2.1/flavors/49155e73-c29b-41c5-ba33-509576125f45 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:39.562218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:39.562964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:39.576092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.579187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.579729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.580697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.581368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.586579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.970574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:39.971139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:39.971385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:39.971802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:39.972221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:39.986312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.987299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.987696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'services' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:39.988772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.990042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.990744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.991364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.013598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.024261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for user d5ed601492e2486bad8ba5b09515d52a and project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.040325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:40.044919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:40.180889 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7834026f-aaaf-4374-a03e-36f3af7b5025 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103907 Oct 18 13:28:40.182276 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 675/1325] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:40.195515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.196060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.208384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.208961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.211122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.211122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.211122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.211592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.302574 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04277cd1-21b7-4731-82fc-215082529ef7 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments/a6fa3a68-e548-401e-885d-2849ca142fd1" status: 202 len: 0 microversion: 2.25 time: 0.744570 Oct 18 13:28:40.310701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 651/1326] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 18 13:28:39 2022] DELETE /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments/a6fa3a68-e548-401e-885d-2849ca142fd1 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:40.326839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fda1a733-04c7-4f38-8eef-0d90f02d62c6 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.395078 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fda1a733-04c7-4f38-8eef-0d90f02d62c6 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082141 Oct 18 13:28:40.402816 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 652/1327] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.419915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a2816cd-8c3b-4385-8bb0-a076f2ac30e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331074e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.433633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.446135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6093ede3-83e7-44bb-b0f5-2378d92ec85d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1466 microversion: 2.1 time: 0.261503 Oct 18 13:28:40.447694 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 676/1328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.485074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.485608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.515494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.521831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.522753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.524317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.526695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.528310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.534777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a2816cd-8c3b-4385-8bb0-a076f2ac30e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.130013 Oct 18 13:28:40.537360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 653/1329] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.545007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.547191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.560576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.561222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.561835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.563812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.568471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.570021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.621632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.631802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.633497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.639948 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a618ff9-cfe8-4970-b1f4-423cb33c69db tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.190997 Oct 18 13:28:40.641759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 677/1330] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:40.649988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.654452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.657472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.658261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.658947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.659884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.660560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.661236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.745148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.754837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb71d499-081e-41d1-9ae8-57176d888676 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1317 microversion: 2.1 time: 0.215951 Oct 18 13:28:40.755696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 654/1331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.761552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-244a831e-9970-4572-bb4d-63e42b13820b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.762224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-244a831e-9970-4572-bb4d-63e42b13820b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.843868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-244a831e-9970-4572-bb4d-63e42b13820b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.851663 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-244a831e-9970-4572-bb4d-63e42b13820b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1211 microversion: 2.1 time: 0.093897 Oct 18 13:28:40.852257 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 655/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.866494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.869636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.877438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.878335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.879163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.879744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.879951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.880417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.880844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.909144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-daa69563-ca9c-4292-adae-c32c4c0dbe35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1325 microversion: 2.1 time: 0.265809 Oct 18 13:28:40.909852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 678/1333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:40.915504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.919015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.922946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-480ce2e0-4608-4fb8-adc3-89fbba9cef4b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066065 Oct 18 13:28:40.927446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.928032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.928591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.929115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 656/1334] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:28:40.929759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.930522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.931205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.934199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db351ac0-75c3-48f3-9ae7-69fc94de87e6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310140d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.027099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.033382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Old instance type tempest-test_resize_flavor_-1358420424, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:28:41.035141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db351ac0-75c3-48f3-9ae7-69fc94de87e6 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-18T13%3A26%3A20Z" status: 200 len: 1899 microversion: 2.1 time: 0.104863 Oct 18 13:28:41.041408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:41.041840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:41.042350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:41.042760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:41.043173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:41.045719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 657/1335] 10.222.0.27 () {58 vars in 1199 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/images?changes-since=2022-10-18T13%3A26%3A20Z => generated 1899 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:41.050615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6daf44-144c-4ea3-9795-7266d8f687fa", "name": "network-vif-plugged", "status": "completed", "tag": "f85c6385-8655-43f5-82a5-d35041abf122"}, {"server_uuid": "a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7", "name": "network-vif-plugged", "status": "completed", "tag": "7142f5d9-e28d-4d64-a461-d1170208c83a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:41.062480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.062940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.063369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.075172 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Creating event network-vif-plugged:f85c6385-8655-43f5-82a5-d35041abf122 for instance 0c6daf44-144c-4ea3-9795-7266d8f687fa on n-h2-858383-13 Oct 18 13:28:41.075798 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] Creating event network-vif-plugged:7142f5d9-e28d-4d64-a461-d1170208c83a for instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 on n-h2-858383-13 Oct 18 13:28:41.085247 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-62113c81-bd59-4427-bc4d-79468198edd7 req-34a5818f-897e-4b6c-b4f4-a54463fa96f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038109 Oct 18 13:28:41.086617 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 658/1336] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.091768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19522cad-80eb-46d0-b8ce-da45c0725862 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310d4e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.172219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19522cad-80eb-46d0-b8ce-da45c0725862 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-571460212" status: 200 len: 484 microversion: 2.1 time: 0.084368 Oct 18 13:28:41.172934 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 659/1337] 10.222.0.27 () {58 vars in 1229 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-571460212 => generated 484 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.187918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7", "tag": "7142f5d9-e28d-4d64-a461-d1170208c83a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:41.199084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.199084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.199431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.222775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] Creating event network-changed:7142f5d9-e28d-4d64-a461-d1170208c83a for instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 on n-h2-858383-13 Oct 18 13:28:41.227947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d2fe18a9-eb96-4a41-8d28-ce839ef85335 req-2968f767-6ab9-4d61-be5b-302149ae75ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044090 Oct 18 13:28:41.228471 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 660/1338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.234107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fea7ac89-bc87-4a55-a833-40a79c4db98f tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310749d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.336843 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fea7ac89-bc87-4a55-a833-40a79c4db98f tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?server=a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 955 microversion: 2.1 time: 0.107166 Oct 18 13:28:41.337728 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 661/1339] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?server=a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 955 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.352654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f99179c0-8ab3-4e5d-9b15-594409278982 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310141f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.427986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f99179c0-8ab3-4e5d-9b15-594409278982 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 485 microversion: 2.1 time: 0.072286 Oct 18 13:28:41.435547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 662/1340] 10.222.0.27 () {58 vars in 1317 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027 => generated 485 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.441305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1a77b49-ccda-4a26-afd2-5b98966a8982 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331133e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.506354 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1a77b49-ccda-4a26-afd2-5b98966a8982 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 485 microversion: 2.1 time: 0.063394 Oct 18 13:28:41.506354 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 663/1341] 10.222.0.27 () {58 vars in 1303 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027 => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:41.522233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65411579-dbd0-45cf-8b34-4d11ffad2160 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331074790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.573996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b58bad76-73a5-40ea-94d4-54668957d33e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c/action" status: 202 len: 0 microversion: 2.1 time: 0.662386 Oct 18 13:28:41.574565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 679/1342] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:41.584499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-abfad8d3-c859-47ab-b59b-494bf1795995 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33528fdc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.700535 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-abfad8d3-c859-47ab-b59b-494bf1795995 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.124683 Oct 18 13:28:41.708792 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 680/1343] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:41.714178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.715002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:41.722917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.723946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.724079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.724746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.725212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.725660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.727281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65411579-dbd0-45cf-8b34-4d11ffad2160 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.211398 Oct 18 13:28:41.734187 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 664/1344] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:41.744457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.745482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:41.752247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.754161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.754161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.754580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.755236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.755857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.967892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.976374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.977818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.992117 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c070aab-d545-4047-a342-5185de83408b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.256601 Oct 18 13:28:42.006083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 665/1345] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:42.006083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abe1401b-432e-4e3c-a1c9-ed5862f679fa tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331107a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.093544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.109648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-73e0dc91-637b-46bc-9340-2475a23da871 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1535 microversion: 2.1 time: 0.397499 Oct 18 13:28:42.110785 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 681/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1535 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.116818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.117889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.128793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.130363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.131013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.132154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abe1401b-432e-4e3c-a1c9-ed5862f679fa tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.138257 Oct 18 13:28:42.132332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.132941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.133751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.143187 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 666/1347] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.152260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.153913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.161882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.163067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.164018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.164906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.165529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.166156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.274204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.285757 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27f8545b-41f8-44c1-b95c-1baf7c85dfe8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1215 microversion: 2.1 time: 0.141382 Oct 18 13:28:42.287511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 667/1348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.304181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.305491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.314410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.314963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.315420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.316279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.316737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.317176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.457135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.465045 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a156269-22f1-4c6c-9698-84ce683e480f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1317 microversion: 2.1 time: 0.352971 Oct 18 13:28:42.469214 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 682/1349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.475041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.482488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.488863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.489571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.490478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.491520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.492251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.492842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.494763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.504669 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-371b23e2-a8f5-4d44-ac0e-90eb1565e53d tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1325 microversion: 2.1 time: 0.214731 Oct 18 13:28:42.506172 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 668/1350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.510090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f7ecf84-4549-4035-b89f-d8fccf9de1ea tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331014b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.547731 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-645c6e08-6f49-4950-9ee3-eb8c9f9c43be tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077199 Oct 18 13:28:42.548467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 683/1351] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:28:42.610108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f7ecf84-4549-4035-b89f-d8fccf9de1ea tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.103628 Oct 18 13:28:42.611155 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 669/1352] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:42.628714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db0484a2-aad3-4a3f-8bdb-5fc4349f4306 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c470d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.712320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db0484a2-aad3-4a3f-8bdb-5fc4349f4306 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-18T13%3A26%3A15Z" status: 200 len: 6330 microversion: 2.1 time: 0.090308 Oct 18 13:28:42.713504 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 684/1353] 10.222.0.27 () {58 vars in 1220 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-18T13%3A26%3A15Z => generated 6330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.717962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82f32d35-2832-49c6-90fe-cf09dde09238 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3310744c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.738081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdfadda8-1f01-4997-915b-f12d9a776ff5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330ce7ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.814221 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82f32d35-2832-49c6-90fe-cf09dde09238 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1411 microversion: 2.1 time: 0.101691 Oct 18 13:28:42.815222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 670/1354] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:42.823229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdfadda8-1f01-4997-915b-f12d9a776ff5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-571460212" status: 200 len: 664 microversion: 2.1 time: 0.084062 Oct 18 13:28:42.824426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 685/1355] 10.222.0.27 () {58 vars in 1250 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-571460212 => generated 664 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:42.840461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc1d5747-9a37-4faa-bfa4-1f511f97f718 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310148b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.920001 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc1d5747-9a37-4faa-bfa4-1f511f97f718 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1467 microversion: 2.1 time: 0.083086 Oct 18 13:28:42.920919 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 671/1356] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027 => generated 1467 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.936381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51779b32-5846-429a-aabb-9b669e555cb2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c47310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.999631 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51779b32-5846-429a-aabb-9b669e555cb2 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1467 microversion: 2.1 time: 0.067363 Oct 18 13:28:43.009140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 686/1357] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F455d57a6-5233-4642-86ee-c29b389fb027 => generated 1467 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:43.031315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.032788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.033168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70316a91-78e8-455d-8291-b06cee284aa8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310145e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.046035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.046887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.048270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.049239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.050800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.051465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.156022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.166773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.168897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.174566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88c3c8bc-74f0-49cb-938b-c92f37a701b4 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.150681 Oct 18 13:28:43.180228 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 687/1358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:43.180228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.181030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.187332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.187954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.188467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.189380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.190044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.190597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.192393 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70316a91-78e8-455d-8291-b06cee284aa8 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.170441 Oct 18 13:28:43.193823 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 672/1359] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.217062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e44f6ed6-75ac-4c16-9493-bd557b307a75 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3310aaf70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.294687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e44f6ed6-75ac-4c16-9493-bd557b307a75 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.082005 Oct 18 13:28:43.295275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 673/1360] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:43.311039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0369cbc7-82ff-48f3-b082-9b0016de637a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331014670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.357242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0369cbc7-82ff-48f3-b082-9b0016de637a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6" status: 200 len: 784 microversion: 2.1 time: 0.049659 Oct 18 13:28:43.358169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 674/1361] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6 => generated 784 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:43.373349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.378604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.381809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.382352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.383653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.384428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.384897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.385347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.428963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.447057 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19514a8b-f3c5-4113-be67-198386e23a96 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1535 microversion: 2.1 time: 0.270581 Oct 18 13:28:43.447582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 688/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1535 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.465517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee0f9fdf-2212-4d2b-9356-9b128dac41eb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c00940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.494688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.507377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec50b0dd-7618-4b75-ac7e-89445e9435b3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1263 microversion: 2.1 time: 0.137866 Oct 18 13:28:43.512109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 675/1363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.513783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.514634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.521699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.524877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.524877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.530700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.531520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.532095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.547487 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee0f9fdf-2212-4d2b-9356-9b128dac41eb tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.093568 Oct 18 13:28:43.548166 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 689/1364] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.563292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.565647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.574088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.574800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.585855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.585855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.585855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.585855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.728966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.741868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0321353-5f1a-40ed-bd6d-793b3ec014e0 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1523 microversion: 2.1 time: 0.191574 Oct 18 13:28:43.755304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 690/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.760570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.762734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.768957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.773846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.773846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.773846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.773846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.774773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.811661 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fdfe86dd-04c8-47dd-9fa7-d5ab8113830c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055028 Oct 18 13:28:43.812245 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 691/1366] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:28:43.818253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ecf243e-d68a-458b-8743-a0d92b626754 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3352691f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.834279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.848787 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69f18b7e-00c1-4947-8b2d-afbd29474789 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1317 microversion: 2.1 time: 0.339303 Oct 18 13:28:43.854492 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 676/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.868232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.869095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:43.877199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.887748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.888465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.889403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.890073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.891392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.925158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:43.929009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:44.331076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0459b3ca-df00-4d96-a4bc-b0e900e7dd35 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 204 len: 0 microversion: 2.1 time: 0.467533 Oct 18 13:28:44.335683 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 677/1368] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:43 2022] DELETE /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:44.336974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bce6876d-6fe9-4c89-a4d6-cb88354b5fdf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331014a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.389989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bce6876d-6fe9-4c89-a4d6-cb88354b5fdf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1420 microversion: 2.1 time: 0.057121 Oct 18 13:28:44.391313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 678/1369] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:44.396465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-unplugged", "status": "completed", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:44.409704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.410232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.410684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.440487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] Creating event network-vif-unplugged:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:28:44.446205 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a8c8141d-a35c-4b93-9dda-21c483096c22 req-f7771558-3862-41ff-a2f6-3c1352bb36d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053155 Oct 18 13:28:44.447112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 679/1370] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:44.457966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.461763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.469393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.472445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.472957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.473692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.474225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.474699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.550235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:44.559006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:44.560576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:44.565518 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-221a5f52-7c41-4f3a-b54a-c9b4916eebe9 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1446 microversion: 2.75 time: 0.117306 Oct 18 13:28:44.578261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 680/1371] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:44.585794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.588967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.597474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.598227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.598828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.600907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.601548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.602167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.751224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:44.762629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58f2e6b0-f5b2-4fbb-9494-19de4f7a301b tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1529 microversion: 2.1 time: 0.192090 Oct 18 13:28:44.762629 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 681/1372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1529 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:44.765004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f725655a-21f5-47e7-9c16-262650e81a10 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33103ec10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.822064 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f725655a-21f5-47e7-9c16-262650e81a10 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 200 len: 1420 microversion: 2.1 time: 0.061245 Oct 18 13:28:44.822789 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 682/1373] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:44.828031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.828636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.835416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.835975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.836388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.837120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.837584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.838328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.001736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:45.010283 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56c3d4de-fff6-485d-8423-71d489bbcaf2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1535 microversion: 2.1 time: 0.186053 Oct 18 13:28:45.017024 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 683/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:45.022038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:45.022683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:45.033466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.033933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.034402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.035102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.035637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.036065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.100245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:45.108943 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4cc984a-304e-49f0-823f-18762087b628 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1263 microversion: 2.1 time: 0.090887 Oct 18 13:28:45.109658 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 684/1375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:45 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:45.114857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:45.117058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:45.123882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.124366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.124799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.125486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.125941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.126461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.156671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fbfb641-b72d-4f94-8b55-93a61374b90a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.045927 Oct 18 13:28:45.157232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 685/1376] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:28:45 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:28:45.161594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:45.162353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:45.168051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.168565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.168971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.170280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.170738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.171207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.206469 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ecf243e-d68a-458b-8743-a0d92b626754 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722" status: 204 len: 0 microversion: 2.1 time: 1.392481 Oct 18 13:28:45.208335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 692/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:43 2022] DELETE /compute/v2.1/images/8bbfb13e-ec1b-4aca-afb7-728950c2f722 => generated 0 bytes in 1395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:45.215597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-485578510", "imageRef": "18a561fa-0a14-40d8-be60-e3846d39751d", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:45.300138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:45.343592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:45.360048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0f82cd8c-339e-42df-8a88-eb436b602aa4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1467 microversion: 2.1 time: 0.201764 Oct 18 13:28:45.360943 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 686/1378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:45 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1467 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:45.365609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94aef7fc-6dee-4c61-b2e5-07af5e3f379b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb3312ccee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:45.787679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:45.788167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:45.788986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:45.789411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:45.789885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:45.798994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.799482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.799925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.800656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.801113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.801545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.819801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:45.828404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:45.844228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:45.846740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='18a561fa-0a14-40d8-be60-e3846d39751d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:45.976826 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6ea1b2d-3144-4063-a255-43be87f92d68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766454 Oct 18 13:28:45.978030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 693/1379] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:45.984657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:45.985281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:45.992291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.992793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.995698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:45.995698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:45.995698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:45.995698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.172653 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f02038b-cccf-4785-bf6c-4b8783dceac4 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1620 microversion: 2.1 time: 0.193252 Oct 18 13:28:46.176104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 694/1380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:45 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1620 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:46.207220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.208621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.218395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.225375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.225375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.225375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.225375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.225719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.233664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:46.331542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.352865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.354621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.361190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8298ecd2-efac-45fb-b5f1-a710ef77b5b3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1452 microversion: 2.75 time: 0.172922 Oct 18 13:28:46.362110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 695/1381] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:46.368931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.369776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.377170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.377944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.378986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.380320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.381324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.381928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.554571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.564318 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96a27e39-f69f-4ce2-bb7f-c54a4c71cbfb tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1529 microversion: 2.1 time: 0.200222 Oct 18 13:28:46.565309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 696/1382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1529 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:46.571112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d519836d-ae9b-457a-a92a-9963f97ba0fa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.572088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d519836d-ae9b-457a-a92a-9963f97ba0fa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.623397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94aef7fc-6dee-4c61-b2e5-07af5e3f379b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29" status: 204 len: 0 microversion: 2.1 time: 1.260303 Oct 18 13:28:46.623855 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 687/1383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:45 2022] DELETE /compute/v2.1/images/3a267c79-0be8-4830-a90e-7f5af67f6d29 => generated 0 bytes in 1262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:46.631095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.631954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.655230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.655230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.655230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.662011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.662547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.662994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.760151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d519836d-ae9b-457a-a92a-9963f97ba0fa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.770692 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d519836d-ae9b-457a-a92a-9963f97ba0fa tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1207 microversion: 2.1 time: 0.201933 Oct 18 13:28:46.772576 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 697/1384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1207 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:46.783267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.785939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.820962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.821116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.821642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.822916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.823411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.824488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.939271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.948653 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-221bca4f-bbf7-4e56-bd67-fb83445f232c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1535 microversion: 2.1 time: 0.323726 Oct 18 13:28:46.949698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 688/1385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1535 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:46.960681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.964813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.972836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.973349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.973802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.974753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.975224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.975660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.007597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a67ba689-adfd-444f-b3b6-71edaab4ddd3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.056629 Oct 18 13:28:47.008166 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 689/1386] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:47.012606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1816823380", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b2d14076-e2e9-4374-b7c3-81beb54bdf78"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:47.030083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:47.041592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-52272221-04dd-4d97-8fd8-dfed306a9cef tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1281 microversion: 2.1 time: 0.267650 Oct 18 13:28:47.046263 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 698/1387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:47.055742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a79f06ba-a918-44ba-8fc9-0b29956188ec tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c00b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.113569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:47.456801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:47.457471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:47.457955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:47.461122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:47.461122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:47.471272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.471853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.472194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.473140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.473611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.475926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.500355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:47.507489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Getting quotas for user 92f8b851f06d4b038a147c7dd873cb34 and project 9f5cd093b94c4161bed82c6495bc37be. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:47.523480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:47.526024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:47.665460 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96130a0c-dc0c-469c-9cb1-a219ea006188 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655614 Oct 18 13:28:47.666287 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 690/1388] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:47.671366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7", "name": "network-vif-deleted", "tag": "7142f5d9-e28d-4d64-a461-d1170208c83a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:47.682806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.683597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.684260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.698729 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] Creating event network-vif-deleted:7142f5d9-e28d-4d64-a461-d1170208c83a for instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 on n-h2-858383-13 Oct 18 13:28:47.704539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-db5386f0-cbe6-4a73-8213-b5671f180dd0 req-bc954f29-0cbc-4599-8712-5a22796a1126 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Oct 18 13:28:47.716366 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 691/1389] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:47.716366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.716366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:47.720859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.721537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.722178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.723271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.723898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.724487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.852356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:47.863980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:47.883069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:47.884144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03bcb5b1-8da8-4fc7-9d06-7c34e4bf9520 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1452 microversion: 2.75 time: 0.174636 Oct 18 13:28:47.885021 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 692/1390] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:47 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:47.890469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.891205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:47.899036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.900305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.912581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.912581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.914695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.915072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.958564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.959093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.959534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.963168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lazy-loading 'fault' on Instance uuid a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:48.011021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3424ff1ac4404c4cb1b47907bf255b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3669621720549bba2466676e40d638a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.019122 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-778ca413-6bf1-4670-89ee-75e54410df23 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 200 len: 1315 microversion: 2.1 time: 0.133102 Oct 18 13:28:48.019730 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 693/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:47 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 1315 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:48.024199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ebc41da9-a382-4209-8052-c9261da7819e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.024800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ebc41da9-a382-4209-8052-c9261da7819e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:48.026513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:48.086209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ebc41da9-a382-4209-8052-c9261da7819e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.093397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ebc41da9-a382-4209-8052-c9261da7819e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1217 microversion: 2.1 time: 0.072686 Oct 18 13:28:48.094482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 694/1392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:48.099260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.106273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:48.108632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.109134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.109581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.116565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.117175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.117789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.230598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.241629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3f4fcd6-b94e-42e6-8fe0-e2d61508797d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1203 microversion: 2.1 time: 0.145011 Oct 18 13:28:48.242614 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 695/1393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1203 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:48.247754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.248561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:48.254801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.255506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.256388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.257410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.258207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.258791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.633373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a79f06ba-a918-44ba-8fc9-0b29956188ec tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b" status: 204 len: 0 microversion: 2.1 time: 1.590051 Oct 18 13:28:48.637060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 699/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:47 2022] DELETE /compute/v2.1/images/79dbee04-dc26-4d3b-a13b-a1bf4fb21d9b => generated 0 bytes in 1591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:48.643608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.652903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.654462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:48.659813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd554542-886c-4f72-b277-2624783c744f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1535 microversion: 2.1 time: 0.415836 Oct 18 13:28:48.662737 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 696/1395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1535 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:48.667508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.673024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.673770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.674594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:48.675227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.678933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.679603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.681923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.682099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.682766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.683370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.684250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.685003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.689102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.729517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:48.793202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:48.981404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.001392 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-67b4e3a5-f423-4f53-9179-e0ebcf189339 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.354665 Oct 18 13:28:49.001392 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 700/1396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.002112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.004568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.016819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.017930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.019288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.020277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.021177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.021915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.137466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.147831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.149420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.155098 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ea7d098-73a2-4617-b5cc-5c0ae88d3a04 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1437 microversion: 2.75 time: 0.158382 Oct 18 13:28:49.158290 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 701/1397] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:49.160278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d54fa-7599-4745-8e3a-b76fec8108ef", "name": "network-vif-unplugged", "status": "completed", "tag": "f15d6adf-83de-4bb8-b539-52112470bdba"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:49.169618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.170128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.170571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.178604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55382220-8470-4cbe-a231-dd6ebbaae6e7 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 204 len: 0 microversion: 2.1 time: 0.514358 Oct 18 13:28:49.181169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 697/1398] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:48 2022] DELETE /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:49.190777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.191507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.201567 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] Creating event network-vif-unplugged:f15d6adf-83de-4bb8-b539-52112470bdba for instance 292d54fa-7599-4745-8e3a-b76fec8108ef on n-h1-858383-13 Oct 18 13:28:49.207180 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bd49a0a7-9aa4-4fc1-b3c5-0bf1cd3335dc req-6bd57d44-1056-4145-a14a-7f44c19613f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050341 Oct 18 13:28:49.208904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.209983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.210968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.211575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.212472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.213468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 702/1399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:49.219260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.220670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.221470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.228773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.229332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.230254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.231396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.232104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.232747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.243666 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 HTTP/1.1 Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:28:49.245637 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. Oct 18 13:28:49.247643 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7'} Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:49.250582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. Oct 18 13:28:49.264905 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.266094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:49.266094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e09594a3-6278-4cfc-8aee-0aefb68cf6a4 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7" status: 404 len: 111 microversion: 2.1 time: 0.064900 Oct 18 13:28:49.266094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 698/1400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/a8c5ca24-dbc2-4093-be3e-cfa1b2eda1c7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:49.266094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.266094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.267377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.268100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.268709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.269423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.269919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.270338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.388587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.405527 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c5d20a0-bd63-4f1c-94fa-7d4f43230a22 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1221 microversion: 2.1 time: 0.190080 Oct 18 13:28:49.420498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 703/1401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.421547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.431535 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61790ffc-0105-460b-99f8-28fc4ad6a5ae tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1472 microversion: 2.1 time: 0.178025 Oct 18 13:28:49.432389 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 699/1402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.437978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef14530b-d2e1-4243-a1eb-f8863a003f36 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb331074dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.471498 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ef14530b-d2e1-4243-a1eb-f8863a003f36 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Image not found. Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef14530b-d2e1-4243-a1eb-f8863a003f36 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674 HTTP/1.1 Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:28:49.476981 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e44dd23d-5f2e-4f4a-9352-2c3330962674'} Oct 18 13:28:49.479842 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e44dd23d-5f2e-4f4a-9352-2c3330962674 to delete Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.480850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e44dd23d-5f2e-4f4a-9352-2c3330962674 could not be found. Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:49.483700 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef14530b-d2e1-4243-a1eb-f8863a003f36 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:49.485518 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef14530b-d2e1-4243-a1eb-f8863a003f36 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674" status: 404 len: 62 microversion: 2.1 time: 0.045146 Oct 18 13:28:49.486779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 700/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] DELETE /compute/v2.1/images/e44dd23d-5f2e-4f4a-9352-2c3330962674 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:49.487618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.488030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.498822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.502564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.502564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.502564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.502564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.502982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.571321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.587147 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7e01bf9-9b1b-4d34-a545-f25334d7f64c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1267 microversion: 2.1 time: 0.103308 Oct 18 13:28:49.588989 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 701/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.630502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.631493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.640858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.641597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.642274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.643457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.644329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.644922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.661294 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 HTTP/1.1 Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:28:49.663169 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.664596 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8a46c087-adba-4f13-942d-aa5a03e70979'} Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:49.665394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.666669 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.670275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:49.670275 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef2e0374-f313-4d73-a712-ee6841c7dc07 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 404 len: 111 microversion: 2.1 time: 0.070042 Oct 18 13:28:49.670275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 702/1405] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:49 2022] DELETE /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:49.677997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.677997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: 8a46c087-adba-4f13-942d-aa5a03e70979] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.686483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:49.689289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.695462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.696020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.696470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.703758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.703925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.704056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.704158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.704242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.704348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.704433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.704433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.704433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.716798 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 HTTP/1.1 Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:28:49.718420 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.719763 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8a46c087-adba-4f13-942d-aa5a03e70979'} Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:49.720539 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. Oct 18 13:28:49.723125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:28:49.725982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance 8a46c087-adba-4f13-942d-aa5a03e70979 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:49.725982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1848c48-368d-497f-9f4a-51d97bdc91e8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979" status: 404 len: 111 microversion: 2.1 time: 0.048655 Oct 18 13:28:49.725982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 703/1406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/8a46c087-adba-4f13-942d-aa5a03e70979 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:49.725982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.726729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.733218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.733724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.734192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.734900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.735855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.735855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.818586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:49.818920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:49.819399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:49.819812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:49.820230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:49.922273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.931490 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ad6df62-032f-42ca-a822-f3234cb8ee14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.209683 Oct 18 13:28:49.932576 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 704/1407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.949859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bafc3aa7-73ad-4a06-9fc2-66dcee2aa1c2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb330feb550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.059453 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bafc3aa7-73ad-4a06-9fc2-66dcee2aa1c2 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015647442" status: 202 len: 0 microversion: 2.1 time: 0.116233 Oct 18 13:28:50.062720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 705/1408] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:28:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015647442 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:50.084453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.087336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.087703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.102749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.102749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.103125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.103713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.104204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.104736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.105793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.106827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.107380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.107922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.108460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.108960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.293045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:50.312369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:50.326544 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c0d89af-488b-43e4-a30d-2750ecda8a29 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2/action" status: 202 len: 1942 microversion: 2.75 time: 0.893995 Oct 18 13:28:50.332650 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 704/1409] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:28:49 2022] POST /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2/action => generated 1942 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:28:50.362859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.363996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.371884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.373293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.375452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.376628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.378002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.378715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.514225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:50.542307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4329094e-5dd7-4159-98c8-1ba8996277b9 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.185987 Oct 18 13:28:50.556482 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 705/1410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:50.579435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.583577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.597920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.600754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.603079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.604019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.607417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.609037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.751688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:50.760890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee6e52e5-72cf-4758-98ed-1f5ba8862521 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1213 microversion: 2.1 time: 0.202852 Oct 18 13:28:50.761729 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 706/1411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:50.767573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.768478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.775010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.776092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.776773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.777753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.778770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.779456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.788390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:50.800988 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56ce9f95-c033-44b3-9365-745fca0aee8b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.729178 Oct 18 13:28:50.812103 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 706/1412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:50.829662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.832673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.849221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.849720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.850208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.851163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.851365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.854745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.966978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:50.978884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c546af45-8b3a-48be-b621-ad3e32fe5eaf tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1265 microversion: 2.1 time: 0.163330 Oct 18 13:28:50.982163 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 707/1413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:50.987327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fbacee-ee4f-438c-80f4-1877607c129c", "tag": "1fb8e507-e9c0-4985-87dd-2c732d7a53c0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:51.015975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.016818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.022713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.037859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] Creating event network-changed:1fb8e507-e9c0-4985-87dd-2c732d7a53c0 for instance 65fbacee-ee4f-438c-80f4-1877607c129c on n-h1-858383-13 Oct 18 13:28:51.065772 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c6c0aab9-8502-4da7-b103-f9cc11b5b4d0 req-efa14a11-74ac-4e5b-9ee5-f599da6064c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082141 Oct 18 13:28:51.070657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 708/1414] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:51.079208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.080154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.087767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.088663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.089188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.090656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.091808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.091808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.405689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:51.417190 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ef890fc-c277-4299-a491-9ee9135804a9 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.345233 Oct 18 13:28:51.418462 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 709/1415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:51.505958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:51.527618 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40551eb2-6f98-4e20-b273-1d607791bb54 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1472 microversion: 2.1 time: 0.763297 Oct 18 13:28:51.532088 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 707/1416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:51.575426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.576218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.587341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.588552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.589202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.590166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.590933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.591542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.806651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.806651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.815021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.821168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.824271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.826437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:51.830438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.832573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.833262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.897675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b36d75a7-5904-45f3-a54e-5ae09f613b77 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.327474 Oct 18 13:28:51.902865 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 710/1417] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:51.908706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.924895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.931078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.932005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.932828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.933848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.935081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.935731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.259880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.292241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.302762 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be7844fb-4bc0-4af6-aa1a-e0da457bc472 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.376658 Oct 18 13:28:52.303604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 711/1418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:52.318715 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-919241c1-74c8-4861-8623-98064214b698 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1269 microversion: 2.1 time: 0.503795 Oct 18 13:28:52.336041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 708/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1269 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:52.336285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.336285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.336285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.336285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.336618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.337703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.337703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.338607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.444692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.445782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.462265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.463808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.464662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.465843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.466553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.467336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.639075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.653114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d392f85-aea2-4b5f-a6b5-5982a9437170 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.330224 Oct 18 13:28:52.655744 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 712/1420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:52.676638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.682812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.685246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.686049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.686699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.687677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.688335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.688959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.915594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.928694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-daf50335-ab2a-4233-8eb3-fa3ba3bcc826 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1472 microversion: 2.1 time: 0.271628 Oct 18 13:28:52.929685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 713/1421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:52.966943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.982410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.004796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.007534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.011335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.015970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.017454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.018860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.212297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:53.254177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-967e57a3-b122-4ea4-a1d8-2e6ec937afa1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.291397 Oct 18 13:28:53.274195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 714/1422] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:53.329084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:53.329713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.351935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.352533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.353042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.354076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.354552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.354988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.619456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:53.629714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:53.641113 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e999e435-e97b-4743-b83a-6b024934d10c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.316961 Oct 18 13:28:53.662206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 715/1423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:53 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:53.662206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:53.662206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.662206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.662810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31c4c3e0-455e-4f8b-a59e-ce4f5e73854e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 1.216045 Oct 18 13:28:53.662926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.663070 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 709/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:53.663215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.663215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.663215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.663215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.682644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:53.683639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.693126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.693907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.695500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.697908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.698613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.699303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.053131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:54.066766 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cafeb3d9-933c-4215-ae52-c82635afc444 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1275 microversion: 2.1 time: 0.422023 Oct 18 13:28:54.067750 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 716/1425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:53 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:54.101193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:54.110402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:54.112280 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d32ab22-f146-41d2-b6f3-1f9756220fa2 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.433033 Oct 18 13:28:54.113693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:54.117749 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 710/1426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:53 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:54.135160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.138357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.139152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.140119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.141425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.143502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.199052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:54.292529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:54.293721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:54.305148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.305705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.310736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.311689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.312091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.312622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.312757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:54.322812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ce8bc4f5-bfba-4bcc-aee4-94b65c46a691 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1430 microversion: 2.1 time: 0.226005 Oct 18 13:28:54.339454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 717/1427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:54 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1430 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:54.395484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:54.451171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455d57a6-5233-4642-86ee-c29b389fb027", "name": "network-vif-deleted", "tag": "60d76e98-d8b4-4f1d-abd4-79511a55540e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:54.483829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.484306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.487023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.512348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] Creating event network-vif-deleted:60d76e98-d8b4-4f1d-abd4-79511a55540e for instance 455d57a6-5233-4642-86ee-c29b389fb027 on n-h1-858383-13 Oct 18 13:28:54.531138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0b1ececc-a3cf-44f8-bcbc-c971dc0d94db req-17a7ec6d-924d-4aa3-8093-36ffd8634dc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080518 Oct 18 13:28:54.532364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 718/1428] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:54.685815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:54.687481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:54.696612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.702930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.702930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.702930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.702930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.703400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.771840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:54.839646 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ceeb5d9-fcb1-4c8b-9e0e-13fbbf113e98 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.551124 Oct 18 13:28:54.841855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 711/1429] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:54 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:54.848832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:54.849455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:54.867878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.873105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.873915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.874707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.875177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.875940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.007936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.020420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2880971f-98d9-4894-a9ab-2413332e546e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.341849 Oct 18 13:28:55.022406 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 719/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:54 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.038426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e4e6a85-5a4d-4898-99e2-5b4cfc08dde9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '.version_select at 0x7fb330f50dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.504335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.513555 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a377b9e5-e431-4990-a1af-5ac1f3fac1ec tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.670559 Oct 18 13:28:55.526754 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 712/1431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:54 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.536379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.537249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:55.544652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.547639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.547639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.547639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.547639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.548029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.705638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.727306 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1290d702-3f7e-498e-9d5b-18dcd2816106 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1275 microversion: 2.1 time: 0.186630 Oct 18 13:28:55.728506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 713/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.740675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.743805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:55.751003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.751500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.752322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.753543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.754252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.754938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.856184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:56.290322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:56.300178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fc4b2d0-37c8-48af-a6d9-af88115bf00d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.570531 Oct 18 13:28:56.302210 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 714/1433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:56.315836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:56.319091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:56.328645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.328645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.329361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.330626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.331361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.332095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.433276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.436356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.438722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.439267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lazy-loading 'fault' on Instance uuid 455d57a6-5233-4642-86ee-c29b389fb027 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:56.629983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:56.641054 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a02c147-701c-495b-bd3e-b9740eca6025 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 200 len: 1307 microversion: 2.1 time: 0.338422 Oct 18 13:28:56.641674 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 715/1434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:56 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:56.652176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:56.652176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:56.665313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.666198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.667533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.683435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.685373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.686617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.765546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:56.837264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:56.883247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cba1298-2a5f-4250-9780-7b2cbcb02ccc tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.240420 Oct 18 13:28:56.884143 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 716/1435] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:56 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:56.898910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:56.899532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:56.910293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.910829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.911277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.911982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.915234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.924421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.493179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:57.691069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:57.706095 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e93f20cb-7cd5-460d-98a0-ff70456ff571 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.806139 Oct 18 13:28:57.706095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 717/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:56 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:57.715759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:57.716390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:57.731772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.732311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.732763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.733504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.733960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.737978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.085084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:58.091954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:58.097963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc37d5e3-d38f-49fe-b0f7-491fc44cb86d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.393115 Oct 18 13:28:58.128916 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 718/1437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:57 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:58.135010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.135931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.143907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.143907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.144456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.145418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.146105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.146884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.515708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:58.527116 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-994df634-9211-4a9f-bc28-3d1a9731369e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.395207 Oct 18 13:28:58.543010 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 719/1438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:58.550251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c068f993-944e-4d9a-b4fa-75509ddbfb4e", "tag": "aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:58.562886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.563515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.564081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.579155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] Creating event network-changed:aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b for instance c068f993-944e-4d9a-b4fa-75509ddbfb4e on n-h2-858383-13 Oct 18 13:28:58.585268 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2a6c0a34-ecff-4bff-bb10-36e43041dcda req-82dcfa19-4f71-4486-a29d-074c086c185e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040761 Oct 18 13:28:58.586366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 720/1439] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:58.593043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.593779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.600110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.600594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.601037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.601828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.602506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.603023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.943952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:58.955057 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c669b5e0-cc1c-4e09-a1cc-adf82d90cc95 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.367181 Oct 18 13:28:58.959366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 721/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:58.970452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.976014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: 455d57a6-5233-4642-86ee-c29b389fb027] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.999258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.004161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.004161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.004161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.004161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.004601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.039905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] HTTP exception thrown: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Request method failure captured: Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 HTTP/1.1 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTql2LcauPY8Y1mjgfzPnlahWOxuyNJCkOy2QVES3XUtwebe0WbLY8H9cuc27n4yjvEaFU_w3eO510AEVnTq5iPza5aJhPd2IgWio7JZ1BBm86tXXrmJbto9o0-sbmS7HdPlQVlLo3o3V4yBoh_wQ_Sj4wj9CrSduMjMmmNZIcTXUqcg Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5ede599ca0234feb928a00539d9aeb82 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:28:59.042387 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5ede599ca0234feb928a00539d9aeb82 Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListImageFiltersTestJSON-1521914809-project Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2dc31958aee54271985c85e5a569ceb0 Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListImageFiltersTestJSON-1521914809-project Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. Oct 18 13:28:59.045178 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '455d57a6-5233-4642-86ee-c29b389fb027'} Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:59.046942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. Oct 18 13:28:59.049036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:28:59.051717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Returning 404 to user: Instance 455d57a6-5233-4642-86ee-c29b389fb027 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:59.053084 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8917c384-32ca-497d-b6c4-88b03ecbf71b tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027" status: 404 len: 111 microversion: 2.1 time: 0.092419 Oct 18 13:28:59.054151 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 722/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/455d57a6-5233-4642-86ee-c29b389fb027 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:59.060173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:59.061503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:59.080617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.081277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.081831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.088104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.088779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.090199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.254188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:59.289946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fa36cab-70d8-4e4d-a345-6c3117e15d26 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.233801 Oct 18 13:28:59.291150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 723/1442] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:59 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:59.297157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:59.298174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:59.306313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.307193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.308296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.314395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.315431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.315906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.628995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:59.654403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e67ddb3b-ef33-46d5-ad59-05647f39d075 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.360788 Oct 18 13:28:59.655123 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 724/1443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:59 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:59.660010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:59.661670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:59.678496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.679248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.680345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.682685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.683269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.683837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.750243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:00.150344 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bf03eb85-6a32-4d25-ad2d-a70482ce0e3e tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 204 len: 0 microversion: 2.1 time: 0.493772 Oct 18 13:29:00.152179 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 725/1444] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:59 2022] DELETE /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:00.160376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.161564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.171609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.172414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.172856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.173844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.175183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.175977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.206771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:00.433715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:00.445139 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2eff98bb-61f7-486d-9775-f7a9c662fcd2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.290010 Oct 18 13:29:00.446495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 726/1445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:00.465611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fbacee-ee4f-438c-80f4-1877607c129c", "name": "network-vif-plugged", "status": "completed", "tag": "1fb8e507-e9c0-4985-87dd-2c732d7a53c0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:00.474187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.474847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.475454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.510629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] Creating event network-vif-plugged:1fb8e507-e9c0-4985-87dd-2c732d7a53c0 for instance 65fbacee-ee4f-438c-80f4-1877607c129c on n-h1-858383-13 Oct 18 13:29:00.517826 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-63f6a0e6-6384-4422-bb1e-99a8c60fb81f req-fe6727af-1e1d-4726-92bf-2b27d5b0f34c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067935 Oct 18 13:29:00.519306 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 727/1446] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:00.524470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.525185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.532180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.532720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.533171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.533885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.534660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.534877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.929302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:00.940703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bd92fa7-019a-4c20-9c2e-5eb4134c7981 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.420086 Oct 18 13:29:00.941315 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 728/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:00.948082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.948745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.956141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.956752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.957384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.958160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.958629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.959073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.130434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.138766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c1592d1-7797-4624-8ca2-93b2c0fde3c6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.196465 Oct 18 13:29:01.139328 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 729/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.146090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.146090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.154491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.155163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.155423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.156252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.156624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.157055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.320098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.328326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c895d4a6-c978-44d7-a404-186df1f49fac tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1472 microversion: 2.1 time: 0.187855 Oct 18 13:29:01.329068 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 730/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.334539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.335397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.347243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.347983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.348543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.353876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.354644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.355471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.449572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:01.474157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1fc60c2-a11c-43b3-8527-857a7f01ecd0 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.143504 Oct 18 13:29:01.475282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 731/1450] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:01.480314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1d9b06-24ab-4eb4-832d-da030463d272", "tag": "aa14dc41-f9ea-4287-9b89-c61cc9b8109c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:01.494758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.495341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.495934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.517012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] Creating event network-changed:aa14dc41-f9ea-4287-9b89-c61cc9b8109c for instance ad1d9b06-24ab-4eb4-832d-da030463d272 on n-h1-858383-13 Oct 18 13:29:01.522417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-66cafb54-b418-4a6c-84cb-ba9c82e49072 req-7d9d1dd9-b1aa-40eb-9f28-a99a37523965 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045521 Oct 18 13:29:01.523838 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 732/1451] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:01.530030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.530776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.539248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.540183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.540643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.541640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.542143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.542618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.717624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.728063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40a21199-3ed2-488f-b64d-41b2e365b8ab tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.202656 Oct 18 13:29:01.728659 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 733/1452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.734379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.735007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.741496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.742088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.742534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.743237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.743703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.744142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.089657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:02.098728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a75f4243-cc12-4299-ba6b-80fec12b1598 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.369007 Oct 18 13:29:02.099388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 734/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:02.105662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.106414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.113169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.113965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.114719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.115714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.116204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.116650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.261895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:02.271404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63406b04-c435-4c86-a001-473911064387 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.170962 Oct 18 13:29:02.271979 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 735/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:02.279027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.279973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.287053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.287554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.289021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.289744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.290895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.291363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.295412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5e4e6a85-5a4d-4898-99e2-5b4cfc08dde9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Image not found. Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e4e6a85-5a4d-4898-99e2-5b4cfc08dde9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/ed8e93e2-3605-4715-bf37-50c71e61f294 HTTP/1.1 Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:02.299099 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ed8e93e2-3605-4715-bf37-50c71e61f294'} Oct 18 13:29:02.300759 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ed8e93e2-3605-4715-bf37-50c71e61f294 to delete Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.301897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed8e93e2-3605-4715-bf37-50c71e61f294 could not be found. Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:02.303455 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e4e6a85-5a4d-4898-99e2-5b4cfc08dde9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:02.304859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e4e6a85-5a4d-4898-99e2-5b4cfc08dde9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/images/ed8e93e2-3605-4715-bf37-50c71e61f294" status: 404 len: 62 microversion: 2.1 time: 7.278403 Oct 18 13:29:02.305816 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 720/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] DELETE /compute/v2.1/images/ed8e93e2-3605-4715-bf37-50c71e61f294 => generated 62 bytes in 7282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:29:02.309329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.309833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.315911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.316408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.316852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.317726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.318693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.318693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.332946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 HTTP/1.1 Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:02.334561 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.336169 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243'} Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:02.337157 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.338997 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.341320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:02.341320 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a99c8555-4be5-46d6-b75e-d2990d98cdf9 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 404 len: 111 microversion: 2.1 time: 0.030597 Oct 18 13:29:02.341320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 721/1456] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:02 2022] DELETE /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:02.344591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.347310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] [instance: e653014b-28e0-4001-a2f6-bbef221b2243] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.351881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.352379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.352826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.353768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.354315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.354695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.372273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] HTTP exception thrown: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Request method failure captured: Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 HTTP/1.1 Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqmU1YfEzcZQoGR3F8INLdDDBMaVUXCs_1JLCQm2L18x_nADBg2gPjJc-0ycdfT60Yl-RPXH_jmFJq8-5MLMKU2s2st6s_9DX-to52VkKzHDqdy3MzVoft3i45o2X5ZEdzKtpjW2gT0qTzXGWj69Z74hhOEKVeHfAIw3fEW-bneLPeI Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:02.373849 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3669621720549bba2466676e40d638a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3669621720549bba2466676e40d638a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3669621720549bba2466676e40d638a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e3669621720549bba2466676e40d638a Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-260612668 Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3424ff1ac4404c4cb1b47907bf255b4b Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-260612668-project Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.375532 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e653014b-28e0-4001-a2f6-bbef221b2243'} Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:02.376468 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. Oct 18 13:29:02.377843 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:02.379285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] Returning 404 to user: Instance e653014b-28e0-4001-a2f6-bbef221b2243 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:02.379285 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c88459c-2416-485d-a045-82c1033c7ee8 tempest-ImagesOneServerNegativeTestJSON-260612668 tempest-ImagesOneServerNegativeTestJSON-260612668-project] 10.222.0.27 "GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243" status: 404 len: 111 microversion: 2.1 time: 0.035946 Oct 18 13:29:02.379285 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 722/1457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/e653014b-28e0-4001-a2f6-bbef221b2243 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:29:02.384809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.386834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.397994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.399063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.399805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.401509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.402597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.403626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.483865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:02.492658 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-099b20f3-5f1b-4d5a-b9af-8f66c1ac4d90 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.219576 Oct 18 13:29:02.498110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 736/1458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:02.508109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.508769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.517530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.518628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.518932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.519659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.520531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.520531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.606422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:02.628065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f60ee79-c6d0-4977-81a1-c6ff11790b16 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.124177 Oct 18 13:29:02.642378 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 737/1459] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:02.727149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:02.735070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44d3a9c5-8093-4ad3-8763-4395492ee2f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1472 microversion: 2.1 time: 0.356895 Oct 18 13:29:02.735873 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 723/1460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:02.760476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.761435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.768749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.769667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.770183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.770882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.772055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.772818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.975827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:02.989008 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-720352ac-3f14-4f82-9500-236f1bdd5f33 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.236299 Oct 18 13:29:03.003171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 738/1461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:03.123244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.123915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.130275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.130779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.131231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.131948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.133999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.133999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.294722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.295937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.302284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.303002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.303457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.304304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.304933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.305529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.396934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:03.405126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2448b1c2-bcaf-4b06-af65-7074da759e74 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1311 microversion: 2.1 time: 0.286391 Oct 18 13:29:03.405940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 724/1462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:03.517197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.517880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.524387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.524874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.525316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.526010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.526519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.526950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.554793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:03.560539 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c4dbc7b-7959-436a-ab13-00a9efa89c6e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.269784 Oct 18 13:29:03.561119 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 739/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:03.658627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.659248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.665096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.665583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.666031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.680529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.680529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.680529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.701128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:03.710680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90303fcf-4dd7-4f97-a35a-0ff6338920e4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.198027 Oct 18 13:29:03.711251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 725/1464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:03.760733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.761959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.762134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:03.769425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.770380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.771041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.771965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.772623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.773262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.779877 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c28f5df-def3-42a9-9348-5f69ffe11be5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.124879 Oct 18 13:29:03.781112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 740/1465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:29:03.927158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:03.939660 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b22dd84-622e-4b02-8891-bde22b97feb4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1472 microversion: 2.1 time: 0.183656 Oct 18 13:29:03.945206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 726/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:04.058386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.058386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.058386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.058386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.058909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.058909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.058909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.058909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.244571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:04.254566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-abb6f995-aa21-429c-ae94-9beed44c9340 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.240486 Oct 18 13:29:04.255150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 741/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:04.432358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.433641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.440866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.444111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.444577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.445310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.446041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.446250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.587669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.588285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.601792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.602420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.602930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.606668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.607177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.619490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.726653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:04.738692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-682d69a4-67cf-4c32-9e61-4f24cd13b408 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1494 microversion: 2.1 time: 0.310109 Oct 18 13:29:04.739534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 727/1468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1494 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:04.747439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.748319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.756118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.756856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.758643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.759540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.760166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.760751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.868844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:04.883520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1327f71-243d-4f7e-943b-cb2b48823d0c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.299537 Oct 18 13:29:04.891403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 742/1469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:04.976540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.977259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.983779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:04.999796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.999796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.999796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.999796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.000187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.000187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.032842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:05.123264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:05.136604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-832863df-99d1-446d-80e9-9fcf5cd9a905 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.395554 Oct 18 13:29:05.138350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 728/1470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.144616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.155820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.165911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.166563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.167706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.169596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.172766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.176975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.254247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-666c64a8-3d80-4287-a284-9271c7f1eaf7 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1647 microversion: 2.1 time: 0.359876 Oct 18 13:29:05.255507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 743/1471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1647 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.261798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.264187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.278440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.279227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.279852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.281023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.282351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.284282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.349923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:05.394184 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2426093e-1718-448c-9909-a2af3bf357d7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.252802 Oct 18 13:29:05.403597 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 729/1472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:05.430979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.431949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.442315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.443779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.444470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.445366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.446000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.446850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.569377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:05.578397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70701a68-949b-47f4-b263-cc7538942a8a tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1472 microversion: 2.1 time: 0.320925 Oct 18 13:29:05.590176 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 744/1473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.591413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.591977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.600114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.600620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.601581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.607703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.607703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.607703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.807858 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d86d7a0-7f14-49c6-9b42-8244655864a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1647 microversion: 2.1 time: 0.395449 Oct 18 13:29:05.822145 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 730/1474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1647 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.838866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.843886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.844795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.845422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.846493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.849566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.849566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.884337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e847388-7f62-4be9-a70f-450f41c327eb tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045765 Oct 18 13:29:05.884337 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 731/1475] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:05.885890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:05.890661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-13", "block_migration": true, "disk_over_commit": false}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:05.893088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.899373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.899869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.900590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.901803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.902342 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1cf2e04e-f07a-4527-8720-09e9ae96821c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.315068 Oct 18 13:29:05.907007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.907007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.907331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 745/1476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.920901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.921807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.934353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lazy-loading 'flavor' on Instance uuid 65fbacee-ee4f-438c-80f4-1877607c129c {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:05.941910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.947932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.948414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.949176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.949647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.950656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.960385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Going to try to live migrate instance to n-h2-858383-13 {{(pid=121010) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:29:06.204687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.215914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a002199c-8374-4c1e-a9b1-744cab674499 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.310401 Oct 18 13:29:06.219739 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 746/1477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.225621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.233240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.245196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.245765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.247325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.249923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.250760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.251436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.480737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.494486 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f848f236-243b-44a7-ad95-f69a94de5b4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.272799 Oct 18 13:29:06.496191 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 747/1478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.503487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.504459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.511529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.513148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.513656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.514365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.514902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.515435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.607167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:06.628474 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11ebc009-3dfc-4907-ab89-6329f03bb3e7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.130220 Oct 18 13:29:06.630180 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 748/1479] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:06.634375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.639185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.641487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.642011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.642490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.643363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.643832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.644385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.850327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.860924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef7cedb2-ea41-4692-ab32-02339967ccf4 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1472 microversion: 2.1 time: 0.230198 Oct 18 13:29:06.874150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 749/1480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.928915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.929756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.940103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.940721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.941304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.943160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.943746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.944356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.130938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:07.144017 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f00691b8-ec6f-4757-ad3a-db491cd37971 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1540 microversion: 2.1 time: 0.219662 Oct 18 13:29:07.144597 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 750/1481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1540 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:07.244638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:07.245542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:07.252540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.262128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.263075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.263834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.264307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.264746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.489519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:07.492892 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-92202e4b-ce70-45cb-a938-71c7a5767791 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.251816 Oct 18 13:29:07.493850 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 751/1482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:07 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:07.526177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:07.527455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:07.534653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.535149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.535654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.536607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.536779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.537213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.736750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:07.746464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ae260a2-0d06-4f32-b401-65978b9c431f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.224505 Oct 18 13:29:07.748654 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 752/1483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:07 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:07.765132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:07.765803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:07.778272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.778272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.778725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.779459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.780123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.780593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.886103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:07.933348 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71edb27d-1304-4e8c-a2ef-1365a784bd3d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.172809 Oct 18 13:29:07.940335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 753/1484] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:07 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:07.945676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a91042-a5a1-4545-a4d1-200ee8d1c2b2", "name": "network-vif-deleted", "tag": "8da0c55a-afc4-4af9-8520-a52c96944a16"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:07.963521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:07.963521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:07.963521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.022286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] Creating event network-vif-deleted:8da0c55a-afc4-4af9-8520-a52c96944a16 for instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 on n-h2-858383-13 Oct 18 13:29:08.042792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e6d1e649-ec97-4a16-bcab-0a20308d716b req-8f6d2470-1469-4216-bab4-33b8fb2ee819 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105192 Oct 18 13:29:08.044251 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 754/1485] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:08.063219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1d9b06-24ab-4eb4-832d-da030463d272", "name": "network-vif-plugged", "status": "completed", "tag": "aa14dc41-f9ea-4287-9b89-c61cc9b8109c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:08.091819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.092592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.093210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.108376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] Creating event network-vif-plugged:aa14dc41-f9ea-4287-9b89-c61cc9b8109c for instance ad1d9b06-24ab-4eb4-832d-da030463d272 on n-h1-858383-13 Oct 18 13:29:08.114746 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d6da440d-f7b9-4501-83ae-a4b3c05e8d85 req-d41628ee-955e-424f-8206-165e627a3359 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064272 Oct 18 13:29:08.116193 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 755/1486] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:08.132252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.134489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.140555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.142351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.142854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.143599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.144073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.144511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.281284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:08.297709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0de508c-3252-43ca-92ed-9f8185d68be5 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1302 microversion: 2.1 time: 0.171331 Oct 18 13:29:08.299148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 756/1487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1302 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:08.308240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.311165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.319330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.319330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.319330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.319645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.320190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.320714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.610458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:08.622774 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-deedb34a-5f34-4572-81ac-cb38c36d53b7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1539 microversion: 2.1 time: 0.320867 Oct 18 13:29:08.623585 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 757/1488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1539 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:08.631449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.633434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.643711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.644220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.644804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.647385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.648274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.649066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.824669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:08.834428 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8d95f40-7ecd-4e05-92e7-1829958a89d1 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.209666 Oct 18 13:29:08.835215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 758/1489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:08.841590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.842254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.848839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.850043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.850043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.850514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.850980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.851418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.029809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.041060 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f1d5c78-56b8-4433-b97e-2b6550072bbe tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.201890 Oct 18 13:29:09.054103 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 759/1490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.054103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.054103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.054103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.054582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.054582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.055095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.055500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.055943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.143581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:09.148519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:09.167762 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21937e51-0e44-4ebe-bf25-8339a260bae7 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.124855 Oct 18 13:29:09.171624 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 760/1491] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:09.325404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.333541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.345187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.346756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.347206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.347912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.348374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.348804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.382418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.382914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.383485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.383945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lazy-loading 'fault' on Instance uuid a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:09.425960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc31958aee54271985c85e5a569ceb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede599ca0234feb928a00539d9aeb82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.435487 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db5f63a0-880d-4972-b1cd-b8af575503f0 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 200 len: 1307 microversion: 2.1 time: 0.114459 Oct 18 13:29:09.436475 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 761/1492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:09.648993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.649623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.656693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.657196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.657702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.658478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.658946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.659379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.806014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.814439 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad86e9df-4f85-48c7-9165-41b6f21fdd58 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1539 microversion: 2.1 time: 0.169467 Oct 18 13:29:09.814994 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 762/1493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.858155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.859101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.866365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.867926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.868464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.869288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.869839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.870407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.064169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:10.074468 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f0f3e1d-9d25-4a53-b7f0-bb3d3bd72525 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1317 microversion: 2.1 time: 0.221243 Oct 18 13:29:10.092249 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 763/1494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:10.103598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.104245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.121973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.122500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.124163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.125423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.126459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.138428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.180899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8a89c09-dd85-4e37-8e90-e1e4ec890e79 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c/action" status: 202 len: 0 microversion: 2.1 time: 4.294706 Oct 18 13:29:10.182072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 732/1495] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:05 2022] POST /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c/action => generated 0 bytes in 4297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:29:10.196109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-unplugged", "status": "completed", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:10.210555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.213744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.213744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.225825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Creating event network-vif-unplugged:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:29:10.235166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:29:10.245868 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f2f736df-e79a-4945-941c-36e2f2e8b127 req-149b4f8f-c0ba-4899-b5e1-acecf24227df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062230 Oct 18 13:29:10.247237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 733/1496] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:10.252669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.253569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.263244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.264175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.264728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.265671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.266308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.266814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.445245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:10.473869 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3088a424-7e01-47dc-bd10-ea77c7ec8896 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.380009 Oct 18 13:29:10.479502 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 764/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:10.480419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.481747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.488742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.489633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.490512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.491240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.491709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.492149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.492269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:10.503585 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7d2b202-624b-4d8f-848f-8b2aa639110d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.254777 Oct 18 13:29:10.519397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 734/1498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:10.529437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.530421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] [instance: a3a91042-a5a1-4545-a4d1-200ee8d1c2b2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.539156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.539982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.541172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.542820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.543564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.544325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.560451 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] HTTP exception thrown: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Request method failure captured: Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 HTTP/1.1 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTql2LcauPY8Y1mjgfzPnlahWOxuyNJCkOy2QVES3XUtwebe0WbLY8H9cuc27n4yjvEaFU_w3eO510AEVnTq5iPza5aJhPd2IgWio7JZ1BBm86tXXrmJbto9o0-sbmS7HdPlQVlLo3o3V4yBoh_wQ_Sj4wj9CrSduMjMmmNZIcTXUqcg Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 5ede599ca0234feb928a00539d9aeb82 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:10.561456 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5ede599ca0234feb928a00539d9aeb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 5ede599ca0234feb928a00539d9aeb82 Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1521914809 Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListImageFiltersTestJSON-1521914809-project Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2dc31958aee54271985c85e5a569ceb0 Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListImageFiltersTestJSON-1521914809-project Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. Oct 18 13:29:10.563460 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a3a91042-a5a1-4545-a4d1-200ee8d1c2b2'} Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:10.564760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. Oct 18 13:29:10.566883 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:10.568554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Returning 404 to user: Instance a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:10.568554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd0fbf44-77c6-4b8d-89be-acdccf939905 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2" status: 404 len: 111 microversion: 2.1 time: 0.043544 Oct 18 13:29:10.568554 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 735/1499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/a3a91042-a5a1-4545-a4d1-200ee8d1c2b2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:10.575650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da270e15-889b-4101-8da5-a14414f8702d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb331107f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.626102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:10.667709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a37c265-7ce5-46fa-805d-e5e27ab103e8 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.191467 Oct 18 13:29:10.668254 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 765/1500] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:10.836730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.837359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.844322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.848634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.848634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.848634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.848634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.849185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.016630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:11.025992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a618534-871d-4181-8d4e-7fdfbb3daaf1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1471 microversion: 2.1 time: 0.193008 Oct 18 13:29:11.026617 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 766/1501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:11.098794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.099669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.105816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.106929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.107370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.108071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.108528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.108958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.259655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:11.268397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e2ea8fd-64d1-4c69-bc54-ba8021227f71 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1466 microversion: 2.1 time: 0.174783 Oct 18 13:29:11.268979 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 767/1502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:11.291875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.292695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.299553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.300055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.300486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.301552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.302138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.302582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.409608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da270e15-889b-4101-8da5-a14414f8702d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365" status: 204 len: 0 microversion: 2.1 time: 0.838692 Oct 18 13:29:11.410769 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 736/1503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] DELETE /compute/v2.1/images/e6319e9c-b03e-427c-968e-2619e6642365 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:11.419536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a180f5e-bf57-4217-932d-72a93e3602f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb33103eaf0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.449057 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f709e754-465a-48f6-830e-53f88a19db29 tempest-ServersOnMultiNodesTest-730662734 tempest-ServersOnMultiNodesTest-730662734-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1619 microversion: 2.1 time: 0.160419 Oct 18 13:29:11.471094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 768/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1619 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:11.478480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.479249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.488325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.489181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.491580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.498719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.498719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.498719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.529041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:11.898604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7aad0759-9aa9-47c2-b35e-c9c2e0016c0e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 204 len: 0 microversion: 2.1 time: 0.424242 Oct 18 13:29:11.899352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 769/1505] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:11 2022] DELETE /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:11.905695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.906460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.913367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.913853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.914335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.915030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.915486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.915915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.161135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:12.170953 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c3fb4411-5476-4048-a3d6-8262cbc4cbd9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.270185 Oct 18 13:29:12.172236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 770/1506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:12.177300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.178208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:12.195701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a180f5e-bf57-4217-932d-72a93e3602f1 tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8" status: 204 len: 0 microversion: 2.1 time: 0.780105 Oct 18 13:29:12.198386 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 737/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] DELETE /compute/v2.1/images/f4c6525a-66c5-4229-8004-fd2aa0aff2e8 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:29:12.199251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.200642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.201265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.202285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.202754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.203202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.205842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.206603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:12.213743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:12.215921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.216617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.217233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.218128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.218814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.224448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.249047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:12.368491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:12.389992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11d95b53-cb8a-4536-a4f8-ceccc520556b tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.188745 Oct 18 13:29:12.393181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:12.403571 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dae9ffa9-eb2e-4b0d-b930-4f0a598eeb07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.229139 Oct 18 13:29:12.407172 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 738/1508] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:12 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:12.421316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 771/1509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:12 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:12.428856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.429908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:12.431164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.431927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:12.441489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.443827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.444426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.444975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.445801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.446506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.447580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.449009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.449331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.449986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.454626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.455287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.639302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:12.647471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4da1a38-0669-41dd-b5b7-ad6ed1264bd0 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1471 microversion: 2.1 time: 0.224836 Oct 18 13:29:12.648237 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 772/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:12 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:12.656291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d7e7357-a3d9-4279-b4b2-5799ecb36d1d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] Calling method '.version_select at 0x7fb330c8fca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.787032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:12.800983 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-705b0764-a738-4752-af4f-8635bf467e0f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1472 microversion: 2.1 time: 0.391725 Oct 18 13:29:12.801572 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 739/1511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:12 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:12.815995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c068f993-944e-4d9a-b4fa-75509ddbfb4e", "name": "network-vif-plugged", "status": "completed", "tag": "aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:12.826418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.827252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.827853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.854588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] Creating event network-vif-plugged:aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b for instance c068f993-944e-4d9a-b4fa-75509ddbfb4e on n-h2-858383-13 Oct 18 13:29:12.866641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9bcd0a18-7fea-4186-b8ef-db2a10b471d4 req-00d45467-032d-49bb-b487-7ef4e39accf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063703 Oct 18 13:29:12.889345 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 740/1512] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:13.194537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.195276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.203120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.203618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.204063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.208370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.208370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.208370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.379659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.389846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf20124a-35ef-47b7-a224-8249d5837204 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1307 microversion: 2.1 time: 0.199537 Oct 18 13:29:13.402077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 741/1513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:13.423278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.424045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.434132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.434770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.435075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.436085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.436775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.437427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.558619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:13.583735 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d7e7357-a3d9-4279-b4b2-5799ecb36d1d tempest-ListImageFiltersTestJSON-1521914809 tempest-ListImageFiltersTestJSON-1521914809-project] 10.222.0.27 "DELETE /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63" status: 204 len: 0 microversion: 2.1 time: 0.934310 Oct 18 13:29:13.590933 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 773/1514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:12 2022] DELETE /compute/v2.1/images/3b78963e-0aa3-4e61-91ae-e5ef295d9b63 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:13.592631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.593633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.598941 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7798ecb4-6752-4ca2-8cfb-577e496de338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.179654 Oct 18 13:29:13.601584 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 742/1515] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:29:13.605591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.606516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.607135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.608080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.608860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.609898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.677582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.678271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.687197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.687648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.688094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.688805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.689271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.689720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.959970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.970913 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7094bd04-a1b3-4fff-903d-6079d1bfa738 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1468 microversion: 2.1 time: 0.297505 Oct 18 13:29:13.972787 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 743/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:13.983543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.984412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.990450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.999772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.001534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.002208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.003902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e07a3e95-8758-428d-ba16-852e957f0eb8 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.416111 Oct 18 13:29:14.005543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.006035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.010443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.010702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 774/1517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:14.019688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:14.021991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.041045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.041664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.042347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.043282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.044386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.045083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.165018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:14.176516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.177419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.178131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.179619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.180345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.181027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.215323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:14.244588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:14.732387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:14.747516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-011205a2-0bd0-48fb-875a-c7c0de399603 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1472 microversion: 2.1 time: 0.772707 Oct 18 13:29:14.750135 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 744/1518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1472 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:14.794449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ebe6c9d2-bb06-4abf-b221-333b4552f45a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c/action" status: 202 len: 0 microversion: 2.1 time: 0.785688 Oct 18 13:29:14.799485 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 775/1519] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:14 2022] POST /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:14.821056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:14.821433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.848089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.848611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.849071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.862098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.863615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.864095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.048268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fbacee-ee4f-438c-80f4-1877607c129c", "name": "network-vif-unplugged", "status": "completed", "tag": "1fb8e507-e9c0-4985-87dd-2c732d7a53c0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:15.064093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.064093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.064093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.076094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] Creating event network-vif-unplugged:1fb8e507-e9c0-4985-87dd-2c732d7a53c0 for instance 65fbacee-ee4f-438c-80f4-1877607c129c on n-h1-858383-13 Oct 18 13:29:15.081787 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-29054f84-0ba3-4c51-9679-a07716404711 req-5f660d6e-77e4-4e89-8375-0fcc3233712b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.328519 Oct 18 13:29:15.083392 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 745/1520] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:15.091811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.093011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:15.101609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.102454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.103190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.104206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.104914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.105584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.388169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:15.453333 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef4db073-2893-4509-a406-2562aba34cb5 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.367648 Oct 18 13:29:15.459856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 746/1521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:15.465131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.481544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:15.516914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.520542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.521214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.522395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.524799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.525505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.816254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:15.828282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15383121-6b26-4743-823d-1f9ed16f9e71 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1488 microversion: 2.1 time: 1.013689 Oct 18 13:29:15.835552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 776/1522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:14 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1488 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:15.860894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1d9b06-24ab-4eb4-832d-da030463d272", "name": "network-vif-deleted", "tag": "aa14dc41-f9ea-4287-9b89-c61cc9b8109c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:15.861073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:15.875753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.878744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.879507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.898115 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] Creating event network-vif-deleted:aa14dc41-f9ea-4287-9b89-c61cc9b8109c for instance ad1d9b06-24ab-4eb4-832d-da030463d272 on n-h1-858383-13 Oct 18 13:29:15.906881 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3678b6d8-186c-42d2-8950-a9e8e7d7866b req-90f90794-d725-414c-98b8-ff63d19089c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054629 Oct 18 13:29:15.907512 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 777/1523] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:15.924299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.925017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:15.947651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.948140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:15.948296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.948605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.949329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.949835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.950304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.968269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c9bf4d6-3e7f-4694-b4ce-3e4b34271c75 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1467 microversion: 2.1 time: 0.506121 Oct 18 13:29:15.970402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 747/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1467 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:15.986669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.988833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.009420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.010499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.011191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.015853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.020654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.020654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.117620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.118140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.124413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.125085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid ad1d9b06-24ab-4eb4-832d-da030463d272 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:16.238222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:16.248974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5dd08b9a-3545-4b8b-8047-656d28072e37 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 200 len: 1307 microversion: 2.1 time: 0.276615 Oct 18 13:29:16.251794 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 748/1525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:16.264710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.265229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.280770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.281533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.282338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.285105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.285813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.286455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.367881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:16.477746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:16.488455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eaf865fa-0bf3-43a4-9543-164d4d59200f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.567292 Oct 18 13:29:16.489592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 778/1526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:16.507855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.510599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.514622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:16.523791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.524313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.526209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.527222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.529161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.531275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.722248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:16.761828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6671aa1-8162-4abe-92d1-1734a23fbd6d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.270262 Oct 18 13:29:16.763089 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 779/1527] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:16 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:16.979936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14ffc779-5062-4b17-b6eb-2337dea4fa45 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 204 len: 0 microversion: 2.1 time: 0.724349 Oct 18 13:29:16.983669 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 749/1528] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:16 2022] DELETE /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:16.989158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.990378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.994024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.995170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.002320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.002533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.002856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.003050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.003337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.004078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.004205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.004655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.005106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.005534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.006104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.006706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.227215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.235698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6886095d-311e-43d5-b5e3-2c1944033b5a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1467 microversion: 2.1 time: 0.247498 Oct 18 13:29:17.275123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 750/1529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:16 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:17.287314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fbacee-ee4f-438c-80f4-1877607c129c", "tag": "1fb8e507-e9c0-4985-87dd-2c732d7a53c0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:17.298424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.299069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.299919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.330185 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] Creating event network-changed:1fb8e507-e9c0-4985-87dd-2c732d7a53c0 for instance 65fbacee-ee4f-438c-80f4-1877607c129c on n-h1-858383-13 Oct 18 13:29:17.335555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-39c4dde2-cb06-4f55-9edc-58400cc4457d req-47353b55-9c34-4238-8d7f-1e1860421dfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057370 Oct 18 13:29:17.336598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 751/1530] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:17.342682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.343632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: ad1d9b06-24ab-4eb4-832d-da030463d272] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.364317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.365737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.366304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.367132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.367674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.368178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.394671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. Oct 18 13:29:17.396385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 HTTP/1.1 Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:17.396553 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. Oct 18 13:29:17.398022 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ad1d9b06-24ab-4eb4-832d-da030463d272'} Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:17.398984 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. Oct 18 13:29:17.400588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:17.401936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance ad1d9b06-24ab-4eb4-832d-da030463d272 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:17.401936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aaf5fc5d-12cb-43f1-8c4d-62afbea510e7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272" status: 404 len: 111 microversion: 2.1 time: 0.060134 Oct 18 13:29:17.401936 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 752/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/servers/ad1d9b06-24ab-4eb4-832d-da030463d272 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:17.404954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb2bfc60-0fa1-4a58-b9f4-554b94bd1c07 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1494 microversion: 2.1 time: 0.420139 Oct 18 13:29:17.406694 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 780/1532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:16 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:17.408071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.408685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.415185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.415828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.416384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.417216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.417935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.419066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.458763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:17.498953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:17.513620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.516674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.521779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.522396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.523149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.523914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.524487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.524997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.925456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.934135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8883d90a-bd0d-40da-951e-76a4c24d220f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.425441 Oct 18 13:29:17.934807 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 781/1533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:17.952630 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad330113-c5c1-4fb6-be1a-31965a287752 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 204 len: 0 microversion: 2.1 time: 0.545295 Oct 18 13:29:17.954201 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 753/1534] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:17 2022] DELETE /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:17.961954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-plugged", "status": "completed", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:17.973799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.974096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.974389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.988405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Creating event network-vif-plugged:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:29:17.995259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:29:18.002352 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-df4f5033-8414-4aa5-aff2-41cdb747a13b req-783aeb89-fb54-41a1-8ea0-e3ba43b339bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046620 Oct 18 13:29:18.007708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 754/1535] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:18.009214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.009985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.022808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.024630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.025314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.026284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.027138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.028464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.130839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3594f4fd-7f08-46fb-9802-58522b469e20 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] Calling method '.version_select at 0x7fb33523c8b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.133157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:18.154221 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ae53e94-94ed-46bf-b902-f7efcdb44df1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.149435 Oct 18 13:29:18.158939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 755/1536] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:18.163556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.164199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.170965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.171683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.172323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.173215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.173855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.174325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.205869 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3594f4fd-7f08-46fb-9802-58522b469e20 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] 10.222.0.27 "GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6" status: 200 len: 784 microversion: 2.1 time: 0.257876 Oct 18 13:29:18.207359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 782/1537] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6 => generated 784 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:18.221945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db0f0334-fedc-4a6e-8f83-9188aeb31855 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] Calling method '.version_select at 0x7fb335233f70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.282947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db0f0334-fedc-4a6e-8f83-9188aeb31855 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.064743 Oct 18 13:29:18.286961 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 783/1538] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/images => generated 445 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:18.303751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.304399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.318232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.318738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.319191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.319912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.320374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.320824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.383872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.395636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6fcbc9b-6346-47f1-9f0f-ece0a9a8a38a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1473 microversion: 2.1 time: 0.239816 Oct 18 13:29:18.401062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 756/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.409118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fea976c-5666-47b9-afd4-68f273658122 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] Calling method '.version_select at 0x7fb3310d4700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.496878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fea976c-5666-47b9-afd4-68f273658122 tempest-ListImagesTestJSON-277994572 tempest-ListImagesTestJSON-277994572-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.094106 Oct 18 13:29:18.498121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 757/1540] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:18.504101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.505260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.535400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.536534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.538256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.543812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.543812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.543812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.776841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.786207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c50996b-50f7-4e46-98bf-a5a10918f978 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1494 microversion: 2.1 time: 0.286604 Oct 18 13:29:18.787001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 758/1541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1494 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.838377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.843025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-029d8fe5-c34b-4476-840b-7a10c4bf886c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1467 microversion: 2.1 time: 0.551471 Oct 18 13:29:18.859057 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 784/1542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1467 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.960130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.960742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.968183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.968676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.970588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.970588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.970588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.971288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.112504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.121521 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef97fe1c-04bb-41df-8973-dae914999e82 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.164950 Oct 18 13:29:19.122126 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 759/1543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.182806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.186288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.190655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.191171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.191622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.192374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.192892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.193383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.277308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:19.308667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f47a83f3-6e83-4745-acff-3102b48df049 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.129540 Oct 18 13:29:19.309859 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 785/1544] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:19.419183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.420057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.428380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.429160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.430139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.431357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.432039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.433183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.659612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.668532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-874a3d0d-9999-4b1c-b588-c8fee83fcff8 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1473 microversion: 2.1 time: 0.253505 Oct 18 13:29:19.669452 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 760/1545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.811547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.812695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.821210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.821717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.822381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.823104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.823737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.824382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.872692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.873690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.884378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.885041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.885496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.886259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.886722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.887237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.080179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:20.089601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a502d3b4-fdd0-4565-b967-dfc9fe712ae3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1467 microversion: 2.1 time: 0.225469 Oct 18 13:29:20.090764 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 761/1546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1467 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:20.111705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:20.143292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d735fde-9a74-468d-9c5b-93d96269b61d tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1494 microversion: 2.1 time: 0.335826 Oct 18 13:29:20.143796 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 786/1547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1494 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:20.149049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:20.149675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:20.161572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.162110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.174734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.175598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.176004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.178456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.337283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:20.342739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:20.348391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.350555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.351182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.352395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.353174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.353827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.365643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:20.374047 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0dd3e219-de17-461f-86d3-5d2aaca1e2ac tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.228828 Oct 18 13:29:20.375192 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 762/1548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:20 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:20.429264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:20.447821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9723a22-a954-4179-a3f0-5c906498237d tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.114825 Oct 18 13:29:20.458039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 787/1549] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:20 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:29:20.692941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:20.694024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:20.708463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.709774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.711174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.713399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.716219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.716840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.968178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:20.979992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a7110b9-ef64-4fda-8676-78fa99515b1c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1473 microversion: 2.1 time: 0.291546 Oct 18 13:29:20.986166 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 763/1550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:20 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1473 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:21.120814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.123232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.134381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.144853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.144853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.144853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.144853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.145662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.172409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.178357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.216816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.219965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.219965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.219965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.219965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.220982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.692887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:21.708186 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26eaeb29-cc81-4c42-99f2-99c5b54b22c5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1494 microversion: 2.1 time: 0.542284 Oct 18 13:29:21.709073 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 764/1551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1494 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:21.722906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.723535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.733796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.734231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.734865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.735763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.736391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.736983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.948356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:21.957132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-521fdccd-a6ce-4014-8ddd-7b8ddd5f8cde tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1467 microversion: 2.1 time: 0.842618 Oct 18 13:29:21.958534 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 788/1552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1467 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:21.969296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.969924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.995182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.995182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.995182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.995182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.995527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.995527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.144535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:22.144777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.154531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b525a532-874a-4776-9afc-443954ace454 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.444325 Oct 18 13:29:22.171404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 765/1553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.180911 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70d4c40a-39d2-4390-8368-922f82d43651 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.218719 Oct 18 13:29:22.190355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 789/1554] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:22.190513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.190513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.195250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.196135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.196744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.197618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.198269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.198862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.359451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70e756fa-1a13-4c29-b683-973dd3d1e870 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb330c9b9d0>, body: {"keypair": {"name": "tempest-keypair-255943427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM55IcZ/PH29VaUK4jS8cOqxovG14pD5T5KIhGbLgmXn7Ubd5LJcwmrulg5PeTsIktOJPcpDqpZ8saP93+DeqCtbooaCfugEvsLHXXQ5vkMFFE+YNIVUFiI5cFmnnynwEw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:22.423305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-70e756fa-1a13-4c29-b683-973dd3d1e870 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:22.439824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-70e756fa-1a13-4c29-b683-973dd3d1e870 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:22.565242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.573337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81cee8cd-5586-40af-977b-4225030bafd0 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1473 microversion: 2.1 time: 0.392783 Oct 18 13:29:22.573917 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 766/1555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.584379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c068f993-944e-4d9a-b4fa-75509ddbfb4e", "name": "network-vif-deleted", "tag": "aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:22.595612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.599282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.599282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.608650 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] Creating event network-vif-deleted:aa45fc7f-ea76-49e3-8ef7-0a3cd6be458b for instance c068f993-944e-4d9a-b4fa-75509ddbfb4e on n-h2-858383-13 Oct 18 13:29:22.613811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-71c940bf-579f-44c4-ac7f-82011b095b03 req-a571e217-0ad5-4efe-b4ac-67d88fa6ce03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037193 Oct 18 13:29:22.614708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 767/1556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:22.665276 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70e756fa-1a13-4c29-b683-973dd3d1e870 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.480785 Oct 18 13:29:22.666321 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 790/1557] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:22.678776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1847a148-4872-4125-9959-5c8e84dafba6 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb331542ee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.697457 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1847a148-4872-4125-9959-5c8e84dafba6 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-255943427" status: 200 len: 496 microversion: 2.1 time: 0.023348 Oct 18 13:29:22.698412 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 768/1558] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-255943427 => generated 496 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:22.712756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-543ae349-01b2-4736-bb1a-fdae43c04c7a tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3314b5af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.739050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.740239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.772795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.772795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.772795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.772795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.773180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.773180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.913898 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-543ae349-01b2-4736-bb1a-fdae43c04c7a tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255943427" status: 202 len: 0 microversion: 2.1 time: 0.205568 Oct 18 13:29:22.915144 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 791/1559] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:29:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255943427 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:22.935310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d0d3586-2293-446d-bf10-61e1d65006a2 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb335307ee0>, body: {"keypair": {"name": "tempest-keypair-257618559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6+Ywr7R3lecd/LNAvLWTUO1j5GUPqYOnVTuELziEzmp7+9AzVFQLOJAUMx6p4JZ43hk2+OJKXa9emoGSiBw1ouqFy7aBqwRHpeKTJhUaXNUWTYlpWINVf43tRPiKfElQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:22.958370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8d0d3586-2293-446d-bf10-61e1d65006a2 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:22.965939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8d0d3586-2293-446d-bf10-61e1d65006a2 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:22.999777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.027358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4796a475-4cf7-48cf-9997-9759d1e02e68 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1292 microversion: 2.1 time: 0.290279 Oct 18 13:29:23.027358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 769/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1292 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.042018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.042648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.056104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.056643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.057084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.058356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.059707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.060341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.151030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d0d3586-2293-446d-bf10-61e1d65006a2 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.228493 Oct 18 13:29:23.157167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 792/1561] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:23.304391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee7885e2-ab4a-4ce1-8689-c4cf7b60dfe2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb335307ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-91771005", "description": "tempest-description-1400798822"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:23.389616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.403130 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37a863c2-8e9a-4e90-992e-83a06a76c953 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1533 microversion: 2.1 time: 0.374915 Oct 18 13:29:23.411391 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 770/1562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1533 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.411391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f234075b-2522-4e18-98d2-8b955278a1a6 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3311ef5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.541802 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f234075b-2522-4e18-98d2-8b955278a1a6 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257618559" status: 202 len: 0 microversion: 2.1 time: 0.135463 Oct 18 13:29:23.542472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 771/1563] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257618559 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:23.552274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.562182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.584118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.584791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.585588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.586551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.587222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.587824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.852853 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee7885e2-ab4a-4ce1-8689-c4cf7b60dfe2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.694506 Oct 18 13:29:23.853909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 793/1564] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:29:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:23.858715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.859676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.876916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.877440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.878020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.878770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.879242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.879829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.888092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.902429 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d4287f5-ed3b-4d20-ad96-0cdc46bcc7d5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.356914 Oct 18 13:29:23.908350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 772/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.919024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52cb664e-b652-480d-8b53-056921297c79 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb331238f70>, body: {"keypair": {"name": "tempest-keypair-667640026", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:23.943493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-52cb664e-b652-480d-8b53-056921297c79 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:23.949141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-52cb664e-b652-480d-8b53-056921297c79 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:23.956043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:23.958957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:23.959705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:23.978987 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46082168-8b51-4413-962d-28889be9f1d1 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.123766 Oct 18 13:29:23.979638 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 794/1566] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:23.984507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.985310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.991423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.992116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.992739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.993750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.994403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.995023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.030668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.031167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.031610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.032072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid 0c6daf44-144c-4ea3-9795-7266d8f687fa {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:24.053739 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52cb664e-b652-480d-8b53-056921297c79 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.143819 Oct 18 13:29:24.055157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 773/1567] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:23 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:24.062766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d3ea892-ec8c-41bb-a7c1-74e4f70ff2e8 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb331190310>, body: {"security_group_rule": {"parent_group_id": "32e67f3c-8ae0-4fcc-8275-e65f18449b35", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:24.081573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.098834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-763f4677-8e4a-47c1-97b7-08599fc3d30a tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1307 microversion: 2.1 time: 0.117846 Oct 18 13:29:24.099758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 795/1568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.104718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.105351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.127724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.131948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.131948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.131948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.131948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.132377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.169165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.169718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.170278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.170809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lazy-loading 'fault' on Instance uuid c068f993-944e-4d9a-b4fa-75509ddbfb4e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:24.204411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:24.232007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.241286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e22afa4-f934-4e62-814f-892bfb9c316e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 200 len: 1297 microversion: 2.1 time: 0.140384 Oct 18 13:29:24.242422 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 796/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 1297 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.247943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c10baf1-4bf3-4661-b767-4674d94e7be5 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb330c9bb80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.420360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c10baf1-4bf3-4661-b767-4674d94e7be5 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667640026" status: 202 len: 0 microversion: 2.1 time: 0.175330 Oct 18 13:29:24.421664 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 797/1570] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667640026 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:24.433679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.435137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.442136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.445344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.446031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.457052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.457798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.459582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.696201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.704511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e540f302-27f4-4ab8-ab68-954f8dc0ff4e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1533 microversion: 2.1 time: 0.280440 Oct 18 13:29:24.705090 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 798/1571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1533 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:24.728531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d973b8b4-f94c-4eb9-8c8e-ab162ee2fe5e tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb330c00e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2095240439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmTHvLvi9+kYNgHreMb9T/n28UWkzuNPw47nDEaaxu4Gcw1CfWLDXFhFR2eL5thzKlwP6AdJQCTzB/y6kSlw8bVNLZ08dt5GPMKDrNIS2o9/HuIStPFCH+M3QtgTTSl0Q=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:24.748231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d973b8b4-f94c-4eb9-8c8e-ab162ee2fe5e tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:24.753487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d973b8b4-f94c-4eb9-8c8e-ab162ee2fe5e tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:24.883377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d973b8b4-f94c-4eb9-8c8e-ab162ee2fe5e tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.158625 Oct 18 13:29:24.884707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 799/1572] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:24.890542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6daf44-144c-4ea3-9795-7266d8f687fa", "name": "network-vif-deleted", "tag": "f85c6385-8655-43f5-82a5-d35041abf122"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:24.902377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.903582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.904122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.919395 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] Creating event network-vif-deleted:f85c6385-8655-43f5-82a5-d35041abf122 for instance 0c6daf44-144c-4ea3-9795-7266d8f687fa on n-h2-858383-13 Oct 18 13:29:24.927890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5d42b2f2-0a55-4754-91cf-996230ac9810 req-90d3e2c7-6ea8-425a-bddb-a25ade3d14ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038972 Oct 18 13:29:24.928688 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 800/1573] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:24.935320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-unplugged", "status": "completed", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:24.968235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.973636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.973636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.992914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Creating event network-vif-unplugged:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:29:25.017195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:29:25.026454 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8a7b6bff-e688-4383-9cff-e42c4f6c6da4 req-44d65413-792b-4faf-9820-7b042cd7a61c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096224 Oct 18 13:29:25.027155 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 801/1574] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:25.033462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb857739-c97c-48eb-8864-0d95bb883f2f tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb330cf84c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-863501555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLX/lLaMB/WprHZmUIuxa4JbMdYu+hr8avmj+uqcfP1WWvkJ5N32gpZ7yZn9JZaDnDLyFvlqegbXKJ3dx8CvRVKqvOwAotTT3ZbHKZatdJQbSvCvX8N81OukPfl73tWlA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:25.051223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fb857739-c97c-48eb-8864-0d95bb883f2f tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:25.057123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fb857739-c97c-48eb-8864-0d95bb883f2f tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:25.149791 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d3ea892-ec8c-41bb-a7c1-74e4f70ff2e8 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.092751 Oct 18 13:29:25.150410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 774/1575] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:25.156204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.159325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.170518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.171878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.172495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.173208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.173826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.174441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.188078 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb857739-c97c-48eb-8864-0d95bb883f2f tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.158395 Oct 18 13:29:25.189460 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 802/1576] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:25.206031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.206031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.206373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:25.206495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:25.208535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.209344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.210578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.211664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.212367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.212993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.313358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:25.334766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-031e0d7f-2352-4195-859c-ed760d627df6 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1929 microversion: 2.75 time: 0.143192 Oct 18 13:29:25.335360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 803/1577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:25.354205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.354205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.354205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.354205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.354667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.354667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.354667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.354667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.381406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:25.392512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9004426-8fcf-46b2-9477-d9bf3cf8fc78 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1504 microversion: 2.1 time: 0.240379 Oct 18 13:29:25.393523 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 775/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.398309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53f9e03d-5e60-4918-b380-992b09735498 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb330fafc10>, body: {"security_group_rule": {"parent_group_id": "32e67f3c-8ae0-4fcc-8275-e65f18449b35", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:25.412553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.413096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.414555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.414686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid 0c6daf44-144c-4ea3-9795-7266d8f687fa {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:25.463867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:25.466310 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-53f9e03d-5e60-4918-b380-992b09735498 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 Oct 18 13:29:25.476847 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-831c326f-d69b-4909-8953-9a4984e90412 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 200 len: 1307 microversion: 2.1 time: 0.140410 Oct 18 13:29:25.491674 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 804/1579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53f9e03d-5e60-4918-b380-992b09735498 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 138 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:25.492356 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: {"security_group_rule": {"parent_group_id": "32e67f3c-8ae0-4fcc-8275-e65f18449b35", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:29:25.494002 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: exception: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'security_group_rule': {'parent_group_id': '32e67f3c-8ae0-4fcc-8275-e65f18449b35', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:25.494982 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.496291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53f9e03d-5e60-4918-b380-992b09735498 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: This rule already exists in group 32e67f3c-8ae0-4fcc-8275-e65f18449b35 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:25.497250 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53f9e03d-5e60-4918-b380-992b09735498 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.099434 Oct 18 13:29:25.497250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 776/1580] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:29:25.499573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.500407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.505901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a9caff37-8df6-4671-a311-6cfe9c1b5177 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Action: 'create', calling method: .version_select at 0x7fb335307af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-149071405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/2B0hI4C3hgnZwgeleUeNeC2hAgTqgBqmSsB67NsPzRc35aqUBZmpKG6go12eHzDfIOAotlJTpR1PHSBO+q15OWnlQGHULLCih4rZBV0ELHt3zz2YeacidyNsqPrpfbQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:25.513624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.514157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.514595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.515471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.515935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.516365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.522405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a9caff37-8df6-4671-a311-6cfe9c1b5177 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:25.528643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a9caff37-8df6-4671-a311-6cfe9c1b5177 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Getting quotas for user 0671920e1f96433b9bba3bfb2162e84a and project a2529bd1ac1f4273a5914da5a633f08d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:25.532836 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e HTTP/1.1 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:25.534475 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:29:25.536230 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c068f993-944e-4d9a-b4fa-75509ddbfb4e'} Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:25.537153 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:29:25.538725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:25.540092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:25.540092 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95829a40-e276-4615-8163-1d1df239646f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 404 len: 111 microversion: 2.1 time: 0.040243 Oct 18 13:29:25.540092 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 777/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:25.544959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c751cdd-e501-4788-a390-5bc31494fd79 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb330fafa60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.667797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a9caff37-8df6-4671-a311-6cfe9c1b5177 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.174508 Oct 18 13:29:25.672842 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 805/1582] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:25.674493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c519597-8658-4f61-b6d6-43f5c96230cc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb330ce7940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.855663 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c751cdd-e501-4788-a390-5bc31494fd79 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/ddd8bd4a-8d8a-4df4-b174-3b6930c2dbd6" status: 202 len: 0 microversion: 2.1 time: 0.314014 Oct 18 13:29:25.860878 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 778/1583] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 18 13:29:25 2022] DELETE /compute/v2.1/os-security-group-rules/ddd8bd4a-8d8a-4df4-b174-3b6930c2dbd6 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:25.866819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a24b78d5-7b5a-483f-bbe7-065c7b3c9e55 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3310d40d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.872655 n-d-858383-13 devstack@n-api.service[121010]: WARNING oslo_db.sqlalchemy.utils [None req-a24b78d5-7b5a-483f-bbe7-065c7b3c9e55 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:29:25.881912 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a24b78d5-7b5a-483f-bbe7-065c7b3c9e55 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.019368 Oct 18 13:29:25.882613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 779/1584] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.895678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.896309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.903188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.903708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.904217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.905003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.905467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.905903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.087080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:26.095750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38f63b38-cad6-4231-a08d-4dd252b873ef tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1533 microversion: 2.1 time: 0.211868 Oct 18 13:29:26.107964 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 780/1585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1533 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:26.113821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cf014e2-40ea-4171-bc39-0cfe0c3b486a tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb3311efa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1161324450", "description": "tempest-description-1842059870"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:26.570691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cf014e2-40ea-4171-bc39-0cfe0c3b486a tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.461289 Oct 18 13:29:26.571294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 781/1586] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:29:26 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:26.577444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58bdb9d1-20f1-48a9-9dbb-d04ac327a7c4 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3311efca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:26.726106 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58bdb9d1-20f1-48a9-9dbb-d04ac327a7c4 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-149071405" status: 202 len: 0 microversion: 2.1 time: 0.153552 Oct 18 13:29:26.727631 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 782/1587] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-149071405 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:26.736046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:26.736046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:26.742768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.743359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.743879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.744696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.745223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.745763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.839628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:26.858289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee20aab3-a55a-4349-ab1f-d3dfe68b1338 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1935 microversion: 2.75 time: 0.128857 Oct 18 13:29:26.859863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 783/1588] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:26 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1935 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:26.867732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:26.867732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:26.875365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.875860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.876294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.877180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.877905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.878283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.027650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:27.037947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f7e6a7d-5d44-4065-b3e4-02e8ad18f829 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1494 microversion: 2.1 time: 0.176568 Oct 18 13:29:27.039325 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 784/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:26 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1494 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:27.043969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.045097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 0c6daf44-144c-4ea3-9795-7266d8f687fa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.052004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.052505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.053007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.053684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.054176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.054616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.071731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa HTTP/1.1 Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:27.073445 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. Oct 18 13:29:27.075071 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0c6daf44-144c-4ea3-9795-7266d8f687fa'} Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:27.075998 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. Oct 18 13:29:27.077227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.078560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance 0c6daf44-144c-4ea3-9795-7266d8f687fa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:27.078560 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71028632-5262-4bf6-afd0-18a3e23a4e9b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa" status: 404 len: 111 microversion: 2.1 time: 0.035351 Oct 18 13:29:27.078560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 785/1590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/servers/0c6daf44-144c-4ea3-9795-7266d8f687fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:27.082783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01ff89ca-4415-482d-a235-c466ce8ecc94 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb330faf430>, body: {"security_group_rule": {"parent_group_id": "072f46ac-7dae-480a-b278-5a4cc1245d9c", "ip_protocol": "tcp", "from_port": 1743542917, "to_port": 22}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:27.195629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-01ff89ca-4415-482d-a235-c466ce8ecc94 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Invalid port range 1743542917:22. Former value cannot be greater than the later Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01ff89ca-4415-482d-a235-c466ce8ecc94 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 146 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:27.197252 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: {"security_group_rule": {"parent_group_id": "072f46ac-7dae-480a-b278-5a4cc1245d9c", "ip_protocol": "tcp", "from_port": 1743542917, "to_port": 22}} Oct 18 13:29:27.198670 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid port range 1743542917:22. Former value cannot be greater than the later Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'security_group_rule': {'parent_group_id': '072f46ac-7dae-480a-b278-5a4cc1245d9c', 'ip_protocol': 'tcp', 'from_port': 1743542917, 'to_port': 22}}} Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1743542917:22. Former value cannot be greater than the later Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.199473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1743542917:22. Former value cannot be greater than the later Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1743542917:22. Former value cannot be greater than the later Oct 18 13:29:27.201288 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.204111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01ff89ca-4415-482d-a235-c466ce8ecc94 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: Invalid port range 1743542917:22. Former value cannot be greater than the later {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:27.204111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01ff89ca-4415-482d-a235-c466ce8ecc94 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.121716 Oct 18 13:29:27.204111 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 786/1591] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:27 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:29:27.206761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-575debec-cbaf-4ba4-adbb-a8031ff427d8 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3311ab940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.403058 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-575debec-cbaf-4ba4-adbb-a8031ff427d8 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-863501555" status: 202 len: 0 microversion: 2.1 time: 0.202181 Oct 18 13:29:27.404170 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 787/1592] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-863501555 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:27.408746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e6c3cfc-0fda-423f-8967-12c8f03f6225 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '.version_select at 0x7fb3311ab670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.412205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6c3cfc-0fda-423f-8967-12c8f03f6225 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.412724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6c3cfc-0fda-423f-8967-12c8f03f6225 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.413172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6c3cfc-0fda-423f-8967-12c8f03f6225 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.425228 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e6c3cfc-0fda-423f-8967-12c8f03f6225 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2756 microversion: 2.1 time: 0.019972 Oct 18 13:29:27.425856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 788/1593] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/os-migrations => generated 2756 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:27.430922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.431424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.442011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.442533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.443744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.448247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.448845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.450480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.483355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:27.834121 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c519597-8658-4f61-b6d6-43f5c96230cc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 204 len: 0 microversion: 2.1 time: 2.163687 Oct 18 13:29:27.834775 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 806/1594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] DELETE /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 0 bytes in 2165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:27.841768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.842400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.850417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.854330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.854330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.854330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.854330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.854661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.941464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-040ef417-5409-4695-9472-f077f8d936d7 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 204 len: 0 microversion: 2.1 time: 0.514292 Oct 18 13:29:27.942048 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 789/1595] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:27 2022] DELETE /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:27.947381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e04e786-0dcd-4c4f-bf7b-44548e5aab4e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb3311904c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1032263526", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:27.949922 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0e04e786-0dcd-4c4f-bf7b-44548e5aab4e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Security group id should be uuid Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e04e786-0dcd-4c4f-bf7b-44548e5aab4e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 131 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:27.951479 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1032263526", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:27.955577 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group id should be uuid Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1032263526', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:27.956396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e04e786-0dcd-4c4f-bf7b-44548e5aab4e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: Security group id should be uuid {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:27.957992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e04e786-0dcd-4c4f-bf7b-44548e5aab4e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009624 Oct 18 13:29:27.959155 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 790/1596] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:27.959155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-201e2df7-f198-44bf-8d7a-8cd509a9fdb9 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] Calling method '.version_select at 0x7fb3311eff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.998008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.005930 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8e8d225-864c-4eee-8ca0-2b93381aebcc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1533 microversion: 2.1 time: 0.169898 Oct 18 13:29:28.006540 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 807/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1533 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.010829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.011449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.018283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.018773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.019215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.019920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.020376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.020810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.076646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-201e2df7-f198-44bf-8d7a-8cd509a9fdb9 tempest-KeyPairsV2TestJSON-1765914057 tempest-KeyPairsV2TestJSON-1765914057-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2095240439" status: 202 len: 0 microversion: 2.1 time: 0.122134 Oct 18 13:29:28.077235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 791/1598] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 13:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2095240439 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:28.081936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.082632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.090705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.091208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.091656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.092428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.093071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.093506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.127040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:28.169859 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a392cd53-b33f-4dc1-8234-e34041005437 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1647 microversion: 2.1 time: 0.162044 Oct 18 13:29:28.170636 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 808/1599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1647 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.177772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.178828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.194492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.194492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.194492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.194492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.194951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.195956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.282029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:28.300083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16a66ee5-be0c-49f3-9ac8-a0998e4ded3a tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1935 microversion: 2.75 time: 0.128131 Oct 18 13:29:28.300699 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 809/1600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1935 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:28.305458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.306096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.312382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.312873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.313317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.314519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.314519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.314998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.463180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.472078 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6788458-570f-495d-9d68-87394d050dff tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1471 microversion: 2.1 time: 0.170075 Oct 18 13:29:28.472657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 810/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.479679 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47f6c376-a41d-4c3c-ba09-5c9b9c5c5ec8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 204 len: 0 microversion: 2.1 time: 0.401125 Oct 18 13:29:28.481165 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 792/1602] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:28 2022] DELETE /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:28.504544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7932f456-fdd5-4da7-ba08-adfd9a045ef2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb3353075e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2113524185", "description": "tempest-description-1587507450"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:28.515152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-746841327", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1d39c162-1076-4759-b728-c0f93d172f89"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:28.601952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] validate_networks() for [('1d39c162-1076-4759-b728-c0f93d172f89', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:28.982514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7932f456-fdd5-4da7-ba08-adfd9a045ef2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.508704 Oct 18 13:29:28.983736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 811/1603] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:29:28 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:28.989319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-764899882", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "b82a01f7-b9df-47f0-bfb7-15b8526d8cab"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:29.091212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] validate_networks() for [('b82a01f7-b9df-47f0-bfb7-15b8526d8cab', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:29.286140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:29.286918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:29.287472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:29.287961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:29.288463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:29.301066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.301640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.302573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.303415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.303999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.304670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.343986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:29.350838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for user d5ed601492e2486bad8ba5b09515d52a and project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:29.372507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:29.375908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:29.571718 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-841a30a7-3dcf-4fc2-aa01-48e5bf945206 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085473 Oct 18 13:29:29.572776 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 793/1604] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:29.589225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1632c1d-0e71-4b44-91bb-27345d1831af tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb3317caa60>, body: {"security_group_rule": {"parent_group_id": "e717ba15-b513-44ca-8746-46dcaa749fdd", "ip_protocol": "tempest-999-725091842", "from_port": 22, "to_port": 22}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:29.649512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:29.650367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:29.651010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:29.652214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:29.652939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:29.662998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.666445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.666445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.666445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.666445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.666894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.684980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:29.690403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Getting quotas for user 356ffdf6f40b4d71a7f39c414c008491 and project a2b1a51ccc344c649308631c71afd5b7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:29.708852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:29.713085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:29.894568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb6dc3f4-f5ae-4a9e-9e80-c8e6ed12ac20 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909325 Oct 18 13:29:29.901522 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 812/1605] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:29.901522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:29.901522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:29.909459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.910222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.910912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.911829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.912589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.913190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.065969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b1632c1d-0e71-4b44-91bb-27345d1831af tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Invalid IP protocol tempest-999-725091842. Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1632c1d-0e71-4b44-91bb-27345d1831af tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 156 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:30.067992 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: {"security_group_rule": {"parent_group_id": "e717ba15-b513-44ca-8746-46dcaa749fdd", "ip_protocol": "tempest-999-725091842", "from_port": 22, "to_port": 22}} Oct 18 13:29:30.069594 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid IP protocol tempest-999-725091842. Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e717ba15-b513-44ca-8746-46dcaa749fdd', 'ip_protocol': 'tempest-999-725091842', 'from_port': 22, 'to_port': 22}}} Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-725091842. Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:30.070476 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-725091842. Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-725091842. Oct 18 13:29:30.071875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:30.074113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1632c1d-0e71-4b44-91bb-27345d1831af tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: Invalid IP protocol tempest-999-725091842. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:30.079294 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1632c1d-0e71-4b44-91bb-27345d1831af tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.488609 Oct 18 13:29:30.079294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 794/1606] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:29 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 496 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:30.080822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.089046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3895c999-cbda-4104-8c86-c23846b8028c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1526 microversion: 2.1 time: 0.192704 Oct 18 13:29:30.090381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.092891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.106509 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 813/1607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:29 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1526 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.110287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.113052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.113596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.113752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.114385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.116401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.118710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.119405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.123140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.123957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.124669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.125683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.127055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.128081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.297624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:30.308431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.317912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e7ef80ca-33b8-43b0-89e0-feb96e68ca77 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1471 microversion: 2.1 time: 0.209994 Oct 18 13:29:30.318761 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 814/1608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.323706 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4df57d0c-9964-460e-9316-5078ddb95f55 tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1935 microversion: 2.75 time: 0.246348 Oct 18 13:29:30.325165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-04e53b4a-fdf5-4353-9c01-cf32e3d36d7c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.326792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-04e53b4a-fdf5-4353-9c01-cf32e3d36d7c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.335234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 795/1609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1935 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:30.354271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac4ba874-15b4-4d23-8836-978868457187 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.354271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac4ba874-15b4-4d23-8836-978868457187 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.440990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-04e53b4a-fdf5-4353-9c01-cf32e3d36d7c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.462196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-04e53b4a-fdf5-4353-9c01-cf32e3d36d7c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1210 microversion: 2.1 time: 0.140207 Oct 18 13:29:30.474647 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 815/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.492966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8a72b4b-1064-4c27-a489-e043a28b961b tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb33521f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1592066446", "description": "tempest-description-1539832583"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:30.523653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac4ba874-15b4-4d23-8836-978868457187 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.544786 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac4ba874-15b4-4d23-8836-978868457187 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1207 microversion: 2.1 time: 0.196918 Oct 18 13:29:30.545581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 796/1611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1207 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.551182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.559043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.572237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.572753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.573384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.576113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.577284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.577907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.897935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.910507 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90c01373-5152-4de5-9288-bcac7f42e63a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1526 microversion: 2.1 time: 0.360269 Oct 18 13:29:30.911564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 797/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1526 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.919015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1561596807", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6d7b5541-416a-4285-abcb-d7b8dba55d22"}], "block_device_mapping_v2": [{"uuid": "e4e120b9-f291-4c58-a3cc-1f9dfa64f273", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:31.004121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] validate_networks() for [('6d7b5541-416a-4285-abcb-d7b8dba55d22', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:31.098495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8a72b4b-1064-4c27-a489-e043a28b961b tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.621387 Oct 18 13:29:31.106272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 816/1613] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:29:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:31.112464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a488a5d6-e54e-4093-ad0f-59a7aa0b05d0", "name": "network-vif-deleted", "tag": "d478c30a-0cc4-4b75-8005-ebbb46a05ca0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:31.135539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.137866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.139214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.166683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] Creating event network-vif-deleted:d478c30a-0cc4-4b75-8005-ebbb46a05ca0 for instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 on n-h2-858383-13 Oct 18 13:29:31.176718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2c70fe11-0004-4483-bef3-c1b5426bf03d req-01f970cd-c389-4acb-8fa2-5dd5aa024c3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067147 Oct 18 13:29:31.178234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 817/1614] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:31.187967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea2c5d30-30f9-47dc-8e4d-006172be3a84 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:31.210760 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-ea2c5d30-30f9-47dc-8e4d-006172be3a84 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] HTTP exception thrown: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea2c5d30-30f9-47dc-8e4d-006172be3a84 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Request method failure captured: Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/flavors/49155e73-c29b-41c5-ba33-509576125f45 HTTP/1.1 Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlCVB-0xSbPDov9EXVd_7eL1pibQq7n3edTVWvLZ5bosb3RGFZkuGvXH8xvnxbjRoKUW3agumkTJbC0t4IL-qFQQQtqFdmfUuLb8tAM0iz4qTT_NsAgTojokRnU1tu2U0TbOl24kuDwNy7mFtpqZObKTPn0H2KZ-qlbmqHUF00Uc-M Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: dd3aea217bc34d51b6816c2f220d1c5e Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MigrationsAdminTest-1046816860 Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:29:31.233713 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd3aea217bc34d51b6816c2f220d1c5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dd3aea217bc34d51b6816c2f220d1c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dd3aea217bc34d51b6816c2f220d1c5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dd3aea217bc34d51b6816c2f220d1c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MigrationsAdminTest-1046816860 Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: dd3aea217bc34d51b6816c2f220d1c5e Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MigrationsAdminTest-1046816860 Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MigrationsAdminTest-1046816860-project-admin Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c8ff684c96ea4fc9beee82ff1c825ee4 Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MigrationsAdminTest-1046816860-project-admin Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. Oct 18 13:29:31.235447 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '49155e73-c29b-41c5-ba33-509576125f45'} Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.236484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. Oct 18 13:29:31.238038 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.241466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea2c5d30-30f9-47dc-8e4d-006172be3a84 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Returning 404 to user: Flavor 49155e73-c29b-41c5-ba33-509576125f45 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:31.242654 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea2c5d30-30f9-47dc-8e4d-006172be3a84 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/49155e73-c29b-41c5-ba33-509576125f45" status: 404 len: 109 microversion: 2.1 time: 0.062005 Oct 18 13:29:31.243737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 818/1615] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:31 2022] DELETE /compute/v2.1/flavors/49155e73-c29b-41c5-ba33-509576125f45 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:31.252930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-637bcd88-3e39-4f3d-90bc-49e760da9a3e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb330c9bee0>, body: {"security_group_rule": {"parent_group_id": "19f71c27-9dd8-40c7-b8ed-8f33ef980b80", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:31.338433 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-637bcd88-3e39-4f3d-90bc-49e760da9a3e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-637bcd88-3e39-4f3d-90bc-49e760da9a3e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 138 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:31.348045 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: {"security_group_rule": {"parent_group_id": "19f71c27-9dd8-40c7-b8ed-8f33ef980b80", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 18 13:29:31.349406 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19f71c27-9dd8-40c7-b8ed-8f33ef980b80', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:31.350409 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:29:31.351580 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:31.352868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-637bcd88-3e39-4f3d-90bc-49e760da9a3e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:31.352868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-637bcd88-3e39-4f3d-90bc-49e760da9a3e tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.097473 Oct 18 13:29:31.352868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 819/1616] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:31 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:29:31.366264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:31.369463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:31.385474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.386663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.388164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.389814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.392973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.393711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.471991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:31.485458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-134f8037-683c-4ac4-8e5b-0d6b474df57f tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1301 microversion: 2.1 time: 0.128449 Oct 18 13:29:31.487619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 820/1617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:31 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:31.493598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2ffdbe6-82f2-4ae1-9add-04144df2ed00 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb330cf8ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1066196019", "description": "tempest-description-688221678"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:31.757592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:31.758109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:31.758790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:31.759314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:31.759826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:31.774331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.775323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.776135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.777134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.778294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.778951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.800334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:31.805962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Getting quotas for user fa4ca05a0c6a405f8fa014ee06dbcef4 and project 5d09f371e0a64ff99d885489a5ca3bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:31.874108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:31.876150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4e120b9-f291-4c58-a3cc-1f9dfa64f273',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:32.023890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2ffdbe6-82f2-4ae1-9add-04144df2ed00 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.534608 Oct 18 13:29:32.029507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 821/1618] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:29:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:32.045570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.046539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.055613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.056062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.056521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.059306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.059796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.060252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.140423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:32.146114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] Lazy-loading 'services' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:32.193570 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f713c4e7-337d-4b43-ade2-e60bf6d14fef tempest-ServersAdmin275Test-739169040 tempest-ServersAdmin275Test-739169040-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1920 microversion: 2.75 time: 0.166757 Oct 18 13:29:32.194743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 822/1619] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:32 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1920 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:32.362733 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2427bd50-bea4-4fbc-b8ce-f8fae4aa4181 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.449558 Oct 18 13:29:32.370100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 798/1620] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:29:32.377212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.378124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.378845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-plugged", "status": "completed", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:32.385436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.386258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.387451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.388774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.389113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.389790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.397672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.398196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.398808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.412816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] Creating event network-vif-plugged:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:29:32.419436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-599ee6c4-5870-4eac-872a-2167028f1a5f req-d1816724-9855-46a2-99fe-0ece2ffb8fdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223363 Oct 18 13:29:32.434754 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 823/1621] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:32.440095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-246200532", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:32.508565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:32.523438 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c9f8199-0138-4acb-89c9-1e1fc08c36c3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1262 microversion: 2.1 time: 0.147645 Oct 18 13:29:32.529511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 799/1622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:32 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:32.541264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:32.543436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.544257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.557579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.558084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.559632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.560362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.560827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.561273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.652856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:32.675177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f8609fc-3bf3-413a-949f-ff5e9811b00f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1203 microversion: 2.1 time: 0.140406 Oct 18 13:29:32.691504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 800/1623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:32 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:32.696673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292d54fa-7599-4745-8e3a-b76fec8108ef", "name": "network-vif-deleted", "tag": "f15d6adf-83de-4bb8-b539-52112470bdba"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:32.707050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.707914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.708546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.723012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] Creating event network-vif-deleted:f15d6adf-83de-4bb8-b539-52112470bdba for instance 292d54fa-7599-4745-8e3a-b76fec8108ef on n-h1-858383-13 Oct 18 13:29:32.728827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c60f0363-5830-4f16-9c3d-df3ee2bfdfd0 req-2afda391-a10a-4feb-b44a-94381295efcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Oct 18 13:29:32.729637 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 801/1624] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:32.735884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b6dfb71-273c-4637-9b72-9d08995f9ca9 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb331014a60>, body: {"security_group_rule": {"parent_group_id": "c46195e5-94aa-4b54-ae32-8c140241a5fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 180597040}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:32.788434 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5b6dfb71-273c-4637-9b72-9d08995f9ca9 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b6dfb71-273c-4637-9b72-9d08995f9ca9 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 145 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:32.794691 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: {"security_group_rule": {"parent_group_id": "c46195e5-94aa-4b54-ae32-8c140241a5fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 180597040}} Oct 18 13:29:32.800749 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c46195e5-94aa-4b54-ae32-8c140241a5fd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 180597040}}} Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:32.802323 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 Oct 18 13:29:32.804053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:32.807935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b6dfb71-273c-4637-9b72-9d08995f9ca9 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 400 to user: Invalid port range 22:180597040. Valid TCP ports should be between 1-65535 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:32.807935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b6dfb71-273c-4637-9b72-9d08995f9ca9 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.065694 Oct 18 13:29:32.807935 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 802/1625] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:32 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:29:32.816359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.819494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.826572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.827550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.828151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.829443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.830101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.831087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.844482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:32.844918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:32.845815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:32.846179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:32.846604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:32.864503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.865731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.867046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.867988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.868662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:32.868831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.869685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.887993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:32.892189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:32.899111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Getting quotas for user 6c1cd81ee6174cee97e384cae58a2e6a and project 41d29c076c7d4bb288da6f42ddee05fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:32.916417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:32.919750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:33.093740 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35a35517-57f4-4569-b03b-bd51e0dc82a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657763 Oct 18 13:29:33.094582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 824/1626] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:33.172611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:33.241353 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc66b0a4-74a9-4577-8714-50f6b2e47046 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 204 len: 0 microversion: 2.75 time: 0.442285 Oct 18 13:29:33.242263 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 803/1627] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:29:32 2022] DELETE /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:29:33.250460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.251413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.259655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.260156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.260599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.261317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.261844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.262304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.309706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.310376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.343530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.343530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.343530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.343530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:33.483670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.503745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.506313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.508740 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-666308ca-a2e0-45d5-b3e3-0a44c2ef6a22 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1104 microversion: 2.25 time: 0.412787 Oct 18 13:29:33.523648 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 825/1628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1104 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:33.532376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.537164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Action: 'create', calling method: .version_select at 0x7fb3352910d0>, body: {"security_group_rule": {"parent_group_id": "1a52aa7d-8042-4a2a-908e-8de764664087", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:33.538337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80e3785a-359e-48de-86fb-85e974208e03 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 200 len: 1306 microversion: 2.1 time: 0.294698 Oct 18 13:29:33.539273 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 804/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:33.550000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53b104c6-e0e0-40c8-b935-f59952cc44d8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.551961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-53b104c6-e0e0-40c8-b935-f59952cc44d8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.588512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:29:33.589143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Neutron security group 1a52aa7d-8042-4a2a-908e-8de764664087 not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:29:33.589687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.589687 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 138 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:33.592282 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: {"security_group_rule": {"parent_group_id": "1a52aa7d-8042-4a2a-908e-8de764664087", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:29:33.593668 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1a52aa7d-8042-4a2a-908e-8de764664087', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:29:33.594498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 18 13:29:33.596806 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.600995 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 404 to user: Security group 1a52aa7d-8042-4a2a-908e-8de764664087 does not exist Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-cab78a55-8755-40fe-806e-be2f57ebb503'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:33.604381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f922d6d-ab0f-4d59-a8da-11c2d6ac7b30 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.068782 Oct 18 13:29:33.606692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 826/1630] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:29:33 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:33.609986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.617382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.641479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.641956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.643858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.643987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.644387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.644828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.682389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53b104c6-e0e0-40c8-b935-f59952cc44d8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.689998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53b104c6-e0e0-40c8-b935-f59952cc44d8 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1212 microversion: 2.1 time: 0.149647 Oct 18 13:29:33.690608 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 805/1631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:33.695179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.696199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.702693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.703420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.704020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.704884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.705500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.706148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.747847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.758236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.760095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.766678 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06f88aa5-68f6-478e-9ead-7d8975331e1c tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1443 microversion: 2.75 time: 0.170086 Oct 18 13:29:33.767544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 827/1632] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:33.772557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb33521f9d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.803984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:29:33.804139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.805112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Neutron security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 not found {{(pid=121009) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 18 13:29:33.805663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] HTTP exception thrown: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.805663 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Request method failure captured: Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-security-group-rules/7d77a7c6-4bde-4a2a-829e-018215d0a364 HTTP/1.1 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqoyKGwNMXhIq9XzX3rRXW6laDCK4gFo_wAumydWXUz5qBLDDZJ7DkZVU9aYSbGgkFsljody_ciCCPx0Pyjso7iB-Tf0wfZIqJbKW70UDJmBSXVrHM2F7nHZ5kGO5gRyuhjskfLoBpLP880t9RXMd8L8WWLmlTK7k_YkFOGI4svs1bU Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:33.807944 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1348916675647e5b2e68cc8d489faf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d1348916675647e5b2e68cc8d489faf8 Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799 Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 35e2af24561642bf90a5650a83b093fa Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.810189 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '7d77a7c6-4bde-4a2a-829e-018215d0a364'} Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.811107 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 18 13:29:33.812388 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.814200 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] Oct 18 13:29:33.815709 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:33.816504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96003e32-f089-47ce-885e-d6c3eaec62d0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1268 microversion: 2.1 time: 0.123403 Oct 18 13:29:33.816504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 806/1633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:33.818233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Returning 404 to user: Security group rule 7d77a7c6-4bde-4a2a-829e-018215d0a364 does not exist Oct 18 13:29:33.818233 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-d75513d5-c6d6-4ffa-9c1d-192ec0e8605b'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:33.819729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bb77720-2384-4997-a099-6cfbdce7647f tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/7d77a7c6-4bde-4a2a-829e-018215d0a364" status: 404 len: 199 microversion: 2.1 time: 0.051049 Oct 18 13:29:33.820670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.821264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.823180 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 828/1634] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 18 13:29:33 2022] DELETE /compute/v2.1/os-security-group-rules/7d77a7c6-4bde-4a2a-829e-018215d0a364 => generated 199 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:33.833654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.834277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.834796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.835075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea39e870-847b-44cc-9fa0-88d2e3c9d8be tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb330c8fe50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.835629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.836277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.836853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.945193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.956365 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0757c24-9cef-4ac3-b7fd-df68fcce75a4 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1259 microversion: 2.1 time: 0.139498 Oct 18 13:29:33.956956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 807/1635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:34.154597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea39e870-847b-44cc-9fa0-88d2e3c9d8be tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c46195e5-94aa-4b54-ae32-8c140241a5fd" status: 202 len: 0 microversion: 2.1 time: 0.324492 Oct 18 13:29:34.155816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 829/1636] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:29:33 2022] DELETE /compute/v2.1/os-security-groups/c46195e5-94aa-4b54-ae32-8c140241a5fd => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:29:34.163880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d1ac439-b2fc-4f99-bc7d-0fbe3cff7e6b tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb33121e5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.542751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.543645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:34.550578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.551073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.551576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.552382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.552937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.553561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.621873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:34.630078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:34.631516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:34.632653 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-570ab33a-d239-49b9-95d4-03fd06580c3f tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1185 microversion: 2.25 time: 0.096279 Oct 18 13:29:34.633209 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 830/1637] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:34 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:34.638456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.639319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: a488a5d6-e54e-4093-ad0f-59a7aa0b05d0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:34.646325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.667171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.667171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.667171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.667171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 HTTP/1.1 Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:34.667799 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. Oct 18 13:29:34.670255 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'a488a5d6-e54e-4093-ad0f-59a7aa0b05d0'} Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:34.671268 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. Oct 18 13:29:34.673377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:34.674928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:34.674928 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61a6cd61-ca62-4787-8ccd-9f356c2188e5 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0" status: 404 len: 111 microversion: 2.1 time: 0.034631 Oct 18 13:29:34.674928 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 831/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:34 2022] GET /compute/v2.1/servers/a488a5d6-e54e-4093-ad0f-59a7aa0b05d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:34.677701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.678227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:34.685050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.685577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.686082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.686822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.687309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.687793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.717511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:34.908395 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d1ac439-b2fc-4f99-bc7d-0fbe3cff7e6b tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/19f71c27-9dd8-40c7-b8ed-8f33ef980b80" status: 202 len: 0 microversion: 2.1 time: 0.748847 Oct 18 13:29:34.909302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 808/1639] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:29:34 2022] DELETE /compute/v2.1/os-security-groups/19f71c27-9dd8-40c7-b8ed-8f33ef980b80 => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:34.915390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.919897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:34.923283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.923780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.924221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.924957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.925601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.926031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.985889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:35.078853 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5caf1d61-9611-49da-a459-ea6c243fe31e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 204 len: 0 microversion: 2.1 time: 0.404600 Oct 18 13:29:35.079674 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 832/1640] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:34 2022] DELETE /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:29:35.089757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.092348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.101269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.101737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.102215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.103010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.103399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.104187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.148879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.168385 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51c8483c-de68-44f2-8215-9a7d64e16d18 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1216 microversion: 2.1 time: 0.257048 Oct 18 13:29:35.170132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 809/1641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:34 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:35.208034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.212119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.241018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.244209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.247502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.248605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.250119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.250812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.253437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.268124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.269575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.286280 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ed615f7-152e-4d13-bd29-1aa7b449f16d tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1443 microversion: 2.75 time: 0.205569 Oct 18 13:29:35.298563 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 833/1642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:35 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:35.313488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23f50400-c386-4697-acad-a45fb94e00c2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb3352d6280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.541683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.551206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f36028e4-59e4-4bab-a04e-ecdce658a9c5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.380033 Oct 18 13:29:35.551800 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 810/1643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:35 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:35.556778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.562410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.563799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.564485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.565109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.565811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.566301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.566734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.681529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.706488 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b57251b6-c0e2-4d47-b56f-85027f42543e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1267 microversion: 2.1 time: 0.138149 Oct 18 13:29:35.706488 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 811/1644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:35 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:35.706488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.706488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.708138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.708572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.709151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.710097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.710747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23f50400-c386-4697-acad-a45fb94e00c2 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e717ba15-b513-44ca-8746-46dcaa749fdd" status: 202 len: 0 microversion: 2.1 time: 0.410914 Oct 18 13:29:35.711278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.712466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.714278 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 834/1645] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:29:35 2022] DELETE /compute/v2.1/os-security-groups/e717ba15-b513-44ca-8746-46dcaa749fdd => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:35.729894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.732680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.750960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.751622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.752079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.752795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.753260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.753698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.774935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:35.833407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.843614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.844748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:35.845878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1720957c-237f-4d05-b43f-bd615ea9299b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1233 microversion: 2.25 time: 0.126086 Oct 18 13:29:35.846647 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 835/1646] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:35 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1233 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:35.851463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-926963ad-7360-49c1-a836-a9a3cbdc8dcc tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb3352d6790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.136067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c704a19-ea26-4fd9-ac9e-b754da68a48e tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 204 len: 0 microversion: 2.1 time: 0.442438 Oct 18 13:29:36.137326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 812/1647] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:35 2022] DELETE /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:36.146215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.147177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.153458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.154134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.154656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.155476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.156170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.156959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.164726 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-926963ad-7360-49c1-a836-a9a3cbdc8dcc tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/072f46ac-7dae-480a-b278-5a4cc1245d9c" status: 202 len: 0 microversion: 2.1 time: 0.316673 Oct 18 13:29:36.165390 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 836/1648] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:29:35 2022] DELETE /compute/v2.1/os-security-groups/072f46ac-7dae-480a-b278-5a4cc1245d9c => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:36.173574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d222002e-c35a-48a5-bfb3-2d4b932c8110 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] Calling method '.version_select at 0x7fb3352699d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.523499 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d222002e-c35a-48a5-bfb3-2d4b932c8110 tempest-SecurityGroupRulesNegativeTestJSON-1369159799 tempest-SecurityGroupRulesNegativeTestJSON-1369159799-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/32e67f3c-8ae0-4fcc-8275-e65f18449b35" status: 202 len: 0 microversion: 2.1 time: 0.353681 Oct 18 13:29:36.524084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 837/1649] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:29:36 2022] DELETE /compute/v2.1/os-security-groups/32e67f3c-8ae0-4fcc-8275-e65f18449b35 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:36.529027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.529654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.537279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.538094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.538801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.541186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.541284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.541882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.644320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.658225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.670755 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49723321-2f4f-463c-a4f5-4f4154aebc13 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1474 microversion: 2.1 time: 0.529107 Oct 18 13:29:36.671892 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 813/1650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1474 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:36.678713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.683014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.683181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1efd8bc-b3d0-4bb2-9094-f853f2b63ffd tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1208 microversion: 2.1 time: 0.157900 Oct 18 13:29:36.684327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 838/1651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:36.687493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.688379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.689014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.689327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.689631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.690721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.691336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.691915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.704454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.704963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.705415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.706155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.706620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.707054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.741752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.742661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.743461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.745077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lazy-loading 'fault' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:36.837973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.864215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.867278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.875456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7af6ec7-ac93-4c92-9bae-ef448259ca5b tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1448 microversion: 2.75 time: 0.202417 Oct 18 13:29:36.876760 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 814/1652] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:36.882975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.887773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.901780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.908555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.909391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.910799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.911539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.913386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.101669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.117317 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b6ff430-0733-410d-8fd1-6aa010ee962c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.431852 Oct 18 13:29:37.118257 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 839/1653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:37.130000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.132716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.140025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.145417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.146233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.147635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.148278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.149400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.167316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.180343 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd5b47f1-b06f-4b93-839b-ab188e228d79 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1265 microversion: 2.1 time: 0.302048 Oct 18 13:29:37.182418 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 815/1654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:37.659344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.672155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.675049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.678372 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80f355a5-367b-4942-b7e8-d8ef94a1e717 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1241 microversion: 2.25 time: 0.559019 Oct 18 13:29:37.679772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 840/1655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1241 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:37.694593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.695234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.703462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.703983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.704634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.705398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.712678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.713269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.713437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.720663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.721253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.721747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.721885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.722802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.723353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.723856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.944634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.965562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dfe1a5f9-ac26-49ac-9474-b738c534c085 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1208 microversion: 2.1 time: 0.255713 Oct 18 13:29:37.970970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 841/1656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1208 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:37.983661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.984402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.990680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.991217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.991691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.992399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.992876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.993311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.052191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.053136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.064395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.064395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lazy-loading 'fault' on Instance uuid fccf2976-cd0a-4c0c-bbd0-d317302251a2 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:38.185846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.196040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.197521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c3878480453431484cbe05c5d2107ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25a068285474cdfa415f75774fab88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.203001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7ac1052-e6e8-479b-be55-1192e343b5d3 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 200 len: 1448 microversion: 2.75 time: 0.230639 Oct 18 13:29:38.207702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 842/1657] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 1448 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:38.209595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:38.210346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:38.216574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.217309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.217960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.218919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.220067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.220859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.295160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.305618 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b070e8d-b935-45b5-bdf2-8f219bd325e4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1474 microversion: 2.1 time: 0.614917 Oct 18 13:29:38.323537 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 816/1658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1474 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:38.328938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:38.329568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:38.345240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.349721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.349721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.349721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.349721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.350178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.477837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.492027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4803d3c6-21a8-4dc6-a1cf-e755113cbfa9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1265 microversion: 2.1 time: 0.165737 Oct 18 13:29:38.493139 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 817/1659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:38 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:38.710438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:38.711812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:38.731164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.735708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.737785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.740925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.741695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.743338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.935992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.945994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:38.978724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.987475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.995139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96d3a8d1-7b25-432d-802a-562446957634 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1251 microversion: 2.25 time: 0.289332 Oct 18 13:29:38.996970 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 818/1660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:38 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1251 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:39.016141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.017067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.048928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.054551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.063387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.064739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.065240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.065690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.072812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.082531 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68e62d62-c399-4920-be29-cc41c6ee949a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.877183 Oct 18 13:29:39.087809 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 843/1661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:38 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.138087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19022241-d0a1-4ac8-b104-5001819f0e58", "name": "network-vif-deleted", "tag": "4f6c48f2-9cf2-40af-9d84-ddd167b98910"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:39.161182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.162244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.166738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.203188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.214872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] Creating event network-vif-deleted:4f6c48f2-9cf2-40af-9d84-ddd167b98910 for instance 19022241-d0a1-4ac8-b104-5001819f0e58 on n-h2-858383-13 Oct 18 13:29:39.220641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8016301e-3288-4f8c-84ac-9f97fc7c969d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1264 microversion: 2.1 time: 0.220300 Oct 18 13:29:39.221234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 819/1662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:38 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.222178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-eaa651fc-f1b5-4a88-94a2-22dbe921e3a9 req-b51527a6-4bf0-4a54-909c-89ac2048eedc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088477 Oct 18 13:29:39.224440 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 844/1663] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:39.235469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.236326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] [instance: fccf2976-cd0a-4c0c-bbd0-d317302251a2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.248771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.253766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.256264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.257882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.260056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.260847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.305489 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] HTTP exception thrown: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Request method failure captured: Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 HTTP/1.1 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqnerpwV3ipqFg_B9OugSaC0UvV6SggquGg2f2N9irWIAHFc9z2s1HUddBUo1B8AKuZeb5cjIB_nifJrEURf80MJh2Mgu7OIcUOohfVFaIzkT_eb7FlQktFKmCIMe14DZr1-BLwv2khN7NcOWBNH9WV_v0g4J1DpQ47ZnFl3ZiK2_Yo Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.75 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e25a068285474cdfa415f75774fab88f Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdmin275Test-1457139540 Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:39.309795 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e25a068285474cdfa415f75774fab88f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e25a068285474cdfa415f75774fab88f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e25a068285474cdfa415f75774fab88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e25a068285474cdfa415f75774fab88f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdmin275Test-1457139540 Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e25a068285474cdfa415f75774fab88f Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdmin275Test-1457139540 Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdmin275Test-1457139540-project Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8c3878480453431484cbe05c5d2107ce Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdmin275Test-1457139540-project Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. Oct 18 13:29:39.311338 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'fccf2976-cd0a-4c0c-bbd0-d317302251a2'} Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:39.312208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. Oct 18 13:29:39.313488 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:39.314751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] Returning 404 to user: Instance fccf2976-cd0a-4c0c-bbd0-d317302251a2 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:39.314751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d7a9d73-7e78-4337-ba36-d4b23c9ee871 tempest-ServersAdmin275Test-1457139540 tempest-ServersAdmin275Test-1457139540-project] 10.222.0.27 "GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2" status: 404 len: 111 microversion: 2.75 time: 0.087229 Oct 18 13:29:39.316888 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 820/1664] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:39 2022] GET /compute/v2.1/servers/fccf2976-cd0a-4c0c-bbd0-d317302251a2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:29:39.338813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.339715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.349615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.350154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.352948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.353524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.355084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.357640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.514834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.529998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.532430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.552356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1414e98b-8ee4-47d2-8d05-01cbd423b26b tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1304 microversion: 2.1 time: 0.218139 Oct 18 13:29:39.554042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.554556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 845/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:39 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.565751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.566782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.567738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.574893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.575348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.759136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af6a1ce-a052-4fbd-958b-2d08be742e47", "tag": "ff2e1c71-d505-46dc-bdcb-09a1b6faa975"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:39.797419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.797906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.798502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.839517 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] Creating event network-changed:ff2e1c71-d505-46dc-bdcb-09a1b6faa975 for instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 on n-h2-858383-13 Oct 18 13:29:39.853602 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-02550bf5-3a18-4467-b713-5a19d9edf952 req-12779b24-14a9-462b-bc84-685631ce3b8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102885 Oct 18 13:29:39.857338 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 846/1666] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:40.029798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.030374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.044199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.045032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.048748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.053866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.053866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.053866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.094571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:40.201895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.213792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.218077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.220158 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a7c4c44-6fe1-4eb4-8e7c-085b3101089a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1251 microversion: 2.25 time: 0.199086 Oct 18 13:29:40.222023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 847/1667] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1251 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:29:40.239926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.242171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.254238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.285410 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37f3efb1-1b19-4197-950d-b5d6417921c8 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.766837 Oct 18 13:29:40.306371 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 821/1668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:39 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:40.309432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.314290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.318290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.321443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.321775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.322459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.323081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.326560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.329848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.330994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.331457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.332338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.332979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.333427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.491980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.505898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ce670ae-02ac-4a12-93c2-cfbe22f531cb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1282 microversion: 2.1 time: 0.197392 Oct 18 13:29:40.507369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 822/1669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:40.586937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.587974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.607277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.607486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.608045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.608886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.609513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.610642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.656177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.657043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.657715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.658421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid 19022241-d0a1-4ac8-b104-5001819f0e58 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:40.763819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.777015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31efce3f-56de-4f7c-b19c-fa31e735dc41 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 200 len: 1309 microversion: 2.1 time: 0.200209 Oct 18 13:29:40.791196 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 823/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:41.248985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.249768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.265553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.265553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.266453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.267349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.267950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.268523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.402413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.411317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.414824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.414824 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eed9641e-5dfe-4646-a191-4677cd76a72a tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1251 microversion: 2.25 time: 0.169030 Oct 18 13:29:41.427395 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 824/1671] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1251 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:41.439936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.447575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.454805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.455993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.456673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.460020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.461273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.461968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.751125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.762462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-beee8da4-c768-4e52-8905-314828d69857 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.332294 Oct 18 13:29:41.773719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 825/1672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:41.773719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.773719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.779270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.780081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.780952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.781839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.782962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.783662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.789990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:41.919941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.928998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ca698a4-954a-42b2-b386-797cee6d610e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1270 microversion: 2.1 time: 0.164054 Oct 18 13:29:41.932772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 826/1673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:41.941352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.942274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 19022241-d0a1-4ac8-b104-5001819f0e58] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.950800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.951667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.952324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.953249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.953869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.954525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.005933 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 HTTP/1.1 Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:42.007535 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. Oct 18 13:29:42.008986 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '19022241-d0a1-4ac8-b104-5001819f0e58'} Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:42.009796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. Oct 18 13:29:42.012098 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:42.013259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance 19022241-d0a1-4ac8-b104-5001819f0e58 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:42.013259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d70c1415-2f9a-4ce0-aaff-be078cd34986 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58" status: 404 len: 111 microversion: 2.1 time: 0.074329 Oct 18 13:29:42.018492 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 827/1674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/19022241-d0a1-4ac8-b104-5001819f0e58 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:42.026510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfebf7e9-004c-4c7c-91d5-4d543e3ecf32", "tag": "97346f44-0414-4bdf-b397-0c8a898c2b95"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:42.048316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.049334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.051670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.068817 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] Creating event network-changed:97346f44-0414-4bdf-b397-0c8a898c2b95 for instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 on n-h2-858383-13 Oct 18 13:29:42.075011 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3cd69135-6aca-4323-9110-0c7c294ed489 req-37c5ac82-b659-4cb4-b860-20b22b378fba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054788 Oct 18 13:29:42.076332 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 828/1675] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:42.083630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.085055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.093866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.094623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.095449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.096401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.097095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.097693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.191090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:42.208942 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d0d772e-66c7-481a-963a-3cd7e6099e7c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1432 microversion: 2.1 time: 0.129544 Oct 18 13:29:42.210347 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 829/1676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1432 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:42.448775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ed0a4d-41f5-4638-9abb-2963f0d3c74b", "name": "network-vif-deleted", "tag": "ca3fc47a-7b29-4791-b49f-c6eeae6a6614"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:42.467208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.467695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.470966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:42.482928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.483424 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8835c10-5b06-4759-8b49-117cdeb3c8ca tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 2.256088 Oct 18 13:29:42.484073 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 848/1677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:42.498858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.499476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.519475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.519978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.527876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] Creating event network-vif-deleted:ca3fc47a-7b29-4791-b49f-c6eeae6a6614 for instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b on n-h1-858383-13 Oct 18 13:29:42.530762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.536318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.536318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.536318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.547791 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-70c4cada-117a-42c5-889f-ba681572ab14 req-9c841cd2-904f-445f-8ab7-7bb23702cce8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334554 Oct 18 13:29:42.551545 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 830/1678] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:42.788289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.789075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.810735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.815816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.815816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.815816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.815816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.816279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.885306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:43.433912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.444315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.450951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.454851 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ae7e49bd-2f18-4c55-bd84-53e426d41c73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1293 microversion: 2.25 time: 0.967646 Oct 18 13:29:43.462776 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 849/1679] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1293 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:43.472644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.478483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.491387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:43.493150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.493825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.494495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.501998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.501998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.501998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.538487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.548452 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58d93cd1-5833-4072-8cfb-bceb099dad8f tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.765303 Oct 18 13:29:43.568463 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 831/1680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:43.575595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.576476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.583342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.584206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.584817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.585721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.586393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.587053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.625077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.627026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.627877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.628546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid 95ed0a4d-41f5-4638-9abb-2963f0d3c74b {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:43.690846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=20 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:43.742748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.758781 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a982bc21-09e2-449b-a17c-0a80941a70bf tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 200 len: 1309 microversion: 2.1 time: 0.187327 Oct 18 13:29:43.774085 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 832/1681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:43.774085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.774085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.784583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.785095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.785887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.786923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.787505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.787948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.831187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.856317 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1fbd2022-c484-415a-bf13-12b7fe7ddfeb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1270 microversion: 2.1 time: 0.389903 Oct 18 13:29:43.883070 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 850/1682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1270 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:44.158973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:44.173041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ca28f9f-a3b8-406f-a4de-921c52cd2836 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.406796 Oct 18 13:29:44.173757 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 833/1683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:44.492325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:44.492878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:44.505340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.505845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.506395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.507085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.507550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.508011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.845831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:44.849744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:44.872866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.875361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.876052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.878918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.881655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.886263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.041779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.057765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.066023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.086692 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c02810b9-218d-4b45-8e58-46b7ea8bed79 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1293 microversion: 2.25 time: 0.599208 Oct 18 13:29:45.090440 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 851/1684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:44 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1293 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:45.104026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.104026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 95ed0a4d-41f5-4638-9abb-2963f0d3c74b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.112987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.113497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.113951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.114762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.115494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.115934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.157745 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b HTTP/1.1 Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:45.159478 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. Oct 18 13:29:45.160854 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '95ed0a4d-41f5-4638-9abb-2963f0d3c74b'} Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:45.161647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. Oct 18 13:29:45.170462 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:45.171859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance 95ed0a4d-41f5-4638-9abb-2963f0d3c74b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:45.171859 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4e2173a-a651-4a03-897d-cb25045ab980 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b" status: 404 len: 111 microversion: 2.1 time: 0.069571 Oct 18 13:29:45.171859 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 852/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/95ed0a4d-41f5-4638-9abb-2963f0d3c74b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:45.171859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.174189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.189391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.189918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.190408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.191134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.191599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.192035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.250681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.264176 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ebc7f183-b7ee-4cb3-bd65-d20a9fdf1b69 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.693145 Oct 18 13:29:45.265696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 834/1686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:44 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:45.281606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2dc23637-d24e-4799-a69a-86b8dddf11cc tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.411435 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2dc23637-d24e-4799-a69a-86b8dddf11cc tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9e4c7ddd-ff07-4303-a5c2-608e6e12d7a0" status: 204 len: 0 microversion: 2.1 time: 0.143530 Oct 18 13:29:45.412032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 835/1687] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:29:45 2022] DELETE /compute/v2.1/os-server-groups/9e4c7ddd-ff07-4303-a5c2-608e6e12d7a0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:45.421766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.423824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.439877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.443209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.445317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.446578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.448566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.450638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.718481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.738190 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d801ede2-3d73-4049-a1b2-82ef2d8e6181 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.317883 Oct 18 13:29:45.739558 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 836/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:45.754969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.755832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.762623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.763127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.763582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.764307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.764811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.765248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.821881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:45.859363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:46.218416 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d528b03d-1e7b-4ebc-9ec7-cba7d93a3640 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 204 len: 0 microversion: 2.1 time: 0.476886 Oct 18 13:29:46.222534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 837/1689] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:45 2022] DELETE /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:46.230898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.232095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.239838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:46.242069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.242882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.243816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.245115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.246607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.247346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.484653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:46.489088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:46.497298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f7ed0eb-ae17-43ba-bbcf-67b853b06f71 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 1.334440 Oct 18 13:29:46.513145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:46.513145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:46.513145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-282ab79b-8910-43d0-b1aa-eeea817dd1ae tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1293 microversion: 2.25 time: 0.280303 Oct 18 13:29:46.513594 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 838/1690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:46 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:46.514085 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 853/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:46.520039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.520831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.523414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.525104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.528632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.529297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.529943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.530878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.531511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.532116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.538547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.539053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.541966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.542790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.545251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.545728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.576763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:46.880744 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d2dfd83-a895-4128-a964-66cd52b820b4 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 204 len: 0 microversion: 2.1 time: 0.366486 Oct 18 13:29:46.883022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 839/1692] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:46 2022] DELETE /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:46.892568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.893302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.910202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.910710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.911171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.911892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.914783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.917702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.031452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.041327 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06ed6c09-2840-4ff3-b465-6de3abf319a6 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.525929 Oct 18 13:29:47.050444 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 854/1693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:46 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.063218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:47.072555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:47.089026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.091731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.092197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.092941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.103639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.103639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.298527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.310324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d5ac7f7-efaa-40aa-a7a7-4ad0f07fc075 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.422047 Oct 18 13:29:47.311506 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 840/1694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:46 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.511313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.520813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:47.521666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:47.528943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5789dc61-0df5-47a0-b50a-c089828d28e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1475 microversion: 2.1 time: 0.476965 Oct 18 13:29:47.530301 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 855/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:47 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.531478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.531982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.532444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.533135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.533602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.534045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.547660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:47.548533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:47.574895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.574895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.574895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.574895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.575294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.575294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.872654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.884246 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdb66cca-154a-4a88-89b1-5f7a994efd2c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 0.364119 Oct 18 13:29:47.886218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 841/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:47 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:47.892460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6", "tag": "46518faf-642f-4adf-acb1-1c4d7e4b35ff"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:47.903864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.904557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.905177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.917915 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] Creating event network-changed:46518faf-642f-4adf-acb1-1c4d7e4b35ff for instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 on n-h1-858383-13 Oct 18 13:29:47.923318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3b1f8869-828e-4eaf-bbd6-b3bc48a6191c req-cb9c818f-0158-49dc-96fb-143202d92d41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034481 Oct 18 13:29:47.924596 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 842/1697] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:47.931145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af6a1ce-a052-4fbd-958b-2d08be742e47", "name": "network-vif-plugged", "status": "completed", "tag": "ff2e1c71-d505-46dc-bdcb-09a1b6faa975"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:47.942418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.943100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.943695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.974489 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] Creating event network-vif-plugged:ff2e1c71-d505-46dc-bdcb-09a1b6faa975 for instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 on n-h2-858383-13 Oct 18 13:29:47.974760 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-442b1c0b-6700-4b10-af07-ce49e1dd3206 req-7695ba26-3a3a-43aa-ae2a-3850e7dab494 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048598 Oct 18 13:29:47.975932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 843/1698] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:48.077775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.084358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.086473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.108664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.113119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.114364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.116437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.117070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.117494 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4b29949-e0c4-4b7a-8a43-b8be46308f33 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1293 microversion: 2.25 time: 0.580263 Oct 18 13:29:48.118433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.140296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 856/1699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:47 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1293 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:48.148103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.149053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.336361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.336361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.343781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.346100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.346100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.346100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.346100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.348396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.640622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.655805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4162a8eb-b8d7-4d33-916b-3cb7e871022c tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.583812 Oct 18 13:29:48.656891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 844/1700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:48.672937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.675406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.688587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.689741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.691526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.692626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.695805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.696446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.721992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.742409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bef766a-bcb5-44f7-bef4-2889abe8ff0f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1310 microversion: 2.1 time: 0.412481 Oct 18 13:29:48.743972 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 857/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1310 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:48.920878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.922085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.941243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.941243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.941521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.942873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.943804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.947130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.350436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:49.361277 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94abbafb-6dd4-41eb-89b6-d421faded514 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1475 microversion: 2.1 time: 0.703000 Oct 18 13:29:49.367992 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 845/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1475 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:49.390385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:49.392879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:49.417196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.420556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.421060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.421990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.422504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.422946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.084801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.099564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.102335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.104664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a031f10-96fd-409d-a364-365b8c8dfd5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.734323 Oct 18 13:29:50.105766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 846/1703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:49 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:50.113208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.114146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.137337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.139074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.140254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.144241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.145730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.151787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.811370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.856326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57314ae7-c4c2-4929-afb6-198442bf5136 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 1.945621 Oct 18 13:29:50.856803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 858/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:50.861495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.878251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.898887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.899400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.906770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.911166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.911166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.911166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.911418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.945136 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a45efb5c-6a27-45eb-942f-df7c6d5ca4dc tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.830038 Oct 18 13:29:50.946774 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 847/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:50.960130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:50.995494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.997060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.998181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.044312 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] Creating event network-changed:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:29:51.080413 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b78fcb6c-fe9b-4460-9182-8f47826c0a60 req-ac07f551-bf61-489f-a612-fbbaad0ce0da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131677 Oct 18 13:29:51.084059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 848/1706] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:51.716850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1520772698", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:51.795131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:51.918666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:51.929898 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a9deddd-628c-4057-804d-900b8e498c93 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1494 microversion: 2.1 time: 1.072019 Oct 18 13:29:51.936731 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 859/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1494 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:51.951120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:51.955211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:51.972060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.976366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.977062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.978412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.980702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.981524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.399016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:52.400885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:52.404168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:52.404957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:52.406495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:52.426612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.427318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.428341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.430412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.431226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.435949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.438935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.449464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9122bc46-5cc7-41e6-abc2-f5af062c910c tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1475 microversion: 2.1 time: 0.511272 Oct 18 13:29:52.457071 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 860/1708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:51 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:52.468117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f197a8-adff-400a-85f0-5a61d9677006", "name": "network-vif-deleted", "tag": "3b35b9d9-9128-4a86-8aad-a8366b499599"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:52.479229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:52.491130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for user d54a9109295b426ba1060c63bfb230ed and project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:52.493104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.503654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.503654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.536804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:52.550682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:52.565125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] Creating event network-vif-deleted:3b35b9d9-9128-4a86-8aad-a8366b499599 for instance 82f197a8-adff-400a-85f0-5a61d9677006 on n-h1-858383-13 Oct 18 13:29:52.584056 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-68a90008-6545-4d7a-90fe-af457a2541c6 req-a7e7edf9-346f-4cab-b812-86c8e17b9b1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125136 Oct 18 13:29:52.586758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 861/1709] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:52.604953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.606364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.623952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.624660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.625277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.626189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.626834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.627432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.786738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e558b23f-cd21-4789-a9f1-d7c382172a4c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700932 Oct 18 13:29:52.789303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 849/1710] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:52.815701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.817749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.849832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.852212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.853104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.854088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.854726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.855555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.901609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.915229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.919830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.941662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b79e6c3f-4505-405d-a7f4-4365c10bfa35 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.352769 Oct 18 13:29:52.950521 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 862/1711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:52.984791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.988939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.005992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.007883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.010596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.012162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.015272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.015933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.238170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:53.254674 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-34e3459a-f215-4157-a00b-41ed4b71b3c6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 0.461895 Oct 18 13:29:53.278859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 850/1712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.289188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.289817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.297167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.298009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.298662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.299793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.300447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.301054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.399549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea284a1b-5538-4e04-93e2-cb70cb937443 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1647 microversion: 2.1 time: 0.447899 Oct 18 13:29:53.411293 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 863/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1647 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.440674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfebf7e9-004c-4c7c-91d5-4d543e3ecf32", "name": "network-vif-plugged", "status": "completed", "tag": "97346f44-0414-4bdf-b397-0c8a898c2b95"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:53.477247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.479782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.481477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.502781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] Creating event network-vif-plugged:97346f44-0414-4bdf-b397-0c8a898c2b95 for instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 on n-h2-858383-13 Oct 18 13:29:53.502930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:53.509540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-42eb3429-8acd-41a2-87c9-8af78c51bb70 req-02a4e0e0-89ea-41a8-beb4-74db574a2f26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089680 Oct 18 13:29:53.510860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 864/1714] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:53.518939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1678617960", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:53.522798 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df5d696f-6b40-4222-8ec5-59765b3997ed tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.242734 Oct 18 13:29:53.525098 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 851/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.540410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295bbcca-5871-4473-9014-e4ed61b8c61b", "name": "network-vif-deleted", "tag": "e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:53.553524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.554383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.556287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.575016 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] Creating event network-vif-deleted:e056d7c2-2c91-4cda-bacd-c2e5c84d6ed3 for instance 295bbcca-5871-4473-9014-e4ed61b8c61b on n-h1-858383-13 Oct 18 13:29:53.582716 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a3fa534f-ab8c-4ddb-868f-d047e3c74d54 req-9fefd051-8194-4206-aad8-d6d62f518585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055402 Oct 18 13:29:53.584043 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 852/1716] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:53.597933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.597933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.613071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:53.617406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.618276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.618858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.620039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.620731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.621464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.911714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b782b8bb-f20a-4018-917b-edc53e231422 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1647 microversion: 2.1 time: 0.324960 Oct 18 13:29:53.928782 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 853/1717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1647 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.934031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.934805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.942973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.943550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.944007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.944727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.945194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.945849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.016484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.027709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b44ec03b-b78d-41e2-b7c0-8cd07212c4e2 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1304 microversion: 2.1 time: 0.113758 Oct 18 13:29:54.028398 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 854/1718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:54.033060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.037770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.038542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.039191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.040175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.040873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.041525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.050288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:54.082309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-057fa979-b786-4fbb-9bbf-34918a12a9b2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052828 Oct 18 13:29:54.083450 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 855/1719] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:54.098662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.099541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.107810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.108601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.109426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.110739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.111793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.112484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.277073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.289616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.292316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.292596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59ec9eb7-04a0-47e9-a0d3-ad25662d0b94 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.207774 Oct 18 13:29:54.310161 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 856/1720] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:54.311940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:54.312486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.320233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.320773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.321210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.321908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.322401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.322852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.400784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:54.401839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:54.402368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:54.402785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:54.403828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:54.413518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.414015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.414496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.415239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.415706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.416145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.434453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:54.440421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for user d54a9109295b426ba1060c63bfb230ed and project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:54.457028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:54.459743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:54.629375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19d60d44-ed6d-4ed6-b5c7-087d578abbd4 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47/action" status: 202 len: 0 microversion: 2.1 time: 0.323342 Oct 18 13:29:54.632239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 857/1721] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:54 2022] POST /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:54.647106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.648395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.673457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98612541-63d9-4562-bd3d-f1e58f983fbf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161058 Oct 18 13:29:54.674855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 865/1722] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:54.679769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.681058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.692198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.692831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.693556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.694439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.695022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.695632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.696425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.696976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.697268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.705061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.705929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.717935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.939548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.951297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:54.979183 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-139c628a-37fd-4fd8-a831-aa269f09e878 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1307 microversion: 2.1 time: 0.303277 Oct 18 13:29:54.982029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 866/1723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:54.988774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.989669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.000725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.002003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.002706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.003803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.004438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.005042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.145071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.158612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0b8f4dc-9a47-4083-b201-01289a88efb6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 0.524479 Oct 18 13:29:55.170087 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 858/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:55.170087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-200a9468-d89f-4b2a-9278-a3c5f352829f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.170087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-200a9468-d89f-4b2a-9278-a3c5f352829f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.252771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-200a9468-d89f-4b2a-9278-a3c5f352829f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.291230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-200a9468-d89f-4b2a-9278-a3c5f352829f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1214 microversion: 2.1 time: 0.122759 Oct 18 13:29:55.300556 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 859/1725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:55.329660 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2bb9920e-2eaf-4644-8b32-0d03a9944fcc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1652 microversion: 2.1 time: 0.345626 Oct 18 13:29:55.330846 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 867/1726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1652 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:55.337645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.338645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.348941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.349963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.362266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.363462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.363926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.364648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.365119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.365817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.376795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.377838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.379177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.381386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.385119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.386775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.499389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.499967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.500654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.501349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid 295bbcca-5871-4473-9014-e4ed61b8c61b {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:55.549219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.558438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.559356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.561226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.566916 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc48d1bc-23fb-4a5e-a291-de9cf0583544 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.230269 Oct 18 13:29:55.566916 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 868/1727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:55.575050 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8dc7c4e-9aa5-4514-a5ac-c48941def98d tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 200 len: 1309 microversion: 2.1 time: 0.266459 Oct 18 13:29:55.578548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 860/1728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:56.007890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.008920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.018187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.019057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.019661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.020570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.021279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.021879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.185581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.187217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.196883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.204810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.204810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.204810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.204810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.205496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.262209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.273763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45d0bc6e-1d4c-4f31-9b19-a0f2ba75a52b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1487 microversion: 2.1 time: 0.265486 Oct 18 13:29:56.274828 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 869/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1487 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:56.303531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1907550628"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:56.308234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.314036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.314588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.315467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.316409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.316930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.317540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.587268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.609070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d420982-da84-4e73-8b7e-9a6a345ce1a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 0.427238 Oct 18 13:29:56.622212 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 861/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:56.622212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.622212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.622212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.622687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.622925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.623635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.624239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.624680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.690222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.698083 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a6620f5-f32e-4387-a2ed-0a306c3a4cb5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1218 microversion: 2.1 time: 0.087312 Oct 18 13:29:56.699456 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 862/1731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:56.733768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.734441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.743741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.744446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.744908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.751461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.752004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.762456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.852605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7a3ac7e-51a8-4be3-975f-2d0e456b8aa7 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "POST /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32/action" status: 202 len: 0 microversion: 2.1 time: 0.553092 Oct 18 13:29:56.859346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 870/1732] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:56 2022] POST /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:29:56.878745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.879470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.906536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.910498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.911310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.912503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.913996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.914804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.187814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:57.201990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:57.203810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:57.205965 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c96cf8b9-7f62-4c24-9172-b03bced2f20c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.337861 Oct 18 13:29:57.206893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 871/1733] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:57.236417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.237112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 295bbcca-5871-4473-9014-e4ed61b8c61b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:57.258801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.262079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.262913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.264079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.264720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.265355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.286596 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b HTTP/1.1 Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:57.288870 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. Oct 18 13:29:57.290634 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '295bbcca-5871-4473-9014-e4ed61b8c61b'} Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:57.291562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. Oct 18 13:29:57.294048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.299053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance 295bbcca-5871-4473-9014-e4ed61b8c61b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:57.300129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83415c29-7236-45c6-b981-90bcecc83222 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b" status: 404 len: 111 microversion: 2.1 time: 0.092279 Oct 18 13:29:57.301417 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 872/1734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/servers/295bbcca-5871-4473-9014-e4ed61b8c61b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:57.308899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18ea1c04-8b46-4983-888f-986ca708a647 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33125f5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.376852 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18ea1c04-8b46-4983-888f-986ca708a647 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1" status: 200 len: 1412 microversion: 2.1 time: 0.074061 Oct 18 13:29:57.377631 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 873/1735] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:57.383583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-plugged", "status": "completed", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:57.396155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.396876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.397495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.418955 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1c83968-43ec-4cf5-8034-48223295a94c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1632 microversion: 2.1 time: 0.718043 Oct 18 13:29:57.420918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 863/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1632 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:57.427202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.428419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: 82f197a8-adff-400a-85f0-5a61d9677006] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:57.435444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.436438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.437107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.439019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.439732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.443165 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] Creating event network-vif-plugged:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:29:57.449425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-db013656-2154-4d7a-90e0-6c2a6ca6fe16 req-9aa4fdce-0e0d-48a7-ac39-361bfbadf27e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070113 Oct 18 13:29:57.450383 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 874/1737] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:57.454117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.457119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b15a773-8249-45cb-a2e8-0801d641f898 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb33125f4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.533874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. Oct 18 13:29:57.538269 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b15a773-8249-45cb-a2e8-0801d641f898 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1" status: 200 len: 1412 microversion: 2.1 time: 0.084485 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 HTTP/1.1 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:29:57.545080 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. Oct 18 13:29:57.546587 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '82f197a8-adff-400a-85f0-5a61d9677006'} Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:57.547338 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. Oct 18 13:29:57.548586 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:29:57.549741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance 82f197a8-adff-400a-85f0-5a61d9677006 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:57.549741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2450a08-cf8c-45b0-8aab-209b058e9707 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006" status: 404 len: 111 microversion: 2.1 time: 0.123775 Oct 18 13:29:57.550601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 864/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/servers/82f197a8-adff-400a-85f0-5a61d9677006 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:57.551974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 875/1739] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:57.558585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14fd4e4a-67ba-4ea7-891d-347456eb63e1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb335269b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.559724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": true, "disk_over_commit": false}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:57.565218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:57.575453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.576140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.576811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.577659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.578270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.579454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.630161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lazy-loading 'flavor' on Instance uuid 5af6a1ce-a052-4fbd-958b-2d08be742e47 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:57.659382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Going to try to live migrate instance to n-h1-858383-13 {{(pid=121010) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:29:57.979174 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14fd4e4a-67ba-4ea7-891d-347456eb63e1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1" status: 204 len: 0 microversion: 2.1 time: 0.425672 Oct 18 13:29:57.980634 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 876/1740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:57 2022] DELETE /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:57.989799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e08b5596-9880-4ebb-86f4-bae051b15639 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.010250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:58.126196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e08b5596-9880-4ebb-86f4-bae051b15639 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/eea054df-817f-4a58-9d08-7f395055b92c" status: 204 len: 0 microversion: 2.1 time: 0.143899 Oct 18 13:29:58.127338 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 877/1741] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:29:57 2022] DELETE /compute/v2.1/os-server-groups/eea054df-817f-4a58-9d08-7f395055b92c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:58.133374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.134251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:58.142285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.142886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.143568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.144404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.145093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.145672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.315431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:58.326879 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f990108e-5356-493e-9859-fcf4183e2140 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1312 microversion: 2.1 time: 0.198069 Oct 18 13:29:58.327704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 878/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:58.341945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.342808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:58.350794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.351574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.352055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.352785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.353339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.353947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.447320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:58.477516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b720599-58b9-47ab-a5b3-798dd7ff715c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1266 microversion: 2.1 time: 0.148056 Oct 18 13:29:58.482307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 879/1743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:58.489443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7410d41f-e6fe-4d96-a8f0-381ed6500df0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3352d6a60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.519213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7410d41f-e6fe-4d96-a8f0-381ed6500df0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7410d41f-e6fe-4d96-a8f0-381ed6500df0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 HTTP/1.1 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:29:58.522293 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '381ea8b4-62fc-4bcf-850b-d3be1c65b4e1'} Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:58.523980 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 Oct 18 13:29:58.525143 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:29:58.528860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 could not be found. Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:29:58.536572 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7410d41f-e6fe-4d96-a8f0-381ed6500df0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:58.538103 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7410d41f-e6fe-4d96-a8f0-381ed6500df0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1" status: 404 len: 62 microversion: 2.1 time: 0.044394 Oct 18 13:29:58.539438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 880/1744] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:29:58.545998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.551649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:58.565400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.570004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.570507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.582069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.582069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.582069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.626475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:59.057575 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-091192bd-b9db-46d3-92f7-d699b86e2b54 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 204 len: 0 microversion: 2.1 time: 0.522124 Oct 18 13:29:59.059072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 881/1745] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:58 2022] DELETE /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:59.064735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:59.065708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:59.083356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.083964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.084631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.085605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.086314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.086890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.610427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:59.624874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:59.626392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:59.627553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1e75d7e-d141-4a49-94c4-620fa3fb24bd tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.567185 Oct 18 13:29:59.649550 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 882/1746] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:29:59 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:29:59.660225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:59.661103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:59.676415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.677188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.683603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.684597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.685248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.685858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.102218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:00.111913 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b8e3e9a6-d8cb-40ba-a4ee-6e636c1e7bd1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1505 microversion: 2.1 time: 0.461083 Oct 18 13:30:00.117157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 883/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:59 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:00.122943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:00.129448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:00.155157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.158014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.158694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.165457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.167479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.172738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.601965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:00.613076 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-426850cd-dfa7-49bc-8e2d-8fc8a1956d40 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1473 microversion: 2.1 time: 0.494530 Oct 18 13:30:00.613689 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 884/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:00 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:00.629271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:00.629862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:00.648632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.649149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.649599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.658551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.658978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.664614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.313516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:01.323336 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a01a68c-ba1c-4d63-8c93-65febd7e9092 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1462 microversion: 2.1 time: 0.708521 Oct 18 13:30:01.351830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 885/1749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:00 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1462 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:01.359449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:01.360624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:01.383004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.383545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.384003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.394932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.395560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.396025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.986639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:01.998215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:02.002204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-721e510a-3f61-4712-8598-80f1637a1b1f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.649117 Oct 18 13:30:02.002813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 886/1750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:01 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:02.008612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.009461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:02.016653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.018180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.018856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.024941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.024941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.024941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.882228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:02.898970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:02.902646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:02.906536 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fb08657-c8f2-49bd-a2d2-f8e34845096b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.902124 Oct 18 13:30:02.910365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 887/1751] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:02 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:02.913372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.922449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:02.954389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.954948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.955413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.956154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.956615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.971148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.588415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:03.603810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-253e00c7-e962-428e-bb17-8117fdff5c82 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1487 microversion: 2.1 time: 0.695124 Oct 18 13:30:03.643685 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 888/1752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:02 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1487 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.658116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.658799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.666983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.673243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.674122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.677643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.678671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.680062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.682255 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4be72084-000c-4a08-902e-c97572e658cc tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47/action" status: 202 len: 0 microversion: 2.1 time: 6.130179 Oct 18 13:30:03.683428 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 865/1753] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:57 2022] POST /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47/action => generated 0 bytes in 6132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:03.694142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.695084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.703062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.703843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.706082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.707019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.707712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.708489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.799987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:03.810259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea04978a-b3c9-4f09-9a28-710606fa4713 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1431 microversion: 2.1 time: 0.123933 Oct 18 13:30:03.837167 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 866/1754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1431 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.854021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:03.874276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.875566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.876958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.899539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] Creating event network-changed:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:30:03.912046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8b850924-14d3-49a3-af3d-a97ce5a22c61 req-4f602a01-ee11-40c2-a443-fa6c719d43bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073250 Oct 18 13:30:03.914169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 867/1755] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:03.928728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.933302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.945371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.950048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.951328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.952414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.952972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.953482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.051483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:04.160851 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86a3f426-5492-45f9-a0c4-a4ec0cdcd510 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1615 microversion: 2.1 time: 0.513545 Oct 18 13:30:04.174974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 889/1756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1615 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:04.196328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:04.198934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.202540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:04.206537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.207395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.208242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.209213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.210670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.211465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.217276 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5479b1e9-1d79-4857-b1c5-53f1a65fad9f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.300463 Oct 18 13:30:04.218487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 868/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:04.224768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:04.225684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.232802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.233572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.238963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.238963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.238963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.238963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.272157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:04.424069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:04.456548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:04.528407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:04.537805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9a5ce75-b4df-45bf-916f-9df8fde91c0a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.317971 Oct 18 13:30:04.552750 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 869/1758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:04 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:04.564881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d14076-e2e9-4374-b7c3-81beb54bdf78", "name": "network-vif-deleted", "tag": "ce5b1d38-c9c4-4e93-b768-2534aa44c142"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:04.579995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.580915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.582088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.642495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] Creating event network-vif-deleted:ce5b1d38-c9c4-4e93-b768-2534aa44c142 for instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 on n-h1-858383-13 Oct 18 13:30:04.654108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2c766f1f-836e-4ebf-8e34-8bbac9860677 req-28b4ca66-bff3-40d8-9c5d-2a0c69335b3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099057 Oct 18 13:30:04.656117 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 870/1759] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:04.666600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:04.670488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.685006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.690579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.690964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.691796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.692261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.692698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.789128 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd804b01-45fd-40df-bb51-8ccec2c8616a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 204 len: 0 microversion: 2.1 time: 0.604457 Oct 18 13:30:04.790018 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 890/1760] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:04 2022] DELETE /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:04.801711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:04.803555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.820873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.826146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.826146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.826146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.826146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.826592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.009613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8ff684c96ea4fc9beee82ff1c825ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3aea217bc34d51b6816c2f220d1c5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.009613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] flavor_id is None. Assuming migration. {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:30:05.009613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:30:05.076173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.088835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.091283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.092457 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ceb989c-8a02-4144-99be-71267a54ba40 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.430179 Oct 18 13:30:05.093030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 871/1761] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:04 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:05.106956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfebf7e9-004c-4c7c-91d5-4d543e3ecf32", "name": "network-vif-plugged", "status": "completed", "tag": "97346f44-0414-4bdf-b397-0c8a898c2b95"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:05.140585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.142082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.142082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.169019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:05.177076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] Creating event network-vif-plugged:97346f44-0414-4bdf-b397-0c8a898c2b95 for instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 on n-h2-858383-13 Oct 18 13:30:05.199892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-884549e4-1cc8-4545-bafb-544400002ce4 req-bc08d59b-2636-4e5f-8d99-60916c06ca2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105581 Oct 18 13:30:05.200519 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 872/1762] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:05.212337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b7800d7-06a0-462e-9bce-8d81eb6b0851 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3312383a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.258825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:05.291930 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8b7800d7-06a0-462e-9bce-8d81eb6b0851 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b7800d7-06a0-462e-9bce-8d81eb6b0851 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 HTTP/1.1 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:30:05.294440 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '381ea8b4-62fc-4bcf-850b-d3be1c65b4e1'} Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:05.295973 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 to delete Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.297034 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 could not be found. Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:05.298478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b7800d7-06a0-462e-9bce-8d81eb6b0851 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b7800d7-06a0-462e-9bce-8d81eb6b0851 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1" status: 404 len: 62 microversion: 2.1 time: 0.094424 Oct 18 13:30:05.299806 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 873/1763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:05 2022] DELETE /compute/v2.1/images/381ea8b4-62fc-4bcf-850b-d3be1c65b4e1 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:30:05.306925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.308383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:05.318559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.324128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.324128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.324128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.324128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.324690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.414404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:05.426767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.427283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.427760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.428239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lazy-loading 'fault' on Instance uuid b2d14076-e2e9-4374-b7c3-81beb54bdf78 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:05.500336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f8b851f06d4b038a147c7dd873cb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f5cd093b94c4161bed82c6495bc37be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.507610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3392ffc4-3e39-4978-aca2-9d16b0e3c4b6 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 200 len: 1307 microversion: 2.1 time: 0.210022 Oct 18 13:30:05.518370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 874/1764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:05 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:05.518370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.518370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:05.534892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.535418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.535875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.536852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.537336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.540418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.771575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.781095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccf2dd2c-04e3-468f-b4a6-737aba11793e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.270705 Oct 18 13:30:05.782420 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 875/1765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:05 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:05.787578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.788369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:05.794847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.795648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.796362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.797323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.797901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.798439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.827288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:06.027484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59cb62a0-04b1-4794-8ee9-8597d948fbfe tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c/action" status: 202 len: 0 microversion: 2.1 time: 1.232497 Oct 18 13:30:06.030159 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 891/1766] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:04 2022] POST /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c/action => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:06.041502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Instance is already in deleting state, ignoring this request Oct 18 13:30:06.041502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f51b13ed-69cb-484f-97eb-8a10bdf78310 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 204 len: 0 microversion: 2.1 time: 0.256804 Oct 18 13:30:06.043017 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 876/1767] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:05 2022] DELETE /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:06.048552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.049017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.052780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf22771-4aae-462f-8e75-e1f055cc1551", "tag": "851050bd-edcd-458c-b9dc-c52489993c33"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:06.065885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.066767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.068259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.080693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.081244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.084931 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] Creating event network-changed:851050bd-edcd-458c-b9dc-c52489993c33 for instance 5cf22771-4aae-462f-8e75-e1f055cc1551 on n-h2-858383-13 Oct 18 13:30:06.086584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.087482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.088973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.090902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.094269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7598c382-38da-4bc0-a0b9-f5f7860e7434 req-aee93341-278e-4ac7-96f7-f27e577bab28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049586 Oct 18 13:30:06.095947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 877/1768] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:06.114624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.116872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.130189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.131034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.133282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.134294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.134983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.136528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.300115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.308999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.310037 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e3c6869-d045-497c-be62-9b86397446a2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 0.203007 Oct 18 13:30:06.311006 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 878/1769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.316818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.329896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.333191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8a0a61d7-60d9-46f9-b3c2-0bb9db01d674 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.301894 Oct 18 13:30:06.333796 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 892/1770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.338104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.338675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.339148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.339869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.340351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.340824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.352763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.352763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.368413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.369156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.371248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.373230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.373937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.375774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.890383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.905108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5519c71-b3a6-4fb6-8ddb-d4eec65a81a0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1493 microversion: 2.1 time: 0.593021 Oct 18 13:30:06.905962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 879/1771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1493 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.919986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.921010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] [instance: b2d14076-e2e9-4374-b7c3-81beb54bdf78] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.932965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.932965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.932965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.932965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.933321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.933321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.978280 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] HTTP exception thrown: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Request method failure captured: Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 HTTP/1.1 Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqlt3VPYZByv6EyF9H8kDRJ2vfLvbKP27_LX-EoPfYUnuM3rQsCM79ZrSQ6lVqNB0mNsidTAqt7QQtSGpmqPyPHbKThQEY89EFCHljQzWFrPuvKuY99rt0YW2vIqsxjgcXjOchEOFaDGtjkXIPLF9V0F64DgsGP4xxqn9VFqrCIZ-RY Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:30:06.987751 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f5cd093b94c4161bed82c6495bc37be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9f5cd093b94c4161bed82c6495bc37be Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1019259091 Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 92f8b851f06d4b038a147c7dd873cb34 Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersOnMultiNodesTest-1019259091-project Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. Oct 18 13:30:06.989395 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'b2d14076-e2e9-4374-b7c3-81beb54bdf78'} Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:06.990622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. Oct 18 13:30:06.992888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.995594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] Returning 404 to user: Instance b2d14076-e2e9-4374-b7c3-81beb54bdf78 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:06.995594 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39f0e355-1b3b-4da3-97dc-d846a2f81322 tempest-ServersOnMultiNodesTest-1019259091 tempest-ServersOnMultiNodesTest-1019259091-project] 10.222.0.27 "GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78" status: 404 len: 111 microversion: 2.1 time: 0.082224 Oct 18 13:30:06.995594 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 880/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/b2d14076-e2e9-4374-b7c3-81beb54bdf78 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:07.013972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:07.014640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:07.041620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.042925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.043564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.044463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.045111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.045713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.081164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:07.095412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:07.099468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:07.101141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e3c6ff7-6047-4a45-8e51-81c6dd62057d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.766316 Oct 18 13:30:07.133292 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 893/1773] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:07.246589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfebf7e9-004c-4c7c-91d5-4d543e3ecf32", "name": "network-vif-unplugged", "status": "completed", "tag": "97346f44-0414-4bdf-b397-0c8a898c2b95"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:07.287004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.288508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.288974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.335599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] Creating event network-vif-unplugged:97346f44-0414-4bdf-b397-0c8a898c2b95 for instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 on n-h2-858383-13 Oct 18 13:30:07.348291 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bdde86b7-6e73-48d0-b06d-175672f33021 req-3451770f-e2df-4c40-8a1f-e5e9443f5e5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105523 Oct 18 13:30:07.351255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 894/1774] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:30:07.357612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:07.358639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:07.369255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.369255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.369255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.369255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.370307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.370666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.369798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:08.393451 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab46c8c0-77eb-445b-9a98-49888d0a1c56 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 1.396816 Oct 18 13:30:08.394156 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 881/1775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:08.413182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:08.413816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:08.436396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.436901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.441712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.444062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.445178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.446444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.897620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:08.921472 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cbc86a31-8220-403a-915d-5b0a9bc372c4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 1.554716 Oct 18 13:30:08.925351 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 895/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:07 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:08.935171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:08.936095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:08.964791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.971316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.972141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.976431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.982986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.982986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.195061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.207919 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-edf19575-6782-4ad7-95ae-16dbe781c601 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.812629 Oct 18 13:30:09.211183 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 882/1777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:08 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:09.224069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.225239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:09.241911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.243569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.244385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.247991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.249557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.251031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.585828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.615833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.617126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.634331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.634331 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e082cf92-be13-4e13-839b-3a826792ebdb tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.407369 Oct 18 13:30:09.645092 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 883/1778] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:09.651172 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ab7374fc-b30f-45f3-96da-d13cbb0c0903 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1493 microversion: 2.1 time: 0.717686 Oct 18 13:30:09.651172 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 896/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:08 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1493 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:09.664959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.672718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:09.680837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6", "name": "network-vif-plugged", "status": "completed", "tag": "46518faf-642f-4adf-acb1-1c4d7e4b35ff"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:09.693269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.693782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.694297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.695301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.695774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.696205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.706995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.707743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.708572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.723552 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] Creating event network-vif-plugged:46518faf-642f-4adf-acb1-1c4d7e4b35ff for instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 on n-h1-858383-13 Oct 18 13:30:09.730178 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-183652e1-5b16-464f-a994-7746027fd8ec req-e9bd94bd-9c74-4821-b592-83e97087a5e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082286 Oct 18 13:30:09.731530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 884/1780] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:09.965442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.966796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.009832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.043992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.047097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.048113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.048871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.049476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.264572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.281849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3e2d6d4-fb78-4aca-8436-45b36ea9e58d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.634547 Oct 18 13:30:10.304742 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 897/1781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.304742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.304742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.312130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.312867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.313596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.314541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.315161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.315856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.675725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.690021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4502070a-e00f-46d4-b41a-baff10f22009 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 0.742910 Oct 18 13:30:10.690657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 885/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:10.695343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfebf7e9-004c-4c7c-91d5-4d543e3ecf32", "name": "network-vif-deleted", "tag": "97346f44-0414-4bdf-b397-0c8a898c2b95"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:10.727199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.729390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.730653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.805645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] Creating event network-vif-deleted:97346f44-0414-4bdf-b397-0c8a898c2b95 for instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 on n-h2-858383-13 Oct 18 13:30:10.829018 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cb7ba1ed-74e4-4368-8e56-95c875a09cf0 req-3a7aa9d1-6195-4277-9e52-01e245f70902 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136550 Oct 18 13:30:10.830575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 886/1783] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:10.845473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.845473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.852103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.856932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.856932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.857924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.857924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.867532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.893953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.903729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fae5ccc8-9ca6-4ca0-a652-ebc7be5da6ea tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.609026 Oct 18 13:30:10.909653 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 898/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.914795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.921605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.935057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.936170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.937803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.938920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.939393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.940031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.993050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.993588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.994160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.994896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lazy-loading 'fault' on Instance uuid bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:11.208755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.232676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43b6e853-27c7-47ed-83ec-17cd91f8eb3b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1297 microversion: 2.1 time: 0.309070 Oct 18 13:30:11.255320 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 899/1785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1297 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:11.311451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.324000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:11.324625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:11.331137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.331755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.334206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.335566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.337634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.339330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.339842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.340295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.340819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94b29bf2-eac6-4815-b22d-803b4bfb319e tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1281 microversion: 2.25 time: 0.508205 Oct 18 13:30:11.343291 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 887/1786] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1281 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:11.402306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:11.717488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:11.718370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:11.740023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.741023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.741656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.744541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.744541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.744541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.841961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.858932 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b2ee12c-f76c-4ae0-a49e-4186875e066f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.543322 Oct 18 13:30:11.859865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 900/1787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:11 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:12.023518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:12.043058 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5cbc0d35-3d3e-49fb-a271-d26b57b4d3d6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 0.326918 Oct 18 13:30:12.044018 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 888/1788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:11 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:12.060621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-plugged", "status": "completed", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:12.086384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.086990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.087515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.122104 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] Creating event network-vif-plugged:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:30:12.136931 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9d01d02e-b9cf-4b78-98b4-c8cac38e6875 req-cdd0fb95-da24-41b0-aafe-309b0d5aec78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085343 Oct 18 13:30:12.140122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 889/1789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:12.160927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.162171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.174825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.176203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.177269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.178752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.179473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.179873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.327558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1019a954-d191-4729-8d6a-596585cea883 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Action: 'create', calling method: .version_select at 0x7fb330cf8430>, body: {"keypair": {"name": "tempest-keypair-1436411161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVf4OSYa0Rymy0ITECNA4kVgCHDfXyb9thNsoYQLtRkL5CmD+EPhFavSKiCVZNeySRKmEQBdJ66J79K91lZLMFWkh2OSYviRdmsy7BuCSdB/lYPwNP+lnFfPiQfFaG7sw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:12.363011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1019a954-d191-4729-8d6a-596585cea883 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Getting quotas for project ec257d037b37472bb8a1b779fa39bb91. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:12.375659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1019a954-d191-4729-8d6a-596585cea883 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Getting quotas for user f6d59e6bbc724bd98b96a2e4458d1c4f and project ec257d037b37472bb8a1b779fa39bb91. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:12.506471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1019a954-d191-4729-8d6a-596585cea883 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.645470 Oct 18 13:30:12.511454 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 901/1790] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:30:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:12.514839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.518412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.539849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.541726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.542446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.543855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.544442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.547153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.682653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.692511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.693289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.695977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lazy-loading 'fault' on Instance uuid bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:12.887224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:12.920302 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84f9068d-ea73-4bcf-8c42-900cd92d1ad5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.776731 Oct 18 13:30:12.933271 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 890/1791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:12.951188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.952521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.964738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.966860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.967860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.970702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.974193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.976581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.099501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356ffdf6f40b4d71a7f39c414c008491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b1a51ccc344c649308631c71afd5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.107234 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f598e2fe-88c9-4421-89f6-f4e3915785a1 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 200 len: 1297 microversion: 2.1 time: 0.598500 Oct 18 13:30:13.107810 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 902/1792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 1297 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:13.146405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:13.147820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:13.153074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.153568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.154008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.154758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.155214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.155643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.183975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.195760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.198206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.210660 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d9b4489-c1c2-4f2e-bea9-733fc5f92067 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1477 microversion: 2.25 time: 0.265523 Oct 18 13:30:13.211717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 891/1793] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:13.238870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af6a1ce-a052-4fbd-958b-2d08be742e47", "name": "network-vif-unplugged", "status": "completed", "tag": "ff2e1c71-d505-46dc-bdcb-09a1b6faa975"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:13.269631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.272422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.273641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.296083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:13.332675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] Creating event network-vif-unplugged:ff2e1c71-d505-46dc-bdcb-09a1b6faa975 for instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 on n-h2-858383-13 Oct 18 13:30:13.350846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1121087d-a9b3-482f-a022-a572a6a61983 req-a415e52c-fff1-43cd-ae59-0b3b46d08ac8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136989 Oct 18 13:30:13.355834 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 892/1794] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:13.370654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:13.373863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:13.390590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.392004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.392993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.393993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.397938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.397938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.758023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.768759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87395f46-6cba-4b30-8417-4fce4906952b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 0.410414 Oct 18 13:30:13.787302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 893/1795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:13.903585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.931821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1cdf874-a490-4fe9-ab06-dd3033654230 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.802064 Oct 18 13:30:13.933214 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 903/1796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:13.956359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:13.957768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:13.972075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.982492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.991933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.991933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.991933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.991933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.327280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.328544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.337022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.337743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.338445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.340033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.340668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.341276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.613205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.629024 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83369dea-9a22-451f-be19-4876f302ce30 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.676401 Oct 18 13:30:14.643488 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 904/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:14.656389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.657015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: bfebf7e9-004c-4c7c-91d5-4d543e3ecf32] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.685218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.685723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.686197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.686913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.687383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.687811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.719781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:14.735196 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e63e4b1-a082-416e-9714-84b9134ae179 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1972 microversion: 2.25 time: 0.944583 Oct 18 13:30:14.737575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 894/1798] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1972 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:14.754241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 HTTP/1.1 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:14.755949 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. Oct 18 13:30:14.757608 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'bfebf7e9-004c-4c7c-91d5-4d543e3ecf32'} Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:14.758576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. Oct 18 13:30:14.760021 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.763902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:14.763902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a7197d6-b7b6-4242-8179-e7114c1c25fd tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32" status: 404 len: 111 microversion: 2.1 time: 0.112804 Oct 18 13:30:14.763902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 905/1799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/bfebf7e9-004c-4c7c-91d5-4d543e3ecf32 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:14.769146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.772935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.781275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.781769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.782697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.783550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.783889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.785110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.785586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.786016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.795094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.795591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.798947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.801307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.801976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.804517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.853783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e HTTP/1.1 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:30:14.858845 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:14.860682 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c068f993-944e-4d9a-b4fa-75509ddbfb4e'} Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:14.861677 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:14.863505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:14.865369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:14.865369 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-869d227c-09fa-4653-a2bf-c5ca2fce8ab9 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 404 len: 111 microversion: 2.1 time: 0.090395 Oct 18 13:30:14.865369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 895/1800] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:14 2022] DELETE /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:14.879151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.885847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.901823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.905573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.909230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.910092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.910598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.911045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.070315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:15.120693 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1514ec46-7e7a-449d-85d9-889e667589bb tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1972 microversion: 2.25 time: 0.352113 Oct 18 13:30:15.121600 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 906/1801] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1972 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:15.134110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.135732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c068f993-944e-4d9a-b4fa-75509ddbfb4e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.143313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.144104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.144556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.145654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.146456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.147441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.173701 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e HTTP/1.1 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:15.175561 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:15.177265 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c068f993-944e-4d9a-b4fa-75509ddbfb4e'} Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:15.178241 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. Oct 18 13:30:15.179767 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.182011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance c068f993-944e-4d9a-b4fa-75509ddbfb4e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:15.183131 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d84299b0-3ed1-48c2-98ec-f606a6e0c6ef tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e" status: 404 len: 111 microversion: 2.1 time: 0.059974 Oct 18 13:30:15.186673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 907/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/c068f993-944e-4d9a-b4fa-75509ddbfb4e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:15.189654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf22771-4aae-462f-8e75-e1f055cc1551", "name": "network-vif-plugged", "status": "completed", "tag": "851050bd-edcd-458c-b9dc-c52489993c33"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:15.200505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.200997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.201433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.236281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.238773 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] Creating event network-vif-plugged:851050bd-edcd-458c-b9dc-c52489993c33 for instance 5cf22771-4aae-462f-8e75-e1f055cc1551 on n-h2-858383-13 Oct 18 13:30:15.247630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-feccb9c4-8282-4bbf-b2c0-15469b6e1bf7 req-b8df9efd-cb47-451e-9658-1538a40b823c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062109 Oct 18 13:30:15.248784 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 908/1803] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:15.250001 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d620998-e5f7-4ea0-9a96-5f50c2903a0d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1471 microversion: 2.1 time: 0.385663 Oct 18 13:30:15.250001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 896/1804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:15.255517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.256461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.263602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.264843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.265795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.269790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.270685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.271448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.272313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.280443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.284902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.286497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.289428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.290164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.290687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.337034 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a636ac26-e009-4207-99fb-efad4fa6d89d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.086005 Oct 18 13:30:15.346842 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 897/1805] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:30:15.359982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffdc3870-522b-403e-afe7-ebb7191f6f4e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3318e2e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.387306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ffdc3870-522b-403e-afe7-ebb7191f6f4e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffdc3870-522b-403e-afe7-ebb7191f6f4e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d HTTP/1.1 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:30:15.389577 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '18a561fa-0a14-40d8-be60-e3846d39751d'} Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:15.391397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 18a561fa-0a14-40d8-be60-e3846d39751d to delete Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.392378 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18a561fa-0a14-40d8-be60-e3846d39751d could not be found. Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:15.393762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:30:15.399630 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.404567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffdc3870-522b-403e-afe7-ebb7191f6f4e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:15.404965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffdc3870-522b-403e-afe7-ebb7191f6f4e tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d" status: 404 len: 62 microversion: 2.1 time: 0.055973 Oct 18 13:30:15.406083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 898/1806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] DELETE /compute/v2.1/images/18a561fa-0a14-40d8-be60-e3846d39751d => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:30:15.413839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-13", "block_migration": "auto"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:15.419916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.427207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.428041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.428800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.429783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.430518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.431429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.473035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'flavor' on Instance uuid 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:15.488622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Going to try to live migrate instance to n-h2-858383-13 {{(pid=121010) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:30:15.565895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.574412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1cce0c2a-1fff-41b1-bb72-886fa4044b37 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.324238 Oct 18 13:30:15.575130 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 909/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:15.582183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.582978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.589753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.590537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.594412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.594412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.594412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.594412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.610298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef HTTP/1.1 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:15.617194 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.618870 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '292d54fa-7599-4745-8e3a-b76fec8108ef'} Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:15.619750 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.621246 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.623557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:15.623557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aeda6217-3156-46e4-b657-9e4d6f6dee46 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 404 len: 111 microversion: 2.1 time: 0.037440 Oct 18 13:30:15.623557 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 910/1808] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:15 2022] DELETE /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:15.623557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af6a1ce-a052-4fbd-958b-2d08be742e47", "tag": "ff2e1c71-d505-46dc-bdcb-09a1b6faa975"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:15.630818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.631313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.631755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.647626 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] Creating event network-changed:ff2e1c71-d505-46dc-bdcb-09a1b6faa975 for instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 on n-h2-858383-13 Oct 18 13:30:15.656514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-aaa28eeb-cf18-45c7-a568-9c07bff94c13 req-01197a0e-ccaa-4bfe-a315-be3239aa2a34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040870 Oct 18 13:30:15.657147 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 911/1809] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:15.670134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.670965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 292d54fa-7599-4745-8e3a-b76fec8108ef] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.673030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:15.677963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.678543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.678995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.679718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.680187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.680630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.695612 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef HTTP/1.1 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:15.697277 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.699835 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '292d54fa-7599-4745-8e3a-b76fec8108ef'} Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:15.700834 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. Oct 18 13:30:15.702704 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:15.704821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance 292d54fa-7599-4745-8e3a-b76fec8108ef could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:15.705872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc6a0cc3-3234-453f-86ae-b3759a56412b tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef" status: 404 len: 111 microversion: 2.1 time: 0.047658 Oct 18 13:30:15.706662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 912/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/292d54fa-7599-4745-8e3a-b76fec8108ef => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:15.711280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.711904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.718441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.718948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.719395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.720349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.721018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.721657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.048638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:16.061016 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7df07a9e-6ea6-4dee-bea3-c7a306d92a6e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.353137 Oct 18 13:30:16.061615 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 913/1811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:16.066707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0fd417e-71dd-42a7-a729-9eca9befd659 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3353dd550>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.101070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d0fd417e-71dd-42a7-a729-9eca9befd659 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0fd417e-71dd-42a7-a729-9eca9befd659 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec HTTP/1.1 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:16.104017 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '929527a7-85cd-409e-95a2-17c73eb096ec'} Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:16.105554 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 929527a7-85cd-409e-95a2-17c73eb096ec to delete Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.107136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 929527a7-85cd-409e-95a2-17c73eb096ec could not be found. Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:16.108471 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0fd417e-71dd-42a7-a729-9eca9befd659 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0fd417e-71dd-42a7-a729-9eca9befd659 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec" status: 404 len: 62 microversion: 2.1 time: 0.042677 Oct 18 13:30:16.112004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 914/1812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] DELETE /compute/v2.1/images/929527a7-85cd-409e-95a2-17c73eb096ec => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:30:16.115099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.115881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.124695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.125272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.125724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.126772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.127810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.128687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.162133 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb HTTP/1.1 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:16.164315 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.165860 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb'} Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:16.169847 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.171853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.173469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:16.173469 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ab70dcd-79a7-4376-baa2-cd3adc91b3d0 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 404 len: 111 microversion: 2.1 time: 0.055760 Oct 18 13:30:16.173469 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 915/1813] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:16 2022] DELETE /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:30:16.188235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.189176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.196587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.197368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.198855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.200239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.201126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.201574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.218475 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb HTTP/1.1 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:16.220012 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.221779 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb'} Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:16.222813 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. Oct 18 13:30:16.224453 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.226009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:16.226009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-712d7115-ef2f-440e-afb3-4afac0d04319 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb" status: 404 len: 111 microversion: 2.1 time: 0.049112 Oct 18 13:30:16.227073 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 916/1814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] GET /compute/v2.1/servers/afa50e09-9f5e-45d1-9c91-b5ed7f8ec0fb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:16.232727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b5f45f1-9144-4cc8-87ce-0e0769c4b005 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb331280940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.264729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-5b5f45f1-9144-4cc8-87ce-0e0769c4b005 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b5f45f1-9144-4cc8-87ce-0e0769c4b005 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 HTTP/1.1 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:16.266952 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5'} Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:16.268908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 to delete Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.271984 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 could not be found. Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:16.274893 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:30:16.276303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.277362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b5f45f1-9144-4cc8-87ce-0e0769c4b005 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:16.278694 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b5f45f1-9144-4cc8-87ce-0e0769c4b005 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5" status: 404 len: 62 microversion: 2.1 time: 0.050531 Oct 18 13:30:16.279525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 917/1815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] DELETE /compute/v2.1/images/4de9a2a1-d8a8-4939-a3a8-d4d34940f3b5 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:30:16.286122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.287010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.296164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.297150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.297893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.298944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.299632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.300361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.776114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:16.786647 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-914cafc0-287c-4e4a-9086-43fd3470ce9a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.505776 Oct 18 13:30:16.790855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 918/1816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:16.805475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.808439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.836476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.836981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.839610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.839610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.842849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.843324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.888899 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd HTTP/1.1 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:16.895097 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:16.896937 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c3fdd130-7ec2-4d75-b7a5-2088436f6bbd'} Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:16.897911 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:16.903605 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:16.906813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:16.906813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe607e17-4a86-478b-a3ec-99f6821d40d5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 404 len: 111 microversion: 2.1 time: 0.108956 Oct 18 13:30:16.906813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 919/1817] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:16 2022] DELETE /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:16.919416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.921346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.934076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.937136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.938673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.941377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.942118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.942864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.349811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.367030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9db255e6-bfac-4f59-888f-df2fde931c43 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1314 microversion: 2.1 time: 0.460407 Oct 18 13:30:17.367806 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 920/1818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:17.391265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.391901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: c3fdd130-7ec2-4d75-b7a5-2088436f6bbd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:17.398509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.399318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.399560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.400392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.400771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.401241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.420497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd HTTP/1.1 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:17.422071 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:17.423646 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c3fdd130-7ec2-4d75-b7a5-2088436f6bbd'} Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:17.424576 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. Oct 18 13:30:17.425987 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.427254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance c3fdd130-7ec2-4d75-b7a5-2088436f6bbd could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:17.427254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6217138-43cf-4a9d-85e8-b0d7224e7661 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd" status: 404 len: 111 microversion: 2.1 time: 0.038230 Oct 18 13:30:17.427404 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 921/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:17 2022] GET /compute/v2.1/servers/c3fdd130-7ec2-4d75-b7a5-2088436f6bbd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:17.432305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.433397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:17.445296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.445296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.445296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.445296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.445778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.445778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.766457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.775593 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2772dc6-8302-4d8c-9e4c-2cc99f8b5a0b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.347186 Oct 18 13:30:17.777891 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 922/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:17 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:17.784244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e85e2d0-b83e-432e-bb8c-5b1660a685e5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '.version_select at 0x7fb3353dd4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.828638 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7e85e2d0-b83e-432e-bb8c-5b1660a685e5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Image not found. Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e85e2d0-b83e-432e-bb8c-5b1660a685e5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 HTTP/1.1 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:17.829269 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '086e681b-5584-4caf-a07f-c9fbb6ca38f9'} Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:17.831037 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 086e681b-5584-4caf-a07f-c9fbb6ca38f9 to delete Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.832168 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 086e681b-5584-4caf-a07f-c9fbb6ca38f9 could not be found. Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:17.833633 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:30:17.835322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:17.837242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e85e2d0-b83e-432e-bb8c-5b1660a685e5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:17.838590 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e85e2d0-b83e-432e-bb8c-5b1660a685e5 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9" status: 404 len: 62 microversion: 2.1 time: 0.057870 Oct 18 13:30:17.839388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 923/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:17 2022] DELETE /compute/v2.1/images/086e681b-5584-4caf-a07f-c9fbb6ca38f9 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:30:17.846725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.851258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:17.866536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.869119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.869817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.872550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.874837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.877679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.233417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:18.245938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b009ee44-ae72-4077-8cea-e98cc9043c1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.403033 Oct 18 13:30:18.249444 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 924/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:17 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:18.262836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.263867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.275827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.275827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.279676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.280532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.281019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.281463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.319213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb HTTP/1.1 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:18.320828 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.322630 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '94d74fea-1d0c-47dd-8bd7-7a74658cd0cb'} Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:18.323800 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.325395 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.333666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:18.333666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a36eb6d4-53b4-4e99-9ef7-dbb333bbbb4a tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 404 len: 111 microversion: 2.1 time: 0.077836 Oct 18 13:30:18.333666 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 925/1823] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:18 2022] DELETE /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:18.351040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.351702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] [instance: 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.370254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.370786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.371246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.371976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.372443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.372963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.396071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] HTTP exception thrown: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Request method failure captured: Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb HTTP/1.1 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkcR4fBlabTu1cO6eCdyx75CidPeb3noi4ZWpaTPwMDrXYudIwjL3Du2QKzrGCsQffJ1L4RpDoL1p8o1tKAfFRapADrC2uoUeLg1qfUY_ZvckW99dYivstxhCc_qYq8g4XMd8dYPgvLjnCb0nmmTuCckLoCMgscTYEzXLsXWic7w88 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:30:18.401780 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2b1a51ccc344c649308631c71afd5b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a2b1a51ccc344c649308631c71afd5b7 Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesTestJSON-502211758 Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 356ffdf6f40b4d71a7f39c414c008491 Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesTestJSON-502211758-project Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.404289 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '94d74fea-1d0c-47dd-8bd7-7a74658cd0cb'} Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:18.405392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. Oct 18 13:30:18.407458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:30:18.410206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] Returning 404 to user: Instance 94d74fea-1d0c-47dd-8bd7-7a74658cd0cb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:18.410206 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20717722-2121-4f07-b705-23c36c931f89 tempest-ImagesTestJSON-502211758 tempest-ImagesTestJSON-502211758-project] 10.222.0.27 "GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb" status: 404 len: 111 microversion: 2.1 time: 0.069955 Oct 18 13:30:18.410206 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 926/1824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/94d74fea-1d0c-47dd-8bd7-7a74658cd0cb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:30:18.415137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.418375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.424364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.424869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.426233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.427642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.428949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.429397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.665527 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-886be2f7-ef10-4970-8603-7375286a446d tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6/action" status: 202 len: 0 microversion: 2.25 time: 3.255409 Oct 18 13:30:18.667479 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 899/1825] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:30:15 2022] POST /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6/action => generated 0 bytes in 3260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:18.678472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.679082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.697831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.698763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.699210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.700693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.701334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.702144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.767715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:18.782216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-173c2aec-0fff-40e3-b1a2-d46d81fa8df7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1464 microversion: 2.1 time: 0.373591 Oct 18 13:30:18.783944 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 927/1826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:18.809057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.810817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.824667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.828240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.828933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.829870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.839329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.840030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.881061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:19.316813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.335294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.341372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.342526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.348497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af286a61-5e43-4060-93d4-3f2e10eb6621 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.676905 Oct 18 13:30:19.350510 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1450720d-ee59-42af-a6bb-42eb60e9ea60 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 0.550757 Oct 18 13:30:19.352626 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 900/1827] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:19.363886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.365723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.374217 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 928/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:19.386479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "22c747c6-5050-423f-9339-6d9079e36f43"}], "security_groups": [{"name": "tempest-securitygroup--601630903"}], "key_name": "tempest-keypair-1436411161", "user_data": "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:19.396772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.397421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.399324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.400884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.404378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.409713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.833439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] validate_networks() for [('22c747c6-5050-423f-9339-6d9079e36f43', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:19.850186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.871403 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e609d22-1823-43d2-8b18-e941ef4dcae8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1464 microversion: 2.1 time: 0.516782 Oct 18 13:30:19.872670 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 901/1829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1464 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:19.882814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.883694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.894403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.896572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.897967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.901434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.902190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.902849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.107485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.118109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95220735-3517-4512-ad21-4fc73524e137 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.244063 Oct 18 13:30:20.138383 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 902/1830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:20.158846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1049310383", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e744b81e-7a31-425e-b2bc-becb2ab83513"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:20.281654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:20.920195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:20.921725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:20.922476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:20.923127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:20.931627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:20.958178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.958757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.959467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.962560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.963446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.964737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.004732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:21.014049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Getting quotas for user d54a9109295b426ba1060c63bfb230ed and project cb1d59a6188a4b2fb67e6eba8f64d79f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:21.035575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:21.038363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:21.223278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3471b0a4-0e56-4d55-b84a-d4ff6a922c29 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083368 Oct 18 13:30:21.238333 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 903/1831] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:21.256570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:21.263194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:21.277105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.280823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.280823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.280823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.280823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.281185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.731461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:21.741678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:21.743715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:21.746089 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59ae1066-6dfa-4231-a46e-bde3d8c2d58d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.505481 Oct 18 13:30:21.747195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 904/1832] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:21 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:21.766259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:21.769202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:21.779597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.780093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.780540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.781253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.781715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.782225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.976011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:21.979768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:21.980606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:21.982297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:21.987815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:22.039180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.039865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.040331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.041156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.041623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.042726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.085637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Getting quotas for project ec257d037b37472bb8a1b779fa39bb91. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:22.099223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Getting quotas for user f6d59e6bbc724bd98b96a2e4458d1c4f and project ec257d037b37472bb8a1b779fa39bb91. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:22.133201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:22.140103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:22.298515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d771505-20e7-4c8e-8c0b-2e87bb0ddf01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.919711 Oct 18 13:30:22.300853 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 929/1833] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:22.311742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:22.317903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:22.326238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.331724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.333748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.334784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.339286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.343412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.809777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:22.834489 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c081f351-9fd2-4790-b5b4-b46f54513a81 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.532937 Oct 18 13:30:22.838592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 930/1834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:22 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:22.850782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:22.851744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:22.882975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.884811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.887356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.889366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.892546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.892546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.938381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:22.946427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0301b8d0-1012-4431-8d4f-fd049064192a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1504 microversion: 2.1 time: 1.197949 Oct 18 13:30:22.948642 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 905/1835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:21 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1504 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:22.955415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63e1f7ac-4f50-4c51-a72e-e1e56a9e7cde tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:22.956259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63e1f7ac-4f50-4c51-a72e-e1e56a9e7cde tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:23.037885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-63e1f7ac-4f50-4c51-a72e-e1e56a9e7cde tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.052621 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63e1f7ac-4f50-4c51-a72e-e1e56a9e7cde tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1226 microversion: 2.1 time: 0.096499 Oct 18 13:30:23.054110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 906/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:22 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:23.086006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:23.092072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:23.109237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.113893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.116767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.130494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.131317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.132877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.183946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.195750 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3c6acb0-ca02-4e98-8014-e8504ebfb59d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1218 microversion: 2.1 time: 0.353369 Oct 18 13:30:23.210964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 931/1837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:22 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1218 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:23.712078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.726665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.729299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.732974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e33a1eb3-a5da-4cda-8955-70f10b9bc3e4 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.658046 Oct 18 13:30:23.735088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 907/1838] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:23.977409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:23.977409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:23.985112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.987796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.989203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.991775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.992324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.993983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.265150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.266097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.278738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.285551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.285551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.285551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.285551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.286513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.433854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.449778 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb5188c0-6c4f-48a1-aa52-3c64fb14d321 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1479 microversion: 2.1 time: 0.477392 Oct 18 13:30:24.451674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 908/1839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1479 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:24.473743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.480646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.500365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.507501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.509172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.512605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.515267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.515974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.665067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.693204 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-696f4a94-a068-4af0-a279-9f84176f4ace tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1230 microversion: 2.1 time: 0.237468 Oct 18 13:30:24.721186 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 909/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1230 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.742775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.748198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.788723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.791962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.792723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.793803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.796619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.798812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.920730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.934199 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e67065ad-b3a6-4cfb-9999-1931a47246eb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 1.076383 Oct 18 13:30:24.940303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 932/1841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.965047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f865c4e1-db45-476d-b23d-0a0afcb18c2a tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '.version_select at 0x7fb3314fc790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.981178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f865c4e1-db45-476d-b23d-0a0afcb18c2a tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.982301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f865c4e1-db45-476d-b23d-0a0afcb18c2a tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.984555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f865c4e1-db45-476d-b23d-0a0afcb18c2a tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.003505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:25.013963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f865c4e1-db45-476d-b23d-0a0afcb18c2a tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3930 microversion: 2.1 time: 0.067412 Oct 18 13:30:25.015445 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 933/1842] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/os-migrations => generated 3930 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:25.015997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fdd9ce4-e586-4b6e-8144-deb531b6da6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1266 microversion: 2.1 time: 0.290785 Oct 18 13:30:25.016574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 910/1843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:25.023006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.024335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.034176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.040732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.053116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.054198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.054959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.055110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.056570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.058250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.058514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.058939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.059725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.059859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.062076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.062552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.081229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:25.677909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb531226-2627-4e70-b3b8-4e004ff7a1ed tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1632 microversion: 2.1 time: 0.650422 Oct 18 13:30:25.682432 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 911/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1632 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:25.709977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d53e02e8-bbed-4e5c-98f5-9f3fb8c5d2c1 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: .version_select at 0x7fb3317caa60>, body: {"keypair": {"name": "tempest-keypair-914678800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkukh9AsXDN45gGgXslMM43UrsJIoKhKan9MPG5kPfGbFIU110IWWfP50jKfPq1dhY3Ld8lWCGX94nQY0QGXd1mMv6JQpiEHtDBjjPg67o3wpRz2UK22u2c5Jqq+cLyCA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:25.773687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d53e02e8-bbed-4e5c-98f5-9f3fb8c5d2c1 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for project 9395a050de444357956d4ac79adefee6. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:25.788787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d53e02e8-bbed-4e5c-98f5-9f3fb8c5d2c1 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for user d5ed601492e2486bad8ba5b09515d52a and project 9395a050de444357956d4ac79adefee6. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:25.800129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:25.977501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d53e02e8-bbed-4e5c-98f5-9f3fb8c5d2c1 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.271673 Oct 18 13:30:25.978092 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 912/1845] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:30:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:25.991926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.992552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:26.008405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.022771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.028234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.031424 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8808d575-dfd4-45f6-ba4b-23cfccf1ba42 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 1.014506 Oct 18 13:30:26.033565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 934/1846] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:26.040304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.040827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.041258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.043808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:26.050546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:26.052179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.052745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.067838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.068933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.069690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.070475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.071426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.075441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.077760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.275376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.284612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-660d88b3-b0e8-4d42-8684-b2d1cf09db6f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1278 microversion: 2.1 time: 0.296667 Oct 18 13:30:26.291442 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 913/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1278 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:26.301246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:26.301882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:26.315932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.316668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.317357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.318403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.319045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.319650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.464908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.490081 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8647630-6b63-47da-9396-69a3b8591853 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1284 microversion: 2.1 time: 0.190985 Oct 18 13:30:26.494341 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 914/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:26 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:26.968502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.977588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88cf84f6-9863-4a41-9dff-e30f47391fa3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.941618 Oct 18 13:30:26.982549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 935/1849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:26 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:27.068449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.069873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.087847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.089809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.090655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.094357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.095894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.130276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.310820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.311792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.327165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.328423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.329189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.330190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.336758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.336758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.627702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.655777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.658464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.662519 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2d899c4-7d6f-444f-a86d-2d8ccbd22f44 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.600474 Oct 18 13:30:27.698519 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 915/1850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:27.710799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.711519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.730967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.731537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.731999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.733462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.735947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.736403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.786907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.802222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-741ce448-20a7-48e2-8f57-57757e2170c5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1286 microversion: 2.1 time: 0.496471 Oct 18 13:30:27.804506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 936/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1286 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:27.876154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.892236 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd4aea46-e700-4e89-bf15-bddcafca5fc7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1272 microversion: 2.1 time: 0.192216 Oct 18 13:30:27.892833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 916/1852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:28.009426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:28.010277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:28.028188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.028840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.029404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.030269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.030844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.031405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.696403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:28.699816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:28.711777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.714901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.719024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.720027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.720696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.721325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.169959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.186121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.187569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.193185 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35302535-da58-4893-9d68-54069a8c4989 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.501586 Oct 18 13:30:29.197429 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 917/1853] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:28 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:29.207815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:29.210797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:29.231248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.232620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.233560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.234594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.237870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.241313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.370289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.397079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cee21b78-abd6-480f-99a3-0ecb202f179a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 1.389424 Oct 18 13:30:29.397079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 937/1854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:28 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:29.417571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:29.418808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:29.430986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.434677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.435495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.442975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.444094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.449410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.450098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a31ad5a7-8a0f-44e9-a254-c7f1576884f5 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1284 microversion: 2.1 time: 0.250532 Oct 18 13:30:29.453669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.460217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 918/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:29 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:29.582007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1524407661", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "e0c80203-419c-4b89-b9bd-dbc75a5f266e"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:29.743048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] validate_networks() for [('e0c80203-419c-4b89-b9bd-dbc75a5f266e', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:29.924660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.950736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e0b4fb0-5212-4d9b-8f85-8e15894ae9df tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1272 microversion: 2.1 time: 0.538399 Oct 18 13:30:29.950736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 938/1856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:29 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1272 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:30.226488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:30.227103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:30.246193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.249540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.251588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.252576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.253206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.257419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.828748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:30.829303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:30.829807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:30.830287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:30.830711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:30.852586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.855739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.856462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.858877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.860663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.861346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.929123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Getting quotas for project 7308e67ff4a34e4e90cc2cb73dd715ca. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:30.944545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:30.963205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:30.968919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Getting quotas for user 25a3037c50994ccfb3fec51fa07bd3c0 and project 7308e67ff4a34e4e90cc2cb73dd715ca. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:30.969458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:30.971167 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-680067fc-a04f-49ba-beb3-469c0cd96d1d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.750120 Oct 18 13:30:30.983569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 939/1857] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:30 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:30.999125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:30.999928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:31.008429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:31.011493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:31.020571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.021359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.021980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.029002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.029737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.030625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.301028 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26c36ab2-aed7-45e0-8799-78f51061429d tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839360 Oct 18 13:30:31.304379 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 919/1858] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:31.317772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:31.320063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:31.346888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.348560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.349033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.349792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.350287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.357619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.780745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.821532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d2945e5-7c92-4b2c-90ce-e063b3d25570 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.512054 Oct 18 13:30:31.821532 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 920/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:31 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:31.837366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:31.837999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:31.864652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.870693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.873011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.877205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.881188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.884289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.062730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:32.122748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:32.366648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.377811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8112a4e2-0e2d-4ee3-aab2-664e31fee12e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.554039 Oct 18 13:30:32.390178 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 921/1860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:31 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.393172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01f072a6-4a2d-40a8-87c2-f442d75bf23b tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.393970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01f072a6-4a2d-40a8-87c2-f442d75bf23b tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.483430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01f072a6-4a2d-40a8-87c2-f442d75bf23b tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.483430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01f072a6-4a2d-40a8-87c2-f442d75bf23b tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1216 microversion: 2.1 time: 0.089913 Oct 18 13:30:32.483430 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 922/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.483430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.498107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.509491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.510480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.511913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.512930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.514285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.514949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.782690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.795338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d37f676b-903c-44f9-ae53-091c443b7cd6 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 1.810226 Oct 18 13:30:32.800911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 940/1862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:30 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.843188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.844800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.860678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.861983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.880306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.880306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.880306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.880306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.981755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.999801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:33.001603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:33.003212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f99f9b59-faee-4e61-b9a9-e3d3d0b4271b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.526895 Oct 18 13:30:33.014296 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 923/1863] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:33.306619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1357610006", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1d39c162-1076-4759-b728-c0f93d172f89"}], "security_groups": [{"name": "tempest-securitygroup--1924527282"}], "key_name": "tempest-keypair-914678800", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:33.545895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:33.616509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f61f122-32bf-43cc-8707-3afbf7d392f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.779469 Oct 18 13:30:33.640462 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 941/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:33.664671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:33.668791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:33.687284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:33.688811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:33.689685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:33.690888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:33.691906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:33.692729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:33.724500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] validate_networks() for [('1d39c162-1076-4759-b728-c0f93d172f89', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:34.550318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:34.550927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:34.551232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:34.551653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:34.552068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:34.581442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.587406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.587406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.587406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.587406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.587918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.593017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.603471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa294dbb-7cf3-49dd-86eb-24052e1139ae tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.958293 Oct 18 13:30:34.624122 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 942/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:33 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:34.636921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:34.640362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:34.655277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.658609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:34.658882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.661246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.664581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.665697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.667974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.680892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for user d5ed601492e2486bad8ba5b09515d52a and project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:34.757660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:34.760616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:34.907523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2edec2f6-3ae7-4696-913d-4d5a98eef01a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.601933 Oct 18 13:30:34.915353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 924/1866] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:34.931492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:34.933007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:34.942223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.942985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.943628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.944533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.945313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.946435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.968026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.995904 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb156c56-ca10-4a89-9edc-b7ae9a451ff0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1212 microversion: 2.1 time: 0.370718 Oct 18 13:30:35.010657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 943/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:34 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1212 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.036220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.052012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.099485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.104038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.106576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.111156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.111821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.116146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.389380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.423783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ea054da-ba68-4240-847d-369024b2a4ba tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.502749 Oct 18 13:30:35.424429 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 925/1868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:34 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.434191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.451516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.483614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.484229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.484679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.485529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.485993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.494167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.766911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.789456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0db4f926-fe8a-4c34-9098-fe08d9699978 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.363016 Oct 18 13:30:35.798530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 926/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.811266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48d4843c-6adb-45f3-bcad-7dd879b03ee2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.811266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48d4843c-6adb-45f3-bcad-7dd879b03ee2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.925757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.948248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.948248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.948248 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-421ace3d-5dbe-40e5-bb9e-468c0fece154 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.939939 Oct 18 13:30:35.948799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-48d4843c-6adb-45f3-bcad-7dd879b03ee2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.948910 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 944/1870] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:35.959300 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48d4843c-6adb-45f3-bcad-7dd879b03ee2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1234 microversion: 2.1 time: 0.154466 Oct 18 13:30:35.960890 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 927/1871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1234 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.964282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2128cb7-3364-4700-97c4-79fc42aa9325", "tag": "0023d0c1-0beb-4ee8-8fb7-774408c3c2be"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:35.969842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.975076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.995449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.999090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.999814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.009358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.010916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.011588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.014702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.018730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.020870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.042973 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] Creating event network-changed:0023d0c1-0beb-4ee8-8fb7-774408c3c2be for instance d2128cb7-3364-4700-97c4-79fc42aa9325 on n-h2-858383-13 Oct 18 13:30:36.057307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1f33cd84-68b6-4013-a2d3-09caad4f19e4 req-2cd4f8f2-536e-4408-8806-216cea67b121 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110744 Oct 18 13:30:36.062867 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 945/1872] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:36.070221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.079572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:36.092882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.099886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.100799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.102794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.108762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.109744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.301675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.320987 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27b6b251-2a42-4708-bb49-afdbe79bb77f tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1268 microversion: 2.1 time: 0.256436 Oct 18 13:30:36.322091 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 946/1873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:36.341533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.354223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80bb7e6d-9548-4b74-994d-af2393211d71 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.391888 Oct 18 13:30:36.355334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 928/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:36.453458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.454526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:36.467446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.467950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.468396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.469126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.469586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.470681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.480500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:36.825804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.826526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:36.834326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.834846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.836173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.837144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.844577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.845097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.846314 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25b92dcb-8484-46a4-ba19-7e53f860d64a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.397406 Oct 18 13:30:36.847886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 947/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:36.848038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.991247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.991839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.003667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.007251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.009054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.011102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.015861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.016325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.074904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.084033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12b64a19-3cd7-46c0-a30c-3afc143fa4d0 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.262785 Oct 18 13:30:37.085632 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 929/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.091289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.092535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.100252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.108832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.108832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.108832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.108832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.109225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.181120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.191209 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c509ade-f79f-4163-b2c6-f7a3e597ad24 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1230 microversion: 2.1 time: 0.104067 Oct 18 13:30:37.194121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 930/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.295440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.337505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.341108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.342332 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5177f11-4430-443e-bc4f-7f3317dc2a5d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.355895 Oct 18 13:30:37.344574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 948/1878] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:37.352983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.353726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.364464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.367617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.368890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.371352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.373093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.373517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.388421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.388421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.396026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.396726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.397395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.399245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.399882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.400694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.586735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.609065 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8aa5129-f888-4fec-ad12-786e713d59a3 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1268 microversion: 2.1 time: 0.262313 Oct 18 13:30:37.614168 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 931/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1268 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.777622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.792062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bca6aab-37be-44a8-8555-4f8bb909cfc0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.406829 Oct 18 13:30:37.792681 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 949/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.875883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.877231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.885559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.886073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.886531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.887295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.887757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.888415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.893979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:38.109140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:38.113712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:38.125664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.128380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:38.132405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.136044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.140531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.142225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.142768 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6cab508-550f-4c35-a216-b0093e79d02d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1476 microversion: 2.1 time: 0.275219 Oct 18 13:30:38.143877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 932/1881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:38.144057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.229170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:38.229953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:38.253755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.259500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.259500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.267076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.268376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.269372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.489724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:38.502446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f043999-ee76-4f91-a482-203ab4f1ae28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1230 microversion: 2.1 time: 0.289752 Oct 18 13:30:38.514916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 933/1882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:38 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1230 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:38.530164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:38.533209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:38.568573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.568573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.568573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.568573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.569075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.569075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.077616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.096788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b486add-cb86-46d7-8825-ff1cd83e7968 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.991647 Oct 18 13:30:39.108639 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 950/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:38 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:39.123366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.126185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.139043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.139543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.140195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.144512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.145303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.146182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.260903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.276198 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-654d48ec-d092-41e0-a517-8d5378b5568a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1274 microversion: 2.1 time: 0.164572 Oct 18 13:30:39.277823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 951/1884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:39.285773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74d90e0-6f8a-4327-9167-274c11068f2e", "tag": "ac9aa433-5168-4482-b939-4a01298ce482"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:39.299369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.303321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.304784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.327835 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] Creating event network-changed:ac9aa433-5168-4482-b939-4a01298ce482 for instance c74d90e0-6f8a-4327-9167-274c11068f2e on n-h1-858383-13 Oct 18 13:30:39.337730 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9009fff8-9d0e-4422-8a18-e3e476bce0dc req-ae785dde-49d2-4364-afb6-26e3374d2569 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057170 Oct 18 13:30:39.339452 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 952/1885] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:39.350537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.350537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.359202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.359785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.360331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.361334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.362200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.363648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.516791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.534979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.536558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.538332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27a29254-1a68-48c0-97fc-3f81c6235a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 1.021276 Oct 18 13:30:39.538899 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 934/1886] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:38 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:39.548214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.554982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.569914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.570781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.571482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.575075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.575842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.576493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.803625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.805434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.817055 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2511b64e-20a0-4c6d-92f3-b5ca6cd52a35 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1475 microversion: 2.1 time: 0.272300 Oct 18 13:30:39.826127 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c847458-3404-4aae-a814-650b87e4aeef tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.477436 Oct 18 13:30:39.826127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 953/1887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:39.842461 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 935/1888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:39.842769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.842769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.855838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-unplugged", "status": "completed", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:39.860134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.860134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.860134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.865365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.865365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.866618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.872017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.872946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.873575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.911106 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Creating event network-vif-unplugged:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h2-858383-13 Oct 18 13:30:39.935822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] Instance 70c46c56-f967-4399-85e3-54a3aac2389c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:30:39.967138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7a68aa7c-2454-4980-b2ba-8db59d81bdf8 req-94e7c603-3f44-45b1-be9e-00fd2bf9e7df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137672 Oct 18 13:30:39.970261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 936/1889] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:40.032432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:40.048915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da5fcd1c-e3c8-48f9-bcda-1f68952e7255 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1286 microversion: 2.1 time: 0.221784 Oct 18 13:30:40.053156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 954/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1286 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:40.127838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.130185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.146560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.147524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.148221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.149267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.149751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.151623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.303906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.304656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.322903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.323595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.324304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.325291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.326043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.326812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.473553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:40.490221 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc6ad69d-f89b-42dd-882d-005257208f7a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1274 microversion: 2.1 time: 0.191219 Oct 18 13:30:40.491157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 955/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:40.566575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.567346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.584090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.591255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.591255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.596898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.597622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.598255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.945597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:40.966620 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc9cee41-9591-4999-a91a-85bbdb072f1f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.844547 Oct 18 13:30:40.983034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 937/1892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:40.993700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.995051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.028273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.029148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.029866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.031071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.031729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.032353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.198886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.222704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.223450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.227984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fcbdc710-cb7f-40c9-a453-69cdedeae74b tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.664070 Oct 18 13:30:41.229268 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 956/1893] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:30:41.236721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:41.237574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.252578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.258720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.259207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.267955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.267955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.267955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.717781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.726203 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11d87433-2101-40d0-82e2-1d0633b7a145 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.495570 Oct 18 13:30:41.728687 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 957/1894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:41 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:41.733989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:41.734836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.736736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:41.745424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.748111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.751844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.752861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.753512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.754276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.881892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.894581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a99b4ed3-b769-4156-9a68-4fe86a2c53eb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1292 microversion: 2.1 time: 0.162004 Oct 18 13:30:41.895741 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 958/1895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:41 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:41.910645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:41.911669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.923233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.935367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.935367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.935367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.935367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.935867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.031980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.047001 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2aa4c09-a2a4-4ee1-a3d3-a000701c067b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1475 microversion: 2.1 time: 1.062316 Oct 18 13:30:42.064808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 938/1896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1475 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.077170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.087759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.104637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.105153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.106740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.107565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.108031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.108676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.242619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.253087 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-804860fa-6d62-4129-be5b-9fc8a93135ae tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.348643 Oct 18 13:30:42.253893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 959/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:41 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.261909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:42.278104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.278710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.279173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.296431 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Creating event network-changed:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h2-858383-13 Oct 18 13:30:42.308774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] Instance 70c46c56-f967-4399-85e3-54a3aac2389c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:30:42.324956 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6e51170c-242a-461f-a923-b31c35fc4db9 req-0cc1b0e1-33ce-43c7-a492-84927ae20a24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069223 Oct 18 13:30:42.325743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 960/1898] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:42.334081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2128cb7-3364-4700-97c4-79fc42aa9325", "name": "network-vif-plugged", "status": "completed", "tag": "0023d0c1-0beb-4ee8-8fb7-774408c3c2be"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:42.357017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.358881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.359342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.388184 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] Creating event network-vif-plugged:0023d0c1-0beb-4ee8-8fb7-774408c3c2be for instance d2128cb7-3364-4700-97c4-79fc42aa9325 on n-h2-858383-13 Oct 18 13:30:42.394044 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-319e1536-d079-4cb0-aed3-9610412522c1 req-3b932d85-a079-42a1-a320-a43c1bf0e831 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066783 Oct 18 13:30:42.401361 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 961/1899] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:42.403933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.405013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.412220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.413045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.413742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.414813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.415533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.416839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.608493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.633111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efe37aac-f69e-4ec7-b308-d92e6ff6b7a6 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.569845 Oct 18 13:30:42.637217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 939/1900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.749404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.757988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.759829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.760867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.761312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.762022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.764851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.765505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.060118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.076955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.078885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.080634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-300749ed-ce28-4b1b-8840-d7fa653f9816 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.684000 Oct 18 13:30:43.081701 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 962/1901] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:43.086860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.088248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.094650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.095413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.096171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.097679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.098346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.098988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.206318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.218042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ae3aa67-473e-4254-9964-c5d5a8dea306 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1292 microversion: 2.1 time: 0.134841 Oct 18 13:30:43.238186 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 963/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:43.255867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.256477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.269711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.269711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.270125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.276199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.276695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.277368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.451776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.477530 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cb109b3-5f63-4d68-97c8-e8bc1b7a4c9c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.731843 Oct 18 13:30:43.484445 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 940/1903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:43.491056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.491589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.499392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.500133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.500762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.501637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.502322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.503355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.698745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.717408 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6303c3cf-7eae-4f49-8ee9-385cf150b631 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1475 microversion: 2.1 time: 0.477064 Oct 18 13:30:43.737577 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 964/1904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:43.743215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a74a32-985c-450b-a1b6-400e9704e08d", "tag": "c03f62b2-47fb-4123-a445-5713e3809bdc"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:43.767396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.767888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.768317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.783956 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] Creating event network-changed:c03f62b2-47fb-4123-a445-5713e3809bdc for instance 69a74a32-985c-450b-a1b6-400e9704e08d on n-h1-858383-13 Oct 18 13:30:43.789664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-47d50d9e-5512-4f79-a359-1477db72d9ca req-945d4e73-6c11-46bc-b6c7-4b7f8d48c33a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052634 Oct 18 13:30:43.794141 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 965/1905] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:43.800172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.801063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.808190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.818575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.818575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.820655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.821222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.821729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.835177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:44.380720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.384510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.390712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18226065-e803-4b50-805e-8c4c1c44c8eb tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.904937 Oct 18 13:30:44.395289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 941/1906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:44.400301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.406931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.407259 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4ce3859-6db4-4c41-87df-97db229bcfe4 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.597111 Oct 18 13:30:44.409849 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 966/1907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:44.433736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.436802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.437509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.438175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.438902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.439907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.440611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.441336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.457461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.457961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.458748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.459126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.464452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.464931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.632688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.640514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:44.654322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d417bde-62ce-4b2d-a51b-1c34dfe381e4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1292 microversion: 2.1 time: 0.228772 Oct 18 13:30:44.658403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 967/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1292 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:44.659276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.670081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.672236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.678882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0bdbf25-b3ea-49bb-8044-bd5306642806 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.277694 Oct 18 13:30:44.678882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 942/1909] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:44.679117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6", "name": "network-vif-unplugged", "status": "completed", "tag": "46518faf-642f-4adf-acb1-1c4d7e4b35ff"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:44.682278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.683179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.689218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:44.691085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.691943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.692605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.694908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.694908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.696195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.696886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.697951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.704905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.719734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] Creating event network-vif-unplugged:46518faf-642f-4adf-acb1-1c4d7e4b35ff for instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 on n-h1-858383-13 Oct 18 13:30:44.725220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d668f469-36a6-4b70-983e-cb63220c7b14 req-36462f87-d40d-4c87-b8c3-020cb59327da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065253 Oct 18 13:30:44.726940 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 968/1910] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:44.741475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.742306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.749376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.749881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.750358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.751080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.751692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.752137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.941616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.951480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d65e5b58-39f3-4fae-ae98-af74d9cf1e6a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1473 microversion: 2.1 time: 0.214337 Oct 18 13:30:44.962145 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 969/1911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:45.086011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.105982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ed6d027-2b85-493d-8db1-67f7e4661a4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1314 microversion: 2.1 time: 0.426409 Oct 18 13:30:45.107213 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 943/1912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:45.417910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.418836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.426202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.429365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.429365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.429365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.429365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.429733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.443230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.443692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.451059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.451817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.452467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.453367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.454158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.454759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.587792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.601083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da63e706-9929-4c8b-a0b0-66f12d60b871 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.187638 Oct 18 13:30:45.620997 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 970/1913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:45.678847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.679563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.686760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.692390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.692390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.692390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.692390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.692984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.783392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.803187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efcf736d-5dd0-49b8-ab5e-876ed898fc01 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.364092 Oct 18 13:30:45.805737 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 944/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:45.815451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.817253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.831227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.832076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.833135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.834462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.835172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.836117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.954421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=28 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:46.020209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.030306 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-618b6024-2fa9-4cb6-8684-ff2da5fcccb6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.358163 Oct 18 13:30:46.031859 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 971/1915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:46.037032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.037851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.046545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.047293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.047951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.048855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.049503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.050134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.328244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.338359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30224d9f-d144-42b8-adff-7b550f0fe48a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1473 microversion: 2.1 time: 0.305112 Oct 18 13:30:46.339385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 972/1916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:46.351613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.353364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.366154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.366876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.367440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.368469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.369766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.370531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.456605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.481786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.486796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.497284 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-786226a1-f294-45bf-939b-b0f63961c2b6 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.689770 Oct 18 13:30:46.501257 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 945/1917] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:46.514223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d90e0-6f8a-4327-9167-274c11068f2e", "name": "network-vif-plugged", "status": "completed", "tag": "ac9aa433-5168-4482-b939-4a01298ce482"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:46.573114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.573613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.576541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.611067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] Creating event network-vif-plugged:ac9aa433-5168-4482-b939-4a01298ce482 for instance c74d90e0-6f8a-4327-9167-274c11068f2e on n-h1-858383-13 Oct 18 13:30:46.624289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-76de75a8-cdf1-40f4-aa9b-5b643184cc0b req-2225bf5c-677b-4ce8-89bb-b9c59cf9879f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120810 Oct 18 13:30:46.627499 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 946/1918] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:46.647217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.649453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.672704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.673215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.673665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.674527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.674991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.675422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.748230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.759621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7bbb1c14-6e9e-4b63-b56b-5866732771f9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1463 microversion: 2.1 time: 0.417875 Oct 18 13:30:46.763316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 973/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1463 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:46.774927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6", "tag": "46518faf-642f-4adf-acb1-1c4d7e4b35ff"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:46.800215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.802760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.803326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.829194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] Creating event network-changed:46518faf-642f-4adf-acb1-1c4d7e4b35ff for instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 on n-h1-858383-13 Oct 18 13:30:46.837731 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5c00687a-f3ba-46c6-918f-67eeba694d3e req-b3827b82-e891-4b3c-ab3b-8a36b40882cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072956 Oct 18 13:30:46.839335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 974/1920] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:47.049638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.054568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'deleted': False, 'project_id': 'c360dd76b1bf4dd891944860b13849cd'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:47.060507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.060991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.061434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.062186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.062649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.063076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.171186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:47.179643 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2fcceff3-e5c7-4797-a58e-64b43dfe4291 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.338225 Oct 18 13:30:47.186826 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 975/1921] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:30:47.189936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-356938a0-0576-47b4-8a5f-8221b9ee1d03 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.560962 Oct 18 13:30:47.191789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.194376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:47.212049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.213586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.215737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.217862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.222490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.223116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.226343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 947/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:47.274443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.274443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:47.286278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.287162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.287998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.292043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.292841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.293315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.643672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:47.655663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-928adc1d-658d-4627-8d9a-18ae50e76ebf tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.467498 Oct 18 13:30:47.657652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 976/1923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:47 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:47.662525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.669384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'deleted': False} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:47.675017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.675590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.676094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.677113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.678333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.678843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.819192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:47.826909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:30:47.855291 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf3caed0-518b-4901-b07b-2b10efd071d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.625459 Oct 18 13:30:47.856386 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 948/1924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:47 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:47.863065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.864131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:47.876133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.880039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.880039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.880039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.884239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.886558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.945757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.947296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.948010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.145016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.148762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:48.170909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b251bd69-efbf-4970-993a-620a19cb0e20 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1470 microversion: 2.1 time: 0.312428 Oct 18 13:30:48.180997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 949/1925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:47 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:48.190010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:48.191515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:48.205316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.206181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.206845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.208066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.208769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.210714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.608578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.618235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.624169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.625728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c37e0af8-a5d5-4411-b3dd-d7c5b2625947 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.442875 Oct 18 13:30:48.639995 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 950/1926] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:48 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:48.647329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:48.647329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:48.653969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.654506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.654953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.655719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.656317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.656747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.819504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b91aca3-a464-4abe-a9f6-aa49c01010db tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 25739 microversion: 2.1 time: 1.160493 Oct 18 13:30:48.820892 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 977/1927] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Oct 18 13:30:47 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 25739 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:30:48.827716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:48.829284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:48.836740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.838849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.839775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.841129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.844363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.844363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.101261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.110838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d414e2d3-10d1-4142-8671-13eeaf53779c tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.288388 Oct 18 13:30:49.111485 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 978/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:48 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.118551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.120019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.128184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.128931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.129743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.131115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.132415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.133388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.238774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b348a45-92d4-42e8-8127-da1822ee018d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "POST /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c/action" status: 202 len: 0 microversion: 2.1 time: 0.601317 Oct 18 13:30:49.246309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 951/1929] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:48 2022] POST /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:49.262257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.268257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'deleted': False, 'project_id': 'c360dd76b1bf4dd891944860b13849cd'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:49.276890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.277879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.278823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.279577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.280793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.281377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.297229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.306206 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08e029b5-9934-4e22-bf94-f40e63f662e9 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1351 microversion: 2.1 time: 0.193070 Oct 18 13:30:49.307945 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 979/1930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.312864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.313882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.320295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.321121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.322035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.323117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.323584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.324016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.413765 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40a48c04-681c-4e0e-9627-399b62549b64 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=cb1d59a6188a4b2fb67e6eba8f64d79f" status: 200 len: 15 microversion: 2.1 time: 0.165283 Oct 18 13:30:49.426091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 952/1931] 10.222.0.27 () {58 vars in 1231 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/detail?tenant_id=cb1d59a6188a4b2fb67e6eba8f64d79f => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:30:49.426091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:49.434163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.434163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.434163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.445907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] Creating event network-changed:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h2-858383-13 Oct 18 13:30:49.459175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cc9ae2c0-b35e-4361-a7e5-49f81bdb3223 req-ec8ee6c0-438a-4ec1-8c39-d3448abacf74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040972 Oct 18 13:30:49.461740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 953/1932] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:49.473704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.474598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.489442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.489952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.490461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.491675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.492838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.493337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.557899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.565765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac413cf2-20d9-4ae9-8c41-49cc0a0caa51 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.256506 Oct 18 13:30:49.566391 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 980/1933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.570910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.578432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'tenant_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'deleted': False} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:49.583646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.584208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.592450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.592450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.592450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.592450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.621650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:30:49.711049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.711534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.711977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.847934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.857260 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8beb04f2-1616-41a9-ad97-96c26ef318b4 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.387721 Oct 18 13:30:49.858315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 954/1934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.881735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.881735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.885603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.886356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.886946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21e5ebfa-7c95-4f72-a87b-3bf4f39c9542 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cb1d59a6188a4b2fb67e6eba8f64d79f" status: 200 len: 4833 microversion: 2.1 time: 0.319116 Oct 18 13:30:49.887565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 981/1935] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cb1d59a6188a4b2fb67e6eba8f64d79f => generated 4833 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.887925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.888886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.889576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.890264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.917378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.925075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'tenant_id': 'c360dd76b1bf4dd891944860b13849cd', 'deleted': False} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:49.930557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.932727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.934149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.937630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.938332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.942811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.975597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98feeabd-878f-42b9-b701-78385909d3d5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c360dd76b1bf4dd891944860b13849cd" status: 200 len: 15 microversion: 2.1 time: 0.062410 Oct 18 13:30:49.976526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 982/1936] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c360dd76b1bf4dd891944860b13849cd => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:30:50.003321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0f30d68-60d1-48c8-b96c-2c15cdaacbe9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.008785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b0f30d68-60d1-48c8-b96c-2c15cdaacbe9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009463 Oct 18 13:30:50.018789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 983/1937] 10.222.0.27 () {58 vars in 1189 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:30:50.038815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:50.041833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.050412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.051279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.051999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.053189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.054136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.054847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.182377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.195629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.197050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.198815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f95871f-b052-4db0-af09-d657799a1bf3 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.339282 Oct 18 13:30:50.199384 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 955/1938] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:50.215538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.216156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.231906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.232409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.232851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.233560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.234014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.234467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.298812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:50.536213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.547810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46c328c5-e591-4c4b-b82d-46abbf3f22a4 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.336490 Oct 18 13:30:50.550358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 956/1939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:50.555129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-plugged", "status": "completed", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:50.580245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.580726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.583525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.603728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Creating event network-vif-plugged:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h2-858383-13 Oct 18 13:30:50.609850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] Instance 70c46c56-f967-4399-85e3-54a3aac2389c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:30:50.621703 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f15cb3ef-9d25-4888-824a-b395e7670c23 req-0a7538b9-1a59-4aff-a790-48c13940fdc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069954 Oct 18 13:30:50.622797 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 957/1940] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:50.628766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.629790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.636759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.637507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.638205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.639108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.639800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.640423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.642270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-336fca62-65ea-4b14-be36-737f3d1679cd tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 0 microversion: 2.1 time: 0.609189 Oct 18 13:30:50.642932 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 984/1941] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:50 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:30:50.650190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.650963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.663237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.664673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.665267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.668124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.668613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.669274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.815356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.828836 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6417cfa-da2e-44d5-aa8a-c203f14d0c46 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1542 microversion: 2.1 time: 0.204555 Oct 18 13:30:50.830206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 958/1942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1542 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:50.839437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.851603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.861685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.864090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:50.873604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.875893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.879364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fd0fcff-1d4d-418d-abb0-f1a7c3ea1e15 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.232487 Oct 18 13:30:50.879511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.879615 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 985/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:50.879704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.879704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.879704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.882371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.886195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.897371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.903551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.904220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.905127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.905756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.906492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.006455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:30:51.053918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cab45fbf-4360-404c-83c6-428b3e79270f tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174619 Oct 18 13:30:51.060581 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 986/1944] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:51.065176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.066078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.079196 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6491c9c8-c105-459d-9b1c-3ceafe7cc42d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.246580 Oct 18 13:30:51.083502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.084964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.085863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.086907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 959/1945] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:51.089555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.090410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.091716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:51.092275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.094901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.101326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.101980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.102499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.103213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.104351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.104802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.359128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.371814 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49b22244-6afe-4604-9e65-bc2ddba4f58a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.308265 Oct 18 13:30:51.372502 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 987/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:51.378595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.380771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.386635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.387132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.387573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.397039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.397733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.402036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.590724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8030388-edc7-4cdb-aba0-08ad7b4f8041 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 0 microversion: 2.1 time: 0.502629 Oct 18 13:30:51.593156 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 960/1947] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:51 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:51.598577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.619559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.623920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.630621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.635664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.637302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c532ad76-84ab-444f-800e-6e714c825828 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.263571 Oct 18 13:30:51.654149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.654149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.654149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.654149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.654650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.654650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.656453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 988/1948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:51.665538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.666816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.677034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.679126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.686313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.686313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.686313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.686313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.975854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-786030a8-2c2c-42d4-a925-12dc12d6ecde tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1617 microversion: 2.1 time: 0.318029 Oct 18 13:30:51.978091 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 989/1949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1617 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:51.987498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.988246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.999234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.000075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.003643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.007603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.012753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.015567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.017742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.021696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b17ac3d5-1244-4355-8549-70f2b582c373 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.425822 Oct 18 13:30:52.028798 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 961/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:52.039225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.039225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.054620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.055716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.057632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.059590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.060734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.062672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.304250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.324528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-161c5d88-7a3d-457a-a570-5efa4203a135 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.334959 Oct 18 13:30:52.329644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 990/1951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:52.406181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.406915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.421496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.422634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.427739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.428944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.429624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.430310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.526782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c818b73-8965-4665-8ccc-a09f2715cdf5 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1617 microversion: 2.1 time: 0.501129 Oct 18 13:30:52.531473 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 962/1952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1617 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:52.553143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.569023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'host': 'n-h2-858383-13', 'deleted': False} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:52.576999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.577755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.578421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.579326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.579951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.580568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.766290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:30:52.885446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc7c51ae-bb1f-4770-bcd6-9841ab5aa8c7 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h2-858383-13&all_tenants=1" status: 200 len: 3268 microversion: 2.1 time: 0.336902 Oct 18 13:30:52.886494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 963/1953] 10.222.0.27 () {58 vars in 1192 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers?host=n-h2-858383-13&all_tenants=1 => generated 3268 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:52.892814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a74a32-985c-450b-a1b6-400e9704e08d", "name": "network-vif-plugged", "status": "completed", "tag": "c03f62b2-47fb-4123-a445-5713e3809bdc"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:52.906750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.907311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.910091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.917428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:52.927174 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] Creating event network-vif-plugged:c03f62b2-47fb-4123-a445-5713e3809bdc for instance 69a74a32-985c-450b-a1b6-400e9704e08d on n-h1-858383-13 Oct 18 13:30:52.933792 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8dd46483-e3ab-48eb-abff-3c652a1a3775 req-e87764bb-358f-48b7-9d19-0ce2e45e3c5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045583 Oct 18 13:30:52.934845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 964/1954] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:52.941442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.942196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.954390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.954914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.955374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.956113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.956571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.958669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.008317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.023209 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ec13c55-8fdf-4295-9a4a-ce8f1bc6eabb tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.628541 Oct 18 13:30:53.024295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 991/1955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:53.030468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.039496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:30:53.045730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.046255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.047118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.048085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.048769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.049653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.173901 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8015d23-c733-4ff3-ad8a-db68e24bc811 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.148419 Oct 18 13:30:53.174756 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 992/1956] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:30:53.179384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.180005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.186970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.187474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.187920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.188923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.189403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.189859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.339876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.351069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.352563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.356397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71be1a31-aa93-4e28-917a-c8e1e254c604 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.418012 Oct 18 13:30:53.359939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 965/1957] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:53.388936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:53.392477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.411511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.411954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.420439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.421899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.421899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.422199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.521753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.536232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4173d30-7b2c-430b-903c-dc7413eadfc1 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1316 microversion: 2.1 time: 0.360131 Oct 18 13:30:53.537841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 993/1958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:53.544663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.545513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.556184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.557351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.558261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.559459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.560200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.560991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.866038 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8c872a3-7c59-4a3c-8713-22196b1f8bd9 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 0 microversion: 2.1 time: 0.480367 Oct 18 13:30:53.866038 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 966/1959] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:53 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:53.874260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74d90e0-6f8a-4327-9167-274c11068f2e", "tag": "ac9aa433-5168-4482-b939-4a01298ce482"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:53.903923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.907123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.908959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.953636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] Creating event network-changed:ac9aa433-5168-4482-b939-4a01298ce482 for instance c74d90e0-6f8a-4327-9167-274c11068f2e on n-h1-858383-13 Oct 18 13:30:53.956851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d36479ea-0432-43ee-86f4-5c52280e3e9a req-cabfa6de-6de0-4cf2-9501-e51f9ce5319f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087300 Oct 18 13:30:53.958255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 967/1960] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:53.965942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:53.969683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.977881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.978961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.979441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.980351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.980826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.981317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.100358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:54.100831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:54.101393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:54.101965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:54.102852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:54.411379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.423383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c3543bb-a12e-4e1a-9576-b0438d371a07 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.881739 Oct 18 13:30:54.424004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 994/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:54.436719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:54.439574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.444545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.460205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.461192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.461656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.464082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.465707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.466950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.476325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.490081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.491373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.492137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.492608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.493062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.615219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96f0a2a8-db2a-4d76-8d0e-981d16ee2d38 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 1068 microversion: 2.1 time: 0.655241 Oct 18 13:30:54.616180 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 968/1962] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:53 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 1068 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:30:54.625754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:54.626834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.637659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.638609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.639229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.640118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.640585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.641180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.999962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.009066 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a406ff5-30fe-4e15-a256-3bba90b71693 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.583927 Oct 18 13:30:55.026423 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 995/1963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:54 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:55.045721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:55.046382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:55.055767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.056275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.057739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.057975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.058471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.058906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.504428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.524255 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f52e8426-1785-47b8-8cde-2a85f14e65cc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1504 microversion: 2.1 time: 0.491548 Oct 18 13:30:55.532476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 996/1964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:55 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:55.594884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.597325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.598844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.600052 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6de37d2-af88-4694-8bf0-1911d3d7c339 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.979993 Oct 18 13:30:55.613790 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 969/1965] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:54 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:55.618563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:55.623750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:55.634981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.637181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.637632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.641052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.641545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.642049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.676519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a710ad0f-50f4-4243-a5bc-a79a8199b84a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb3307875e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1492663768", "description": "tempest-description-1534648537"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:55.945990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.958474 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a12a8882-4877-44d3-bef7-0a3c62b5fcc1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.347475 Oct 18 13:30:55.967121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 970/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:55 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:55.968752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:55.973767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:55.986187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.987238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.989022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.989964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.990466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.991215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.219827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.229068 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c1e3884-175b-47fc-a986-15fd8546b6aa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.267997 Oct 18 13:30:56.229870 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 971/1967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:55 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:56.234595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.235099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.241606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.242127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.242576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.243281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.243784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.244416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.280077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:56.398685 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a710ad0f-50f4-4243-a5bc-a79a8199b84a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.849117 Oct 18 13:30:56.399444 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 997/1968] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:30:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:56.404326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.404952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.414137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.416264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.417965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.418191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.421113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.421582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.585991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.595572 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-662b9e5a-974b-442e-801d-004415a11f6c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.195053 Oct 18 13:30:56.596734 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 998/1969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:56 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:56.602160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31af89c5-853e-495f-9d18-0691eb7d970b tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb3307875e0>, body: {"security_group_rule": {"parent_group_id": "7d3dc854-2525-4fe9-80ba-69c61d879f12", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:56.856964 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e0cb751-3fd4-4316-92e3-fd387b2a39af tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 204 len: 0 microversion: 2.1 time: 0.625675 Oct 18 13:30:56.862835 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 972/1970] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:56 2022] DELETE /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:56.866168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.866882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.876078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.876582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.877029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.877746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.878251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.878676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.109979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.120689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.122145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.123327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8b62115-c075-4377-8387-e08fa0502a2c tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1487 microversion: 2.25 time: 0.261766 Oct 18 13:30:57.124396 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 973/1971] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:56 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:57.130424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.131743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.139784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.140466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.147277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.147277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.147277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.147277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.350659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.359689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc62a627-6f13-4807-a773-75a9d35c781a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1510 microversion: 2.1 time: 0.233929 Oct 18 13:30:57.360270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 974/1972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:57.365205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.366125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.372498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.374314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.374833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.375559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.376199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.376791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.383962 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31af89c5-853e-495f-9d18-0691eb7d970b tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.785796 Oct 18 13:30:57.394438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 999/1973] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:30:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:57.394438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.394438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.397815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.398481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.399056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.399879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.400988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.401556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.571787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.599402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-650c273e-29ae-4cfc-9ba6-3b301b9b0812 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.234352 Oct 18 13:30:57.600456 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 975/1974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:57.625413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72949a30-d8fc-4c85-bb55-4b66959d3106 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330d83940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1709212811", "description": "tempest-description-1515538259"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:57.625890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.636302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9b41bdd-7a48-480b-8ca9-79bcba9c5067 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.250281 Oct 18 13:30:57.654910 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1000/1975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:57.663866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.663866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.674025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.674693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.675024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.675761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.676234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.676677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.868380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.881804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb1daf99-ade2-4b10-b546-b79233921b3e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.221360 Oct 18 13:30:57.898804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1001/1976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:58.081052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "name": "network-vif-plugged", "status": "completed", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:58.100168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.101060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.102487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.138156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] Creating event network-vif-plugged:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h2-858383-13 Oct 18 13:30:58.141011 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-66c38200-8759-41fe-8bb5-8e415a365b53 req-79a71474-0cfc-4830-ae1a-c9d90930854d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066036 Oct 18 13:30:58.142250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1002/1977] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:58.153694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.163264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.175833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.176452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.176902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.177669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.178153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.178676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.184294 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72949a30-d8fc-4c85-bb55-4b66959d3106 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.582540 Oct 18 13:30:58.185373 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 976/1978] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:30:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:58.202021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-292f9822-149d-4eca-a13c-80d235304001 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330dd4550>, body: {"security_group_rule": {"parent_group_id": "62481a32-eb44-4007-a97e-f1527ea96cac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:58.559037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.566852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.568430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.569722 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-619e3ca6-54d1-4259-adeb-b3a900d7f377 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1477 microversion: 2.25 time: 0.423940 Oct 18 13:30:58.570734 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1003/1979] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:58.575367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.576088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.582667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.583463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.584168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.585086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.585808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.586549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.591754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:58.862502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.875659 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-292f9822-149d-4eca-a13c-80d235304001 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.680835 Oct 18 13:30:58.884680 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 977/1980] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:30:58 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:30:58.884680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd2bb3de-5466-48a0-a17e-1344b429e45a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '.version_select at 0x7fb330ce1280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.886629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cfe42559-c71c-4a90-9fce-831db09daf7e tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1510 microversion: 2.1 time: 0.313809 Oct 18 13:30:58.888518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1004/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:58.889919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2bb3de-5466-48a0-a17e-1344b429e45a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.890548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2bb3de-5466-48a0-a17e-1344b429e45a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.891124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2bb3de-5466-48a0-a17e-1344b429e45a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.897670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.902881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.909662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.910194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.910647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.911355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.912003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.912637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.912773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd2bb3de-5466-48a0-a17e-1344b429e45a tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4511 microversion: 2.25 time: 0.034895 Oct 18 13:30:58.913663 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 978/1982] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/os-migrations => generated 4511 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:58.918794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.919412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.927246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.927825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.928339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.929119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.929657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.930221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.070101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.073345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:59.081094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33f6bfc9-13ba-4388-b6c8-70ea028fa92f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1360 microversion: 2.1 time: 0.166322 Oct 18 13:30:59.093173 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 979/1983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:59.093173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-188e7ddb-f38a-474e-bd40-a29123e72195 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb3317caa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1507176336", "description": "tempest-description-1616422280"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:59.182449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.190403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d00266a-46df-49a1-977a-ea6f7ff6c590 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.300600 Oct 18 13:30:59.191199 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1005/1984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:59.196533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.198030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.204471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.206389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.206963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.207793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.208347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.208856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.545303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.556057 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ad4780d-668c-465b-ba99-769916ed71b3 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.363521 Oct 18 13:30:59.561874 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1006/1985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:59.577175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.581480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.591819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:59.595497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.597090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.597540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.598283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.599489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.601465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.701083 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-188e7ddb-f38a-474e-bd40-a29123e72195 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.616464 Oct 18 13:30:59.701083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 980/1986] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:30:59 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:59.706313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a74a32-985c-450b-a1b6-400e9704e08d", "name": "network-vif-deleted", "tag": "c03f62b2-47fb-4123-a445-5713e3809bdc"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:59.722170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:59.726232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.727118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.727811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.742701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] Creating event network-vif-deleted:c03f62b2-47fb-4123-a445-5713e3809bdc for instance 69a74a32-985c-450b-a1b6-400e9704e08d on n-h1-858383-13 Oct 18 13:30:59.750150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f4fad0e3-d710-4a91-9a51-e39fdeabfe5e req-54d3f8f3-d14b-4bce-a44b-c8ca53b3dace service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047939 Oct 18 13:30:59.757003 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 981/1987] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:59.770077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-125ebe18-2a56-4e8c-b9e4-0eb7ea97077f tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330ffcf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1821485939", "description": "tempest-description-1983129022"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:59.886764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] Lazy-loading 'services' on Instance uuid 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:59.929409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-127ff55f-219f-4e29-a52d-b11793712c44 tempest-LiveAutoBlockMigrationV225Test-887354888 tempest-LiveAutoBlockMigrationV225Test-887354888-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1972 microversion: 2.25 time: 0.362163 Oct 18 13:30:59.944606 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1007/1988] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1972 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:59.948679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.949308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.955370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.956128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.966631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.967734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.974109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.974933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.031906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.032114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.032663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.034256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lazy-loading 'fault' on Instance uuid 69a74a32-985c-450b-a1b6-400e9704e08d {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:00.105882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a3037c50994ccfb3fec51fa07bd3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7308e67ff4a34e4e90cc2cb73dd715ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.112838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02e5075c-4f25-4237-bc0d-04d0770207ba tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 200 len: 1306 microversion: 2.1 time: 0.169135 Oct 18 13:31:00.113946 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1008/1989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 1306 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:00.120062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.120560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.128370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.128961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.129447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.130463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.130921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.131550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.197164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:00.297390 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-125ebe18-2a56-4e8c-b9e4-0eb7ea97077f tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.532987 Oct 18 13:31:00.305553 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 982/1990] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:30:59 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:00.323043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.323043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.323043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.323043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.323798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.323798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.324168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.324655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.521601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.545090 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46f94e82-d4aa-4617-b8ff-f36686544905 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1543 microversion: 2.1 time: 0.230216 Oct 18 13:31:00.550036 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 983/1991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1543 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:00.558024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-unplugged", "status": "completed", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:00.566642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.567513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.568973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.582859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Creating event network-vif-unplugged:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:31:00.590818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] Instance 70c46c56-f967-4399-85e3-54a3aac2389c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:31:00.605099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0601267d-8372-4caf-8327-01f3b436fb5a req-e86bea8d-5339-4958-a19c-1464030ca17e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053499 Oct 18 13:31:00.605959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 984/1992] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:00.615301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.617073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.624833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.626280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.626280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.627075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.627538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.627966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.648180 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c1bf606-9f0c-4cba-9088-ad2a43e1d115 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 204 len: 0 microversion: 2.25 time: 0.530795 Oct 18 13:31:00.651235 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1009/1993] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:31:00 2022] DELETE /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:00.656538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c2b9310-70d1-4ff4-95ce-54fbb020c36a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb3309cad30>, body: {"security_group_rule": {"parent_group_id": "4bf4d1f1-8218-4684-b803-4b296d953d0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "af145b5e-725e-4d52-a53e-a99967f2b412"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:00.794156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.802484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbc14dd5-ddd1-4bc7-b269-2aac250ef187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.194321 Oct 18 13:31:00.803071 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 985/1994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:00.815214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.815824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.829651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.836393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.841455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.842319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.843350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.844222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.933741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c04cb2d3-18f5-448d-9865-3f224515609e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122208 Oct 18 13:31:00.934562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 986/1995] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:00.939524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.942191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.954117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.955349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.956715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.957476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.957949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.958448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.177972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.186995 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-466c0244-b9d6-4fc5-9222-248f01fcf076 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.251148 Oct 18 13:31:01.187593 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 987/1996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:01.192628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.193418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.200294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.200964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.201595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.202547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.203168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.203755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.371653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.380925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.382712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.384231 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1345520a-1804-4b17-b46e-344663708046 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1483 microversion: 2.25 time: 0.195482 Oct 18 13:31:01.398912 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 988/1997] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1483 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:01.414300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.414300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.427977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.428527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.428992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.429759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.430263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.430702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.446855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d HTTP/1.1 Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.449283 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.451032 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '69a74a32-985c-450b-a1b6-400e9704e08d'} Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.452315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.454375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.459537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.460629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95144954-88e0-4063-9654-c2d7b5dc4da6 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 404 len: 111 microversion: 2.1 time: 0.060220 Oct 18 13:31:01.461684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 989/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.475656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2018678749", "metadata": {"image_type": "test"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.480017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.484428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:01.492429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.492929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.493373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.494227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.495057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.495190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.512186 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d/action HTTP/1.1 Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 112 Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.514420 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2018678749", "metadata": {"image_type": "test"}}} Oct 18 13:31:01.516609 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '69a74a32-985c-450b-a1b6-400e9704e08d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2018678749', 'metadata': {'image_type': 'test'}}}} Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.517765 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.519672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.521560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.522315 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73a77fb9-49ac-4c27-a781-4fb9e57c6cab tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "POST /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d/action" status: 404 len: 111 microversion: 2.1 time: 0.055489 Oct 18 13:31:01.524967 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 990/1999] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.557785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1187555488", "metadata": {"image_type": "test"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.561922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Failed to fetch instance by id tempest-invalid-1891010106 {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:31:01.562567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance tempest-invalid-1891010106 could not be found. Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/tempest-invalid-1891010106/action HTTP/1.1 Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 112 Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.564347 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1187555488", "metadata": {"image_type": "test"}}} Oct 18 13:31:01.566600 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance tempest-invalid-1891010106 could not be found. Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'tempest-invalid-1891010106', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1187555488', 'metadata': {'image_type': 'test'}}}} Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1891010106 could not be found. Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.568320 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1891010106 could not be found. Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1891010106 could not be found. Oct 18 13:31:01.571648 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.576972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance tempest-invalid-1891010106 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.576972 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-174a7cae-8fcd-4a21-867b-1a8dd96f9ecc tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1891010106/action" status: 404 len: 101 microversion: 2.1 time: 0.017018 Oct 18 13:31:01.578147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 991/2000] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/servers/tempest-invalid-1891010106/action => generated 101 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.584833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2091993965"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.591368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:31:01.591596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 57 Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.594278 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: {"createImage": {"name": "tempest-test-snap-2091993965"}} Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.595922 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2091993965'}}} Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.596873 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.598917 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.600626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.600626 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-daca56aa-6174-4091-b9cc-a336e2a86902 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016310 Oct 18 13:31:01.602492 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 992/2001] 10.222.0.27 () {60 vars in 1275 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.607290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1370229626"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.609530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:31:01.610048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 57 Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.612056 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: {"createImage": {"name": "tempest-test-snap-1370229626"}} Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.613590 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1370229626'}}} Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.614574 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:31:01.616210 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.620102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.620102 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea65edcb-a6ef-4bc6-ae63-a45736ae4131 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.009722 Oct 18 13:31:01.620102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 993/2002] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.624779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.625092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.632782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.633381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.633969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.635299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.635775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.636211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.650190 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d HTTP/1.1 Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.652779 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.654699 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '69a74a32-985c-450b-a1b6-400e9704e08d'} Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.656812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.658464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.659976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.659976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-edaa5b7a-1f6d-46f7-9c02-a363936e39d0 tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 404 len: 111 microversion: 2.1 time: 0.034194 Oct 18 13:31:01.659976 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 994/2003] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:01 2022] DELETE /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:01.663477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.664102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] [instance: 69a74a32-985c-450b-a1b6-400e9704e08d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.671650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.672096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.672552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.673267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.673729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.674694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.691054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] HTTP exception thrown: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Request method failure captured: Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d HTTP/1.1 Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqp0lNB8CQZW7u2bNfF0feklsZVqIXdBLRtJT6htUhcNKQQx74RE9ttrIcJlF3J-u4F8e56gUTgzctoPLe47s7DP_ZLNcXZ_xp2W-0nahyjCwM5VXsyJxPxoH-LdOmaGjoKGr7iKTfoEDjkV4mwGY_fWhvVJGoPTuRud75mQTsX0v5o Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:01.692871 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7308e67ff4a34e4e90cc2cb73dd715ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 7308e67ff4a34e4e90cc2cb73dd715ca Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1487001024 Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 25a3037c50994ccfb3fec51fa07bd3c0 Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesNegativeTestJSON-1487001024-project Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.694765 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '69a74a32-985c-450b-a1b6-400e9704e08d'} Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:01.695696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. Oct 18 13:31:01.697796 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:01.699301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] Returning 404 to user: Instance 69a74a32-985c-450b-a1b6-400e9704e08d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:01.699301 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-676727ca-f596-4fa6-b2d9-cb25c71d741a tempest-ImagesNegativeTestJSON-1487001024 tempest-ImagesNegativeTestJSON-1487001024-project] 10.222.0.27 "GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d" status: 404 len: 111 microversion: 2.1 time: 0.034821 Oct 18 13:31:01.699301 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 995/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/69a74a32-985c-450b-a1b6-400e9704e08d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:31:01.794595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.821210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.823017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.824946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.867370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Creating event network-changed:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:31:01.876724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] Instance 70c46c56-f967-4399-85e3-54a3aac2389c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:31:01.895324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-38293abc-e427-4d68-8b06-bfc3b39cd649 req-7846368b-e309-4268-9f64-8017015351b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111897 Oct 18 13:31:01.896518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 996/2005] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:01.905259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.910667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.913860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.914412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.914873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.915799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.916186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.916632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.247229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c2b9310-70d1-4ff4-95ce-54fbb020c36a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.594858 Oct 18 13:31:02.247836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1010/2006] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:02.252579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.253481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.262068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.263158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.263615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.264378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.265047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.265853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.338006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.350213 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-023f8c71-e17c-459f-aff2-df3ae8572187 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.451633 Oct 18 13:31:02.351322 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 997/2007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:02.357729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bba0b29c-39f5-4381-b769-a8a7f28e802f tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330dd4f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1876535520", "description": "tempest-description-369978039"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:02.496791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.505169 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1fd9a95c-c350-4de0-8c4a-c5f764274acc tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.256272 Oct 18 13:31:02.506195 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1011/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:02.511026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.511643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.518865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.519586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.520224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.521113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.522369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.522817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.620031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.626927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.628808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.630000 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c03ac3c3-3a55-406e-9347-6a56d9846954 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1441 microversion: 2.25 time: 0.122688 Oct 18 13:31:02.630841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1012/2009] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1441 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:02.642090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:02.703592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6", "name": "network-vif-deleted", "tag": "46518faf-642f-4adf-acb1-1c4d7e4b35ff"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:02.720906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.721703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.722435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.743161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] Creating event network-vif-deleted:46518faf-642f-4adf-acb1-1c4d7e4b35ff for instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 on n-h2-858383-13 Oct 18 13:31:02.750819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-cdcc0b02-4699-4913-b7ee-7f0c8fce62bb req-2e671366-3ba0-4e64-8ee3-f52d593ee285 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050409 Oct 18 13:31:02.764619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1013/2010] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:03.120611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bba0b29c-39f5-4381-b769-a8a7f28e802f tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.767898 Oct 18 13:31:03.121206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 998/2011] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:03.142130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:03.151881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0299a60-1e14-4055-a549-51d9c19deee0 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb33079b040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1138479555", "description": "tempest-description-671151006"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:03.377225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.378390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.389935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.390513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.390978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.391720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.392205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.392912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.895361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0299a60-1e14-4055-a549-51d9c19deee0 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.758883 Oct 18 13:31:03.896171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1014/2012] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:03.901594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.905942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.932099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.932623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.936357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.937687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.942865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.943531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.229755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.241794 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46be7714-f765-4a57-ae06-cd3e7be418a0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.866823 Oct 18 13:31:04.242959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 999/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:04.258459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:04.259418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:04.268312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.271438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.272102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.273011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.274148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.277422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.348137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.361655 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2753dde-ab79-4dc0-ac6f-0186a30bec4d tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1469 microversion: 2.1 time: 0.464333 Oct 18 13:31:04.363922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1015/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:04.371138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86ef3983-26ad-4012-b835-2561130abc7c tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb3312a54c0>, body: {"security_group_rule": {"parent_group_id": "13f1c92c-4ec5-4672-b875-235c15d4e4bf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5f70e566-88ce-46fd-82da-80080dcb90c7"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:04.392729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.412160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.418857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.423700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dacd6d1a-e958-4d70-aa7f-8c774f6f4f57 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1266 microversion: 2.25 time: 0.177892 Oct 18 13:31:04.427695 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1000/2015] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:04 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:04.439786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:04.495043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.495043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.495043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.517558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] Creating event network-changed:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h2-858383-13 Oct 18 13:31:04.528052 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-56cb3b1e-79c7-4436-88a9-fb48588ae25d req-b98982e2-9518-4246-851f-aa72b99f47f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099685 Oct 18 13:31:04.529877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1001/2016] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:05.182250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86ef3983-26ad-4012-b835-2561130abc7c tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.816428 Oct 18 13:31:05.186296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1016/2017] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:05.197412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed76fdb4-a4d8-4b30-8aa8-1d69ef021806 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330ce1dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.269815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.270476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.278649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.279367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.280099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.281224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.281892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.283357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.492341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.502560 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71bc09d7-a6dd-4d8f-85f6-7ea8585d27ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.236449 Oct 18 13:31:05.513544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1017/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:05.513544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.513544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.518219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.519347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.521192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.524184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.525581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.526220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.741482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.750036 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5dc5ccaf-c089-4522-b6d5-1c776026e82a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1462 microversion: 2.1 time: 0.244455 Oct 18 13:31:05.766082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1018/2019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1462 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:05.766082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.766082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.771268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.771795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.772252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.772994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.773456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.778803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.854524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.864609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.866632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.868404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-186d05e5-b9c6-4cfc-af8d-04643c94aae8 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1266 microversion: 2.25 time: 0.116411 Oct 18 13:31:05.869591 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1019/2020] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:06.001114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed76fdb4-a4d8-4b30-8aa8-1d69ef021806 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5f70e566-88ce-46fd-82da-80080dcb90c7" status: 202 len: 0 microversion: 2.1 time: 0.809227 Oct 18 13:31:06.005838 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1002/2021] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:05 2022] DELETE /compute/v2.1/os-security-groups/5f70e566-88ce-46fd-82da-80080dcb90c7 => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:06.012313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb5c9abd-6abb-4aa3-b21a-44e783da3159 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb33167bee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.134089 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb5c9abd-6abb-4aa3-b21a-44e783da3159 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/13f1c92c-4ec5-4672-b875-235c15d4e4bf" status: 200 len: 247 microversion: 2.1 time: 0.125539 Oct 18 13:31:06.149326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1003/2022] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:31:06 2022] GET /compute/v2.1/os-security-groups/13f1c92c-4ec5-4672-b875-235c15d4e4bf => generated 247 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:06.165800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.166455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:06.169774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-491c0e6f-35fa-469c-a031-10f3509f626a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330d83790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1719203180", "description": "tempest-description-629186327"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:06.182887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.185086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.185086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.185086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.185086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.185636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.649360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5976d01-5e89-4413-aef6-95c9219a42d2 tempest-MigrationsAdminTest-1046816860 tempest-MigrationsAdminTest-1046816860-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1615 microversion: 2.1 time: 0.778190 Oct 18 13:31:06.651108 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1020/2023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1615 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:06.678406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.680698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:06.687054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-491c0e6f-35fa-469c-a031-10f3509f626a tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.536252 Oct 18 13:31:06.687687 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1004/2024] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:06.701628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.702373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:06.711125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.714528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.715065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.716424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.717156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.717813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.718303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.718597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.718866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.719061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.721377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.722194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.783951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:07.024846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.036170 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10755960-08fc-4b8f-8350-7a80c0866690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.383655 Oct 18 13:31:07.037671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1021/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:06 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:07.055379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2619b2fb-65a3-4f1e-89a4-d6b3a6b2bcd7 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330857280>, body: {"security_group_rule": {"parent_group_id": "26197c1e-cdcd-4851-acc0-6cb7b9df694e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:07.224818 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d0c055f-65e0-44d7-a6c7-63d83f98e75b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 204 len: 0 microversion: 2.1 time: 0.527511 Oct 18 13:31:07.229108 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1005/2026] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:06 2022] DELETE /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:07.238315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.239110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.246380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.247131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.247581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.248970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.249448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.249880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.393983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.407265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.410243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.410243 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f06b1bcd-1477-4314-9f48-61c5a8d711ce tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1266 microversion: 2.25 time: 0.179908 Oct 18 13:31:07.410979 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1006/2027] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:07.421209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.422121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.440773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.441158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.441802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.442945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.443588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.444515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.723409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.732054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91f3d8b5-2fb4-410a-a373-18d89f28b798 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1468 microversion: 2.1 time: 0.316689 Oct 18 13:31:07.741436 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1007/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:07.761086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2619b2fb-65a3-4f1e-89a4-d6b3a6b2bcd7 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.721932 Oct 18 13:31:07.762173 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1022/2029] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.773983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a9b60665-59bb-4165-b6df-72ec86abc467 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Action: 'create', calling method: .version_select at 0x7fb330cf5d30>, body: {"security_group_rule": {"parent_group_id": "26197c1e-cdcd-4851-acc0-6cb7b9df694e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:08.063105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.063737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.069879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.070635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.071270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.072169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.072824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.073431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.078510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:08.399670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.413201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9188d08e-ceb8-4c16-9469-b3ccddc6c642 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.353085 Oct 18 13:31:08.428887 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a9b60665-59bb-4165-b6df-72ec86abc467 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.650847 Oct 18 13:31:08.428887 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1008/2030] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:07 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:08.430811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1023/2031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:08.433558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-plugged", "status": "completed", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:08.448451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.449232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.449839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.459124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb8ca58e-e6f5-497d-b0ae-f0331742b2ef tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb33087d040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.472724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] Creating event network-vif-plugged:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:31:08.495973 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-199626a9-1fe1-461a-a86f-e502fa2592f0 req-56603782-7267-4c23-aaab-97a297bce306 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066067 Oct 18 13:31:08.502407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1009/2032] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:08.518299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.519007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.530085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.530587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.533017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.533017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.533017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.533017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.575931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:08.645252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb8ca58e-e6f5-497d-b0ae-f0331742b2ef tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/26197c1e-cdcd-4851-acc0-6cb7b9df694e" status: 200 len: 664 microversion: 2.1 time: 0.212816 Oct 18 13:31:08.650479 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1024/2033] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/os-security-groups/26197c1e-cdcd-4851-acc0-6cb7b9df694e => generated 664 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:08.650668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.661945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a76a8b0-867f-4f4b-8a3f-4568422ad15b tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb33079baf0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.662323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.663757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.676251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef4e0276-0ee0-4645-9a11-d22fa1016066 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1266 microversion: 2.25 time: 0.172490 Oct 18 13:31:08.677329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1010/2034] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:08.758008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.760074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.773895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.781399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.781981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.782886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.787253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.788064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.177025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.198180 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2a8c6ad-8c40-4f7c-a7d6-5aedc1d3a19e tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1468 microversion: 2.1 time: 0.445924 Oct 18 13:31:09.199728 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1011/2035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:09.442417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.443118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.460031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.460533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.460990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.462046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.462654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.463221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.754517 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a76a8b0-867f-4f4b-8a3f-4568422ad15b tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/e24b5118-4b7f-4e90-b5e6-3822cf1bad70" status: 202 len: 0 microversion: 2.1 time: 1.096746 Oct 18 13:31:09.759929 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1025/2036] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Oct 18 13:31:08 2022] DELETE /compute/v2.1/os-security-group-rules/e24b5118-4b7f-4e90-b5e6-3822cf1bad70 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:09.761836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.762954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.787391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.787838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.788291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.789029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.789485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.797271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.852074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.852808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.853490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.853949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'fault' on Instance uuid 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:09.926705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.940345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.943492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.947857 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-adfb1ada-e494-45d4-aedd-7d78230ef048 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 200 len: 1271 microversion: 2.25 time: 0.190042 Oct 18 13:31:09.950560 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1026/2037] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:09 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:09.964910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2285ec3d-372b-46bc-b0ef-bb1e52e758cd tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330857040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.135715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.145250 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b920c43-e783-4765-b075-e6a26855bed8 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.706511 Oct 18 13:31:10.173597 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1012/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:09 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:10.223754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.224581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.250842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.252854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.253432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.255489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.256709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.260530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.388931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.398527 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b51322d2-b106-4ff9-adb3-1911e510117f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1426 microversion: 2.1 time: 0.178747 Oct 18 13:31:10.399669 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1013/2039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1426 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:10.435568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46c56-f967-4399-85e3-54a3aac2389c", "name": "network-vif-deleted", "tag": "ec590fdb-4161-477e-a925-89542c7e1a19"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:10.445307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.446536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.447187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.464138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] Creating event network-vif-deleted:ec590fdb-4161-477e-a925-89542c7e1a19 for instance 70c46c56-f967-4399-85e3-54a3aac2389c on n-h1-858383-13 Oct 18 13:31:10.471913 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-479e5e6f-32ec-4209-979f-1f986f68df0e req-66658498-cdb3-4953-bc56-6386e875f7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Oct 18 13:31:10.479052 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1014/2040] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:10.929244 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2285ec3d-372b-46bc-b0ef-bb1e52e758cd tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/26197c1e-cdcd-4851-acc0-6cb7b9df694e" status: 202 len: 0 microversion: 2.1 time: 0.977350 Oct 18 13:31:10.930558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1027/2041] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:09 2022] DELETE /compute/v2.1/os-security-groups/26197c1e-cdcd-4851-acc0-6cb7b9df694e => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:10.941015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330d75b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.974687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.975698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.981329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:31:10.982152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Neutron security group 5f70e566-88ce-46fd-82da-80080dcb90c7 not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:31:10.982978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] HTTP exception thrown: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:10.982978 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:10.985409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.987862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Request method failure captured: Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/5f70e566-88ce-46fd-82da-80080dcb90c7 HTTP/1.1 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqqOfoGfuu0yXbePbU05GL4ocD5nAwN78xt-sTGpUMOUWtDpZMNz1E0lFnUs8eEOUdEXcT9SttNZ6ME0nneA6NJUKXL8XAsQPRZ-LqxA2pzM550_QPx6rvXh80sndY_6alwiTIbr7fuyw4rd06i7_hFMQVF4DOPkw_ESxHo9yPLVfS0 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: aea9ea82f78a407996b24272734e942f Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-620816665 Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:10.994323 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aea9ea82f78a407996b24272734e942f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aea9ea82f78a407996b24272734e942f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aea9ea82f78a407996b24272734e942f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aea9ea82f78a407996b24272734e942f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupRulesTestJSON-620816665 Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: aea9ea82f78a407996b24272734e942f Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-620816665 Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupRulesTestJSON-620816665-project Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a1d6385312694da692b60a1d7756dffd Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupRulesTestJSON-620816665-project Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:10.996116 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5f70e566-88ce-46fd-82da-80080dcb90c7'} Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:31:10.997234 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:31:10.999038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.000540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Returning 404 to user: Security group 5f70e566-88ce-46fd-82da-80080dcb90c7 does not exist Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-3ae450ab-f8a0-48fe-a320-bb6f9b5019bc'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8aae181a-dcb8-4d58-9365-1b168f6b95d4 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5f70e566-88ce-46fd-82da-80080dcb90c7" status: 404 len: 194 microversion: 2.1 time: 0.053926 Oct 18 13:31:11.002462 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1015/2042] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:10 2022] DELETE /compute/v2.1/os-security-groups/5f70e566-88ce-46fd-82da-80080dcb90c7 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:11.003413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.003413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.003413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.003413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.007136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3de2cbe-d623-4f1e-bf81-639ce9b21f10 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330c109d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.032163 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] HTTP exception thrown: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Request method failure captured: Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 HTTP/1.1 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkC4VsZelqTw7XMfl9pUV9hnGyB74MzCYKXd2pv1ZauuJNcmOV9O_SeOwytyumBk6-EHtnXkvYDH3TKdBdyOQBdAJ1h3Vf7ejQekG-Dv3I74mWi0tbAT5LBra-FyiOzvexMYrmFpf1SWLXKJHX-NKf25fKSqwMJokVsPcIDNHDCKao Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:11.033974 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: fa4ca05a0c6a405f8fa014ee06dbcef4 Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. Oct 18 13:31:11.035706 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6'} Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:11.036616 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. Oct 18 13:31:11.041653 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.044162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Returning 404 to user: Instance 14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:11.044162 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d745c5e-e5b7-4b73-8cf2-ca7c29aa04a2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6" status: 404 len: 111 microversion: 2.25 time: 0.066387 Oct 18 13:31:11.057072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1028/2043] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/14fc5e5f-c4cb-499d-92da-0c8cab1cb3c6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:31:11.180719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.182352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.193390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.194658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.196855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.198077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.200445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.201090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.467387 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3de2cbe-d623-4f1e-bf81-639ce9b21f10 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/13f1c92c-4ec5-4672-b875-235c15d4e4bf" status: 202 len: 0 microversion: 2.1 time: 0.462621 Oct 18 13:31:11.467387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1016/2044] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:10 2022] DELETE /compute/v2.1/os-security-groups/13f1c92c-4ec5-4672-b875-235c15d4e4bf => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:31:11.469184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.470143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.491559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.492127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.494869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.499487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.499893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.500399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.576879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.580800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.581698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.582414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.584024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lazy-loading 'fault' on Instance uuid 70c46c56-f967-4399-85e3-54a3aac2389c {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:11.592344 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6941b19c-5496-4eac-b18f-ae79864fd409 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.415923 Oct 18 13:31:11.593759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1029/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:11.600977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8a1dd403-eaad-4f03-98b8-d730290ac9d5 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330787e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.708094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.720076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dff5739a-f2ff-47ec-a006-132f9fce1a76 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 200 len: 1302 microversion: 2.1 time: 0.254485 Oct 18 13:31:11.725577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1017/2046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 1302 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:12.316286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8a1dd403-eaad-4f03-98b8-d730290ac9d5 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/af145b5e-725e-4d52-a53e-a99967f2b412" status: 202 len: 0 microversion: 2.1 time: 0.720809 Oct 18 13:31:12.317745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1030/2047] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:11 2022] DELETE /compute/v2.1/os-security-groups/af145b5e-725e-4d52-a53e-a99967f2b412 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:12.326187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-117d0b81-9d58-4426-9b69-6639724c1bc8 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb330d75ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.618750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.619381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.633688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.634755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.635203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.635916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.636384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.636843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.865199 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-117d0b81-9d58-4426-9b69-6639724c1bc8 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4bf4d1f1-8218-4684-b803-4b296d953d0b" status: 202 len: 0 microversion: 2.1 time: 0.543583 Oct 18 13:31:12.866668 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1018/2048] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:12 2022] DELETE /compute/v2.1/os-security-groups/4bf4d1f1-8218-4684-b803-4b296d953d0b => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:12.874767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.875639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 70c46c56-f967-4399-85e3-54a3aac2389c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.889049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.889551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.890006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.890766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.891235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.891673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.898513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.909653 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6b98efe1-dfb7-45b1-a66c-e2bfb862ae94 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1472 microversion: 2.1 time: 0.295986 Oct 18 13:31:12.911081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1031/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:12 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:12.917315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-946b9886-06fe-484b-80a8-b0db45d528f5 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb33074d3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.928543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] HTTP exception thrown: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Request method failure captured: Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c HTTP/1.1 Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk_NrW42A5tYYt4WL_4LH7PfyxdOc486ZMRVZkqBxScujYT2UNAsBoKDJmvlgQyMQb-h6xAmtElaRmq5s_Ngp_JfcH-dupEuDG6DYIloXhJsLTG-ExjY_2-ycsb6lYPhWWdcAdmMQm__HCODWP7nMEymBkv2VjDoAcmjF4HDIOD53g Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:12.930715 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c1cd81ee6174cee97e384cae58a2e6a Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. Oct 18 13:31:12.939310 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '70c46c56-f967-4399-85e3-54a3aac2389c'} Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:12.940511 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. Oct 18 13:31:12.941896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:12.956740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Returning 404 to user: Instance 70c46c56-f967-4399-85e3-54a3aac2389c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:12.962569 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5da83c4b-c511-43a8-b5a1-328eae220689 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c" status: 404 len: 111 microversion: 2.1 time: 0.089936 Oct 18 13:31:12.962569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1019/2050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:12 2022] GET /compute/v2.1/servers/70c46c56-f967-4399-85e3-54a3aac2389c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:12.969691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.972387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.986085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.989588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.995484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.997294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.998710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.999382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.062407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:13.442525 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-946b9886-06fe-484b-80a8-b0db45d528f5 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/62481a32-eb44-4007-a97e-f1527ea96cac" status: 202 len: 0 microversion: 2.1 time: 0.529598 Oct 18 13:31:13.443286 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1032/2051] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:12 2022] DELETE /compute/v2.1/os-security-groups/62481a32-eb44-4007-a97e-f1527ea96cac => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:13.454206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39e027af-dfe2-4668-81c1-dad10c91c4d7 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] Calling method '.version_select at 0x7fb33074d820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.596445 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d821992f-1be7-4de3-be84-2bbbf527755f tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 204 len: 0 microversion: 2.1 time: 0.632411 Oct 18 13:31:13.599082 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1020/2052] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:12 2022] DELETE /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:31:13.611098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.612112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.628914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.637046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.638206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.639264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.640133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.640777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.070927 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39e027af-dfe2-4668-81c1-dad10c91c4d7 tempest-SecurityGroupRulesTestJSON-620816665 tempest-SecurityGroupRulesTestJSON-620816665-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7d3dc854-2525-4fe9-80ba-69c61d879f12" status: 202 len: 0 microversion: 2.1 time: 0.623303 Oct 18 13:31:14.075029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1033/2053] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:31:13 2022] DELETE /compute/v2.1/os-security-groups/7d3dc854-2525-4fe9-80ba-69c61d879f12 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:14.078805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:14.079743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:14.091953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.101130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.104612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.104612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.104612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.104612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.465914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.484834 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1033f50-6612-4334-af63-fcf0166a9221 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1532 microversion: 2.1 time: 0.878824 Oct 18 13:31:14.493365 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1021/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:13 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1532 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:14.732758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.756045 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a35f610-7e3e-476e-b407-cdf74fbed690 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.681856 Oct 18 13:31:14.757257 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1034/2055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:14 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:14.765996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-829303f5-809f-4461-a3a2-0134a300364b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb330c26d30>, body: {"keypair": {"name": "tempest-keypair-1707227876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkrRHq/vo6fXe8EFRaUpTbeu2jcXGTHn0nxnjV88zoKpnbsZJMlf3HljlQQC7BTJaQaMdF9wLlN9nAoXR3zflWnNNxSOMGeORMo/qdXSQqGAj6agJNgEWtSIB2EzXDfzg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:14.804158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-829303f5-809f-4461-a3a2-0134a300364b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:14.821007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-829303f5-809f-4461-a3a2-0134a300364b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:14.944957 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-829303f5-809f-4461-a3a2-0134a300364b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.442177 Oct 18 13:31:14.944957 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1022/2056] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:14.956358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a710c30f-2cb5-41fb-a6ef-e36e474d9365 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb3307fe280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:14.967458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a710c30f-2cb5-41fb-a6ef-e36e474d9365 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1707227876" status: 200 len: 513 microversion: 2.2 time: 0.016598 Oct 18 13:31:14.968687 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1035/2057] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1707227876 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:14.980969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-218713ba-fa44-47ad-b931-c0536aab227c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c328b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.119151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-218713ba-fa44-47ad-b931-c0536aab227c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707227876" status: 204 len: 0 microversion: 2.2 time: 0.140894 Oct 18 13:31:15.119982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1023/2058] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707227876 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:15.132308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ed72e79-4f96-4623-947e-53406063f9cc tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb33074d4c0>, body: {"keypair": {"name": "tempest-keypair-1258819304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsTMVqtF+eUZHSSTYEClm4mPrQFQHgdRrjtrG6kl80Xd1NRW9HBQ9VGRRnUDHR5zPdeBWQu12FSfRyJn3DI033P9OHxRdtmAiZFe/bbvNL+r1JwHR2aOel/vwpJeYSX0A=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:15.173841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8ed72e79-4f96-4623-947e-53406063f9cc tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:15.189724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8ed72e79-4f96-4623-947e-53406063f9cc tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:15.317914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ed72e79-4f96-4623-947e-53406063f9cc tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.189800 Oct 18 13:31:15.324930 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1036/2059] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:15.335431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8bb781e2-f6f7-405d-8f2c-1ef29720189f tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c32af0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.404249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d00f0324-c4b0-403f-a5ee-d7d316b5d442 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Action: 'create', calling method: .version_select at 0x7fb33074d9d0>, body: {"keypair": {"name": "tempest-keypair-430416498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmCY3mBN1OmfwMCiouMRrXJGBczLIBP9VX++fFwu5tvvuhlZngZmKsYgmnsx367RYXEw/VND3BjJ2QMYvQIkEN1gvC9rC8QN18pHCmp7FgMWkSMyNIqWYNmiaYOZlXFjg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:15.418367 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8bb781e2-f6f7-405d-8f2c-1ef29720189f tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258819304" status: 204 len: 0 microversion: 2.2 time: 0.092132 Oct 18 13:31:15.421858 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1024/2060] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258819304 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:15.436912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb57288a-1b63-4581-9163-da1dfc78eab8 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb330c265e0>, body: {"keypair": {"name": "tempest-keypair-2145457979", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:15.466741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d00f0324-c4b0-403f-a5ee-d7d316b5d442 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Getting quotas for project b3f57afe938f4118aed9e3b1f6b2bcdc. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:15.475956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bb57288a-1b63-4581-9163-da1dfc78eab8 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:15.484527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d00f0324-c4b0-403f-a5ee-d7d316b5d442 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Getting quotas for user 677fe6a60f0742b3820c41beccc07d11 and project b3f57afe938f4118aed9e3b1f6b2bcdc. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:15.492945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bb57288a-1b63-4581-9163-da1dfc78eab8 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:15.594737 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d00f0324-c4b0-403f-a5ee-d7d316b5d442 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.195240 Oct 18 13:31:15.596330 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb57288a-1b63-4581-9163-da1dfc78eab8 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.167552 Oct 18 13:31:15.597104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1037/2061] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:31:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 13:31:15.598640 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1025/2062] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:15 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:15.614174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5036e6bc-7ca1-4371-b754-0a0f6315342a tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c21d30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.615844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.616986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.623799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.624570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.630758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.630758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.630758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.630758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.760290 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5036e6bc-7ca1-4371-b754-0a0f6315342a tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145457979" status: 204 len: 0 microversion: 2.2 time: 0.150259 Oct 18 13:31:15.767379 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1026/2063] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145457979 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:15.774537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11fa0d0c-3e94-45d7-b816-82850f550aa0 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb33156be50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-292570138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD6bvyu4mQKWaGlPOzxjvU/WeTKqnqYlQp4fPph7miTNpHJzUYyhaAJkTHKhFuquxmHHGSOEieJX+9eKI+JixWZqtsSx5hBTXdr88J22zvxeepzYcbewM0loN8I2ELDjg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:15.800357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-11fa0d0c-3e94-45d7-b816-82850f550aa0 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:15.807452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-11fa0d0c-3e94-45d7-b816-82850f550aa0 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:15.818321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:15.887808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:15.895642 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c4f58b5-5e20-44ae-981f-4fb8a6ac8675 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1532 microversion: 2.1 time: 0.285357 Oct 18 13:31:15.896229 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1038/2064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1532 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:15.916589 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11fa0d0c-3e94-45d7-b816-82850f550aa0 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.147564 Oct 18 13:31:15.916983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.917624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.917894 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1027/2065] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 18 13:31:15.932581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50b04d84-b905-453e-8c93-e8217a6977e9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb330c32940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1814172568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB+UfmvFL7iuNfommec7A76M4Y31uS2isZIrvPdZvfLDovJPIGw3S7h3AjJgDSh3l3w6CnSJQ5mjZdFuSmDQdReP+WFR00z135qqhbxxLcQN697eMOnRvCjy/K5F1XBhQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:15.935282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.936015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.936647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.937543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.938197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.942429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.967453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-50b04d84-b905-453e-8c93-e8217a6977e9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:15.981920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-50b04d84-b905-453e-8c93-e8217a6977e9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:16.094797 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50b04d84-b905-453e-8c93-e8217a6977e9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.167804 Oct 18 13:31:16.095778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1028/2066] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:15 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:16.119752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7769c2b3-9fd9-413c-835d-7f02fa630d23 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb330c269d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1824546502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPBxyYGRJuqWVkaavDcN0Dm88LDHVds4yMI57vWdjtagG/Pl2IZ9yrXEylxRHuLNsHRLwOmWrjf6LREKtMxrNTOpI6DkOk3KdiyeXrM9C1qu9fLSbuuYCPW3bWJtxx37Q=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:16.151901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7769c2b3-9fd9-413c-835d-7f02fa630d23 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:16.170429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7769c2b3-9fd9-413c-835d-7f02fa630d23 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:16.262670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:16.276119 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7769c2b3-9fd9-413c-835d-7f02fa630d23 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.164937 Oct 18 13:31:16.276986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1029/2067] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:16.291066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e2926ac-54d2-4b59-aad7-3b3025b665d1 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330d831f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.292557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-392d8333-9af2-472e-acba-d88a44137b6c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.375921 Oct 18 13:31:16.294296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1039/2068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:16.309378 n-d-858383-13 devstack@n-api.service[121010]: WARNING oslo_db.sqlalchemy.utils [None req-7e2926ac-54d2-4b59-aad7-3b3025b665d1 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:16.323557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e2926ac-54d2-4b59-aad7-3b3025b665d1 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.039744 Oct 18 13:31:16.325453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1030/2069] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:16.344624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bf62e276-b586-4dc6-ae5a-b6cb70a912e6 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330a3a280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.413882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-unplugged", "status": "completed", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:16.423785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bf62e276-b586-4dc6-ae5a-b6cb70a912e6 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1824546502" status: 204 len: 0 microversion: 2.2 time: 0.082968 Oct 18 13:31:16.429032 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1040/2070] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Oct 18 13:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1824546502 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:16.440935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ceb3ec9b-e832-489a-9c69-ed15cd2b3978 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330a33e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.444802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:16.445310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:16.445759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.501172 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] Creating event network-vif-unplugged:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:31:16.506686 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9c0aa240-58b5-4035-a1a1-a151d1ae1d4d req-124f0bef-a54a-4ee7-b9d7-dc2abc8042ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097022 Oct 18 13:31:16.507724 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1031/2071] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:16.591952 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ceb3ec9b-e832-489a-9c69-ed15cd2b3978 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1814172568" status: 204 len: 0 microversion: 2.2 time: 0.161197 Oct 18 13:31:16.594558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1041/2072] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Oct 18 13:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1814172568 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:16.604397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ac58588-950b-47be-b6ad-87c704ac201c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330ca1700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.729960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ac58588-950b-47be-b6ad-87c704ac201c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-292570138" status: 204 len: 0 microversion: 2.2 time: 0.132285 Oct 18 13:31:16.730832 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1032/2073] 10.222.0.27 () {60 vars in 1318 bytes} [Tue Oct 18 13:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-292570138 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:16.745367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8e5b393-cb31-4e99-83f5-031f0efae849 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb33076e430>, body: {"keypair": {"name": "tempest-keypair-1495445913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFwfMvJE/dzJf0mWexStM2X+yYCYY8DasPimedqEpXrwF04yj1uw6DfHZbTkiRYgyRuN7Qv8oOkSo0priFSkFqPQ7V5WZKGo2hWp2ocxNwyKHDQLNxG3uh6s2rmBgqOTA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:16.768713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e8e5b393-cb31-4e99-83f5-031f0efae849 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:16.776157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e8e5b393-cb31-4e99-83f5-031f0efae849 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:16.901336 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8e5b393-cb31-4e99-83f5-031f0efae849 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.162084 Oct 18 13:31:16.903216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1042/2074] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:16.914856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0c661ea-821b-4771-9e1d-c68b7cf4e5fa tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c26dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.921384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.922386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:16.937549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:16.945846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:16.951857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.951857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:16.951857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:16.951857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.954375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0c661ea-821b-4771-9e1d-c68b7cf4e5fa tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1495445913" status: 200 len: 513 microversion: 2.2 time: 0.041582 Oct 18 13:31:16.955181 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1033/2075] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1495445913 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:16.967929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4298c81c-ec2d-4119-bb6e-266ed65b83c9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c32af0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.979751 n-d-858383-13 devstack@n-api.service[121010]: WARNING oslo_db.sqlalchemy.utils [None req-4298c81c-ec2d-4119-bb6e-266ed65b83c9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:17.006368 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4298c81c-ec2d-4119-bb6e-266ed65b83c9 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.042303 Oct 18 13:31:17.007059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1034/2076] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:17.033959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87c03621-bf8b-4bf6-ab76-aba4b9d97403 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330c32820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.175436 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87c03621-bf8b-4bf6-ab76-aba4b9d97403 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495445913" status: 204 len: 0 microversion: 2.2 time: 0.158976 Oct 18 13:31:17.176355 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1035/2077] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495445913 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:17.186792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Action: 'create', calling method: .version_select at 0x7fb330d75b80>, body: {"keypair": {"name": "tempest-keypair-1487600169", "type": "x509"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:17.204955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:17.218510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:17.263269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.processutils [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpu0s99fdd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpu0s99fdd/temp.key -subj /CN=ff608b054a0c49ce8598b8f49f7e241d -extensions v3_req_client {{(pid=121010) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 13:31:17.400182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.413389 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15cab19b-3482-4c95-ad50-6af78603379c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1532 microversion: 2.1 time: 0.495717 Oct 18 13:31:17.432175 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1043/2078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1532 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:17.438039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.438039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:17.450427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.459838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.462788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.464182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.processutils [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpu0s99fdd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpu0s99fdd/temp.key -subj /CN=ff608b054a0c49ce8598b8f49f7e241d -extensions v3_req_client" returned: 0 in 0.200s {{(pid=121010) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 13:31:17.465897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.processutils [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpu0s99fdd/temp.key -password pass: {{(pid=121010) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 13:31:17.475716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.476175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.476638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.559709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.processutils [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpu0s99fdd/temp.key -password pass:" returned: 0 in 0.092s {{(pid=121010) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 13:31:17.757549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:17.773462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Getting quotas for user ff608b054a0c49ce8598b8f49f7e241d and project 4dca924d685b46a2a0e1ef8b6a92e5bd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:17.816243 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-07a0202e-a763-4a0a-9ac2-4e00abd0b92b tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.634143 Oct 18 13:31:17.818465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.819801 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1036/2079] 10.222.0.27 () {62 vars in 1198 bytes} [Tue Oct 18 13:31:17 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 639 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:17.829330 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ed13863-e581-4cbf-b4fb-89532ee788bb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.408723 Oct 18 13:31:17.830914 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1044/2080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:17.834670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10038e1c-3b68-4753-a2ca-696a1ee7342c", "name": "network-vif-deleted", "tag": "a65c6c14-19d5-4fbf-b9df-9ca8817455fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:17.847748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58c91249-6504-4bd6-8747-a065823bbf94 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb33074de50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.860497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.861024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.861488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.881974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:17.888211 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58c91249-6504-4bd6-8747-a065823bbf94 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1487600169" status: 200 len: 1534 microversion: 2.2 time: 0.054855 Oct 18 13:31:17.890954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] Creating event network-vif-deleted:a65c6c14-19d5-4fbf-b9df-9ca8817455fa for instance 10038e1c-3b68-4753-a2ca-696a1ee7342c on n-h2-858383-13 Oct 18 13:31:17.891154 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1045/2081] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1487600169 => generated 1534 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:17.904214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d2f2fe2-5bd7-4d3e-be18-2542e84fa92c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330a3adc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.905347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3fad21a2-df32-4ce1-9cee-d01b7b2f5b85 req-0ef5bfad-0b01-4dc8-8cad-b5f10a608a65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081081 Oct 18 13:31:17.906656 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1037/2082] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:17.911045 n-d-858383-13 devstack@n-api.service[121009]: WARNING oslo_db.sqlalchemy.utils [None req-7d2f2fe2-5bd7-4d3e-be18-2542e84fa92c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:17.939109 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d2f2fe2-5bd7-4d3e-be18-2542e84fa92c tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.040987 Oct 18 13:31:17.939904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1046/2083] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:17.952184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c34a505f-ff74-48ed-a7c3-c68b9273cf99 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] Calling method '.version_select at 0x7fb330d75e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.029687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c34a505f-ff74-48ed-a7c3-c68b9273cf99 tempest-KeyPairsV22TestJSON-1408631085 tempest-KeyPairsV22TestJSON-1408631085-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487600169" status: 204 len: 0 microversion: 2.2 time: 0.081942 Oct 18 13:31:18.031705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1038/2084] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487600169 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:31:18.127643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.128214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.141787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.141787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.141787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.145849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.146580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.147194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.218546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:18.447300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.448881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.462902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.467129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.467129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.467129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.467129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.467544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.567225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.568829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.570603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.571372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lazy-loading 'fault' on Instance uuid 10038e1c-3b68-4753-a2ca-696a1ee7342c {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:18.676202 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba5f7cb8-f08a-45d9-b812-62333fc3da47 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 204 len: 0 microversion: 2.25 time: 0.552610 Oct 18 13:31:18.677346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1047/2085] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:31:18 2022] DELETE /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:18.691058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.701953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.722751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:18.738870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.748828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.750619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.753686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.754417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.756557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.757693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c91a95f3-ec04-444c-abdd-1523ac97f12b tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 200 len: 1367 microversion: 2.1 time: 0.315566 Oct 18 13:31:18.794511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1039/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:18 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:18.858567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.859971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.872155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.874806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.875910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.877518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.879979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.880697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.202646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.208297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94b0209f-dbde-4325-9dca-1e4ec250ce81 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.353480 Oct 18 13:31:19.210698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1040/2087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:18 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:19.305707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.319775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.323015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.325231 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-55e5033f-807a-445d-af7e-3152fc363390 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1730 microversion: 2.25 time: 0.642511 Oct 18 13:31:19.330259 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1048/2088] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:18 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1730 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:19.783461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:19.784088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 10038e1c-3b68-4753-a2ca-696a1ee7342c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:19.793754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:19.794322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:19.794763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.796244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:19.796922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:19.797361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.814338 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] HTTP exception thrown: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Request method failure captured: Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c HTTP/1.1 Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk_NrW42A5tYYt4WL_4LH7PfyxdOc486ZMRVZkqBxScujYT2UNAsBoKDJmvlgQyMQb-h6xAmtElaRmq5s_Ngp_JfcH-dupEuDG6DYIloXhJsLTG-ExjY_2-ycsb6lYPhWWdcAdmMQm__HCODWP7nMEymBkv2VjDoAcmjF4HDIOD53g Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:19.816085 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c1cd81ee6174cee97e384cae58a2e6a Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. Oct 18 13:31:19.817678 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '10038e1c-3b68-4753-a2ca-696a1ee7342c'} Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:19.818629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. Oct 18 13:31:19.820028 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:19.822286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Returning 404 to user: Instance 10038e1c-3b68-4753-a2ca-696a1ee7342c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:19.822646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9a5e880-4294-4dd0-823a-36f07340b056 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c" status: 404 len: 111 microversion: 2.1 time: 0.043294 Oct 18 13:31:19.823253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1041/2089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:19 2022] GET /compute/v2.1/servers/10038e1c-3b68-4753-a2ca-696a1ee7342c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:19.831694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2673ff08-1b69-4a98-8c33-e8b98eac055a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '.version_select at 0x7fb33076eaf0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:19.853905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-189122071", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "61c38a63-7e08-454b-9f91-71583748c546"}, {"port": "da60ea4f-7615-4adc-8662-808ebb5bb0e0", "tag": "port-1"}, {"port": "90cc59d7-23c7-4f5c-9230-0ddc8edac2a5", "tag": "port-2"}, {"uuid": "0ada6139-9cdf-47c9-8d5a-ba3b3315f2b2", "tag": "net-1"}, {"uuid": "0ada6139-9cdf-47c9-8d5a-ba3b3315f2b2"}, {"uuid": "9cb62307-7fcd-403a-8497-632f41807b65", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9cb62307-7fcd-403a-8497-632f41807b65", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6744cb93-65d1-44db-b235-6cd1e9c59053", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c6acdeaf-4e74-4aae-a1f5-c44d0a41cc42", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "89f55204-50d8-483a-966c-5a55b76f07b7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--88652921"}], "key_name": "tempest-keypair-430416498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:19.932694 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2673ff08-1b69-4a98-8c33-e8b98eac055a tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647066205" status: 202 len: 0 microversion: 2.1 time: 0.104628 Oct 18 13:31:19.933632 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1049/2090] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647066205 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:20.067649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] validate_networks() for [('61c38a63-7e08-454b-9f91-71583748c546', None, None, None, None, None), (None, None, 'da60ea4f-7615-4adc-8662-808ebb5bb0e0', None, None, None), (None, None, '90cc59d7-23c7-4f5c-9230-0ddc8edac2a5', None, None, None), ('0ada6139-9cdf-47c9-8d5a-ba3b3315f2b2', None, None, None, None, None), ('0ada6139-9cdf-47c9-8d5a-ba3b3315f2b2', None, None, None, None, None), ('9cb62307-7fcd-403a-8497-632f41807b65', '10.2.2.100', None, None, None, None), ('9cb62307-7fcd-403a-8497-632f41807b65', '10.2.2.200', None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:20.236014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:20.241748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:20.245673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.246624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.247082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.248028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.248782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.249763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.538171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:20.546101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a05322e-a748-47c9-9178-70cf30111dbb tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.315342 Oct 18 13:31:20.550763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1050/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:20 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:20.555571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:20.556927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:20.563228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.563988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.564627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.565517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.566210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.566841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.081389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.090226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.095846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.097515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2130a1ae-c65e-450c-9d60-d5645dfefc78 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1730 microversion: 2.25 time: 0.545626 Oct 18 13:31:21.103561 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1051/2092] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:20 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1730 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:21.111226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-plugged", "status": "completed", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:21.135603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.139584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.140308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.159053 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] Creating event network-vif-plugged:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:31:21.181850 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d81c9818-da2c-4223-a1ab-44c53b2811ba req-30a18690-8ece-41be-a238-6d8d57802de6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076001 Oct 18 13:31:21.184236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1052/2093] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:21.575916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.576720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:21.593627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.593627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.598272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.599333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.600064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.600674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.966470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.980030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8adf0cd1-82d2-4819-b639-86d781726d28 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.409862 Oct 18 13:31:22.003148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1053/2094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:21 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:22.010580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87353b3-9372-4f59-9da9-f5d85111e132", "name": "network-vif-deleted", "tag": "49e4bccc-d61a-42a7-858e-64ca93e0aa89"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:22.025017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.025514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.025959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.031475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:22.039864 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] Creating event network-vif-deleted:49e4bccc-d61a-42a7-858e-64ca93e0aa89 for instance d87353b3-9372-4f59-9da9-f5d85111e132 on n-h1-858383-13 Oct 18 13:31:22.045405 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-154dee0c-c417-4369-88fb-a8bb0895c773 req-3cbd5a9f-d898-4556-a08c-68675d29da26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040638 Oct 18 13:31:22.046644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1054/2095] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:22.053474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.054292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.064846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.065344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.066040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.071275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.071275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.071275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.098411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:22.497324 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-850808c8-0260-4337-bccc-39cf19e248a1 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 204 len: 0 microversion: 2.1 time: 0.448144 Oct 18 13:31:22.502273 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1055/2096] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:22 2022] DELETE /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.509634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.510363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.517224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.517760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.518252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.519165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.519823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.520453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.594773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.595425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.595699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.597189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'fault' on Instance uuid d87353b3-9372-4f59-9da9-f5d85111e132 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:22.663888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.673751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.675253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.676423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-645f0dba-8f1b-4345-b0d3-e63c45d5e831 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 200 len: 1376 microversion: 2.25 time: 0.172065 Oct 18 13:31:22.682176 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1056/2097] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:22.682176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.682588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.689812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.691054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.691833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.692738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.693400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.694046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.975857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.991919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e260764d-9deb-4059-ac09-3233d93607f2 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1468 microversion: 2.1 time: 0.313133 Oct 18 13:31:23.003915 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1057/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:23.019875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.020519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.032780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.033565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.034255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.035322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.035967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.036684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.230465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:23.238359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6898b44-9297-4143-99d4-045a618710e7 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1478 microversion: 2.1 time: 0.226623 Oct 18 13:31:23.238944 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1058/2099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1478 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:23.473056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:23.473561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:23.475407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:23.475552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:23.475935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:23.490774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.490774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.490774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.490774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.491887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.491887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.509239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Getting quotas for project b3f57afe938f4118aed9e3b1f6b2bcdc. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:23.514891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Getting quotas for user 677fe6a60f0742b3820c41beccc07d11 and project b3f57afe938f4118aed9e3b1f6b2bcdc. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:23.682870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:23.685815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6744cb93-65d1-44db-b235-6cd1e9c59053',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c6acdeaf-4e74-4aae-a1f5-c44d0a41cc42',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89f55204-50d8-483a-966c-5a55b76f07b7',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:23.701447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.702235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d87353b3-9372-4f59-9da9-f5d85111e132] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.708741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.709231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.709745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.710467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.710932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.711367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.731252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] HTTP exception thrown: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Request method failure captured: Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 HTTP/1.1 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkC4VsZelqTw7XMfl9pUV9hnGyB74MzCYKXd2pv1ZauuJNcmOV9O_SeOwytyumBk6-EHtnXkvYDH3TKdBdyOQBdAJ1h3Vf7ejQekG-Dv3I74mWi0tbAT5LBra-FyiOzvexMYrmFpf1SWLXKJHX-NKf25fKSqwMJokVsPcIDNHDCKao Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:23.733510 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: fa4ca05a0c6a405f8fa014ee06dbcef4 Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. Oct 18 13:31:23.735204 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd87353b3-9372-4f59-9da9-f5d85111e132'} Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:23.736072 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. Oct 18 13:31:23.737603 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.740749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Returning 404 to user: Instance d87353b3-9372-4f59-9da9-f5d85111e132 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:23.740749 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e508400e-db00-4a77-b7f3-23fc4d179367 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132" status: 404 len: 111 microversion: 2.25 time: 0.038791 Oct 18 13:31:23.741345 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1059/2100] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/d87353b3-9372-4f59-9da9-f5d85111e132 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:31:23.746474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-286843c4-3597-4e64-ad15-3e888039f9f9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '.version_select at 0x7fb330797d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.845997 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-286843c4-3597-4e64-ad15-3e888039f9f9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963644730" status: 204 len: 0 microversion: 2.25 time: 0.103465 Oct 18 13:31:23.846902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1060/2101] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963644730 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:24.027329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:24.028083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:24.047559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.048280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.048894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.050106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.050738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.051388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.401694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:24.413014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d55b796-6df5-46fd-8e98-1d143cf1d55c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1468 microversion: 2.1 time: 0.390470 Oct 18 13:31:24.431266 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1061/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:24 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:24.437574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:24.438243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:24.444460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.444955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.449128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.449128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.455825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.456561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.850216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:24.860564 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08decfb8-c2d4-49e7-b057-e106ea1015fe tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1464 microversion: 2.1 time: 0.427701 Oct 18 13:31:24.865737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1062/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:24 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1464 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:24.911111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:24.912103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:24.920861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.920861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.920861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.920861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.921384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.922007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.171318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.173764 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0050030d-fd99-4f6d-a42e-df61ccb4b272 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 5.327196 Oct 18 13:31:25.182538 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1042/2104] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Oct 18 13:31:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 5337 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:31:25.189476 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb562924-d2b3-470f-b657-8671cd5d38c9 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1464 microversion: 2.1 time: 0.298426 Oct 18 13:31:25.190155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.194433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1063/2105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:24 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1464 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:25.194592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.197647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.198497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.203439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.204027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.204764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.205756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.206619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.207281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.238848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:25.270768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.281375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.282781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.284122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdc319a3-cf8f-4d6a-9e64-a3fd07fbba1a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1284 microversion: 2.32 time: 0.091783 Oct 18 13:31:25.290720 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1064/2106] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:25.290720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:25.292800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.299813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.300623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.301308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.302274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.302971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.303409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.392862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:25.393366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:25.393759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:25.394470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:25.394888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:25.500400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:25.635806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59156fdc-937f-46ef-9152-a07d23a8e207 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 204 len: 0 microversion: 2.25 time: 0.451601 Oct 18 13:31:25.637713 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1043/2107] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:31:25 2022] DELETE /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:25.642467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.643402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.653386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.654160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.654813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.655716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.655854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.656551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.657157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.676186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.678320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.679958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.682017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.682986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.684898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.768217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3050286f-a046-4fbe-82e1-252bc14c2986 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 1068 microversion: 2.1 time: 0.480997 Oct 18 13:31:25.769322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1065/2108] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:31:25 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 1068 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:31:25.777627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.801998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de3d4f20-60eb-440e-866e-6ee183737db7 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1426 microversion: 2.1 time: 0.150616 Oct 18 13:31:25.801998 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1044/2109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1426 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:25.802541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.802541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.802753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb", "name": "network-vif-deleted", "tag": "a79ec258-d36b-4f8e-bfaa-7cb8b559addb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:25.812718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.813352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.816134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.816979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.818951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.819633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.826924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.827788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.830592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.856456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:25.863696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] Creating event network-vif-deleted:a79ec258-d36b-4f8e-bfaa-7cb8b559addb for instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb on n-h2-858383-13 Oct 18 13:31:25.872555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-11e1c341-ac56-4d42-bce9-af0098e96708 req-b14ca1ad-25a9-45ad-af94-e5de0cdff7be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079127 Oct 18 13:31:25.873194 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1045/2110] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:25.883966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.886537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.900562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.903158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.903710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.904958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.906207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.907100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.222411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.233760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.236972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.238557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eee9f22b-cec1-43d3-8991-a1539a172a0d tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1549 microversion: 2.25 time: 0.467911 Oct 18 13:31:26.239703 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1066/2111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1549 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:26.253703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.264914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d45975b-5e24-46a9-bf68-eca33af1f24d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.390252 Oct 18 13:31:26.265494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1046/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:26.310703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:26.316640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:26.821870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:26.823063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:26.840526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.843513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.853341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.853341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.854920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.855799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.909037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.919703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.922217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.925828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5dccad2b-f7be-4eda-8b7c-5cd5c345d496 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1284 microversion: 2.32 time: 0.618930 Oct 18 13:31:26.928631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.929578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1067/2113] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:26 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1284 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:26.930399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.931526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.932270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lazy-loading 'fault' on Instance uuid e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:27.021120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.029997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d2419c7-a5da-49fe-87fc-3f25573cee1c tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 200 len: 1302 microversion: 2.1 time: 0.212944 Oct 18 13:31:27.030746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1047/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:26 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 1302 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:27.270877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:27.273954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:27.289100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.292793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.297103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:27.301954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:27.302521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.302521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.303998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.304530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.330278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.330278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.330278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.330278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.330869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.330869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.405473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.417101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.419179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.421018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ec02236-9611-4301-91dc-6cfb7f324b73 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1507 microversion: 2.25 time: 0.154360 Oct 18 13:31:27.422092 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1068/2115] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:27 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:27.443425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6115940-280d-4e29-81ec-47dc4c07ebe3", "name": "network-vif-deleted", "tag": "2b5e1c6c-c6b7-4eea-82f3-3f426accebd2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:27.456508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.457285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.458005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.480039 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] Creating event network-vif-deleted:2b5e1c6c-c6b7-4eea-82f3-3f426accebd2 for instance d6115940-280d-4e29-81ec-47dc4c07ebe3 on n-h1-858383-13 Oct 18 13:31:27.484785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-68e2f426-a317-4e4d-9856-11a6ff5ea465 req-2aad1c9c-3d58-40e1-b6c0-f7a01bb665b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045846 Oct 18 13:31:27.487415 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1069/2116] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:27.642851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.661084 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6356dd4-1384-4105-9909-1773465e5971 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.370955 Oct 18 13:31:27.669590 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1048/2117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:27 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:27.956463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:27.957448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:27.973820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.974673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.975299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.976210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.976838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.977546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.007633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.008146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.015598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.016104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.016559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.020127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.020127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.020127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.072893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:28.195765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.212294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.215114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.216430 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-00b2dbc5-37c1-47f2-a0ba-727b9ae34c48 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1518 microversion: 2.32 time: 0.265234 Oct 18 13:31:28.244612 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1070/2118] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:27 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:28.250318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.257719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.260201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.260896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.261504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.262680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.263306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.263923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.278421 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] HTTP exception thrown: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Request method failure captured: Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb HTTP/1.1 Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqk_NrW42A5tYYt4WL_4LH7PfyxdOc486ZMRVZkqBxScujYT2UNAsBoKDJmvlgQyMQb-h6xAmtElaRmq5s_Ngp_JfcH-dupEuDG6DYIloXhJsLTG-ExjY_2-ycsb6lYPhWWdcAdmMQm__HCODWP7nMEymBkv2VjDoAcmjF4HDIOD53g Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:28.281204 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 6c1cd81ee6174cee97e384cae58a2e6a Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. Oct 18 13:31:28.287897 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb'} Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:28.288891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. Oct 18 13:31:28.291140 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:28.292666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Returning 404 to user: Instance e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:28.292666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e240531-47f8-4804-9fa8-ef46edb67501 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb" status: 404 len: 111 microversion: 2.1 time: 0.037011 Oct 18 13:31:28.292666 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1071/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/e4c4e593-9f93-40b1-bcc3-6bcc0e1306eb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:28.299651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.300498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.308555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.309315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.309952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.310930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.311412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.312399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.336149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:28.351725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:28.496588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1463bc9f-1777-4edb-a748-bca1368fb651 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 204 len: 0 microversion: 2.1 time: 0.492466 Oct 18 13:31:28.501149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1049/2120] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:28 2022] DELETE /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:31:28.507010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.507988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.520433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.522915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.525177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.526405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.529186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.533444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.599656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.603858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.604536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.605172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'fault' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:28.653839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.662238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.663701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.664881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8fac7daf-0734-4d81-9da0-793e5565f8df tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1352 microversion: 2.25 time: 0.162285 Oct 18 13:31:28.666016 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1050/2121] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:28.670449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.671069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.676950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.677458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.677904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.679064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.679716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.680158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.888006 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9ec55d2-7515-4a44-9d1b-187308d319f5 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 204 len: 0 microversion: 2.1 time: 0.592741 Oct 18 13:31:28.888876 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1072/2122] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:28 2022] DELETE /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:28.895950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.896673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.904587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.905911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.907457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.909009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.909682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.910391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.290476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.310195 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8f6853a-948b-4605-abca-e72157a15042 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.419621 Oct 18 13:31:29.313642 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1073/2123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:29.323750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:29.324834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:29.337632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.346094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5d3510d-a8d6-4a17-8a70-2333c2b89c2b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1666 microversion: 2.1 time: 0.678856 Oct 18 13:31:29.354584 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1051/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1666 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:29.361995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.366567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.367189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.368727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.369412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.370012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.372047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:29.374265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:29.386728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.387489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.389229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.390168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.393797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.394289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.657887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.673068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.682677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.684185 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a59ca14-897f-4d21-a0ff-d2144d3f7f74 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1574 microversion: 2.32 time: 0.328536 Oct 18 13:31:29.686967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.687694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1052/2125] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:29 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1574 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:29.709152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a74d5f0-a883-4329-b57c-2d953331ec14 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1468 microversion: 2.1 time: 0.391620 Oct 18 13:31:29.718084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1074/2126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:29 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1468 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:29.719609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:29.729812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:29.746072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.749233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.749981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.755990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.755990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.755990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.846329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.851133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.851133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.851133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'fault' on Instance uuid d6115940-280d-4e29-81ec-47dc4c07ebe3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:29.948687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.962639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.967537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.970871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-155c715e-65b7-4090-b142-bf16957e0790 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 200 len: 1352 microversion: 2.25 time: 0.279852 Oct 18 13:31:29.977410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1053/2127] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:29 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:30.341007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:30.341730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:30.357640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.358192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.360213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.360966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.361441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.361882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.372951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:30.373577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:30.380012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.380508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.381151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.382142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.383043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.383820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.901645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:30.910810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-378f611d-d099-45ce-8e04-1254f0c5a7f1 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1666 microversion: 2.1 time: 0.541245 Oct 18 13:31:30.911361 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1054/2128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:30 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1666 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:30.927705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7278cff0-11bf-476d-834c-be5d3089da95", "name": "network-vif-deleted", "tag": "32ee365e-4585-4001-a3bf-66ccbf87645a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:30.952088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.955928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.956930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.991891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] Creating event network-vif-deleted:32ee365e-4585-4001-a3bf-66ccbf87645a for instance 7278cff0-11bf-476d-834c-be5d3089da95 on n-h2-858383-13 Oct 18 13:31:31.003708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3c7971ec-74c9-476e-b437-4d0a49ee9d9a req-7aa5172f-6304-4f32-9564-9750b400e3d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089875 Oct 18 13:31:31.010802 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1055/2129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:31.022598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.029138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.038529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.042397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.043078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.046585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.047404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.048083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.167406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.179837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.188287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.192109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.192109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e570341c-7878-4394-bfc2-0471dc8594ba tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1582 microversion: 2.32 time: 0.183448 Oct 18 13:31:31.193552 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1056/2130] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:31 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1582 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:31.199692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.201759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.207976 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17297daa-25e6-4ab4-a0ff-917b73c7273f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.871825 Oct 18 13:31:31.222079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1075/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:30 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:31.222079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.224665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: d6115940-280d-4e29-81ec-47dc4c07ebe3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.245601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.247393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.247624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.247906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.249836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.250286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.250828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.255238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.255384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.255384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.255384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.255697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.290827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] HTTP exception thrown: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Request method failure captured: Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 HTTP/1.1 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkC4VsZelqTw7XMfl9pUV9hnGyB74MzCYKXd2pv1ZauuJNcmOV9O_SeOwytyumBk6-EHtnXkvYDH3TKdBdyOQBdAJ1h3Vf7ejQekG-Dv3I74mWi0tbAT5LBra-FyiOzvexMYrmFpf1SWLXKJHX-NKf25fKSqwMJokVsPcIDNHDCKao Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:31.292675 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: fa4ca05a0c6a405f8fa014ee06dbcef4 Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. Oct 18 13:31:31.294319 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd6115940-280d-4e29-81ec-47dc4c07ebe3'} Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:31.295231 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. Oct 18 13:31:31.296675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:31.298873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Returning 404 to user: Instance d6115940-280d-4e29-81ec-47dc4c07ebe3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:31.300526 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad9449bc-3bab-4b4b-90b3-91f69788ccd9 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3" status: 404 len: 111 microversion: 2.25 time: 0.087453 Oct 18 13:31:31.308294 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1076/2132] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:31 2022] GET /compute/v2.1/servers/d6115940-280d-4e29-81ec-47dc4c07ebe3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:31:31.315207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.329270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.335911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.337224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.340091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.340091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.340091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.340907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.349425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.350235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.353187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.353845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lazy-loading 'fault' on Instance uuid 7278cff0-11bf-476d-834c-be5d3089da95 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:31.404671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:31.639841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c1cd81ee6174cee97e384cae58a2e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d29c076c7d4bb288da6f42ddee05fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.659044 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29ac3ded-0362-45d6-9073-eb876c5a0e59 tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 200 len: 1303 microversion: 2.1 time: 0.463796 Oct 18 13:31:31.659690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1057/2133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:31 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 1303 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:31.748126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:31.840240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf7af560-3c97-4e6a-b4a7-a8998f542bd2 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 204 len: 0 microversion: 2.25 time: 0.529882 Oct 18 13:31:31.841169 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1077/2134] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:31:31 2022] DELETE /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:31.850237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.850867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.861011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.865028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.865028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.865028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.865028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.865461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.938410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:31.939177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.949588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.950122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.950577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.951300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.951765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.957396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.177640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.193821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.201954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.203677 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea8e9724-5cb2-43da-98a5-e5181ca8ac23 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1562 microversion: 2.25 time: 0.358143 Oct 18 13:31:32.206855 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1058/2135] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:31 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1562 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:32.228459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:32.229457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:32.240903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.243612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.257998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.262833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.273503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.279391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.595014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.613186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.618950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.620716 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-966e71dd-5bb9-4091-a0c4-aefea570c65f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1592 microversion: 2.32 time: 0.399680 Oct 18 13:31:32.637147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1059/2136] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:32 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1592 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:32.650588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d59e6bbc724bd98b96a2e4458d1c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec257d037b37472bb8a1b779fa39bb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:32.651123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:32.651123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:32.656738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-babf0a66-ac00-40bd-95fd-74f036625f3b tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 200 len: 1599 microversion: 2.1 time: 0.723447 Oct 18 13:31:32.661735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.662454 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1078/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:31 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 1599 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:32.678579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.679171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.679947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.680423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.681652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.689519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:32.948151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5649ef27-cf34-4b12-bce2-69f866da7b86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb3307b60d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1235211721", "description": "tempest-description-632137253"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:33.225989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:33.247693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca3827c8-0700-4f8c-86a6-19e30eea58bf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.609068 Oct 18 13:31:33.261381 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1060/2138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:32 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:33.261381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:33.261763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] [instance: 7278cff0-11bf-476d-834c-be5d3089da95] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:33.279370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.280036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.280694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.281610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.282387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.283038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] HTTP exception thrown: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Request method failure captured: Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 HTTP/1.1 Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqk_NrW42A5tYYt4WL_4LH7PfyxdOc486ZMRVZkqBxScujYT2UNAsBoKDJmvlgQyMQb-h6xAmtElaRmq5s_Ngp_JfcH-dupEuDG6DYIloXhJsLTG-ExjY_2-ycsb6lYPhWWdcAdmMQm__HCODWP7nMEymBkv2VjDoAcmjF4HDIOD53g Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:31:33.318238 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_41d29c076c7d4bb288da6f42ddee05fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 41d29c076c7d4bb288da6f42ddee05fb Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-MigrationsAdminTest-1832710775 Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c1cd81ee6174cee97e384cae58a2e6a Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-MigrationsAdminTest-1832710775-project Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. Oct 18 13:31:33.320447 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7278cff0-11bf-476d-834c-be5d3089da95'} Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:33.322382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. Oct 18 13:31:33.324400 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:31:33.326170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] Returning 404 to user: Instance 7278cff0-11bf-476d-834c-be5d3089da95 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:33.326170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04c00281-5f0b-4c59-92e3-5b5cb3006ece tempest-MigrationsAdminTest-1832710775 tempest-MigrationsAdminTest-1832710775-project] 10.222.0.27 "GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95" status: 404 len: 111 microversion: 2.1 time: 0.069649 Oct 18 13:31:33.326170 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1061/2139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:33 2022] GET /compute/v2.1/servers/7278cff0-11bf-476d-834c-be5d3089da95 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:33.334709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74d90e0-6f8a-4327-9167-274c11068f2e", "name": "network-vif-deleted", "tag": "ac9aa433-5168-4482-b939-4a01298ce482"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:33.356883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.357214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.357650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.386767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] Creating event network-vif-deleted:ac9aa433-5168-4482-b939-4a01298ce482 for instance c74d90e0-6f8a-4327-9167-274c11068f2e on n-h1-858383-13 Oct 18 13:31:33.396243 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9c4b15ad-35c6-4b4a-b433-4e4ceb5696f3 req-dfd9511d-be26-4d3e-aeb6-0b797849fce7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069983 Oct 18 13:31:33.398941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1062/2140] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:33.412889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:33.413904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:33.431952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.432750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.433392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.436163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.436876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.437513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.515184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:33.522205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=34 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:33.989142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.004207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.008373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.011431 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7af7c860-ea73-44cf-98a7-72140b184326 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1562 microversion: 2.25 time: 0.611253 Oct 18 13:31:34.018452 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1063/2141] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:33 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1562 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:34.035191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.037493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.059116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.059116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.059116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.059116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.059790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.060277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.524027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5649ef27-cf34-4b12-bce2-69f866da7b86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.859638 Oct 18 13:31:34.533266 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1079/2142] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:34.539132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.540449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] [instance: c74d90e0-6f8a-4327-9167-274c11068f2e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.564525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.566835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.568204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.568842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.569324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.570605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.614188 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] HTTP exception thrown: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Request method failure captured: Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e HTTP/1.1 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqpjRkSUqWJZr1fObiWRcft6icUw7nzcNDXRdeD2shJk6oeRh1-VmwjIdCegs_rQd51GeUhdAZdf4FrHm5vVsAe9QaVI-GubWimh5i0ewlRWy6vcn6Q_ImPuwkHI8MFA1cEXEvhYAOkFNwZ74-vF3QyQT53bDU2AcWKXlcDUZy5jwec Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec257d037b37472bb8a1b779fa39bb91 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestFqdnHostnames-379310176 Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:34.619990 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec257d037b37472bb8a1b779fa39bb91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec257d037b37472bb8a1b779fa39bb91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec257d037b37472bb8a1b779fa39bb91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec257d037b37472bb8a1b779fa39bb91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestFqdnHostnames-379310176 Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec257d037b37472bb8a1b779fa39bb91 Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-379310176 Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestFqdnHostnames-379310176-project Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: f6d59e6bbc724bd98b96a2e4458d1c4f Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestFqdnHostnames-379310176-project Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. Oct 18 13:31:34.621972 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c74d90e0-6f8a-4327-9167-274c11068f2e'} Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:34.623237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. Oct 18 13:31:34.624845 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.626968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Returning 404 to user: Instance c74d90e0-6f8a-4327-9167-274c11068f2e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:34.629096 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4043455a-5523-4724-98bb-b7b2985cea8d tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e" status: 404 len: 111 microversion: 2.1 time: 0.101040 Oct 18 13:31:34.634544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1080/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/c74d90e0-6f8a-4327-9167-274c11068f2e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:34.644485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.650910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.661004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.663503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.667826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.669384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.682761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.682761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.760686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.778346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.781046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.785950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49a8809f-c04a-422a-9ec4-190a3a151122 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1658 microversion: 2.32 time: 0.765079 Oct 18 13:31:34.787243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1064/2144] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1658 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:34.801642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-34d47983-c9e0-4034-b05d-d23206a328ec tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb330c32040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1439393719", "description": "tempest-description-1699207205"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:35.156987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.165461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7582a8e4-5176-4cd0-a088-b5b3ab162c98 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.528894 Oct 18 13:31:35.168133 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1081/2145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:35.174995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a89b651-4f05-422d-80e1-4c4a3b4addf2 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] Calling method '.version_select at 0x7fb3306afca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.294434 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a89b651-4f05-422d-80e1-4c4a3b4addf2 tempest-ServersTestFqdnHostnames-379310176 tempest-ServersTestFqdnHostnames-379310176-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436411161" status: 202 len: 0 microversion: 2.1 time: 0.124604 Oct 18 13:31:35.294434 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1082/2146] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436411161 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:35.300989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa60c9d-d83f-4f3f-8974-69ceb98836ae", "name": "network-vif-deleted", "tag": "369422a0-3597-4d1c-9a37-b27b2052317e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:35.327700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.328199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.328645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.363465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] Creating event network-vif-deleted:369422a0-3597-4d1c-9a37-b27b2052317e for instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae on n-h2-858383-13 Oct 18 13:31:35.369947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-271e2c82-080d-413e-8e63-6eca8f5c8ac6 req-0de6e98e-c6e9-4a21-81ee-770485309359 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072703 Oct 18 13:31:35.375924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1083/2147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:35.381550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.390932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:35.404888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.405588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.406264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.407176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.410580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.411287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.483448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.486154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.486801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.487442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lazy-loading 'fault' on Instance uuid 7aa60c9d-d83f-4f3f-8974-69ceb98836ae {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:35.829828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.845793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.847710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa4ca05a0c6a405f8fa014ee06dbcef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d09f371e0a64ff99d885489a5ca3bd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.851192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-464ff5a6-dfd5-440f-8004-53a79ae58710 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 200 len: 1351 microversion: 2.25 time: 0.473825 Oct 18 13:31:35.857594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1084/2148] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:35 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 1351 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:35.862666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.870666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:35.886116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.888578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.894518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.895362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.895869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.896294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.479492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.492316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.493845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.500457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db9cd086-9d1c-4a12-9715-22aff2f0bcd3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1658 microversion: 2.32 time: 0.641447 Oct 18 13:31:36.501056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1085/2149] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:35 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1658 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:36.515200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.515864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.527410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.530567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.535942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.536963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.537850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.538809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.591739 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-34d47983-c9e0-4034-b05d-d23206a328ec tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.800972 Oct 18 13:31:36.592749 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1065/2150] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:34 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:36.822159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1194519064", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9358abc3-51ca-4f7f-8a21-63a190c72b3a"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:36.917946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=16 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:36.943181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] validate_networks() for [('9358abc3-51ca-4f7f-8a21-63a190c72b3a', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:37.168353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:37.186736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75d21702-52ea-48d8-a763-0c453a234ed4 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.677840 Oct 18 13:31:37.187914 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1086/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:36 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:37.210917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:37.210917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] [instance: 7aa60c9d-d83f-4f3f-8974-69ceb98836ae] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:37.218359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.219236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.219814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:37.222788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.223496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.224018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:37.252847 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] HTTP exception thrown: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Request method failure captured: Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae HTTP/1.1 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqkC4VsZelqTw7XMfl9pUV9hnGyB74MzCYKXd2pv1ZauuJNcmOV9O_SeOwytyumBk6-EHtnXkvYDH3TKdBdyOQBdAJ1h3Vf7ejQekG-Dv3I74mWi0tbAT5LBra-FyiOzvexMYrmFpf1SWLXKJHX-NKf25fKSqwMJokVsPcIDNHDCKao Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:31:37.257481 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d09f371e0a64ff99d885489a5ca3bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 5d09f371e0a64ff99d885489a5ca3bd2 Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994 Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: fa4ca05a0c6a405f8fa014ee06dbcef4 Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081315994-project Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. Oct 18 13:31:37.260086 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '7aa60c9d-d83f-4f3f-8974-69ceb98836ae'} Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:37.261093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. Oct 18 13:31:37.262771 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:31:37.269299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] Returning 404 to user: Instance 7aa60c9d-d83f-4f3f-8974-69ceb98836ae could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:37.279831 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0207393-d8df-481b-a501-11d26909f1d5 tempest-LiveAutoBlockMigrationV225Test-2081315994 tempest-LiveAutoBlockMigrationV225Test-2081315994-project] 10.222.0.27 "GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae" status: 404 len: 111 microversion: 2.25 time: 0.081175 Oct 18 13:31:37.280548 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1087/2152] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:37 2022] GET /compute/v2.1/servers/7aa60c9d-d83f-4f3f-8974-69ceb98836ae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:31:37.530316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:37.530948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:37.552955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.561309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.561991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:37.566995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.566995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.566995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.434423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.446503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.460037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.460037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2958d836-b5da-4305-98cc-26ea71338085 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1703 microversion: 2.32 time: 0.928751 Oct 18 13:31:38.461006 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1088/2153] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:37 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1703 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:38.466389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:38.486528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:38.493604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.494125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.494578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.495314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.495779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.496215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.095895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:39.105018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62c897d3-ef5f-40c7-92f9-49a3f33ad038 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.643102 Oct 18 13:31:39.114811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1089/2154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:38 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:39.140760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:39.141198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:39.141653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:39.142083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:39.143584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:39.188459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.188982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.192695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.197077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.197629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.199999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.264554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Getting quotas for project 4f11662f8c8f4d15bce1b769946dff4e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:39.275183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Getting quotas for user c3bebd1e839f467e981fa5b8d5228ce5 and project 4f11662f8c8f4d15bce1b769946dff4e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:39.310442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:39.313520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:39.481043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:39.481800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:39.500123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.500789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.501444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.502305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.503025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.503552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.506977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:39.529357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8233b2c-1997-45c3-9fc5-8518c9ddeede tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.707745 Oct 18 13:31:39.533431 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1066/2155] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:39.545152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ec77a80-7987-4e67-ad0a-d7e89dddfbed tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:39.551416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ec77a80-7987-4e67-ad0a-d7e89dddfbed tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.085278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ec77a80-7987-4e67-ad0a-d7e89dddfbed tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.107156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ec77a80-7987-4e67-ad0a-d7e89dddfbed tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1216 microversion: 2.1 time: 0.564617 Oct 18 13:31:40.113745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1067/2156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:39 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1216 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:40.121522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.124429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.156593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.161506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.162982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.166807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.168546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.170010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.240594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.256379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.261797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.269861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1212ed75-855e-4224-866f-72e7aae70395 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1748 microversion: 2.32 time: 0.791928 Oct 18 13:31:40.281321 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1090/2157] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:39 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1748 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:40.292649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.294880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.331587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.332404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.336230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.337794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.342179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.343124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.596523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69ab2e47-4191-4297-ac98-ddba5feac6b9 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1815 microversion: 2.1 time: 0.485637 Oct 18 13:31:40.597943 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1068/2158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1815 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:40.623825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.628428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.630268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.632842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.636358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.637044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.637654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.716110 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59adbf1f-a314-4e13-91a0-9690f693a294 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.088812 Oct 18 13:31:40.716110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1069/2159] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:41.132628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ecb16c2-06c6-40c1-90bd-6529ec460c77 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.133691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ecb16c2-06c6-40c1-90bd-6529ec460c77 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.262272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ecb16c2-06c6-40c1-90bd-6529ec460c77 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.272476 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ecb16c2-06c6-40c1-90bd-6529ec460c77 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1216 microversion: 2.1 time: 0.143939 Oct 18 13:31:41.273989 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1070/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:41 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:41.303000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.303866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.317932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.318705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.319654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.330664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.331396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.331858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.772221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.790733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.790733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.801503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f1c5aae-169e-481a-a6b6-fa3e560d2b00 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1748 microversion: 2.32 time: 0.492347 Oct 18 13:31:41.814661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1071/2161] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:41 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1748 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:41.849084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.862184 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e3b29e7-f34b-4efc-a294-36a0488681b5 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 1.579208 Oct 18 13:31:41.878248 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1091/2162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:42.146984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1316273381", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:42.240525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:42.270897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10926c06-eeed-4534-89b1-fdd7f5e746b2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Action: 'create', calling method: .version_select at 0x7fb330c32940>, body: {"keypair": {"name": "tempest-keypair-109810894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH38+BKdNHRBRsVM9rG7IyWc3hDvpzBVZ+4uNsjP60vaOLpPitG7CGvqqC3pK9OiAM8WdZzRaHLO8Z1dpcEe2TVDBfIrotwqZSwv2VnKhuLh0d/3dJ63BBwkK0i1cZcYZw=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:42.308363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-10926c06-eeed-4534-89b1-fdd7f5e746b2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:42.325911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-10926c06-eeed-4534-89b1-fdd7f5e746b2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for user cfb4fc39da53465d9bf6262a60b9c922 and project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:42.336173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:42.478195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10926c06-eeed-4534-89b1-fdd7f5e746b2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.662327 Oct 18 13:31:42.479932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1072/2163] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:31:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:42.485401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:42.487801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:42.504253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.506826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.510785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.512792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.513523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.514890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.188901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:43.189421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:43.189793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:43.190479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:43.191072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:43.209939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.212294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.212956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.215031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.217895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.220112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.301204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Getting quotas for project 38f95c7096d240c88053e9fb05fb9e3c. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:43.320686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Getting quotas for user 2182a3c281364aa6b39832172235e711 and project 38f95c7096d240c88053e9fb05fb9e3c. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:43.352613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:43.360099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:43.494757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:43.511061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04302b4c-9981-4a45-8dd7-48abc107b6f6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1268 microversion: 2.1 time: 1.030887 Oct 18 13:31:43.514779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1073/2164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:42 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1268 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:43.531441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:43.532070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:43.548467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.548965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.549411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.550143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.550601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.551028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.597461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee1282e3-9c24-4c09-b3c7-d17c9db9bebf tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711750 Oct 18 13:31:43.598618 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1092/2165] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:43.651886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:43.652464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:43.699779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.700295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.707531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.722825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.722825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.722825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.192517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.207572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.209038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.215590 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de301705-39af-45cf-a7af-19895df6192a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1793 microversion: 2.32 time: 0.698045 Oct 18 13:31:44.217063 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1074/2166] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:43 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1793 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:44.251706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba725254-540b-4119-8f91-334fc05fc3fc tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:44.251706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba725254-540b-4119-8f91-334fc05fc3fc tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:44.351848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba725254-540b-4119-8f91-334fc05fc3fc tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.359481 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba725254-540b-4119-8f91-334fc05fc3fc tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1223 microversion: 2.1 time: 0.125775 Oct 18 13:31:44.364779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1075/2167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:44 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:44.537272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:44.538019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:44.548391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.548898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.549346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.550100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.553012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.556106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.722356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.744345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1332f67-fdbb-4974-8625-232a03b49a6b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1274 microversion: 2.1 time: 0.211114 Oct 18 13:31:44.746084 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1076/2168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:44 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:44.841464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.861649 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-205c11a9-7041-4a39-bac6-7c871662fed0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 1.224971 Oct 18 13:31:44.864023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1093/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:43 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:45.202640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da1b5985-6817-4429-b355-29ab2be91dd8", "device": "/dev/xvdb"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:45.206443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:45.216784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.217687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.220124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.222276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.223112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.227886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.245281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:45.245912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:45.262183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.262694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.263141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.263868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.264339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.264786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.367128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.405013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e169df3f-9ae3-4060-b5e3-4398cef85c90 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207324 Oct 18 13:31:46.411674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1077/2170] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:31:45 2022] POST /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 194 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:46.426813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:46.438443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.446920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:46.460632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.481079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-affaa2b2-baac-44c6-96d3-f0e3972a0446 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1793 microversion: 2.32 time: 1.220963 Oct 18 13:31:46.483564 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1094/2171] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:45 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1793 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:46.500938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.502751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.504391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.505777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:46.508654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:46.509074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.510261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.513751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.534225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.537247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.543982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.544688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.551093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.553375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.216484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:47.233304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6165f6f-6d20-47c1-a744-aadf957ed95b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1275 microversion: 2.1 time: 0.813031 Oct 18 13:31:47.248390 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1078/2172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:46 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1275 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:47.271811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:47.272465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:47.294803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.295314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.302553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.306617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.309200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.312136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.945102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:47.959067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5554e3a9-beae-43f1-a6a8-d5de69c7c939 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.705860 Oct 18 13:31:47.960043 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1079/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:47 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:47.974456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:47.975145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:47.986510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.991745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.991745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.992649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.993654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.994120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.710591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.722697 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aafa19b8-6b86-48f0-8c11-2eab900e3de6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 2.237632 Oct 18 13:31:48.724191 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1095/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:46 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:48.739003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:48.740006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:48.752649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.755744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.756317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.765081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.766100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.767902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.768572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.769114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.770095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.771486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-812a21fe-36f3-44cf-9411-a6ca99dc226d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1793 microversion: 2.32 time: 0.810404 Oct 18 13:31:48.772510 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1080/2175] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:47 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1793 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:48.988526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:48.990035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:49.001617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.004045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.004782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.007928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.010178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.010872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.058523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:49.074853 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b37f8f4e-4f56-4042-ab4d-7022a815251f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1293 microversion: 2.1 time: 0.349279 Oct 18 13:31:49.082883 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1096/2176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:48 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:49.295428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:49.317097 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83c1e599-1e6d-4c80-98f0-d560dacb109c tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.331192 Oct 18 13:31:49.320214 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1081/2177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:48 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:49.751276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:49.751823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:49.765774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.768765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.771671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.772644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.773306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.778352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.799193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:49.804677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:49.822469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.823191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.823855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.825378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.827955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.834237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.301658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.322752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.324201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.325379 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9fdcce0a-a5f8-4a89-9161-12ec10628d2f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1793 microversion: 2.32 time: 0.530453 Oct 18 13:31:50.325950 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1082/2178] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:49 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1793 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:50.346183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:50.354626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:50.367499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.370351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.371187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.374448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.374448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.374448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.424189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:50.517746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.528314 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94fd5236-21dd-4682-9d69-4fd1c78dfe94 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1281 microversion: 2.1 time: 0.201276 Oct 18 13:31:50.537248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1083/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:50 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:50.538679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:50.539305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:50.553850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.554415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.554872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.555686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.556154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.556589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.648327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:50.722710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.733216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-302e6e66-1410-416c-8f85-da6ca36314da tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.985932 Oct 18 13:31:50.738243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1097/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:49 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:50.872576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.887332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7604d214-020f-42d6-a6c1-a12a41ddab00 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.352389 Oct 18 13:31:50.888729 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1084/2181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:50 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:51.356119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.357352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.371051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.371763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.372553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.375302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.375966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.376581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.563661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.564554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.575335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.576662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.577280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.578376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.578995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.579747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.884116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.896641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87d6941f-51d8-4974-bd8c-f6c48959375a tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.339348 Oct 18 13:31:51.900430 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1085/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:51.908280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b6cf85-b480-47cf-94e3-f061378c91ab", "tag": "d5568670-c3e7-4236-ae86-04532dd4c752"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:51.932860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.933486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.937892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.944126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.960394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.962002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] Creating event network-changed:d5568670-c3e7-4236-ae86-04532dd4c752 for instance a2b6cf85-b480-47cf-94e3-f061378c91ab on n-h1-858383-13 Oct 18 13:31:51.967785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.970281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2b66749-1838-4204-ae2c-d087e2bd8215 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1838 microversion: 2.32 time: 0.618082 Oct 18 13:31:51.971621 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1098/2183] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1838 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:51.979459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.980480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.984244 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d4d54c31-1a25-4b0c-ac36-71ed756b7f27 req-d356ea69-36e9-4a53-bf4a-35d5e183ad92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069071 Oct 18 13:31:51.984981 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1086/2184] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:51.994162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.996284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.996439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.997079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.997235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.998978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.999730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.001037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.011236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.017267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.017897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.018874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.019511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.020132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.260562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:52.272724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-86dde52d-8c66-4ab0-80c7-01f6a7a1c5ab tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.286463 Oct 18 13:31:52.273898 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1087/2185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:52.325523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4253befc-b939-408e-9333-f5fa53a339d8", "tag": "47687f30-0817-485e-acb3-59abfb37e0ef"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:52.337746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.338578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.339196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.352758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] Creating event network-changed:47687f30-0817-485e-acb3-59abfb37e0ef for instance 4253befc-b939-408e-9333-f5fa53a339d8 on n-h2-858383-13 Oct 18 13:31:52.358929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7c4841e7-d7f8-4e4e-aa71-d2f50fb00b38 req-b2f41aa3-612e-4adf-ab7c-14af6f9f83f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037652 Oct 18 13:31:52.360378 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1088/2186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:52.928127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:52.928999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:52.937723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.938370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.938955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.939691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.940287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.942122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.008787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.028515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4af5152-589f-49c3-a3a6-94abd03a6f86 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 1.055388 Oct 18 13:31:53.034843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1099/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:53.060349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:53.061279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:53.069650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.070566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.071738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.072768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.073589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.074252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.114409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.125910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c238daa8-aacb-4e29-bd73-7bd7cbe79b8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.200547 Oct 18 13:31:53.125910 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1089/2188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:52 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:53.264188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:53.307082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:53.309663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:53.326847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.328842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.330799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.333897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.334780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.335599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.340471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:53.618825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.632325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.637050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.640835 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9af76420-85a6-4be7-8b33-712fcfebea1c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1838 microversion: 2.32 time: 0.585883 Oct 18 13:31:53.642360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1100/2189] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:53 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1838 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:53.949498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.958714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-208252e4-5868-41ca-8f34-6b61ed671949 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1473 microversion: 2.1 time: 0.661520 Oct 18 13:31:53.960008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1090/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:53 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1473 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:54.059306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:54.059932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:54.066856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.067344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.067983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.068699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.069334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.069940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.150426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:54.150426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:54.156221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.157082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.157538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.158576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.159132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.159573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.308824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:54.339660 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28fec5c4-a69b-461b-b715-0600182cd013 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.191417 Oct 18 13:31:54.342673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1091/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:54 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:54.415369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:54.431332 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-714595a5-8dd6-4a3d-8d26-4fc70567f22d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.371077 Oct 18 13:31:54.431332 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1101/2192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:54 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:54.668278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:54.669218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:54.671425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:54.678014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.678937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.679588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.681079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.681786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.684180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.704805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "4fe9140b-8dcf-48c2-a74d-9e2d29acff9f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:54.720352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.724823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.725529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.750296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] Creating event network-changed:4fe9140b-8dcf-48c2-a74d-9e2d29acff9f for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:31:54.761420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ca404178-3556-4612-83f4-b5df38d33f56 req-9562cdd7-4f08-4b9e-98eb-d3cc486e305c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061053 Oct 18 13:31:54.768447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1102/2193] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:54.982909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:54.983866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:54.998810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.999583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.000193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.001078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.001716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.002176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.169513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.186781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.188806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.190383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b69c702e-b74d-413d-928c-e979ecc8011d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1838 microversion: 2.32 time: 0.526838 Oct 18 13:31:55.191479 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1092/2194] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:54 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1838 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:55.376337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:55.376959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:55.384085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.384896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.385528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.386526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.387289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.387928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.914974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.922907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40866a39-b824-4e0b-af48-0d8d02020eda tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.550388 Oct 18 13:31:55.923541 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1093/2195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:55 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:55.938820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:55.939429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:55.961615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.962139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.962598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.963307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.976501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.979383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.279301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.287273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c291c70-7e86-4017-9b47-e31aba16a00b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.362681 Oct 18 13:31:56.293656 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1094/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:55 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:56.298505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:56.310672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:56.323850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.327054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.327701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.328636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.329274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.331853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.347300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.367158 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f54b16b-30b2-4a5d-84ea-d023c5bf8e7f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1479 microversion: 2.1 time: 1.386489 Oct 18 13:31:56.369718 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1103/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:54 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1479 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:56.585069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.600241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.601690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.610492 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ecfee837-c879-4f07-99ca-7aa6063c04cf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1838 microversion: 2.32 time: 0.315600 Oct 18 13:31:56.611694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1095/2198] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:56 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1838 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:56.949290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:56.950275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:56.981621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.982182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.983592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.985852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.986846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.987585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.042172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-unplugged", "status": "completed", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:57.062408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.063088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.063718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.085539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] Creating event network-vif-unplugged:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:31:57.102523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fc084d1c-e455-4ac3-a8d2-a3383f6b7ceb req-3d02c08b-c9e7-44ee-aa19-479fb8aaad4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065974 Oct 18 13:31:57.103369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1096/2199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:57.314743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:57.316117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:57.323579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.324314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.324978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.326545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.327209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.327839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.647125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:57.656130 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1369044-44cc-4a8a-8870-fbbc8077273d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.345487 Oct 18 13:31:57.674087 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1097/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:57 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:57.676640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:57.677094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:57.694457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.695051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.695536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.698493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.698975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.699470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.059195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.076227 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-777015f0-2ea2-495b-993d-d9d9d9ffe1ca tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1479 microversion: 2.1 time: 0.410543 Oct 18 13:31:58.080800 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1098/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:57 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1479 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:58.093742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:58.096647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:58.129501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.130504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.135753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.137581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.138330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.139305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.334761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.350432 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7d571dc-c94d-4339-95eb-e30b88bafa88 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 1.407557 Oct 18 13:31:58.362543 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1104/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:56 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:58.421718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.442279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.446310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.447544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a5c1f20-ec76-43b1-8260-725e8fdcc8f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1838 microversion: 2.32 time: 0.365441 Oct 18 13:31:58.450403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1099/2203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:58 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1838 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:58.696354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:58.698167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:58.711424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.711922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.712549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.713456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.715800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.716460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.112391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:59.114704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:59.128976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.129921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.130913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.136895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.138971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.141415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.301398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:59.323132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8b6ee5f-8d7d-4dbb-a47e-ac8ada976c4f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.629748 Oct 18 13:31:59.333946 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1105/2204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:58 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:59.376017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:59.377429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:59.399760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.402151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.402817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.404687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.405930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.407977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.578497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:59.594442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf6a4f0c-713b-4e53-9230-768e06d81154 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1479 microversion: 2.1 time: 0.488903 Oct 18 13:31:59.598346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1100/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:59 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1479 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:59.629991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:59.644870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:59.664785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.667315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.667869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.668683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.672951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.673542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.083156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.095006 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef533720-9171-4f75-b8f4-ee67c410e9a2 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.723944 Oct 18 13:32:00.095902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1106/2206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:59 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:00.106881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-plugged", "status": "completed", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:00.120841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.125503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.125503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.139001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] Creating event network-vif-plugged:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:32:00.144410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-80874c39-d6f8-42e4-94e6-e10310373928 req-ffc5189b-9c03-42b3-a3d8-dee78aa3aec4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046927 Oct 18 13:32:00.146898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1107/2207] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:00.216597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.231212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:00.236934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "da60ea4f-7615-4adc-8662-808ebb5bb0e0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:00.245279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.250237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.253862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aec3453e-fc74-42a4-b0a2-fd82aecef0a9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1859 microversion: 2.32 time: 0.640403 Oct 18 13:32:00.256846 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1101/2208] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:59 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1859 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:00.274674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.280066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.280681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.302434 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] Creating event network-changed:da60ea4f-7615-4adc-8662-808ebb5bb0e0 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:00.317042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e97bb695-1f83-40a0-bead-22a5176ac7dc req-f85685e3-b233-4dad-8823-ef270295da36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084104 Oct 18 13:32:00.318489 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1108/2209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:00.347256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:00.347920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:00.358180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.364750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.366111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.369891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.370638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.371274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.630965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:00.631704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:00.649706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.649706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.649706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.650107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.656881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.657358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.705984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:00.809502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.821168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a98490ee-c775-46d8-b78c-6d94a91abbd7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.475428 Oct 18 13:32:00.822254 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1102/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:00 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:01.124212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.126485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.138597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.139479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.140259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.141313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.142043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.142744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.341220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.350173 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-559fd165-0497-4a2e-842f-7ea0fc3adca5 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.231310 Oct 18 13:32:01.359116 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1103/2211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:01.371341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.372261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.381253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.381977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.382987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.384278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.384928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.385790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.639725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.652327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.655289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.656950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4452f137-49f9-416c-b22f-f2668895026d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1859 microversion: 2.32 time: 0.295830 Oct 18 13:32:01.662197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1104/2212] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1859 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:01.759533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.781326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d48b545-e336-4c45-8fa7-201470e9218a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1479 microversion: 2.1 time: 1.154681 Oct 18 13:32:01.781326 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1109/2213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:00 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1479 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:01.860729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.863826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.892550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.894258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.895166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.896335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.898219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.899676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.190934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b6cf85-b480-47cf-94e3-f061378c91ab", "name": "network-vif-plugged", "status": "completed", "tag": "d5568670-c3e7-4236-ae86-04532dd4c752"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:02.224057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:02.233457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.234171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.234841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.240689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11958f14-b1cb-4634-88f8-2d9a23c72777 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.396080 Oct 18 13:32:02.247098 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1105/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:02.256334 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] Creating event network-vif-plugged:d5568670-c3e7-4236-ae86-04532dd4c752 for instance a2b6cf85-b480-47cf-94e3-f061378c91ab on n-h1-858383-13 Oct 18 13:32:02.264442 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-227b3074-f5d7-4903-8b53-cb7e8198c976 req-5097a902-c142-4b9a-a3d9-77fc091fc507 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077127 Oct 18 13:32:02.266172 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1110/2215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:02.374918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:02.375926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:02.390376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.393937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.396392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.398338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.400485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.403153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.687108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:02.688034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:02.703600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.705291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.705824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.710007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.710007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.710007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.805027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:02.816287 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d679bd8-fceb-4d5f-b902-60d74dc3ff27 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.445204 Oct 18 13:32:02.823301 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1106/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:02 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:02.830134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:02.840619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:02.863087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.864341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.864995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.865910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.866847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.867653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.411957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:03.426441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:03.430572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:03.433661 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f7dd7aa-6349-432a-91eb-9aa6f7124651 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1880 microversion: 2.32 time: 0.753714 Oct 18 13:32:03.437283 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1111/2217] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:02 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1880 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:03.451374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:03.452256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:03.459986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.460129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.460611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.461339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.461880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.462516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.055819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.065895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6dafea83-82f6-468d-82e2-4d3feeae604e tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1464 microversion: 2.1 time: 1.241476 Oct 18 13:32:04.092350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1107/2218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:02 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1464 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:04.102819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:04.104100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:04.112226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.112941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.113583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.114537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.115176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.115789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.382984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.409755 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10296418-da62-4565-a173-989545617e13 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1316 microversion: 2.1 time: 0.964880 Oct 18 13:32:04.409755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1112/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:03 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1316 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:04.420020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:04.440442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.453068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:04.454443 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0488c60f-a3d7-47a6-8f30-171d462aeb95 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.362915 Oct 18 13:32:04.462433 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1108/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:04 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:04.486739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "90cc59d7-23c7-4f5c-9230-0ddc8edac2a5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:04.495046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.496355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.501623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.501623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.501623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.505524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.519933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.524808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.526243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.608127 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] Creating event network-changed:90cc59d7-23c7-4f5c-9230-0ddc8edac2a5 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:04.620125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b08a298f-df08-4419-8787-3501c232c9a4 req-5f752fd7-c6e9-4825-adde-895dd9f3afe2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152243 Oct 18 13:32:04.622842 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1109/2221] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:04.662200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:04.664118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:04.675285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.676150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.676865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.679308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.683065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.684118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.988894 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c026a810-0ba4-499a-be14-03e72dbf0cc4 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 0 microversion: 2.1 time: 0.581308 Oct 18 13:32:04.990225 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1113/2222] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:04 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:04.998410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253befc-b939-408e-9333-f5fa53a339d8", "name": "network-vif-plugged", "status": "completed", "tag": "47687f30-0817-485e-acb3-59abfb37e0ef"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:05.031098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:05.035603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.039789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.040654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.078362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] Creating event network-vif-plugged:47687f30-0817-485e-acb3-59abfb37e0ef for instance 4253befc-b939-408e-9333-f5fa53a339d8 on n-h2-858383-13 Oct 18 13:32:05.088543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b9cc756d-7c3d-432c-b0dc-c62ddadb9ce7 req-3adef5d5-ed60-41ee-8457-41b5ee13e9c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096960 Oct 18 13:32:05.090354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1114/2223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:05.100254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.101232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.111069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.112424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.113313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.115864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.116833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.118327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.165976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.166771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.167694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.168457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lazy-loading 'fault' on Instance uuid e744b81e-7a31-425e-b2bc-becb2ab83513 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:05.181937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.199155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.200793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.206908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf94f9e2-a4db-4505-8812-f4d517adcaa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1880 microversion: 2.32 time: 0.581716 Oct 18 13:32:05.207529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1110/2224] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:04 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1880 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:05.435303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.435958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.448818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.452349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.453008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.455560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.456244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.459192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.750461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.764060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f058f3ea-8cb9-4279-8c48-508dcdd3bacd tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1505 microversion: 2.1 time: 0.333703 Oct 18 13:32:05.778852 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1111/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:05.792742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.797161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.805806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.806985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.807665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.819561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.821873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.825900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.934429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-591a61b3-aa3e-4d34-a084-618059b3146d tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1600 microversion: 2.1 time: 0.839279 Oct 18 13:32:05.936496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1115/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1600 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:05.976797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.978680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.003511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.009860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.009860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.009860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.009860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.010690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.095687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:06.106910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5b3573e-ac31-4a27-b0b0-9589d8d3932d tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1323 microversion: 2.1 time: 0.324400 Oct 18 13:32:06.107512 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1112/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.127253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1235211721"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:06.130473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.142355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.143090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.143552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.144902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.145767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.145929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.355311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Adding security group 9380f67f-9baf-4996-95b7-aaecc90be041 to port d5568670-c3e7-4236-ae86-04532dd4c752 Oct 18 13:32:06.786826 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2cc203f9-a1d5-47f0-9fb5-675218f57a46 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1861 microversion: 2.1 time: 0.833216 Oct 18 13:32:06.790450 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1116/2228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1861 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.809535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:06.812110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.821449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.826859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.827647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.828609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.829292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.832571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.940191 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f2470d1-f752-4bd0-aa8a-420173122e06 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/action" status: 202 len: 0 microversion: 2.1 time: 0.831539 Oct 18 13:32:06.941712 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1113/2229] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:06 2022] POST /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:06.948768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:06.950470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.975811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.977760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.980571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.982213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.982493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.986837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.257686 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3368804-9e36-41d3-9642-fc71018fb8f1 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action" status: 202 len: 0 microversion: 2.1 time: 0.465820 Oct 18 13:32:07.259890 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1117/2230] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:06 2022] POST /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:07.266235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": true, "disk_over_commit": false}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:07.272392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:07.286132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.290255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.296252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.296252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.296252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.296252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.350271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lazy-loading 'flavor' on Instance uuid 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:07.365835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Going to try to live migrate instance to n-h1-858383-13 {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:32:07.486290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.498554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.500500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.503046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-119abbeb-f7ec-4d51-b590-0ed51cdc2531 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1880 microversion: 2.32 time: 0.559697 Oct 18 13:32:07.521062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1114/2231] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:06 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1880 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:07.526487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1439393719"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:07.527142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:07.535465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.535902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.536926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.537911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.538609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.539313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.719171 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Adding security group ddcfbfc8-2926-4d06-9f75-409782ef56f0 to port d5568670-c3e7-4236-ae86-04532dd4c752 Oct 18 13:32:08.432862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7377b71b-28b8-421e-88fc-356b8a4c93f1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/action" status: 202 len: 0 microversion: 2.1 time: 0.916332 Oct 18 13:32:08.433931 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1115/2232] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:07 2022] POST /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:08.439399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b6cf85-b480-47cf-94e3-f061378c91ab", "tag": "d5568670-c3e7-4236-ae86-04532dd4c752"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:08.474266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.477303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.477303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.512288 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] Creating event network-changed:d5568670-c3e7-4236-ae86-04532dd4c752 for instance a2b6cf85-b480-47cf-94e3-f061378c91ab on n-h1-858383-13 Oct 18 13:32:08.521628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fd41d87b-4199-4218-be3d-834f1546779b req-2e9caa62-769d-4e52-93e8-a8bbf41c48e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086259 Oct 18 13:32:08.522270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1116/2233] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.555928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.557514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:08.569355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.576367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.576367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.576367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.576367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.577101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.832718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:08.856575 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-baa93d2a-0e23-455b-91f9-ee8530fdfd36 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1473 microversion: 2.1 time: 0.330820 Oct 18 13:32:08.857861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1117/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.867393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.870759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:08.879037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.883851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.887055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.893210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.894001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.895799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.114554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee653bea-7778-432a-be5f-04a3eede2117 tempest-ServersAdminTestJSON-1403836569 tempest-ServersAdminTestJSON-1403836569-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1617 microversion: 2.1 time: 0.254256 Oct 18 13:32:09.118361 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1118/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1617 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:09.135060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "0a2abc3c-716f-417d-8562-5e0b82309599"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:09.152662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:09.163906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.165441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.167139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.219082 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] Creating event network-changed:0a2abc3c-716f-417d-8562-5e0b82309599 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:09.226327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4453a8b7-a1ab-4911-a2bf-0e66d8190a1c req-bbb60362-2d41-49d3-b493-49064261f479 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105797 Oct 18 13:32:09.227764 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1119/2236] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:09.238453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.239146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:09.248242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.248882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.249466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.250774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.251316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.251761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.573251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23d088be-616d-406b-9ea0-ddaf3cb1fec0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.343607 Oct 18 13:32:09.586409 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1120/2237] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab/os-security-groups => generated 1158 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:09.592002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.592862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:09.599064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.599555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.600212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.600926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.601393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.602568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.620707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:09.901570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.919893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.922076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.923490 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9da9fdc3-f66a-4113-9c00-11d5f1591771 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.335448 Oct 18 13:32:09.924504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1121/2238] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:09.931335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.932151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:09.940868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.953961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.954377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.955172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.955640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.956077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.989229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Request method failure captured: Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8/diagnostics HTTP/1.1 Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq7pohRPR5_o6k4HVHdm3Lb0b4OYU7fKpi-NCrN2JYwPaB709GrBdFULMknpF2gUh9LziGj_LBmDudcsnP2ytvxNLFh3Wi419Jge5b6-EbiAekMAIzF4AHBtcVsfacj6Rj42jd_DGhBxHoT4gdPdgNxK6wf5CtbLU3PebzndAJq-GY Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 38f95c7096d240c88053e9fb05fb9e3c Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:32:09.995200 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 38f95c7096d240c88053e9fb05fb9e3c Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerDiagnosticsNegativeTest-819412142-project Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2182a3c281364aa6b39832172235e711 Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-819412142-project Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:32:09.997195 n-d-858383-13 devstack@n-api.service[121010]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '4253befc-b939-408e-9333-f5fa53a339d8'} Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:32:10.002870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.004644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:10.006184 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-572a19c5-7bf0-4d4b-b9d2-08f0bc8b024b tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.071125 Oct 18 13:32:10.006184 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1122/2239] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8/diagnostics => generated 117 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:10.006184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.006184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:10.027391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.028601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.030283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.031880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.032563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.033111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.117353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:10.566531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97c595bd-1bb7-488f-80e2-0cec245595b2 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 204 len: 0 microversion: 2.1 time: 0.567370 Oct 18 13:32:10.571547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1123/2240] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:09 2022] DELETE /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:10.577590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad4e0d86-186b-4f0b-b976-1f33956516d5 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb330bdfe50>, body: {"security_group": {"name": " tempest-securitygroup -1199924665 ", "description": "tempest-description-1473214973"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:10.696624 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f4fe3c7-0a95-40f9-87ab-0b75ecc468d2 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/action" status: 202 len: 0 microversion: 2.1 time: 3.434543 Oct 18 13:32:10.703773 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1118/2241] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:07 2022] POST /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/action => generated 0 bytes in 3437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:10.707096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.707636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:10.715038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.715933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.716647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.717665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.718679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.719489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.755394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:11.160353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-191611f6-0915-4e4d-a872-6ed695ae29a6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 204 len: 0 microversion: 2.1 time: 0.461078 Oct 18 13:32:11.161326 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1119/2242] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:10 2022] DELETE /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:11.167474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b6cf85-b480-47cf-94e3-f061378c91ab", "tag": "d5568670-c3e7-4236-ae86-04532dd4c752"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:11.194033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.194547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.205886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.218338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] Creating event network-changed:d5568670-c3e7-4236-ae86-04532dd4c752 for instance a2b6cf85-b480-47cf-94e3-f061378c91ab on n-h1-858383-13 Oct 18 13:32:11.227552 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-81de8c82-1173-429a-bed6-8751868e6316 req-11d3ab8e-4a95-4b42-a1d5-c6d28bd88131 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063427 Oct 18 13:32:11.234408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1120/2243] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:11.240842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:11.245215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:11.262136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.263406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.265443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.266887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.269572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.270256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.286159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:11.623046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad4e0d86-186b-4f0b-b976-1f33956516d5 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.049929 Oct 18 13:32:11.624840 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1124/2244] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:10 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:11.631383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:11.632438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:11.643491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.643984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.652554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.652554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.652554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.652554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.847129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:11.862834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bbe10951-7512-4d9c-aae9-b748248385d3 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1469 microversion: 2.1 time: 0.630509 Oct 18 13:32:11.863723 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1121/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:11 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1469 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:11.875702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:11.877620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:11.892267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.894475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.895114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.899188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.900198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.900749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.012674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.024904 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e25c30e8-837e-4fe8-9d6a-a23b8c4f9f04 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.398796 Oct 18 13:32:12.028821 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1125/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:11 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:12.033519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:12.034192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:12.052702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:12.053207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:12.053651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.062229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:12.063412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:12.063412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.275045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.284194 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca934386-3b28-4705-987d-bcd8fd527e8f tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1479 microversion: 2.1 time: 0.254238 Oct 18 13:32:12.288966 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1126/2247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:12 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1479 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:12.293872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "be74ac22-ab15-4d00-9974-0c19505e3929"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:12.323770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:12.323770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:12.323770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.347740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] Creating event network-changed:be74ac22-ab15-4d00-9974-0c19505e3929 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:12.355542 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5bd298ce-351c-47f5-8b23-d7681207f154 req-0f0fde7b-c3a7-48ae-85d2-47f40accb04f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066502 Oct 18 13:32:12.359594 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1127/2248] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:12.382349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bda116b9-3434-4027-9143-f42ef7045a35 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3316889d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:12.505655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bda116b9-3434-4027-9143-f42ef7045a35 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae" status: 200 len: 224 microversion: 2.1 time: 0.136222 Oct 18 13:32:12.506289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1128/2249] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:12 2022] GET /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae => generated 224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:12.889982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Action: 'update', calling method: .version_select at 0x7fb330bdff70>, body: {"quota_set": {"ram": "5120"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:12.937520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.955075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.956827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.962668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47270058-80df-48b6-bc99-c1e7fcdbb41c tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 1.092104 Oct 18 13:32:12.962668 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1122/2250] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:11 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:12.968259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea96809b-5e46-4482-a983-418b0017390e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3307b6ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:12.993130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.006316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.009788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.012154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.012842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.013929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.195207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a2333ad-5775-4940-8344-a9e3789108f3 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9" status: 200 len: 240 microversion: 2.36 time: 0.687697 Oct 18 13:32:13.196843 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1129/2251] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Oct 18 13:32:12 2022] PUT /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9 => generated 240 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:13.201841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:13.202638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:13.209878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.210470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.211155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.212086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.212735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.213408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.954753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:13.971045 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e239d95-5f21-4a39-941d-870ca3816be1 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1469 microversion: 2.1 time: 0.773087 Oct 18 13:32:13.971645 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1130/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:13 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1469 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:13.977464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:13.982721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.006408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.007216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.008368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.009277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.009962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.010589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.260217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea96809b-5e46-4482-a983-418b0017390e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae" status: 202 len: 0 microversion: 2.1 time: 1.293958 Oct 18 13:32:14.260217 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1123/2253] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:12 2022] DELETE /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae => generated 0 bytes in 1296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:14.263718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Calling method '.version_select at 0x7fb3314730d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.379073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.380808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.381057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.381820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.382316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.383328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.423282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6be6fb2b-f882-406c-bde6-f0b3fc43d733 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9/detail" status: 200 len: 672 microversion: 2.36 time: 0.163351 Oct 18 13:32:14.424413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1124/2254] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9/detail => generated 672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:14.429151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.430558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.438795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.439612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.440239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.441907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.443066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.443696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.661549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:14.678982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54b4245b-2dfd-46f1-8dc6-c18efb350bde tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.705554 Oct 18 13:32:14.680859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1131/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:13 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:14.690168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.691132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.699672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.701140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.701834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.704353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.705021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.705685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.959611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:14.978408 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cee44910-6079-4dd4-b622-cc336b9fdcd6 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1479 microversion: 2.1 time: 0.552716 Oct 18 13:32:14.979017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1125/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1479 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:14.988672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3314a0dc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:15.113601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:15.114249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group af0517df-02d3-4931-89d0-39dfda92b2ae not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:32:15.114871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.114871 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae HTTP/1.1 Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:15.119405 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.120972 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'af0517df-02d3-4931-89d0-39dfda92b2ae'} Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:15.122733 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:32:15.124313 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.125689 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-fa3ffbb4-0f06-4b0d-8f47-d206a4c374b5'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e11be1d-1cff-4d95-8893-bf73cccdb9b9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae" status: 404 len: 194 microversion: 2.1 time: 0.140931 Oct 18 13:32:15.129148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1126/2257] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae => generated 194 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:15.135912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "b6196777-36fd-4ea6-9393-e0693c5210e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:15.166796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.167359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.167941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.181163 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] Creating event network-changed:b6196777-36fd-4ea6-9393-e0693c5210e1 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:15.198358 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-963e5959-dfad-4365-b541-17d1a4d06500 req-d78fecc7-8f24-4875-a718-00793e4afdb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074220 Oct 18 13:32:15.201124 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1127/2258] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:15.245282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Action: 'update', calling method: .version_select at 0x7fb331271160>, body: {"quota_set": {"ram": "2048"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:15.315445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:15.332060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:15.335242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:15.337039 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f264f9d-beb4-4254-922b-88af31cd812d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.654776 Oct 18 13:32:15.337789 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1132/2259] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:15.356341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:15.357185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:15.365700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.366848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.368018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.369487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.370484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.371246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.421473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.424678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.426498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.428947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.429781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.432789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.552865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:15.582848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.583619 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b717db34-6629-45eb-b2bb-93f3fe8c447a tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 200 len: 1427 microversion: 2.1 time: 0.239675 Oct 18 13:32:15.593525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1133/2260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:15 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 1427 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:15.595720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.603946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.604962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.610248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.617226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.620750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e07b8109-f9af-46c9-bcb7-b8296c3fd442 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb3314d3280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-764212601", "description": "tempest-description-1276737990"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:15.922865 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc660732-7a14-43f9-84c4-5b036f8fc992 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9?user_id=811304cd440c42d4adb27c0607e40e68" status: 200 len: 240 microversion: 2.36 time: 0.720088 Oct 18 13:32:15.949317 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1128/2261] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Oct 18 13:32:15 2022] PUT /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9?user_id=811304cd440c42d4adb27c0607e40e68 => generated 240 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:15.954300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2128cb7-3364-4700-97c4-79fc42aa9325", "name": "network-vif-deleted", "tag": "0023d0c1-0beb-4ee8-8fb7-774408c3c2be"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:15.982805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.984800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.988534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.016164 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] Creating event network-vif-deleted:0023d0c1-0beb-4ee8-8fb7-774408c3c2be for instance d2128cb7-3364-4700-97c4-79fc42aa9325 on n-h2-858383-13 Oct 18 13:32:16.029290 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b6d990ae-1af5-433e-a3d5-40f375923e9e req-cf4a2954-e938-49ed-8598-4ceac5be2df9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078198 Oct 18 13:32:16.030965 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1129/2262] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:16.152615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1085343534", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:16.231767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e07b8109-f9af-46c9-bcb7-b8296c3fd442 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.636706 Oct 18 13:32:16.232609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1134/2263] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:16.238026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:16.238865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:16.251609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:16.252439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:16.254635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.255819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:16.258515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:16.259217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.314381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:16.560235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:16.575643 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6c19038-1204-499d-b2b8-62b3de353c2a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.341624 Oct 18 13:32:16.576236 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1135/2264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:16 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:16.596887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d15e2c1-f2fb-4a75-8f67-e665e09b4497 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Calling method '.version_select at 0x7fb330b6be50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:16.721289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d15e2c1-f2fb-4a75-8f67-e665e09b4497 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9?user_id=811304cd440c42d4adb27c0607e40e68" status: 200 len: 282 microversion: 2.36 time: 0.139784 Oct 18 13:32:16.724900 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1136/2265] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Oct 18 13:32:16 2022] GET /compute/v2.1/os-quota-sets/46d64b8e42bb4469bd2c382192a531b9?user_id=811304cd440c42d4adb27c0607e40e68 => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:16.739987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:16.741160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:16.752327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:16.753209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:16.753900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.756597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:16.757402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:16.758774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.839196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:16.840249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:16.842617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.844147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lazy-loading 'fault' on Instance uuid 4253befc-b939-408e-9333-f5fa53a339d8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:16.922153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2182a3c281364aa6b39832172235e711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f95c7096d240c88053e9fb05fb9e3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:16.942871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eca96342-fcec-4f86-aeb3-75b52d46c217 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 200 len: 1313 microversion: 2.1 time: 0.216235 Oct 18 13:32:16.943516 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1137/2266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:16 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:16.958267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a767065e-ec1a-4cf3-8d8a-6d249a0bbd2c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb330d833a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-70437015", "description": "tempest-description-1282220498"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:17.246884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:17.248043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:17.248870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:17.249854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:17.250704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:17.282961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.282961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.282961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.283365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.283640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.286446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.332206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:17.349311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:17.385945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:17.385945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:17.615157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ab463cb6-ca86-4c47-960b-6807eda7bb8f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582684 Oct 18 13:32:17.616724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1130/2267] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:17.625349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:17.626338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:17.634723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.635689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.636337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.637487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.638356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.638963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.718713 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a767065e-ec1a-4cf3-8d8a-6d249a0bbd2c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.721591 Oct 18 13:32:17.718713 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1138/2268] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:16 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:17.718713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:17.718713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: d2128cb7-3364-4700-97c4-79fc42aa9325] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:17.737378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.743862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.744862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.745597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.746548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.747018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.798258 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] HTTP exception thrown: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Request method failure captured: Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 HTTP/1.1 Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqpMzvtbLC86TmZSvKo9uV4Txonn9LtgM60Y2Mtdgq1D6lFViceNusI4mfDHlKXtOPo8FRri0VLvNHV8ZMSkQ28AeQvNK463_VnDu6COfHaylxBwh0xo5nzn7cs_MiBmV9Kq07RbPJQCrLAzx9Gmwyr7_2oUlQbkcwIr466UmQmjPJA Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:32:17.802604 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d54a9109295b426ba1060c63bfb230ed Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. Oct 18 13:32:17.804650 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'd2128cb7-3364-4700-97c4-79fc42aa9325'} Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:17.805784 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. Oct 18 13:32:17.807512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:17.810453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Returning 404 to user: Instance d2128cb7-3364-4700-97c4-79fc42aa9325 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:17.811920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cd4af37-fba1-4ae1-9a88-3b008986575d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325" status: 404 len: 111 microversion: 2.1 time: 0.139824 Oct 18 13:32:17.818493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1139/2269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:17 2022] GET /compute/v2.1/servers/d2128cb7-3364-4700-97c4-79fc42aa9325 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:17.825379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "a8cd0da4-8c52-4382-853b-1e381dc48b82"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:17.853516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.854732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.856495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.879857 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] Creating event network-changed:a8cd0da4-8c52-4382-853b-1e381dc48b82 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:17.886533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3dacb78b-3086-49e4-a55f-bc479ce03fd6 req-7a0e06fb-9547-4a95-a9e9-e05cbec63d06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066248 Oct 18 13:32:17.889923 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1140/2270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:17.896378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:17.897575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:17.905781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.911377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.918675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.922697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.926138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.927021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:18.218782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.244477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79307764-a23e-4306-be33-f67bedad5fe4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.347508 Oct 18 13:32:18.249130 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1141/2271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:17 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:18.261681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dfa7e56a-811a-464e-bed5-57f4ac723e76 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:18.267589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfa7e56a-811a-464e-bed5-57f4ac723e76 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:18.326012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.338970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.347092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.347092 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1f214cb-96c4-476c-93f9-703bd97c1e19 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.722402 Oct 18 13:32:18.359715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1131/2272] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:17 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:18.386654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6fcf7cb-268f-4e2a-bfa1-5ff973fe2748 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb330810ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1971368986", "description": "tempest-description-220631579"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:18.411845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfa7e56a-811a-464e-bed5-57f4ac723e76 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.434432 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfa7e56a-811a-464e-bed5-57f4ac723e76 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1215 microversion: 2.1 time: 0.181810 Oct 18 13:32:18.435746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1142/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:18 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:18.442137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:18.442653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:18.459534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:18.460097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:18.460931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:18.462002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:18.469439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:18.470259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:18.508112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:18.723409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:19.027935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70f3a24b-94fb-4a2f-8721-efbc2bf3fe4d tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 204 len: 0 microversion: 2.1 time: 0.586545 Oct 18 13:32:19.027935 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1143/2274] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:18 2022] DELETE /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:19.033041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:19.035506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] [instance: 4253befc-b939-408e-9333-f5fa53a339d8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:19.054844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.054844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.054844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.058004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.061316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.063937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.111947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] HTTP exception thrown: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Request method failure captured: Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 HTTP/1.1 Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq7pohRPR5_o6k4HVHdm3Lb0b4OYU7fKpi-NCrN2JYwPaB709GrBdFULMknpF2gUh9LziGj_LBmDudcsnP2ytvxNLFh3Wi419Jge5b6-EbiAekMAIzF4AHBtcVsfacj6Rj42jd_DGhBxHoT4gdPdgNxK6wf5CtbLU3PebzndAJq-GY Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 38f95c7096d240c88053e9fb05fb9e3c Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:32:19.114700 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_38f95c7096d240c88053e9fb05fb9e3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 38f95c7096d240c88053e9fb05fb9e3c Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-819412142 Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerDiagnosticsNegativeTest-819412142-project Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2182a3c281364aa6b39832172235e711 Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-819412142-project Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. Oct 18 13:32:19.116417 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4253befc-b939-408e-9333-f5fa53a339d8'} Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:19.117620 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. Oct 18 13:32:19.119125 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:19.125954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] Returning 404 to user: Instance 4253befc-b939-408e-9333-f5fa53a339d8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:19.127439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6c723b3-cb97-4b9c-bb69-03014ac70c80 tempest-ServerDiagnosticsNegativeTest-819412142 tempest-ServerDiagnosticsNegativeTest-819412142-project] 10.222.0.27 "GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8" status: 404 len: 111 microversion: 2.1 time: 0.100386 Oct 18 13:32:19.128696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1144/2275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:19 2022] GET /compute/v2.1/servers/4253befc-b939-408e-9333-f5fa53a339d8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:19.134426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253befc-b939-408e-9333-f5fa53a339d8", "name": "network-vif-deleted", "tag": "47687f30-0817-485e-acb3-59abfb37e0ef"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:19.167931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.169371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.170911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.211090 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] Creating event network-vif-deleted:47687f30-0817-485e-acb3-59abfb37e0ef for instance 4253befc-b939-408e-9333-f5fa53a339d8 on n-h2-858383-13 Oct 18 13:32:19.227589 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2ef6262b-b66c-4d7a-ac7f-04a5a1ad8f06 req-911bedb3-1342-4a10-89b1-6ecefd3b522a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096416 Oct 18 13:32:19.229781 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1145/2276] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:19.238796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:19.240914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:19.260107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.266686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.266686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.267301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.267777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.268285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.548845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:19.557814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c629d0f6-adeb-479a-bfc2-10f4cbef6845 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1470 microversion: 2.1 time: 0.326019 Oct 18 13:32:19.557951 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1146/2277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:19 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:19.583481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:19.585003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:19.597012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.602667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.603389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.604525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.605170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.605810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.788925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6fcf7cb-268f-4e2a-bfa1-5ff973fe2748 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.424142 Oct 18 13:32:19.789708 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1132/2278] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:19.803383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:19.809364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:19.823055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.825245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.825966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.832222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.832222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.832222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.996058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:20.012481 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a8d5d97-e1a0-4048-b14b-d79b253163dd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.438062 Oct 18 13:32:20.022671 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1147/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:19 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:20.022671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:20.022671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:20.031794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:20.032490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:20.033117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:20.034171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:20.034806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:20.035409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:20.247369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:20.265930 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22ed1dab-434b-4d21-86b8-5b03b1e91fbf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1219 microversion: 2.1 time: 0.250514 Oct 18 13:32:20.272433 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1148/2280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:20 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:20.280990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fc17e75-49ad-452a-bd60-5b54fc8e3458 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330dd4b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:21.051932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:21.067288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:21.073287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:21.089044 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-011e8d4c-4436-4715-9c43-5ae085b13d81 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 1.275917 Oct 18 13:32:21.095966 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1133/2281] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:19 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:21.106127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:21.107063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:21.116744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.119203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.124706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:21.125086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.125605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.126128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:21.617277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:21.630880 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ecaadbc-6cee-4937-9d0f-09a2b0e3ca8f tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1470 microversion: 2.1 time: 0.530211 Oct 18 13:32:21.633713 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1134/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:21 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:21.638751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:21.647776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:21.664865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.665441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.665968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:21.666792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.668213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.670289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:22.011276 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4fc17e75-49ad-452a-bd60-5b54fc8e3458 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.737211 Oct 18 13:32:22.012448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1149/2283] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:32:20 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:22.024229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:22.025738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:22.038490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:22.055536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:22.056415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:22.057570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:22.058243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:22.059289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:22.175366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:22.190996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81789c46-4e5b-4b80-ba68-1239b99808a5 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.556040 Oct 18 13:32:22.211918 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1135/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:21 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:22.225233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35eea80d-dde7-438d-a20e-cea1f873178b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3309d49d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:22.536650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:22.559101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8043919-e4da-48a3-8bf5-1f2a594f3cab tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1275 microversion: 2.1 time: 0.544547 Oct 18 13:32:22.565202 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1150/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:22 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1275 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:22.582902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:22.583546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:22.608705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:22.611563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:22.613210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:22.622565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:22.622565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:22.622565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.025342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:23.090554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:23.100860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:23.105875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:23.107614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40515904-d88b-4a5a-bd7c-eaf3dfd23c54 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.541342 Oct 18 13:32:23.126151 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1151/2286] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:22 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:23.134780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.135701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:23.142731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.143616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.144267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.145474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.146000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.146762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.220240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35eea80d-dde7-438d-a20e-cea1f873178b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe" status: 202 len: 0 microversion: 2.1 time: 1.006718 Oct 18 13:32:23.220848 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1136/2287] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:22 2022] DELETE /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:23.224917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:23.230132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf22771-4aae-462f-8e75-e1f055cc1551", "name": "network-vif-deleted", "tag": "851050bd-edcd-458c-b9dc-c52489993c33"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:23.240678 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e60b25c2-c3f3-4a9b-9ce2-414200bc70ed tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 200 len: 1299 microversion: 2.1 time: 0.116528 Oct 18 13:32:23.255007 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1152/2288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:23.274088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.275829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.276351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:23.277680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.279039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.294743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.294743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.294743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.297379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.298599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.300153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.301040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] Creating event network-vif-deleted:851050bd-edcd-458c-b9dc-c52489993c33 for instance 5cf22771-4aae-462f-8e75-e1f055cc1551 on n-h2-858383-13 Oct 18 13:32:23.318100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0bdb91cd-a5ca-4918-bb51-026da82f8bdd req-3127cf85-e5e5-4763-b8fb-abd0f830e42d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090984 Oct 18 13:32:23.323526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1137/2289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:23.331692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3314da430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.483243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:23.484184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 4db8e709-27da-4306-b966-e8e068c669fe not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:32:23.484897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.484897 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe HTTP/1.1 Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:23.487195 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.489043 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4db8e709-27da-4306-b966-e8e068c669fe'} Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:23.490185 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:32:23.492160 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.497138 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-08fc0a11-1eb2-41cd-be52-13fd057e85c8'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-800b1430-49fa-400f-ad10-093d38c2223d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe" status: 404 len: 194 microversion: 2.1 time: 0.168160 Oct 18 13:32:23.500055 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1138/2290] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:23.509371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0dc934a0-9d2e-411d-92f5-3368ff5aa1d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb331b80670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.761985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:23.776670 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28b9828c-15ca-47f8-be29-8ad723af5dc0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.517828 Oct 18 13:32:23.778330 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1153/2291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:23.787472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.790296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:23.804429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.806685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.812516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.812516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.812516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.812516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.981957 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0dc934a0-9d2e-411d-92f5-3368ff5aa1d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14" status: 202 len: 0 microversion: 2.1 time: 0.482679 Oct 18 13:32:23.987330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1139/2292] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:23 2022] DELETE /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:23.996832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3313f6ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.046352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:24.046956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:32:24.048219 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.048219 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14 HTTP/1.1 Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:24.050380 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.052185 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '01ecbaf8-acf9-43ee-a1a9-af7435c28c14'} Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.053337 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:32:24.055063 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.057397 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:32:24.061377 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-82cf40d6-9443-4883-88f3-2e97612b88f8'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:24.073540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51d67442-e3ae-42a3-82f6-8fdf1bec9857 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14" status: 404 len: 194 microversion: 2.1 time: 0.076932 Oct 18 13:32:24.073540 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1140/2293] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:24.081133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.090674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fd08f4e-8b34-4b02-9567-6c08aa554e60 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33125f280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.108625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9be4db9a-a3ee-42e7-a635-d26487d20e0b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1273 microversion: 2.1 time: 0.326560 Oct 18 13:32:24.112086 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1154/2294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:24.141408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.142466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:24.151669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.155726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.155726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.155726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.156052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.156770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.721520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fd08f4e-8b34-4b02-9567-6c08aa554e60 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e" status: 202 len: 0 microversion: 2.1 time: 0.644802 Oct 18 13:32:24.722143 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1141/2295] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:24 2022] DELETE /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:24.743007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.750905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: 5cf22771-4aae-462f-8e75-e1f055cc1551] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:24.771463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.772412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.774291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.775404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.777227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.777940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.805919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] HTTP exception thrown: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Request method failure captured: Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 HTTP/1.1 Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqpMzvtbLC86TmZSvKo9uV4Txonn9LtgM60Y2Mtdgq1D6lFViceNusI4mfDHlKXtOPo8FRri0VLvNHV8ZMSkQ28AeQvNK463_VnDu6COfHaylxBwh0xo5nzn7cs_MiBmV9Kq07RbPJQCrLAzx9Gmwyr7_2oUlQbkcwIr466UmQmjPJA Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:24.808409 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d54a9109295b426ba1060c63bfb230ed Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. Oct 18 13:32:24.810452 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5cf22771-4aae-462f-8e75-e1f055cc1551'} Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:24.811421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. Oct 18 13:32:24.812967 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.818536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Returning 404 to user: Instance 5cf22771-4aae-462f-8e75-e1f055cc1551 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:24.819941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d711160e-db18-4443-a69d-0833816d78e0 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551" status: 404 len: 111 microversion: 2.1 time: 0.096642 Oct 18 13:32:24.821157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1142/2296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/servers/5cf22771-4aae-462f-8e75-e1f055cc1551 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:24.833969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33194a160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.899339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.916856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.919418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.921883 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51ac4bd9-fcdd-45fa-9ed1-583f6cb67888 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.785530 Oct 18 13:32:24.924081 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1155/2297] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:24.934667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.937047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:24.974731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:24.976936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 44218f48-c19f-4ee7-86cc-a551b265c28e not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:32:24.978023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.978023 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e HTTP/1.1 Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:24.983328 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.985114 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '44218f48-c19f-4ee7-86cc-a551b265c28e'} Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.986095 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:32:24.987650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.994700 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-74c42939-13e2-4c60-86ab-ac0611887621'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:24.996590 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d34a673-7b12-4bfd-83fb-7f41994b3256 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e" status: 404 len: 194 microversion: 2.1 time: 0.171665 Oct 18 13:32:24.997381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.997381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.997381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.997381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.997715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.997882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.001974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1143/2298] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:25.018770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:25.025226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:25.032358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.033444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.034627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.036293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.036954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.037568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.080790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:25.334839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:25.345471 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e634976-a041-432a-bd28-529fa17c4914 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.419489 Oct 18 13:32:25.346913 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1156/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:25.363031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b183979-7a38-483b-83af-35bda157b4f2 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330bdff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:25.736335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-613b8349-f18b-4ee8-9061-ea9cfafa4936 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 204 len: 0 microversion: 2.1 time: 0.551126 Oct 18 13:32:25.736335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1144/2300] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:25 2022] DELETE /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:25.736335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:25.736335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:25.736335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:25.738909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.738909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.738909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.738909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.740155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.740155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.824944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:25.836987 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5be619eb-c827-489f-b971-e75c90a913f1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.277182 Oct 18 13:32:25.838323 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1145/2301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:25 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:25.843583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:25.844955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:25.853357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.853935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.854701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.855491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:25.855957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:25.856583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.890222 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b183979-7a38-483b-83af-35bda157b4f2 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.540199 Oct 18 13:32:25.890988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1157/2302] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:32:25 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:25.906955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03dbb118-b812-4b08-a010-e404d7dc11b0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb330b6be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237896167", "description": "tempest-description-1972182101"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:26.028387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:26.037973 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40edb59d-5aa2-4668-beda-2aca796cffb6 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1470 microversion: 2.1 time: 0.198586 Oct 18 13:32:26.039136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1146/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:25 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:26.044534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:26.045286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:26.051843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.052586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.053221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.054078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.054701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.055261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.297513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:26.312432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:26.313978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:26.315590 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa42e8b6-55be-4a37-8e01-162ff3f4ca9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.275401 Oct 18 13:32:26.316297 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1147/2304] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:26 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:26.369920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:26.370869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:26.379557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.380359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.381620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.384291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.385322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.385850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.614228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:26.624588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61a8d6ca-f33d-4807-a66c-c0dbd39e6a29 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.259409 Oct 18 13:32:26.625526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1148/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:26 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:26.640076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03dbb118-b812-4b08-a010-e404d7dc11b0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.737110 Oct 18 13:32:26.641598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1158/2306] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:26.658228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3434f7a5-292d-4659-896c-9ee2705c0e5e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb33125fd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-8538092", "description": "tempest-description-114576210"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:26.837542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e1e1b1-5ffd-4136-a75a-89425fb70265", "tag": "892897fe-77bf-4dc7-87b7-ada975961f7c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:26.862907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.864276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.866356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.896492 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] Creating event network-changed:892897fe-77bf-4dc7-87b7-ada975961f7c for instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 on n-h2-858383-13 Oct 18 13:32:26.914112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e292df0f-a8d7-45e0-9fdc-06560655724b req-c5bdd425-a491-430a-926c-19fb221ca5c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080982 Oct 18 13:32:26.919822 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1159/2307] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:26.927239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:26.928045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:26.932030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:26.937333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.937829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.938331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.939249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.939860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.940306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.106562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3434f7a5-292d-4659-896c-9ee2705c0e5e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.452134 Oct 18 13:32:27.108571 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1149/2308] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:26 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:27.134321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:27.135325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:27.142777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.143380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.143929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.144745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.145450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.146157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.154032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:27.286527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:27.302908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=9 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:27.305714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7e2d393-022d-4772-80e1-483f5c757ccd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.384127 Oct 18 13:32:27.306589 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1160/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:26 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:27.352291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:27.362427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-44ba3918-260f-433b-a21e-920c33646f53 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1470 microversion: 2.1 time: 0.232556 Oct 18 13:32:27.363226 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1150/2310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:27 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:27.368816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:27.369633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:27.375426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=20 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:27.377248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.377944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.378770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.379721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.380687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.382332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.575239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Action: 'update', calling method: .version_select at 0x7fb330bdf160>, body: {"quota_set": {"ram": "5120"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:27.608148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:27.619699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:27.621204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:27.622458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9140ee11-5b1e-49ff-bdda-107f200b8169 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.258123 Oct 18 13:32:27.623029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1151/2311] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:27 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:27.628870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1063335131", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9358abc3-51ca-4f7f-8a21-63a190c72b3a"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:27.700387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] validate_networks() for [('9358abc3-51ca-4f7f-8a21-63a190c72b3a', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:27.797484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.798007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.798460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.799206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:27.799673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.800109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:27.992405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-648d7f75-37b9-4c39-a8e8-8cf093c0aeb0 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659" status: 200 len: 148 microversion: 2.57 time: 0.683095 Oct 18 13:32:27.993795 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1161/2312] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Oct 18 13:32:27 2022] PUT /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659 => generated 148 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:28.004941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.005672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:28.013453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.027480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.028073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.029564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.030235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.030697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.168074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:28.168555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:28.168968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:28.169377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:28.169786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:28.180676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.181188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.181638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.182419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.182887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.183323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.211064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Getting quotas for project 4f11662f8c8f4d15bce1b769946dff4e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:28.217427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Getting quotas for user c3bebd1e839f467e981fa5b8d5228ce5 and project 4f11662f8c8f4d15bce1b769946dff4e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:28.232400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:28.234812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:28.290205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.296608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06ad4d30-fd13-4e1a-b0f8-0f60226584ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.295869 Oct 18 13:32:28.297439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1162/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:27 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:28.301998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Calling method '.version_select at 0x7fb330bdf790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.378725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dcfe78ff-b02a-43c9-8ba1-748545741802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754304 Oct 18 13:32:28.384651 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1152/2314] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:28.390094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.393043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:28.406749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.407156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.407585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.408333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.408805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.409238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.564787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.565359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.566325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.567612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.568487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.569285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.594157 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-045dc11c-b8c0-4874-93f1-089d0763b812 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659/detail" status: 200 len: 463 microversion: 2.57 time: 0.295390 Oct 18 13:32:28.597473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.603556 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1163/2315] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 18 13:32:28 2022] GET /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659/detail => generated 463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:28.608887 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bec5d81-7a33-44fb-afd8-46e439b34b73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.222703 Oct 18 13:32:28.609637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1153/2316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:28 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:28.611268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.611903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:28.615953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a60855e-9e03-4c24-93e3-fff0b055ece6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.617877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a60855e-9e03-4c24-93e3-fff0b055ece6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:28.631505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.633395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.633395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.633564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.633970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.634403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.705522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a60855e-9e03-4c24-93e3-fff0b055ece6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.713822 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a60855e-9e03-4c24-93e3-fff0b055ece6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1216 microversion: 2.1 time: 0.103048 Oct 18 13:32:28.714407 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1154/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:28 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:28.725470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.731677 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49237d9b-49d7-48f8-b959-7f310bb4da32 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1428 microversion: 2.1 time: 0.124399 Oct 18 13:32:28.732657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1164/2318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:28 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:28.737447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:28.738404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:28.745485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.746035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.746520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.747217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:28.747678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:28.748114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.786729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-581413641", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:28.847958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:28.958210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.969747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.971590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.973060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1988ba9f-fc60-4f0b-8cca-fed2ce9aa179 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.239442 Oct 18 13:32:28.973697 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1165/2319] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:28 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:28.979153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Action: 'update', calling method: .version_select at 0x7fb330bdfee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:29.068782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.073549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.073549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.073549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.073549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.073884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.082277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:29.082977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:29.083621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:29.084040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:29.084485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:29.095117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.095812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.096720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.097674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.098305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.098885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.109891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.110534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.111104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.112262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.112996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.113603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.125420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Getting quotas for project 748285ba5df14278b813bddf805b0f2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:29.129141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:29.133336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Getting quotas for user 873c602253894da88809e4df2664c688 and project 748285ba5df14278b813bddf805b0f2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:29.149127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:29.151362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:29.343822 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ddd58b31-e267-4671-b5be-0d0b9705b069 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659?user_id=5f7128b87ff04026a88b24c813ac2c74" status: 200 len: 148 microversion: 2.57 time: 0.368831 Oct 18 13:32:29.344754 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1166/2320] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Oct 18 13:32:28 2022] PUT /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659?user_id=5f7128b87ff04026a88b24c813ac2c74 => generated 148 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:29.354617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e744b81e-7a31-425e-b2bc-becb2ab83513", "name": "network-vif-deleted", "tag": "48b0f9df-43f1-494a-9398-8abaf93a4aed"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:29.365351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.365989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.366456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.375978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e225cec8-3cfd-4585-a1e2-569b84b7e666 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660391 Oct 18 13:32:29.379496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] Creating event network-vif-deleted:48b0f9df-43f1-494a-9398-8abaf93a4aed for instance e744b81e-7a31-425e-b2bc-becb2ab83513 on n-h2-858383-13 Oct 18 13:32:29.381475 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1155/2321] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:29.388825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d227d27f-17aa-4e3b-bcef-4d64a2d1cc8a req-cce14e6e-be2e-4941-9171-34f17fb840e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Oct 18 13:32:29.388825 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1167/2322] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:29.392811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9c010cd-8924-42c8-878c-eab5d7870511 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Calling method '.version_select at 0x7fb330bdff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.397523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.398363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.406434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.407004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.407522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.408309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.408992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.409508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.526923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9c010cd-8924-42c8-878c-eab5d7870511 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659?user_id=5f7128b87ff04026a88b24c813ac2c74" status: 200 len: 190 microversion: 2.57 time: 0.139330 Oct 18 13:32:29.528657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1168/2323] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/os-quota-sets/b4958181912a4bffa35b302d42988659?user_id=5f7128b87ff04026a88b24c813ac2c74 => generated 190 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:29.533435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daae21b8-27db-4b2d-bf26-f3b5bb15710d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.539135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-daae21b8-27db-4b2d-bf26-f3b5bb15710d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.608909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:29.620242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ebeb21f-2c93-4bf2-8097-d08de0e24ff0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.237578 Oct 18 13:32:29.621156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1156/2324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:29.635247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.636718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.644796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.645460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.646533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.647341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.648340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.649362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.678329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-daae21b8-27db-4b2d-bf26-f3b5bb15710d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:29.690203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-daae21b8-27db-4b2d-bf26-f3b5bb15710d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1221 microversion: 2.1 time: 0.159593 Oct 18 13:32:29.690203 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1169/2325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:29.737250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.737872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.746031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.747660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.747660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.748500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.749425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.749904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.824416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:29.831971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:29.834420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-278cfc8b-6dca-41b1-b95b-add0a22a5bf4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.205286 Oct 18 13:32:29.840879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcdefa8b-f5f1-4cfe-9b61-cf2163253098 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1220 microversion: 2.1 time: 0.107402 Oct 18 13:32:29.841537 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1157/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:29.841673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1170/2327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:29.847008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.847749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.855305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.855892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.856401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.857165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.857686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.858234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.894721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.894721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.894721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.894721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lazy-loading 'fault' on Instance uuid e744b81e-7a31-425e-b2bc-becb2ab83513 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:29.947427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54a9109295b426ba1060c63bfb230ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:29.965324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fdc46d0-a232-4ed9-b9f7-b3ec33642a63 tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 200 len: 1304 microversion: 2.1 time: 0.122427 Oct 18 13:32:29.975300 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1171/2328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:30.000499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.001150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.007705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.008196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.008649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.009346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.009811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.010319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.215058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.225655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.229116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.230364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5152170-3d32-4af4-b153-461dee1f4bca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.234028 Oct 18 13:32:30.230975 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1158/2329] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:30.646140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.646947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.653986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.654525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.654973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.655681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.656145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.656580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.714618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f32e3df-e711-4f2e-8d00-e1070467be78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.714967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f32e3df-e711-4f2e-8d00-e1070467be78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.782240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4f32e3df-e711-4f2e-8d00-e1070467be78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.791112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f32e3df-e711-4f2e-8d00-e1070467be78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1221 microversion: 2.1 time: 0.083870 Oct 18 13:32:30.791696 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1159/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:30.808460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.818658 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec223571-4292-400f-a3e6-4508bc9dea69 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.176014 Oct 18 13:32:30.818658 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1172/2331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:30.860864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.861661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.869233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.870183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.870296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.870715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.871432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.872154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.872647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.873084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.877378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.877877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.878358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.879066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.879824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.880396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.946693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.957115 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb2b0de8-be32-4bff-b3d4-e4f3eb15013a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1268 microversion: 2.1 time: 0.095688 Oct 18 13:32:30.957797 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1173/2332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:30.992832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.993532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] [instance: e744b81e-7a31-425e-b2bc-becb2ab83513] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:31.000447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.001095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.001614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.002698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.003389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.003924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.018704 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] HTTP exception thrown: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Request method failure captured: Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 HTTP/1.1 Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqpMzvtbLC86TmZSvKo9uV4Txonn9LtgM60Y2Mtdgq1D6lFViceNusI4mfDHlKXtOPo8FRri0VLvNHV8ZMSkQ28AeQvNK463_VnDu6COfHaylxBwh0xo5nzn7cs_MiBmV9Kq07RbPJQCrLAzx9Gmwyr7_2oUlQbkcwIr466UmQmjPJA Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:32:31.020495 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cb1d59a6188a4b2fb67e6eba8f64d79f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: cb1d59a6188a4b2fb67e6eba8f64d79f Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminTestJSON-1349988704 Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d54a9109295b426ba1060c63bfb230ed Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminTestJSON-1349988704-project Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. Oct 18 13:32:31.021576 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e744b81e-7a31-425e-b2bc-becb2ab83513'} Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:31.023592 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. Oct 18 13:32:31.025151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.026242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] Returning 404 to user: Instance e744b81e-7a31-425e-b2bc-becb2ab83513 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:31.026242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32e973aa-6f20-47e0-8844-4b8fbbaa59cf tempest-ServersAdminTestJSON-1349988704 tempest-ServersAdminTestJSON-1349988704-project] 10.222.0.27 "GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513" status: 404 len: 111 microversion: 2.1 time: 0.033347 Oct 18 13:32:31.026242 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1174/2333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/e744b81e-7a31-425e-b2bc-becb2ab83513 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:32:31.034620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:31.044111 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1268e11-f107-449b-ba52-9917db029048 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.187286 Oct 18 13:32:31.054130 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1160/2334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:31.261515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:31.262166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:31.274007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.274549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.275207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.275933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.276405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.276844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.549653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:31.565236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:31.569481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:31.575916 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8d42deb-0667-446a-88a9-1fe24cf4bf5b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.316982 Oct 18 13:32:31.591485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1175/2335] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:31 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:31.816777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:31.818233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:31.827426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.828471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.830769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.843933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.843933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.843933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.844853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:31.846166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:31.855006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.857530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.858273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.859293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.859969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.860765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.057357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.067377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef76f7e2-716d-4447-8e39-17802543aa41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1217 microversion: 2.1 time: 0.256003 Oct 18 13:32:32.073982 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1161/2336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:31 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:32.075132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:32.075751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:32.082405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.083433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.084060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.085498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.086190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.087034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.227633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.237190 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b659435-ffde-43f8-8e0b-ff9c5b501a89 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.397942 Oct 18 13:32:32.237859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1176/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:31 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:32.243729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:32.244435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:32.251116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.251879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.252636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.253571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.254265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.254706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.273107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.285215 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-926915ff-dcd1-4e56-9918-8a09a3e13a3f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1276 microversion: 2.1 time: 0.214094 Oct 18 13:32:32.287111 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1162/2338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:32 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:32.302131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "name": "network-vif-unplugged", "status": "completed", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:32.323052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.325517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.332096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.343059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] Creating event network-vif-unplugged:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h2-858383-13 Oct 18 13:32:32.348634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ab0ff385-8ba2-458b-8da4-7be32c796f0c req-f7c5914d-6f9a-47c2-bd2c-159cf253e25d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060070 Oct 18 13:32:32.349254 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1163/2339] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:32.480155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.491024 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03cfc80c-6271-41fe-a451-d138cf7f7e53 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.251599 Oct 18 13:32:32.492732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1177/2340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:32 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:32.612494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:32.614564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:32.623342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.624098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.625061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.626026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.626704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.627328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.920702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.927224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.928909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.930246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a78141a4-a341-4692-b32b-6d7222f5b7ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.329849 Oct 18 13:32:32.930823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1164/2341] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:32 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:33.095633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.096490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.108013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.108543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.109006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.109747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.110980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.112902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.262101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.262984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.275341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.276955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.277590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.279897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.281083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.283026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.286967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:33.303700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ece02b9-7539-423c-bb06-fe6298b33ce4 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1273 microversion: 2.1 time: 0.212334 Oct 18 13:32:33.319414 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1178/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:33.326722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.327681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.334740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.335573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.341579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.341579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.341579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.341579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.529497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:33.539465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-55b0d831-3241-4320-8f03-9ba7143bbab2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.281965 Oct 18 13:32:33.540195 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1165/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:33.545150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.546037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.553074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.553859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.555068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.555993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.556664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.557307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.730578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:33.744554 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0431c405-116f-47f1-9e2c-11f71e351a77 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.203029 Oct 18 13:32:33.745193 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1166/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:33.751069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e1e1b1-5ffd-4136-a75a-89425fb70265", "name": "network-vif-plugged", "status": "completed", "tag": "892897fe-77bf-4dc7-87b7-ada975961f7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:33.771535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.772450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.773253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.793260 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] Creating event network-vif-plugged:892897fe-77bf-4dc7-87b7-ada975961f7c for instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 on n-h2-858383-13 Oct 18 13:32:33.799158 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2126011d-6b7b-49f4-99d0-dcf60b909d73 req-78386b8a-49d1-47b8-bef3-ff34ad50be76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052554 Oct 18 13:32:33.799945 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1167/2345] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:33.964842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.968714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.977812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.978608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.979238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.980106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.980749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.981187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.192285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:34.201909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc843944-ddfc-4c7d-a5d3-c1ea3d48494f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.880264 Oct 18 13:32:34.211755 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1179/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:34.332084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:34.333532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:34.347354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.349837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.350607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.351593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.353726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.354411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.502964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:34.518340 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2bfac2d-b88c-4e03-9c67-24f2dfa4f0c2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1279 microversion: 2.1 time: 0.190850 Oct 18 13:32:34.519271 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1180/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:34 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:34.546883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:34.565794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.572292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.572292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.594211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] Creating event network-changed:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h2-858383-13 Oct 18 13:32:34.608237 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-caf09a7b-756b-498d-a539-906a429b5e25 req-13711818-9a25-4c98-85af-da9f487e9837 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065256 Oct 18 13:32:34.609252 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1181/2348] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:34.620282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:34.622661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:34.656589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.657093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.657539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.658287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.658746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.659180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.683624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:34.710048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:34.714297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:34.715822 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10c8b2c4-a846-4bf3-b26e-6172cba7f785 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.755896 Oct 18 13:32:34.719457 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1168/2349] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:34.790379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:34.794297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:34.810840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.817432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.820629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.823842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.826648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.828632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.054681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.073565 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a31ae4e4-4cf0-466a-aa4f-dda6434ead1c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1315 microversion: 2.1 time: 0.294949 Oct 18 13:32:35.074897 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1169/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:34 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:35.103145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.115377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-281a0ac7-b24f-46cf-9781-552c7084ea3d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.504909 Oct 18 13:32:35.115978 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1182/2351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:34 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:35.233434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:35.235382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:35.259116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.263383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.266579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.272837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.274033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.279446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.504171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.516783 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8383b0a1-fb4c-4f70-8c54-49cd50454171 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.295485 Oct 18 13:32:35.517803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1170/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:35.546329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:35.547565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:35.554486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.555242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.555760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.556641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.557343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.563576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.663070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.674517 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe5f6df0-aed9-4ba7-b502-686801c06f29 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1279 microversion: 2.1 time: 0.133042 Oct 18 13:32:35.675841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1183/2353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:35.749475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:35.750112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:35.756402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.756944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.757909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.758644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.759103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.759534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.780678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:35.998038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.998411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-314742997", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dda63765-b9a9-4640-8fb5-bbf9b46217dc"}], "security_groups": [{"name": "tempest-securitygroup--1203751749"}], "key_name": "tempest-keypair-109810894", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "342a5de6-e005-4774-9a2b-aead0cca99d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:36.016298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.018387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.020888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57585f11-fd17-4e53-9800-73bb47319275 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.275601 Oct 18 13:32:36.025826 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1171/2354] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:36.058557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a55208d-dd23-4be6-87f5-72be4eaefbc0", "tag": "7f6aab1d-3ff6-4f75-9286-498d12f4168c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:36.075186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.075848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.076564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.100326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] Creating event network-changed:7f6aab1d-3ff6-4f75-9286-498d12f4168c for instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 on n-h2-858383-13 Oct 18 13:32:36.119407 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-51abcbb3-b058-40b2-a764-3e5e8c8728a3 req-a8b0dd44-b32d-4f90-82ca-b5d140dd6feb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065273 Oct 18 13:32:36.120457 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1172/2355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:36.127496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:36.128923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:36.136317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.136900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.137416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.138384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.139159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.139593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.343645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.355034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-579dc311-ed5a-4582-bfcf-21886e171e37 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1502 microversion: 2.1 time: 0.233240 Oct 18 13:32:36.368637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1173/2356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:36 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:36.383589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:36.384406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:36.392203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.392945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.393545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.395002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.395631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.396266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.399698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] validate_networks() for [('dda63765-b9a9-4640-8fb5-bbf9b46217dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:36.601309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.609979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f123b258-0757-474d-88d6-5b32a4bf14d3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.240104 Oct 18 13:32:36.610729 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1174/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:36 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:36.615556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:36.616054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:36.622579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.623565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.623565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.624206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.624666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.625101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.653869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:37.009493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f8ddd7f-0263-48db-8bf0-3b0984005288 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 204 len: 0 microversion: 2.1 time: 0.397476 Oct 18 13:32:37.010243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1175/2358] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:36 2022] DELETE /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:37.015374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.018019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:37.025546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.025879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.026361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.027525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.027525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.027950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.201390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.212662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d07656ae-2dc8-4af9-bb5d-d65349bcf8c1 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.200907 Oct 18 13:32:37.213437 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1176/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:37.219147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.222688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:37.229184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.235250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.235250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.235250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.235250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.235626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.235626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.385849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.406455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3c3cbb7-3243-439c-93d0-9c94310fe2a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.191539 Oct 18 13:32:37.408335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1177/2360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:37.414425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.415430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:37.423415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.424549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.425264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=43 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.426361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.427276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.427746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.428422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.437819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:37.440614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.449855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for user cfb4fc39da53465d9bf6262a60b9c922 and project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:37.475320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:37.476093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:37.476577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:37.476996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:37.477423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:37.486533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.487242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.487690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.488616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.489387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.489832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.509229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:37.514717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Getting quotas for user cfb4fc39da53465d9bf6262a60b9c922 and project 9a43ee032d0f403db4cb4223c63b7f2e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:37.584280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.590859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:37.593520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='342a5de6-e005-4774-9a2b-aead0cca99d2',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:37.593711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d81b2cb4-0a5a-4b4f-a8c9-5fc0edba1cea tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1508 microversion: 2.1 time: 0.183957 Oct 18 13:32:37.594321 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1178/2361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:37.600469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.601401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:37.609151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.609652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.613195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.613195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.613195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.613195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.806470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.815715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.817323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.818556 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bf6e15e9-84c8-4dd5-8e8b-09abccb40d98 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.223281 Oct 18 13:32:37.819126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1179/2362] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:38.013986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.017659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.018199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.021907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.021907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.021907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.021907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.046168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2965f798-6464-4255-aaca-8efa56357b34 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.209152 Oct 18 13:32:38.046168 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1180/2363] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/os-services => generated 949 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:38.049208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.049816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.053711 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8569cdd-02dd-41db-abd9-34994b5a5730 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.060395 Oct 18 13:32:38.055051 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1184/2364] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:32:38.066606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.067115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.067569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.068274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.068740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.069336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.123574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-703216621", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:38.194038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:38.194541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:38.195026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:38.195541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:38.195863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:38.209971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.209971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.209971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.209971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.210558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.210631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.232854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Getting quotas for project d82cf578b2864ab381b613144be6b00b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:38.238117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Getting quotas for user d0e1b26675df4407a678af7ac54892fe and project d82cf578b2864ab381b613144be6b00b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:38.244202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.251865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:38.254035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:38.274968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4230e83-3147-4241-9e6b-6e1e34c55a62 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.229073 Oct 18 13:32:38.275565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1181/2365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.281126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.286027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.286686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.287130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.287890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.289041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.289596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.314797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bcd38bde-401c-4b08-8a24-94bef54922a9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.038048 Oct 18 13:32:38.315341 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1182/2366] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:38.320736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-011a3d60-d2ae-45c5-85bf-4f6cc6d3444f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.321727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-011a3d60-d2ae-45c5-85bf-4f6cc6d3444f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.383115 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-469b320e-7324-4910-9b2f-e70d8a3806ff tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.326957 Oct 18 13:32:38.384111 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1185/2367] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:32:38.388838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49528696-5eee-43d9-8525-9c6e01aad026", "tag": "5c734cf3-a187-46a0-ba56-a9eebb7288f9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:38.400860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.401361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.401807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.405427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-011a3d60-d2ae-45c5-85bf-4f6cc6d3444f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.415397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-011a3d60-d2ae-45c5-85bf-4f6cc6d3444f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1120 microversion: 2.1 time: 0.098971 Oct 18 13:32:38.416213 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1183/2368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1120 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.439265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] Creating event network-changed:5c734cf3-a187-46a0-ba56-a9eebb7288f9 for instance 49528696-5eee-43d9-8525-9c6e01aad026 on n-h2-858383-13 Oct 18 13:32:38.441260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.441893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.446687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c2e69ec2-10e7-4489-aa1d-68e251c6df47 req-8ed7e424-b529-484c-8716-6851bb07f1cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060766 Oct 18 13:32:38.450308 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1186/2369] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:38.456260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.459963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.461232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.461457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.461750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.462790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.462949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.463867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.464371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.464651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.465084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.465418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.466815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.508099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d6cdc95-c74d-47e4-901f-0c8e3ffbb780 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.056308 Oct 18 13:32:38.514243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1187/2370] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:38.521480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.522423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.660026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.668492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4fdcc06-3e8c-435b-87ef-984ebfa550be tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.231817 Oct 18 13:32:38.682897 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1184/2371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.682897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.682897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.682897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.683248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.683248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.683248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.683248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.683489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.746478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.759342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.761893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.774685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-452a9bb9-fd98-48b1-9654-e4bb75fe87b4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1452 microversion: 2.91 time: 0.257972 Oct 18 13:32:38.775643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1188/2372] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:38.780855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.784596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.785140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.785584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.786778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.787251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.787689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.815220 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32475995-4767-41e7-b358-897774a546e9 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037961 Oct 18 13:32:38.816056 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1189/2373] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/os-services?host=n-d-858383-13&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:32:38.824067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.825746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.832237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.833053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.833360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.834248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.834973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.836131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.842513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.850506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-079510e9-848f-44b4-ac49-a271d865ec8b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.180111 Oct 18 13:32:38.851300 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1185/2374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.863453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.868237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.868893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.869644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.870585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.871279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.871719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.900011 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-594e41ba-56cd-47f5-8cca-7b14a3eb45fb tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040539 Oct 18 13:32:38.901190 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1186/2375] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:38.906130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.906752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.913101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.913627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.914103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.914811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.915280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.915711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.124466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.134955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.136529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.137708 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e658e2ea-bae8-4349-b9e9-b7878da0714e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.235252 Oct 18 13:32:39.138299 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1187/2376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:39.142651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.146298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.146787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.147367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.148154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.148615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.149051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.173013 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e65515b-4326-4f82-9567-f3f7d2877115 tempest-ServicesAdminNegativeTestJSON-338416570 tempest-ServicesAdminNegativeTestJSON-338416570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.033593 Oct 18 13:32:39.173627 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1188/2377] 10.222.0.27 () {58 vars in 1198 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:32:39.271883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.281494 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f1234b5-a8ed-4374-830d-6aa8b8ca363a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1508 microversion: 2.1 time: 0.464360 Oct 18 13:32:39.282509 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1190/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:39.287905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daade5c5-fdea-46e9-bf3c-3731dfb18710 tempest-ServicesAdminNegativeTestJSON-158998221 tempest-ServicesAdminNegativeTestJSON-158998221-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.291541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-daade5c5-fdea-46e9-bf3c-3731dfb18710 tempest-ServicesAdminNegativeTestJSON-158998221 tempest-ServicesAdminNegativeTestJSON-158998221-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e95f7902b8fb41c6b04a7e7a07a18130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afca137bbbfd441f9afcc19b5833465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daade5c5-fdea-46e9-bf3c-3731dfb18710 tempest-ServicesAdminNegativeTestJSON-158998221 tempest-ServicesAdminNegativeTestJSON-158998221-project] Request method failure captured: Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqr0fZuCsmBUjHkCnS1SinCUHRoMIaF8EO2pgPx7ikTxb-v3y4_qDVAuSJ9mAJx1_TRfxo_FZoDJ3x1voboM5AwbJSvrOeYmn_1GGVqKg2BgGDVXAP8Mz7vdTEgav9o2mJTg7sKjQsxaNsDbsMy6yBrlotwQQjniDIyDJqjFwKFtRbA Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: afca137bbbfd441f9afcc19b5833465c Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-158998221 Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:39.293277 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afca137bbbfd441f9afcc19b5833465c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/afca137bbbfd441f9afcc19b5833465c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/afca137bbbfd441f9afcc19b5833465c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_afca137bbbfd441f9afcc19b5833465c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-158998221 Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: afca137bbbfd441f9afcc19b5833465c Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-158998221 Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServicesAdminNegativeTestJSON-158998221-project Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e95f7902b8fb41c6b04a7e7a07a18130 Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-158998221-project Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:32:39.301711 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:32:39.302498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:32:39.303729 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:39.305308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daade5c5-fdea-46e9-bf3c-3731dfb18710 tempest-ServicesAdminNegativeTestJSON-158998221 tempest-ServicesAdminNegativeTestJSON-158998221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:39.305308 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-daade5c5-fdea-46e9-bf3c-3731dfb18710 tempest-ServicesAdminNegativeTestJSON-158998221 tempest-ServicesAdminNegativeTestJSON-158998221-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.111615 Oct 18 13:32:39.305308 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1189/2379] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:39.308891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.309653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.318398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.318959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.319459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.321449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.322169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.322795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.332189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.440964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.441588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.457353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.457864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.458350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.459117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.459584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.460033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.537411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.546527 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af6b61dc-c9de-4a0e-957e-0f5a84f05717 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1170 microversion: 2.1 time: 0.110093 Oct 18 13:32:39.547133 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1190/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1170 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:39.694777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.695661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.699383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.704821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.705714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.706461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.707339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.707810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.708389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.710738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5d58793-7505-4888-9f11-00e1753b4f87 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.411301 Oct 18 13:32:39.711577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1191/2381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:39.807833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.808449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.881225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.888868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.891551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3da5b02-dd65-4403-977f-14cf0b4a771e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.199781 Oct 18 13:32:39.892130 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1191/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:39.897041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.898212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.906100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.906650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.907095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.907829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.908290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.908893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.959050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.999180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.002085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.008145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-649ff41a-8f8d-441d-8f8b-cd7f20cd6c28 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1452 microversion: 2.91 time: 0.205009 Oct 18 13:32:40.019651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1192/2383] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:40.080462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.092127 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c631335f-8044-4440-849f-5efccb85cafb tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.198783 Oct 18 13:32:40.098589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1192/2384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:40.166332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.167568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.177716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.178430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.179019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.179845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.180431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.181028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.303858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.304499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.314706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.324446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.324446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.324446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.324446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.324976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.396985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.408985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.410516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.411813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e12bae0d-7a2d-49fe-9ecd-ee18499584c7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.251272 Oct 18 13:32:40.412574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1193/2385] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:40.421499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.439672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-66cec0b4-baf3-41af-880c-9e19d8319120 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1466 microversion: 2.1 time: 0.138967 Oct 18 13:32:40.446492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1193/2386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:40.571774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.572402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.578499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.579001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.579458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.580157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.580627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.581067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.652041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.661196 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-534e9f59-1457-41b9-8633-08fe8bf5043b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1218 microversion: 2.1 time: 0.093921 Oct 18 13:32:40.662396 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1194/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:40.687458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e1e1b1-5ffd-4136-a75a-89425fb70265", "name": "network-vif-deleted", "tag": "892897fe-77bf-4dc7-87b7-ada975961f7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:40.697897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.698412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.698849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.710544 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] Creating event network-vif-deleted:892897fe-77bf-4dc7-87b7-ada975961f7c for instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 on n-h2-858383-13 Oct 18 13:32:40.715693 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-34a55e63-34cb-4e72-abf3-5177a67018dc req-042268f9-76d9-4588-8a17-6760218e7392 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Oct 18 13:32:40.716292 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1194/2388] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:32:40.734682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.735306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.742260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.742848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.743307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.744007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.746174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.746174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.875674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.884779 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c731c239-06fd-4437-8ffd-0eeee6fa10f2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.154002 Oct 18 13:32:40.885267 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1195/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:40.917059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.918264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.924965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.925569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.926015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.926759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.927216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.927648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.038934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.039691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.046200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.046710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.047159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.047878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.048546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.048994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.078631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.089628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64a469d2-69ea-4e36-9903-36f721320554 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.177205 Oct 18 13:32:41.105922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1195/2390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:41.119152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.119952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.126499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.127440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.128144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.129238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.129905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.130901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.135528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.144546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.146022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.157802 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da89ce8f-5916-4eb1-886f-d4cab1632130 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1448 microversion: 2.91 time: 0.117933 Oct 18 13:32:41.157802 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1196/2391] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1448 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:41.301966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.314173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40d686e5-ac50-4613-a4b5-2af1d9d62ea9 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.198031 Oct 18 13:32:41.318162 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1196/2392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:41.439272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.439993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.448446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.448952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.449401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.450228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.450641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.451078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.465499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.466257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.476748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.477046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.480091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.480091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.480091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.480091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.531429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.531934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.532382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.533048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 23e1e1b1-5ffd-4136-a75a-89425fb70265 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:41.618857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.627234 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f949d107-49c4-4918-8bd4-47d7cff34ab2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1305 microversion: 2.1 time: 0.167731 Oct 18 13:32:41.628196 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1197/2393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:41.684944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.685570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.691797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.692299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.692751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.693459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.693937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.694431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.737312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.748057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.749525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.750884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4fcd0ac5-7c6d-4fe7-9e0e-98e9be05c590 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.315961 Oct 18 13:32:41.751337 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1197/2394] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:41.772512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:41.782026 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-231825e3-2093-4240-9785-8557ac0fc111 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1218 microversion: 2.1 time: 0.100801 Oct 18 13:32:41.782868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1198/2395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:41.907666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.908294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.914883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.915383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.915945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.916703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.916983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.917417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.123128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.123128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.126273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.140176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.140684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.141194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.141857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.142334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.151799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.156950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-244260e5-9e76-47ca-a535-fcf135de41a2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.253056 Oct 18 13:32:42.170472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1198/2396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:42.191463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.192129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.216386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.217677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.219560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.221224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.223084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.226289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.392337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.400353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.403456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da4838cb-ea7c-457a-9db4-13132ab57248 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.290083 Oct 18 13:32:42.410354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.422637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1199/2397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:42.422758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.430489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.431124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.438089 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0049a55f-3cf8-4426-87a3-8f938bc126d9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1448 microversion: 2.91 time: 0.255390 Oct 18 13:32:42.440097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1199/2398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1448 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:42.465654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.466201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.469477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.469477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.469477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.469477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.653459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.654271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.675155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.676970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.678820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.682523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.683922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.685981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.825799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.830263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.830956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.831605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 23e1e1b1-5ffd-4136-a75a-89425fb70265 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:42.873232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.881148 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82b3cafb-9373-464c-b5cf-7abab6c5af0d tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.460263 Oct 18 13:32:42.881739 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1200/2399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:42.890909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.894839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.908738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.909179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.910247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.911166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.912019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.912598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.916006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.924342 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae7e7af3-7bc2-4f52-bd56-1288b1334fa1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 200 len: 1305 microversion: 2.1 time: 0.276528 Oct 18 13:32:42.925122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1200/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 1305 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:42.941837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.942506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.951511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.952249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.953665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.955204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:42.955892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:42.956646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.159535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.171462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69d222fb-3f92-420b-b34f-669d3b89f9e6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1236 microversion: 2.1 time: 0.245436 Oct 18 13:32:43.176495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1201/2401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1236 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:43.199494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.203662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.228803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.231191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.234173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.234980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.241040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.246430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.586744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.594049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.605080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.606689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21753528-3f05-47ea-922b-aac6247d0f0a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.719523 Oct 18 13:32:43.622805 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1201/2402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:43.639139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.640430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.670914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.677166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.678032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.679618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.681405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.684811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.686721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f90e9e9-418b-4f16-816b-941c9adc25fa tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.493275 Oct 18 13:32:43.687447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.688184 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1202/2403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:43.692964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.693725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.701477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.701980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.702460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.703172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.703792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.704233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.849857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.874326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.875833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.903392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c794ba3-2046-4406-9ba9-ff2e2b805834 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1512 microversion: 2.91 time: 0.213501 Oct 18 13:32:43.904016 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1203/2404] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:43.919442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.921516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.937568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.947012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.947723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.948516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.949014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.949466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.061245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.073425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-860a965f-3996-49af-91fe-aa5070972212 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.449245 Oct 18 13:32:44.077767 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1202/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:44.089612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:44.091075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:44.107081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.120715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.125566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.126818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.128389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.132795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.172626 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 HTTP/1.1 Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:44.177856 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:32:44.179066 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '23e1e1b1-5ffd-4136-a75a-89425fb70265'} Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:44.179679 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:32:44.180634 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:44.182760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:44.185081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08125356-d37a-43ff-9b9f-36aae858f342 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 404 len: 111 microversion: 2.1 time: 0.105291 Oct 18 13:32:44.186787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1203/2406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:44 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:44.209674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:44.211228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:44.222117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.223834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.225234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.231465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.232230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.232868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.361449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.391754 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ee5f600-836c-487f-b52b-0ed697dee189 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1236 microversion: 2.1 time: 0.184699 Oct 18 13:32:44.392482 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1204/2407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:44 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1236 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:44.400199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.405406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-100535945", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:44.409594 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dba5b4a4-17d4-4208-81ce-8f57acb48383 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.504531 Oct 18 13:32:44.414596 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1204/2408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:44.513969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:44.644630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:44.645901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:44.656252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.662131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.662969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.663939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.664571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.665400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.107620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.123084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.139428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.141386 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76376b7f-5ec3-4602-adec-1db9824d9c0d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.502575 Oct 18 13:32:45.142608 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1205/2409] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:44 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:45.149719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.150915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.158213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.164149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.164149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.164149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.164149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.164441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.255755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:45.256256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:45.256948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:45.257516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:45.258113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:45.273161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.273863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.275726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.276652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.277385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.278022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.300456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:45.308329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:45.326339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:45.328957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:45.520598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c926bf65-7888-473e-b031-a741adbfd778 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124048 Oct 18 13:32:45.529072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1205/2410] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:45.538127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.551908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.561053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.571026 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e602e75a-295d-479d-8366-4a0b8415cb5c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.427124 Oct 18 13:32:45.584776 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1206/2411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:45 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:45.586389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.591665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.592266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.594789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.596802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.602071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.603446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.606007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.617098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.617545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.617998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.630593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.631119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.631577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.831148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.848841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.868195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.883559 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-787d1147-d495-4c56-bae4-f84f68cc7397 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1510 microversion: 2.91 time: 0.358976 Oct 18 13:32:45.894277 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1206/2412] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:45 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:45.902089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.902089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.919145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.919952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.920159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.920848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.921319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.921773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.273036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.290828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6370b8f-ac14-4d55-89fc-0b4872ba8640 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1304 microversion: 2.1 time: 0.398587 Oct 18 13:32:46.291438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1207/2413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:45 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1304 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:46.311800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.312440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.319039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.319916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.320591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.321566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.322283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.323306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.419342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.431682 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e1c16bd-38f5-4218-9bbf-22a053915975 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.858456 Oct 18 13:32:46.451385 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1207/2414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:45 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:46.469829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-837e119f-c459-4da4-bd2a-ca4e8b0cfdd8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.469829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-837e119f-c459-4da4-bd2a-ca4e8b0cfdd8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.481689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:46.595476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-837e119f-c459-4da4-bd2a-ca4e8b0cfdd8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.606217 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-837e119f-c459-4da4-bd2a-ca4e8b0cfdd8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1214 microversion: 2.1 time: 0.153894 Oct 18 13:32:46.606808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1208/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:46.625602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.626264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.642381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.643084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.643669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.644439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.644908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.645342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.676970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:46.868290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.877107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d57ea06-bb7c-4c36-96ea-d59e945db46b tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.573832 Oct 18 13:32:46.878023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1208/2416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:46.883628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.884261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.896530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.897037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.898019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.898765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.899229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.899665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.912386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.928539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.931435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.933150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd49b3b6-23f9-4d30-a43d-dde84ad3b3fa tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.324798 Oct 18 13:32:46.941007 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1209/2417] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:46.948334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.949248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.965871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.967078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.969100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.971317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.972764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.974719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.075580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.089291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.090988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.103473 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94810864-03ce-4fcf-95ac-6a6e1f9f154f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1531 microversion: 2.91 time: 0.160740 Oct 18 13:32:47.112158 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1210/2418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1531 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:47.299992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.316080 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1553cd59-5e7a-48e1-9984-37013ef8be55 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1718 microversion: 2.1 time: 0.434016 Oct 18 13:32:47.318177 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1209/2419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1718 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:47.344431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:47.348476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:47.375457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.378254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.379328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.382822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.389495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.389495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.399831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:47.513878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:47.514547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:47.522007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.523255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.523943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.524771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.525344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.526262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.636606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lazy-loading 'services' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:47.671144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c22e4d92-4fd7-4030-b0ce-6a763348ea7c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1938 microversion: 2.91 time: 0.543055 Oct 18 13:32:47.682107 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1211/2420] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:47 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1938 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:47.682107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:47.682107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:47.697457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.698267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.699143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.700209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.701005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.701684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.832503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.845217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf1ae88b-8fca-4933-befc-6c8a4a5e9a63 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1304 microversion: 2.1 time: 0.525672 Oct 18 13:32:47.846559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1210/2421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:47 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1304 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:47.852550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:47.853331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:47.868534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.871181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.872851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.873708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.874487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.874936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.115158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:48.145748 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd2191f0-c893-4270-8715-2c88b2e61f2e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.471975 Oct 18 13:32:48.151112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1212/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:47 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:48.156644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.157943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.167357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.179282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.180422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.181275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.181829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.182403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.340527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lazy-loading 'services' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:48.422516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d09526c0-f702-460b-8b6a-48a9edd27c76 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1938 microversion: 2.91 time: 0.270073 Oct 18 13:32:48.437675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1213/2423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1938 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:48.445309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a812b4b0-8e2a-4e46-8443-a0e0dc36a742", "tag": "e9e05584-8df4-45a0-8270-f3a4e0084472"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:48.486880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.488385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.489003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.510168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] Creating event network-changed:e9e05584-8df4-45a0-8270-f3a4e0084472 for instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 on n-h1-858383-13 Oct 18 13:32:48.516547 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f0ce2222-1483-48db-af66-8ed1fdb5afa1 req-e9bbeb9e-d698-4071-8576-92cb88d0bd18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076892 Oct 18 13:32:48.517934 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1214/2424] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:48.525132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.526151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.534898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.535751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.536299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.537448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.538695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.539236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.652654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:48.665273 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f3be265-8ce7-43f6-8f80-a6a3ca572457 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1266 microversion: 2.1 time: 0.817019 Oct 18 13:32:48.678799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1211/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:47 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1266 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:48.687089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.693470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.704176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.711964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.711964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.711964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.711964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.712264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.798044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=17 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:48.965621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:48.975106 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a9729f75-6c5c-4b13-bb50-b4bdf29b7c27 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.455528 Oct 18 13:32:48.987302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1215/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:49.011709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:49.013301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:49.022085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.023067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.023723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.024657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.025986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.031202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.435426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.445526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49af4a6d-de7c-41c6-9fb2-48d05786ef47 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1708 microversion: 2.1 time: 0.443348 Oct 18 13:32:49.468342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.486778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1216/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1708 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:49.488583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.490164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.495214 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3548057-6a6a-4dec-bf6b-49782520d430 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.811268 Oct 18 13:32:49.495516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a55208d-dd23-4be6-87f5-72be4eaefbc0", "name": "network-vif-plugged", "status": "completed", "tag": "7f6aab1d-3ff6-4f75-9286-498d12f4168c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:49.495803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1212/2428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:49.506389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:49.519454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.520209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.520843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.523518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.524176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.525779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.549024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.549567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.549943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.572132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:49.584070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] Creating event network-vif-plugged:7f6aab1d-3ff6-4f75-9286-498d12f4168c for instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 on n-h2-858383-13 Oct 18 13:32:49.595352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9bc5046f-d9c6-4d96-ab92-446565b2035c tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.095581 Oct 18 13:32:49.595691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ae2de2d9-fd89-4103-971f-e3580b1cb0fb req-37f0ecb2-f4a8-4188-b622-ac9c6bc1a8bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107563 Oct 18 13:32:49.603788 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1217/2429] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:49.605028 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1213/2430] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Oct 18 13:32:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:49.617207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:49.618029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:49.619645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:49.620422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:49.632627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.633389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.635988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.637034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.638480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.640206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.640716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.641024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.641163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.641883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.642485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.658851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.157203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:50.169254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d9bc5a0-80eb-4ce9-84ff-36a8bbaff378 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.559103 Oct 18 13:32:50.177313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:50.187138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1214/2431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:49 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:50.187564 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0649a68-55eb-4e48-beeb-3127f6e4d02a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1304 microversion: 2.1 time: 0.589756 Oct 18 13:32:50.188164 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1218/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:49 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1304 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:50.192171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa9dcba6-38ba-4a29-83ab-d25345017ffd tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '.version_select at 0x7fb330cf8160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.197059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa9dcba6-38ba-4a29-83ab-d25345017ffd tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.197710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa9dcba6-38ba-4a29-83ab-d25345017ffd tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.198327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa9dcba6-38ba-4a29-83ab-d25345017ffd tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.206255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:50.206824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.208235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa9dcba6-38ba-4a29-83ab-d25345017ffd tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1179 microversion: 2.1 time: 0.019817 Oct 18 13:32:50.219557 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1215/2433] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/os-migrations => generated 1179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:50.224522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.225038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.225555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.225752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.226313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.226703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.226812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.227211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.234041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.234963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.235564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.236507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.237311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.237896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.283660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lazy-loading 'flavor' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:50.334087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:50.347068 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-33de5214-00f4-4f9c-b881-55bd9ba55e70 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1272 microversion: 2.1 time: 0.126109 Oct 18 13:32:50.347873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1216/2434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:50.355636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.356715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.363695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.364453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.365629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.367471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.368174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.369691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.871428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:50.888495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-813000b9-e5ad-4fa8-bd08-834f11b5e47e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.539185 Oct 18 13:32:50.892697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1217/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:50.901746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.902680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.941782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e273749b-be46-4ed1-a547-d993ff960e91 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action" status: 202 len: 0 microversion: 2.91 time: 0.752311 Oct 18 13:32:50.943210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1219/2436] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:32:50 2022] POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:50.948127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.954637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.956389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.957584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.961706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.962511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.965214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.970424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.994763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.995475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.995927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.996654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.997108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.997548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.309397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48ef176d-7ba5-4971-8ca8-2d5c05f40952 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1861 microversion: 2.1 time: 0.415238 Oct 18 13:32:51.311040 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1218/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1861 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:51.339878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:51.340938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:51.349895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.350844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.351531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.352318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.352786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.353222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.447798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.499707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.506935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.529246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-859188a5-890d-4197-b1f5-6b20666bf9e7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.194851 Oct 18 13:32:51.544711 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1219/2438] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:51 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:51.572708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:51.573640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:51.581845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.583246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.584013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.585962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.586738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.587397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.749791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.761167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.773296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.774713 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1aac0853-b556-49cd-80ac-7852ca59bd7e tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.828595 Oct 18 13:32:51.775352 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1220/2439] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:51.782769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.788762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:51.791098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:51.799427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8cfb8db8-f066-481f-ac47-8a0a4242fcf8 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1316 microversion: 2.1 time: 0.240395 Oct 18 13:32:51.800024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1220/2440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:51 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:51.804758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:51.805376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:51.811356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.811862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.812379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.813091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.813752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.814857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.825133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.825653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.826126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.827374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.827990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.830705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.009123 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-703dcf09-1614-4e3d-9546-afd0fa4a4afa tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1861 microversion: 2.1 time: 0.207944 Oct 18 13:32:52.009981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1221/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:51 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1861 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.014922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.015803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.022045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.022852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.023369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.024186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.024703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.025487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.273526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.291373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c86c96f-ef3c-458e-bcde-c1b8a85de044 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.279866 Oct 18 13:32:52.291889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1222/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.296658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "4fe9140b-8dcf-48c2-a74d-9e2d29acff9f"}, {"server_uuid": "49528696-5eee-43d9-8525-9c6e01aad026", "name": "network-vif-plugged", "status": "completed", "tag": "5c734cf3-a187-46a0-ba56-a9eebb7288f9"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "da60ea4f-7615-4adc-8662-808ebb5bb0e0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:52.317906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.318592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.318859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.349373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Creating event network-vif-plugged:4fe9140b-8dcf-48c2-a74d-9e2d29acff9f for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:52.350110 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Creating event network-vif-plugged:5c734cf3-a187-46a0-ba56-a9eebb7288f9 for instance 49528696-5eee-43d9-8525-9c6e01aad026 on n-h2-858383-13 Oct 18 13:32:52.351605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] Creating event network-vif-plugged:da60ea4f-7615-4adc-8662-808ebb5bb0e0 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:52.352086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.360290 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3e6b640-b6b2-4efe-accd-16447c47a693 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1304 microversion: 2.1 time: 0.583466 Oct 18 13:32:52.360883 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1221/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:51 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1304 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.367524 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-453d6929-a43a-4f0e-8088-e25b1442e1a7 req-3e0a8c44-23af-4e25-9c9b-79829c60b732 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.071815 Oct 18 13:32:52.367524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1223/2444] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:52.374010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.374758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.382100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.382938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.383557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.384291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.384761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.385208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.385570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.386252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.396347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.398149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.398356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.399312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.399961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.400581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.587691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lazy-loading 'services' on Instance uuid 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:52.887838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f38433a1-6a3c-4811-8cf3-a7e77702e7a4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments/da1b5985-6817-4429-b355-29ab2be91dd8" status: 202 len: 0 microversion: 2.1 time: 0.518509 Oct 18 13:32:52.888976 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1224/2445] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:32:52 2022] DELETE /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments/da1b5985-6817-4429-b355-29ab2be91dd8 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:52.896525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.898117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.901484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.907590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.908392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.909107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.910290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.911048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.911746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.914470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f08271b-337a-4bb5-b06b-663e45385a78 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.552486 Oct 18 13:32:52.916628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1222/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.923768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.925143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.933852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.936132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.937059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.938325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.938941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.939520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.986242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.995542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.997235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.003073 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-503ef113-bd59-43b2-b508-96dbab3a3ae8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.112648 Oct 18 13:32:53.014236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1225/2447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:53.019767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.020445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.032279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.032797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.034163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.034163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.034573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.035018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.186846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.198567 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ec2fc76-a69d-4800-9227-68ffb87dfc84 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1504 microversion: 2.1 time: 0.183101 Oct 18 13:32:53.199376 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1226/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:53.222781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.225186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.236439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.236933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.237535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.238291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.238763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.239200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.274177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c0a7d4c-f815-46e1-902f-a3f62988a52e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055835 Oct 18 13:32:53.279406 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1227/2449] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:53.279406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237896167"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:53.280178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.285974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.286449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.286899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.287618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.288105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.288534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.292542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:53.319619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.337829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.340649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.342026 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e62a9df-c669-4ebe-a39c-dc31059a6cf8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.423579 Oct 18 13:32:53.342862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1223/2450] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:53.364321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.367377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.374458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.375181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.375779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.376649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.377777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.378430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.483916 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.network.security_group_api [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Adding security group 3e463703-e852-4fd3-8b1f-a7017e272201 to port 7f6aab1d-3ff6-4f75-9286-498d12f4168c Oct 18 13:32:53.613498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.621395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:53.623712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bfdb8d79-143f-46f5-9fe6-d29d596a92ba tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.279186 Oct 18 13:32:53.624672 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1224/2451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:53.640354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.640988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.652843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.657796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.657796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.657796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.657796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.658124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.874296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:53.883657 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31f9eae4-2f04-492b-a5e3-e431cac53e1a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.258323 Oct 18 13:32:53.890698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1225/2452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:53.940971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.941835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.955162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.961001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.961748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.962698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.963351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.963946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.214555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.222763 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8bcfbe5-fe7c-47dc-af94-702ccee73dad tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1321 microversion: 2.1 time: 0.285820 Oct 18 13:32:54.239703 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1226/2453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:54.256325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:54.265453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:54.290935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.291486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.292452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.293219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.293691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.294698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.441222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f74271d-f9d4-41c7-a91f-9ce9f3f17872 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action" status: 202 len: 0 microversion: 2.1 time: 1.165320 Oct 18 13:32:54.442126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1228/2454] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:53 2022] POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:54.448797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d833f2c-718a-469c-ad77-88641f826647", "tag": "d6e40e43-a741-422e-aabd-238235873c51"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:54.477129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.479082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.480757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.514599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] Creating event network-changed:d6e40e43-a741-422e-aabd-238235873c51 for instance 7d833f2c-718a-469c-ad77-88641f826647 on n-h2-858383-13 Oct 18 13:32:54.522901 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-feeb47fe-be11-47ed-8614-79102832ebc1 req-be3d5eac-929f-49c6-b908-856f7f1149b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079190 Oct 18 13:32:54.526667 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1229/2455] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:54.539789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:54.542153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:54.558802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.559317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.559771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.560490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.560957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.561397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.576295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.591035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.593013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.605567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59c9b264-a94b-4af6-8a82-57e683aa59fb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.364424 Oct 18 13:32:54.607720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1227/2456] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:54 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:54.612388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:54.613294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:54.623580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.624440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.625470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.626435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.627092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.627916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.640839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f759e7d2-47dc-4a51-aba8-350a67ede370 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113033 Oct 18 13:32:54.652411 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1230/2457] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:32:54 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:54.657367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "90cc59d7-23c7-4f5c-9230-0ddc8edac2a5"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "be74ac22-ab15-4d00-9974-0c19505e3929"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "b6196777-36fd-4ea6-9393-e0693c5210e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:54.683806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.684291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.684749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.726388 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Creating event network-vif-plugged:90cc59d7-23c7-4f5c-9230-0ddc8edac2a5 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:54.728267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Creating event network-vif-plugged:be74ac22-ab15-4d00-9974-0c19505e3929 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:54.728267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] Creating event network-vif-plugged:b6196777-36fd-4ea6-9393-e0693c5210e1 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:54.742035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-20d22b06-0d79-4237-955f-224a0d7762a5 req-e817e983-230b-4840-aec8-39f5e5b24f07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087343 Oct 18 13:32:54.747387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1231/2458] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:54.757687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33521f670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:54.967071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use.", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:54.967782 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.967782 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201 HTTP/1.1 Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:32:54.969802 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: exception: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.970963 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3e463703-e852-4fd3-8b1f-a7017e272201'} Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:54.971724 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.972779 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:54.974970 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 400 to user: Security Group 3e463703-e852-4fd3-8b1f-a7017e272201 in use. Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-116dbece-f207-4378-9cb0-d8ebe7efa01e'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7327d389-3587-4472-bb7c-bb41a605ee03 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201" status: 400 len: 185 microversion: 2.1 time: 0.222648 Oct 18 13:32:54.978149 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1232/2459] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:54 2022] DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201 => generated 185 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:32:54.988500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a55208d-dd23-4be6-87f5-72be4eaefbc0", "tag": "7f6aab1d-3ff6-4f75-9286-498d12f4168c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:54.998164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.014601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.018568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.022882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a60ac761-cf26-4c2e-b720-de0da47f6177 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.412303 Oct 18 13:32:55.022882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1228/2460] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:54 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:55.032295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.032943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.047178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.048605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.049061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.059375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.059903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.060546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] Creating event network-changed:7f6aab1d-3ff6-4f75-9286-498d12f4168c for instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 on n-h2-858383-13 Oct 18 13:32:55.061609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.062402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.062887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.063337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.066361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-46cf6ef4-e251-4c88-aade-8df87544b760 req-688793c9-3cdc-4214-b411-290ebe5eaa6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093325 Oct 18 13:32:55.067416 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1233/2461] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:55.073141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.074233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.081855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.082556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.083153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.084022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.085363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.086046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.320266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=24 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:55.342235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.351785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d20b82a-d20e-4c87-b251-b32c12d9da71 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.282915 Oct 18 13:32:55.354788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1234/2462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:55.359551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.366390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:55.369699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.370555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d06b9e9-133f-4e06-881b-133bb45d65a6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.348658 Oct 18 13:32:55.371139 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1229/2463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:55.378867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.379874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.380481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.381378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.382603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.383258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.394732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.399712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.437615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.438178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.442332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.443832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.445403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.447533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.651443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.669392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02650e44-211f-4888-9d1c-cd1012e6c887 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1471 microversion: 2.1 time: 0.285987 Oct 18 13:32:55.672068 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1230/2464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:55.677162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.677782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.693448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.698837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.699563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.700512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.701137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.701737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.781733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb8f0aca-b3bf-4b9d-a2a6-336c74490df7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action" status: 202 len: 0 microversion: 2.1 time: 0.425307 Oct 18 13:32:55.783619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1235/2465] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:55 2022] POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:55.797859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.805790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.810473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.825697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.827233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.827700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.828941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.830425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.838264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.838576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa35edd5-6381-44ec-936b-44665f6441e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.162708 Oct 18 13:32:55.839362 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1231/2466] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:55.840351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.841437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.909431 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9557f011-ca04-4e23-84e0-bd40415edc9e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121490 Oct 18 13:32:55.909988 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1236/2467] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:55.917325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.917882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.929400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.930152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.930604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.931323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.931784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.932448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.983681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:55.984611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] [instance: 1f9cce47-9a9d-4ab5-8355-d8109f30968f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.992532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] HTTP exception thrown: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Request method failure captured: Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/1f9cce47-9a9d-4ab5-8355-d8109f30968f/action HTTP/1.1 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrsO_ioXSooE_7MMJPydmsbHvxjAMkXHLltsGLzERWcTVsQux0x70NSwmzmp0vxwI6Qo4kmr8O0pq3X9ZMBgR0KKkCbxlwfIeW6KTUZ7YmOhNzJ51FRrUehAb1ARp5HWY8HB2lba7wINE2_wkWCWInnkkv2sfbx0R0N3-m0zRPjscM Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:32:55.994578 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3c382d351ca340848b459676a41d0596 Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: {"migrate": {}} Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:32:55.995710 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '1f9cce47-9a9d-4ab5-8355-d8109f30968f', 'body': {'migrate': {}}} Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:55.996376 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. Oct 18 13:32:55.997352 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.002963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Returning 404 to user: Instance 1f9cce47-9a9d-4ab5-8355-d8109f30968f could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:56.016071 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6470113e-68f5-4f6b-a754-06ff77a24e3a tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1f9cce47-9a9d-4ab5-8355-d8109f30968f/action" status: 404 len: 111 microversion: 2.1 time: 0.163610 Oct 18 13:32:56.016071 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1232/2468] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:55 2022] POST /compute/v2.1/servers/1f9cce47-9a9d-4ab5-8355-d8109f30968f/action => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:56.051470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:56.052154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:56.075830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.076537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.077076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.077904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.078482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.079004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.188568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.203606 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ed2d947f-b82d-4d84-ae96-c9a62a92037f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1574 microversion: 2.1 time: 0.292402 Oct 18 13:32:56.205220 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1237/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1574 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:56.367639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.380400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:56.381117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:56.399930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.399930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.400138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.400232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.400319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.401277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.402019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.402727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.402934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2025c569-48da-4730-8d27-abf198b881b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.357807 Oct 18 13:32:56.403972 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1233/2470] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:56 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:56.408906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1057243965", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:56.520995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:56.599500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=21 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:57.147681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:57.148278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:57.148702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:57.149200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:57.149726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:57.167066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.167942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.168466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.169294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.169841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.170396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.203166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Getting quotas for project 748285ba5df14278b813bddf805b0f2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:57.211256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Getting quotas for user 873c602253894da88809e4df2664c688 and project 748285ba5df14278b813bddf805b0f2b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:57.234734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:57.237533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:57.386753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4fbf4e5-bc45-4709-a1c5-3ebfd9f56b0a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980264 Oct 18 13:32:57.387508 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1234/2471] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:57.406247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:57.407276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:57.408971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:57.417285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb3c6877-1cd5-40f4-9a9a-34df5de8ea18 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 1.040090 Oct 18 13:32:57.418227 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1238/2472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:56 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:57.431666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:57.438548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:57.442431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.443438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.444624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.445684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.446466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.447117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.462627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.463282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.463853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.464656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.465190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.467134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.646606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:57.656489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:57.663796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:57.685294 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-535a8500-5dcf-4c0e-af0c-38e486f580b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.263007 Oct 18 13:32:57.698840 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1239/2473] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:57 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:57.716983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "a8cd0da4-8c52-4382-853b-1e381dc48b82"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-plugged", "status": "completed", "tag": "0a2abc3c-716f-417d-8562-5e0b82309599"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:57.742452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.743131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.743758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.780808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Creating event network-vif-plugged:a8cd0da4-8c52-4382-853b-1e381dc48b82 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:57.792145 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] Creating event network-vif-plugged:0a2abc3c-716f-417d-8562-5e0b82309599 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:32:57.800847 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-127213f1-c0ac-47de-8dcf-ed1499f97829 req-8f97cc8f-0bf9-48d8-ba3e-8408bbd585e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100579 Oct 18 13:32:57.805842 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1240/2474] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:57.815360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:57.824153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:57.841841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.843277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.845020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.846085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.847626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.852527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.927855 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dbd98bd4-9fcc-47c5-b503-a4b5a5930a9d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119671 Oct 18 13:32:57.929483 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1241/2475] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:32:57 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:57.967623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:57.970722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:57.981849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.983568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.985073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.987099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.989132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.989793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.032952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.042831 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09c14ccf-42ba-4c58-9003-097be10179d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.645633 Oct 18 13:32:58.043419 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1235/2476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:57 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:58.062445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9038819e-0a10-4e49-ae31-75818d3934f5 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:58.075946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9038819e-0a10-4e49-ae31-75818d3934f5 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:58.193401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.206801 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-286593cf-835b-4e01-9b95-29b8018b1f38 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1574 microversion: 2.1 time: 0.273552 Oct 18 13:32:58.207769 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1242/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:57 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1574 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:58.215403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:58.216405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:58.224245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.224894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.226255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.227207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.227895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.228525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.560447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.573752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.575168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.576401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa3cf9d8-2091-42d5-861b-9e78f194a647 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.367311 Oct 18 13:32:58.580886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1243/2478] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:58 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:58.693933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-885084597", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:58.778672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] validate_networks() for [('d750ef80-4f0b-4d54-9c5b-98c20b1a10bd', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:58.843730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9038819e-0a10-4e49-ae31-75818d3934f5 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.851531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9038819e-0a10-4e49-ae31-75818d3934f5 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1222 microversion: 2.1 time: 0.792782 Oct 18 13:32:58.866709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1236/2479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:58 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1222 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:58.877291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:58.886524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:58.895048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.900712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.901744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.902781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.903474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.904002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.145616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.170804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d6b7c15-18c2-4b11-a7d2-73be211cf621 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.302522 Oct 18 13:32:59.172278 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1237/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:58 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:59.183719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.184346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.198132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.200994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.200994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.200994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.206871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.207597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.266718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:59.267458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:59.268636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:59.269218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:59.269847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:59.281639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.282630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.283378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.284386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.285213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.285889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.302042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=17 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:59.315960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Getting quotas for project 963d4b082d364d08a0d20f49f2085f1b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:59.323320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Getting quotas for user 04584b0879e6499285f815007b4e8e1b and project 963d4b082d364d08a0d20f49f2085f1b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:59.352718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.353429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:59.356181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:59.362448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.363907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.390655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b5da4c9-8896-4d7f-a8a0-8fcefbb1a537 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.208945 Oct 18 13:32:59.391815 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1238/2481] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:59.397997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.401797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.419874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.420571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.426432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.429363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.430483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.431572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.483069 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca8b19c1-be1d-4434-8ee5-6a8d931d570e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089955 Oct 18 13:32:59.484620 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1239/2482] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:59.489928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.492456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.500049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.500730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.501339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.502758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.503475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.504446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.603372 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-249b0dd9-e9aa-47d1-8ce7-4e3f2dc17db0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020889 Oct 18 13:32:59.611465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1244/2483] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:59.619103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.626259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.627456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.627964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.628416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.629136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.629598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.630035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.980120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.013009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2656e0ea-74d0-4a56-85bf-d6ab0ade696a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1574 microversion: 2.1 time: 0.400180 Oct 18 13:33:00.017200 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1245/2484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1574 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.030450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.031291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.038698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.039439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.040133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.041052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.041708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.042402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.081685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.097072 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2bd05eb-a47b-4de6-a68c-69ec9cc1d927 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.604328 Oct 18 13:33:00.097806 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1240/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.115318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7b641cf-9b74-479e-8431-6c50951b4ffc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.117318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7b641cf-9b74-479e-8431-6c50951b4ffc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.251472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7b641cf-9b74-479e-8431-6c50951b4ffc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.261684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7b641cf-9b74-479e-8431-6c50951b4ffc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1223 microversion: 2.1 time: 0.150267 Oct 18 13:33:00.262354 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1241/2486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.286015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.286919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.294813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:00.299227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.300454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.301124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.302040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.302715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.303917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.441443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.451917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6764839e-d8c4-4bce-9e16-1320fa5e26d8 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1274 microversion: 2.1 time: 0.171256 Oct 18 13:33:00.452849 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1242/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.458227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d833f2c-718a-469c-ad77-88641f826647", "name": "network-vif-plugged", "status": "completed", "tag": "d6e40e43-a741-422e-aabd-238235873c51"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:00.490515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.494916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.495378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.495777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.507164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.514578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.521788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75425f76-cb99-47e5-80d5-fef8ce242591 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1868 microversion: 2.32 time: 0.505119 Oct 18 13:33:00.523037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1246/2488] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1868 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:00.523588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] Creating event network-vif-plugged:d6e40e43-a741-422e-aabd-238235873c51 for instance 7d833f2c-718a-469c-ad77-88641f826647 on n-h2-858383-13 Oct 18 13:33:00.535400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.548398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4dfe286f-862f-430a-9029-28622f6168a3 req-1920b3e6-5ec9-4b01-95c1-84dbb2990b7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092681 Oct 18 13:33:00.549036 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1243/2489] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:00.554739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.564228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.565226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.565909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.566946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.568040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.568678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.577524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.578424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.587699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.588239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.589431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.590795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.591449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.592012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.802165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.811592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1af004b1-66ab-421c-94d0-9b976a220357 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.286602 Oct 18 13:33:00.812239 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1247/2490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.831257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.838197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.840445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.840607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.841944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.847112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.847658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.848106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.848378 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53b9d84c-d9f3-4e1c-a3d9-4a54a4454886 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.296595 Oct 18 13:33:00.849481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1244/2491] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:00.851720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.852237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.852683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.894260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:00.909062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b40bf3be-ad47-4d04-8452-be13eb682d81 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084844 Oct 18 13:33:00.910355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1248/2492] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:01.045070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.047161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.055684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.057349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.058883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.062670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.063352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.064399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.124650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.125689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.151490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.152279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.153013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.164950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.168520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.170244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.276312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.284321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:01.288819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d18bef6d-39d4-4c6e-96cb-74aaed0d4b87 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1579 microversion: 2.1 time: 0.251381 Oct 18 13:33:01.289979 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1245/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.295438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.296436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.304739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.305469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.306132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.307036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.307659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.308603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.418811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.429612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.442689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae1032b5-2f8e-4f97-a2a5-c0ea4d57b08a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1227 microversion: 2.1 time: 0.151247 Oct 18 13:33:01.443572 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1246/2494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1227 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.457381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4b3cb4e6-026d-4254-b370-897b91b815bd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1314 microversion: 2.1 time: 0.326923 Oct 18 13:33:01.461204 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1249/2495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.480016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.481088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.491584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.496051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.499066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.500189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.500900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.502717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.556008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.558510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.571623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.571623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.571623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.571623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.571956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.571956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.624777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.633969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3598f4b3-91c2-4712-ae89-2c56d156545f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1292 microversion: 2.1 time: 0.158696 Oct 18 13:33:01.643495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1247/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1292 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.777888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.791061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.793336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.794117 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f58dede-8131-48c0-8e9f-24c9cd3424e4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2819 microversion: 2.32 time: 0.243444 Oct 18 13:33:01.795017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1250/2497] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2819 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:01.822503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.822956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.829684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.836398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.836398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.836398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.836398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.836841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.843153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.843786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.852192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.852686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.853144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.854268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.854750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.855620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.010600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.018449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0069325-04f4-4c98-b1ab-da61b74e359a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.180596 Oct 18 13:33:02.019031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1251/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:02.028481 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-704dff74-0e09-447b-ab02-eea34b4f0d37 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.209850 Oct 18 13:33:02.029021 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1248/2499] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524/os-interface => generated 1830 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:02.034459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.036873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.043470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.043988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.044444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.047480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.047480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.047480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.057229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.057867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.074554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.075109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.075657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.076392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.076867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.077313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.114883 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00e2f20f-c87b-44c6-8317-9f923d69020e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079761 Oct 18 13:33:02.118389 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1249/2500] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:33:02.251524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.251524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.251911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.261951 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d1d6df9-9222-47b8-aa38-5cdfb05cf7f6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.234897 Oct 18 13:33:02.262584 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1252/2501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:02.319413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.320870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.333187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.333719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.334185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.335481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.335949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.352359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.470766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.471697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.479690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.482610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.489433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.489433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.489433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.489433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.645176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.657290 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be1e0ed5-fc7f-47cd-94e3-de06298eff0d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1275 microversion: 2.1 time: 0.189506 Oct 18 13:33:02.672501 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1253/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:02.684542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.687273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.690272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:02.707374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.707894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.708345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.711275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.711962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.712413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.726456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.737936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2b38ce9-86ec-4519-b6ea-8ec34f3f93f7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1572 microversion: 2.1 time: 0.420346 Oct 18 13:33:02.740226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1250/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1572 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:02.749517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.750172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.775168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.776489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.778494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.781387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.782500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.784670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.155030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.163332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba46dca8-a2be-45ca-8724-d050e1487abe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.420722 Oct 18 13:33:03.174447 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1251/2504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:03.174736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.184852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-8538092"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:03.185818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:03.191085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5435890-7060-4e03-bb38-18abfea1be67 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1500 microversion: 2.1 time: 0.514967 Oct 18 13:33:03.191699 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1254/2505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1500 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:03.192876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.193589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.194392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.195341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.196032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.196670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.204430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:03.205400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:03.215397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.215963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.216679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.217674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.218169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.223303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.441229 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Adding security group 6729f002-049c-4e41-908d-eaed5364fed3 to port 7f6aab1d-3ff6-4f75-9286-498d12f4168c Oct 18 13:33:03.682169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.698334 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d7a9d8d-dfae-4f94-b509-9c00d8531856 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.502966 Oct 18 13:33:03.700753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1255/2506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:03 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:03.714711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:03.715340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:03.727125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.727680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.728120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.732754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.733440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.734091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.921395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.932760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.934283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:04.016461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f697b44f-89a2-4b77-aa98-a184af97d30e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.315385 Oct 18 13:33:04.031471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1256/2507] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:03 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:04.047912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:04.048435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:04.066607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.067416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.068124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.068923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.069400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.069836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.308082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:04.317281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ade73bb-f588-47b8-9ca6-11ae1b034ff3 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1293 microversion: 2.1 time: 0.284149 Oct 18 13:33:04.322203 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1257/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:04 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1293 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:04.333027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a812b4b0-8e2a-4e46-8443-a0e0dc36a742", "name": "network-vif-plugged", "status": "completed", "tag": "e9e05584-8df4-45a0-8270-f3a4e0084472"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:04.349349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.350377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.351324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.365862 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] Creating event network-vif-plugged:e9e05584-8df4-45a0-8270-f3a4e0084472 for instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 on n-h1-858383-13 Oct 18 13:33:04.373043 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-aa1d4ef4-a473-4ede-be7c-1847a0df3275 req-1ff6279f-da8f-49d5-9bd5-3522a61ba7fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048757 Oct 18 13:33:04.375992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1258/2509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:04.390683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:04.391833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:04.409688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.410240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.413150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.414112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.414761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.421755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.749500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63b1ede0-c47f-4262-a13f-ef050f350802 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action" status: 202 len: 0 microversion: 2.1 time: 1.573140 Oct 18 13:33:04.750472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1252/2510] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:03 2022] POST /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0/action => generated 0 bytes in 1575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:33:04.761254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "tag": "4fe9140b-8dcf-48c2-a74d-9e2d29acff9f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:04.785497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:04.791368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.792614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.793498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.801095 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d58bf8b3-cb03-41a4-bc1e-02424d9d15e2 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.417080 Oct 18 13:33:04.801591 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1259/2511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:04 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:04.808689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:04.811634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:04.824711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.825215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.825664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.826433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.826893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.827324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.828671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] Creating event network-changed:4fe9140b-8dcf-48c2-a74d-9e2d29acff9f for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:33:04.845551 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-41c0eaac-1b4d-4909-9605-f412dd8997bd req-233ea45b-6125-404d-bf22-ce72d076263a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085808 Oct 18 13:33:04.847116 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1253/2512] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:04.860999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330bdf700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.064882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:05.076754 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b67e063-dbe2-4597-b1a8-f0067903a9b3 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.273832 Oct 18 13:33:05.091219 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1260/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:04 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:05.102146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a55208d-dd23-4be6-87f5-72be4eaefbc0", "tag": "7f6aab1d-3ff6-4f75-9286-498d12f4168c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:05.120179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.120899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.121621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.134984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] Creating event network-changed:7f6aab1d-3ff6-4f75-9286-498d12f4168c for instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 on n-h2-858383-13 Oct 18 13:33:05.140840 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f3242481-c680-471f-a95a-448ed329bc86 req-54b41bb2-3b5e-4a11-ad51-c2e6d2fbc6b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048125 Oct 18 13:33:05.142223 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1261/2514] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:05.150252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.153834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.163589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.164385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.165079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.166099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.166768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.167426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.305267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:05.314508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:05.316972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:05.323641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25333b77-c57b-4551-a8dc-2402fa40b52f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.179848 Oct 18 13:33:05.352774 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1262/2515] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:05 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:05.355807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.357066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.365544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.367292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.367967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.368913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.369789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.370689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.466645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:05.483495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be05ca97-9f94-4afc-aafb-6c24fe4688e6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1281 microversion: 2.1 time: 0.135661 Oct 18 13:33:05.501003 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1263/2516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:05 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:05.637668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use.", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:05.644437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.644437 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3 HTTP/1.1 Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:05.655012 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: exception: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.656210 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '6729f002-049c-4e41-908d-eaed5364fed3'} Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:05.656881 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.657819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:05.658824 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 400 to user: Security Group 6729f002-049c-4e41-908d-eaed5364fed3 in use. Oct 18 13:33:05.659885 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-38b2db6d-b019-43c7-8c7a-9e23330fab0a'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:05.672245 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c8f796e-bd81-4255-983c-4857e823f78d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3" status: 400 len: 185 microversion: 2.1 time: 0.818708 Oct 18 13:33:05.680329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1254/2517] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:04 2022] DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3 => generated 185 bytes in 831 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:05.683958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.685903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.701613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.704491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.710543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.722506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.722506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.722506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.794633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:05.832266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.840259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.855067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.856439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.858576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.861094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.861827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.862543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.943195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:06.170359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-726be1da-ff08-43e0-981f-2275b2ff24ce tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 204 len: 0 microversion: 2.1 time: 0.490728 Oct 18 13:33:06.171351 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1264/2518] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:05 2022] DELETE /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:06.179093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.179872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.199922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.200142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.200835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.201960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.207523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.207523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.445910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.484360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7c3ee24-3819-441b-9140-1cb9ceab7b06 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.662586 Oct 18 13:33:06.486448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1255/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:05 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:06.495408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.496045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.508391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.515807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.515807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.515807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.515807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.516173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.555618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.570679 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d7dd530-6891-40b6-8bbd-282172edb12d tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1292 microversion: 2.1 time: 0.397911 Oct 18 13:33:06.573970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1265/2520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1292 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:06.589141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.592596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.610727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.613108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.615193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.620834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.623935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.624564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.865247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.877355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.879353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.887821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a22ea2f6-5f1a-409f-8ad0-a216aabce8b9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.312438 Oct 18 13:33:06.902085 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1266/2521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:06.902085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.902085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.916914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.922734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.923225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.924531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.925016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.925499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.945849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.957614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82d6918a-6f2e-42c6-84f8-446acf461a3c tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1644 microversion: 2.1 time: 0.470076 Oct 18 13:33:06.959485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1256/2522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1644 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:07.100236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:07.108406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d47ca7b4-6a60-4644-9f61-86549f8ffacb tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.218485 Oct 18 13:33:07.108992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1267/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:07.339792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c8cffb-3ed5-427d-a019-8beffc139790", "tag": "ce6391a8-7ac3-46c9-827e-e0ef69b51249"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:07.345075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:07.359736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.360222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.360667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.375945 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] Creating event network-changed:ce6391a8-7ac3-46c9-827e-e0ef69b51249 for instance 93c8cffb-3ed5-427d-a019-8beffc139790 on n-h2-858383-13 Oct 18 13:33:07.382925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e3695463-dcf0-47d7-8ee5-0d46a1f8c81b req-5c29977d-0798-4439-abd4-c590957b4739 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045981 Oct 18 13:33:07.391404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1257/2524] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:07.408888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3aadfae-bf99-4da2-b5a6-f87d754447e1"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:07.414421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:07.422480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.423233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.423858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.424791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.425245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.425884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.513967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:07.514715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:07.529632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.530170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.530623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.534994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.535688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.536339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.307464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.311733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6acdb00f-2ea2-4af0-8249-50c8d9ad5b0a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906325 Oct 18 13:33:08.312215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1268/2525] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:33:07 2022] POST /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:08.320177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.321831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.326553 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-733aec9c-0662-4604-8df1-546de7602654 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.817635 Oct 18 13:33:08.332358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1258/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:07 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:08.336684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.338253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.338737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.339531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.340882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.341344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.348177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.350276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.367452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.368372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.369053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.370885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.372272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.373109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.548295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.564751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.566247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.586759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa328f33-7f50-4aa9-b7a5-74af5b7228bc tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.251129 Oct 18 13:33:08.599993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1259/2527] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:08.604140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.604937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.629523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.629523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.629523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.629523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.629790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.629790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.797224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.799481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.807597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78812d83-8161-4acb-9243-7e922c552dbf tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1468 microversion: 2.1 time: 0.215237 Oct 18 13:33:08.813388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1260/2528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:08.815090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ca847b4-0785-4ab1-9dab-6e1743c4067c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1483 microversion: 2.1 time: 0.501745 Oct 18 13:33:08.826609 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1269/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1483 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:08.826795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.828088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.839467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a55208d-dd23-4be6-87f5-72be4eaefbc0", "name": "network-vif-deleted", "tag": "7f6aab1d-3ff6-4f75-9286-498d12f4168c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:08.845539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.848784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.860241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.860241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.860521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.860521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.860521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.860744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.860744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.886424 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] Creating event network-vif-deleted:7f6aab1d-3ff6-4f75-9286-498d12f4168c for instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 on n-h2-858383-13 Oct 18 13:33:08.895978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4f409373-068a-4fd7-a9e1-76c584243a39 req-882e12d6-ada4-4585-a612-c4bab754bc95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068006 Oct 18 13:33:08.902786 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1270/2530] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:08.911228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.917563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.930475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.934854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.934854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.934854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.934854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.935189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.059389 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ba11967-38a9-4ac2-9763-3a93d8b6190f tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154535 Oct 18 13:33:09.068088 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1271/2531] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:09.126372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.138702 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1ee25e6-c626-4f04-9c1e-9c3f77d41003 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.321540 Oct 18 13:33:09.140675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1261/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.360696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.362204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.364627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:09.373723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.376138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.376797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.378664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.382980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.383691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.384980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:09.618326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.620031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.626676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.627391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.628016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.628874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.629479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.630080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.726893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.740250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.743116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.751577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e237bd27-672f-4ec9-90e3-2d37873289e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.137463 Oct 18 13:33:09.752572 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1262/2533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:09.784597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.793950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-387881d5-06d5-4ddb-82f2-6e1afd347066 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.436968 Oct 18 13:33:09.795126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1272/2534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.842182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.842850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.851125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.851679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.856802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.856802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.856802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.856802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.896707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.897262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.897962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.898455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lazy-loading 'fault' on Instance uuid 0a55208d-dd23-4be6-87f5-72be4eaefbc0 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:09.952851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.967192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:09.969624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3aa79f6-e7d1-4402-851c-54b85198690f tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1306 microversion: 2.1 time: 0.131220 Oct 18 13:33:09.972914 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1263/2535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1306 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.996056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.996922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.997514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.021287 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] Creating event network-changed:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:33:10.026656 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-984ffd77-d9fb-4b34-9fdc-5214233f6335 req-99ef4b18-44ac-4130-8005-e023e5bed098 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063153 Oct 18 13:33:10.027276 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1273/2536] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:10.163231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.164067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.174335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.175070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.175784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.176791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.177462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.178701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.256424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:10.331221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.339421 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c6e7638-d7f9-4593-891f-35cd9bab19e4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.180230 Oct 18 13:33:10.354777 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1264/2537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:10.786869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.788674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.798285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.799010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.799648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.800571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.801218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.801838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.818401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.819077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.832309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.838565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.839105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.839888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.840386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.840836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.888993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.899000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.900966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.916769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c0355e8-7465-4407-9be3-851311ce2b71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.135474 Oct 18 13:33:10.917682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1274/2538] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:10.922700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.923309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.926646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:10.929790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.930477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.931150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.932023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.932623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.933196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.151230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:11.164614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1de84e5-8730-4db3-aec4-d3ac8ec5be8e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.351639 Oct 18 13:33:11.165848 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1265/2539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:11.174984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a812b4b0-8e2a-4e46-8443-a0e0dc36a742", "tag": "e9e05584-8df4-45a0-8270-f3a4e0084472"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:11.191622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:11.206788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a5b4c5c-8dd0-4382-beed-1a8faf14845c tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1483 microversion: 2.1 time: 0.286994 Oct 18 13:33:11.208312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1275/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1483 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:11.218159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:11.224668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.225050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:11.226667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.228926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.239577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.240092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.240574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.242361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.245329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.245329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.253449 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] Creating event network-changed:e9e05584-8df4-45a0-8270-f3a4e0084472 for instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 on n-h1-858383-13 Oct 18 13:33:11.294669 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1fd48fa8-23d8-42d1-bd3c-4b82ef5cc771 req-3d5a34db-1d19-420c-b2f9-9fb623d2f49b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123825 Oct 18 13:33:11.296012 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1266/2541] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:11.337175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.339276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.339276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.339276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lazy-loading 'fault' on Instance uuid 0a55208d-dd23-4be6-87f5-72be4eaefbc0 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:11.370950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:11.376018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:11.387576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.389295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.390301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.392132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.394821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.395903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.476936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:11.494552 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9cb895d8-dc59-44d7-a415-3b081dc1bb95 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 200 len: 1306 microversion: 2.1 time: 0.278986 Oct 18 13:33:11.515819 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1276/2542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:11 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:11.801355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:11.813274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-176e2c57-6a2d-44d2-987c-71111c54b428 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.452580 Oct 18 13:33:11.822515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1267/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:11 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:11.945390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:11.946230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:11.965537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.968663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.968663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.968663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.968663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.969078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.133481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.144564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.147819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.161682 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fb4db13-b720-4299-82b0-3d082cd36e1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.220759 Oct 18 13:33:12.164841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1277/2544] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:11 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:12.193535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.195145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:12.209573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.210486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.212368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.222213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.223149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.223907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.519795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.523567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:12.527465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.528250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.528969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.530008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.530823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.531512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.548404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 HTTP/1.1 Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:12.550563 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:12.552019 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0a55208d-dd23-4be6-87f5-72be4eaefbc0'} Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:12.552822 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:12.554730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:12.556907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:12.558204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f54eabd4-9313-4562-b778-8ec73bd0b8d0 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 404 len: 111 microversion: 2.1 time: 0.042579 Oct 18 13:33:12.559233 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1278/2545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:12 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:12.565860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.574828 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d820e23-cfb4-4f10-9d14-63c302f02d1a tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.388291 Oct 18 13:33:12.575445 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1268/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:12 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:12.580267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f784fed-3350-4acb-b7fd-55d6b053bda6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330caca60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.838151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.838759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:12.846204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.847616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.848076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.849115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.850372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.851446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.914563 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f784fed-3350-4acb-b7fd-55d6b053bda6 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201" status: 202 len: 0 microversion: 2.1 time: 0.338212 Oct 18 13:33:12.915749 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1279/2547] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:12 2022] DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:33:12.924973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc0a3b16-7b31-4d6e-a237-02528584bbfb tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330b0e040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.033390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.042417 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-635805df-6838-4a41-b77b-dd5946bf3dc9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.209352 Oct 18 13:33:13.043870 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1269/2548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:12 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:13.204880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.206103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:13.215937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.216174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.216435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.217753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.218902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.219511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.290113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.300971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.302684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.309172 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66b86a2c-5beb-4a95-91a5-ba95a3f15565 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.108144 Oct 18 13:33:13.309841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1270/2549] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:13 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:13.328991 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc0a3b16-7b31-4d6e-a237-02528584bbfb tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3" status: 202 len: 0 microversion: 2.1 time: 0.408742 Oct 18 13:33:13.329702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1280/2550] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:12 2022] DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:33:13.350989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffe4cbea-9f02-4316-a0ee-9536e37289a9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'create', calling method: .version_select at 0x7fb331659430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1483174319", "description": "tempest-description-713803709"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:13.600454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.601225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:13.609828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.610367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.610977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.611810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.612362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.612830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.747498 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffe4cbea-9f02-4316-a0ee-9536e37289a9 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.404170 Oct 18 13:33:13.750923 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1271/2551] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:33:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:13.765772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a7704e5-0f49-4768-8629-0763cf5d9655 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Action: 'update', calling method: .version_select at 0x7fb3311ef790>, body: {"security_group": {"name": "tempest-sg-hth-1238521761", "description": "tempest-description-hth-512744641"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:13.799885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.811666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14ae778e-5421-4cbc-852a-778e5b81180e tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.215232 Oct 18 13:33:13.813138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1281/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:13 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:13.831456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c8cffb-3ed5-427d-a019-8beffc139790", "name": "network-vif-plugged", "status": "completed", "tag": "ce6391a8-7ac3-46c9-827e-e0ef69b51249"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:13.855334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.855824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.856286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.870637 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] Creating event network-vif-plugged:ce6391a8-7ac3-46c9-827e-e0ef69b51249 for instance 93c8cffb-3ed5-427d-a019-8beffc139790 on n-h2-858383-13 Oct 18 13:33:13.876199 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8ab48d7e-555b-4523-9c80-81178379105c req-e2d2afa0-653c-4332-a93a-b1470413ea24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051207 Oct 18 13:33:13.877830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1282/2553] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:14.067555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.068317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.076192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.076942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.077821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.080795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.081718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.082345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.104053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a7704e5-0f49-4768-8629-0763cf5d9655 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238" status: 200 len: 217 microversion: 2.1 time: 0.345895 Oct 18 13:33:14.112659 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1272/2554] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Oct 18 13:33:13 2022] PUT /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238 => generated 217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:14.118849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e08d650f-4f33-46c6-a0d2-f0a236aa3084 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3311efee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.217153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e08d650f-4f33-46c6-a0d2-f0a236aa3084 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238" status: 200 len: 217 microversion: 2.1 time: 0.103141 Oct 18 13:33:14.222268 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1273/2555] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238 => generated 217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:14.235017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d94e5e8c-d9c4-4692-bb46-640f56c37a19 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb3317eae50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.259167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.268454 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-00fd124b-dd06-428d-8e19-0673cb24c3cc tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.205520 Oct 18 13:33:14.269612 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1283/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:14.339884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.341396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.350765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.351615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.352220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.353105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.353717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.354633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.440099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.446470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:14.452237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.454044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.460539 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aee6f42b-8570-4f82-a834-fc45f46bde84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.124586 Oct 18 13:33:14.465912 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1284/2557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:14.516979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d94e5e8c-d9c4-4692-bb46-640f56c37a19 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238" status: 202 len: 0 microversion: 2.1 time: 0.285665 Oct 18 13:33:14.523177 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1274/2558] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/636f8cd6-49f0-47f7-9040-4e8ad50ca238 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:33:14.526818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.527418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.536885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.537946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.538427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.539140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.539604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.540041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.556465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 HTTP/1.1 Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:14.556824 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.558073 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0a55208d-dd23-4be6-87f5-72be4eaefbc0'} Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.558757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.559783 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.561848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.562946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d25f590-f314-4172-a8f2-bbcd9b667f8d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 404 len: 111 microversion: 2.1 time: 0.041086 Oct 18 13:33:14.563898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1285/2559] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.573232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.573928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: 0a55208d-dd23-4be6-87f5-72be4eaefbc0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.585278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.585278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.585278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.585278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.585605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.585605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.603923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 HTTP/1.1 Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:14.606149 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.609821 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0a55208d-dd23-4be6-87f5-72be4eaefbc0'} Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.610509 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. Oct 18 13:33:14.611770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.612889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Instance 0a55208d-dd23-4be6-87f5-72be4eaefbc0 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.612889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48bb3378-e9da-4dd3-bdf0-714ba96554ff tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0" status: 404 len: 111 microversion: 2.1 time: 0.039562 Oct 18 13:33:14.612889 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1275/2560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/0a55208d-dd23-4be6-87f5-72be4eaefbc0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:14.618990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330c8f040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.644500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.645112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 6729f002-049c-4e41-908d-eaed5364fed3 not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.645633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.645633 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3 HTTP/1.1 Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:14.648158 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.649559 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '6729f002-049c-4e41-908d-eaed5364fed3'} Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.650413 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.651870 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.653176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 6729f002-049c-4e41-908d-eaed5364fed3 does not exist Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-c929fbaf-e9cc-4729-a140-5de585094fd4'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ceaedc7-ba24-4fe6-8122-0438a7b6de9d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3" status: 404 len: 194 microversion: 2.1 time: 0.035460 Oct 18 13:33:14.655886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1286/2561] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/6729f002-049c-4e41-908d-eaed5364fed3 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.659336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33136c3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.682381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.683070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 3e463703-e852-4fd3-8b1f-a7017e272201 not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.683606 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.683606 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201 HTTP/1.1 Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:14.685527 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.686687 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3e463703-e852-4fd3-8b1f-a7017e272201'} Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.687478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.688451 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.689912 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 3e463703-e852-4fd3-8b1f-a7017e272201 does not exist Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-dce93574-4516-44d9-b1c8-a2dc2e566427'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9f5baf5-4073-4d2d-8ca7-dd048876bb5a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201" status: 404 len: 194 microversion: 2.1 time: 0.032024 Oct 18 13:33:14.691021 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1276/2562] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/3e463703-e852-4fd3-8b1f-a7017e272201 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.699965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330cba700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.726369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.727052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 44218f48-c19f-4ee7-86cc-a551b265c28e not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.727690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.727690 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e HTTP/1.1 Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:14.729533 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.730759 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '44218f48-c19f-4ee7-86cc-a551b265c28e'} Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.731456 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.732896 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.734020 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 44218f48-c19f-4ee7-86cc-a551b265c28e does not exist Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-dd88baf6-edd6-47d3-83e1-10e1ad0ea10d'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6abc731e-1726-45b6-bd73-3c7dc269f688 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e" status: 404 len: 194 microversion: 2.1 time: 0.037887 Oct 18 13:33:14.735476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1287/2563] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/44218f48-c19f-4ee7-86cc-a551b265c28e => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.739966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33122c940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.765093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.765811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.766752 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.766752 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14 HTTP/1.1 Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:14.769181 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.770366 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '01ecbaf8-acf9-43ee-a1a9-af7435c28c14'} Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.771106 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.772678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.773887 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 01ecbaf8-acf9-43ee-a1a9-af7435c28c14 does not exist Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-4abb1457-47d4-483a-a7a4-c3f91f4615eb'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b24585b8-d9f1-4f32-a2f1-3b5fcc14a0e7 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14" status: 404 len: 194 microversion: 2.1 time: 0.035167 Oct 18 13:33:14.775317 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1277/2564] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/01ecbaf8-acf9-43ee-a1a9-af7435c28c14 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.780804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb335269430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.805719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.806350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group 4db8e709-27da-4306-b966-e8e068c669fe not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.806872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.806872 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe HTTP/1.1 Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:14.808676 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.809912 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4db8e709-27da-4306-b966-e8e068c669fe'} Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.810787 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.811945 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.813122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group 4db8e709-27da-4306-b966-e8e068c669fe does not exist Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-97c0797c-bd22-4f94-ae7a-321b385b9543'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f33309c9-859c-4d91-ab97-5fb0283c2210 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe" status: 404 len: 194 microversion: 2.1 time: 0.033376 Oct 18 13:33:14.814478 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1288/2565] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/4db8e709-27da-4306-b966-e8e068c669fe => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.821190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33180ff70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.838181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.838927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.849533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:33:14.849932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.850347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Neutron security group af0517df-02d3-4931-89d0-39dfda92b2ae not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:33:14.850586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.851150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.851150 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.851358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.852118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae HTTP/1.1 Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:14.853253 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.854538 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'af0517df-02d3-4931-89d0-39dfda92b2ae'} Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.855383 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:33:14.856622 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.857587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Security group af0517df-02d3-4931-89d0-39dfda92b2ae does not exist Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-96d49c82-535d-4c9a-a1fb-5de2542887e8'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7123346-2614-40bf-b203-f49e1a3c1013 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae" status: 404 len: 194 microversion: 2.1 time: 0.038154 Oct 18 13:33:14.858694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1278/2566] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/os-security-groups/af0517df-02d3-4931-89d0-39dfda92b2ae => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:14.860620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.861194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.865214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.865845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.875122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.875717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.876239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.877020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.877561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.878085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.910516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:15.041817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.050742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2220a0fb-e96a-4bd3-aa2f-1b3a156ffafe tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1322 microversion: 2.1 time: 0.218612 Oct 18 13:33:15.051314 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1289/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:15.187230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0574cbac-2712-426a-ae76-655e3e5c4429 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 204 len: 0 microversion: 2.1 time: 0.325920 Oct 18 13:33:15.188166 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1279/2568] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:14 2022] DELETE /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:15.196912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.197850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.205834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.206385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.207173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.208009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.208746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.209206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.293401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.294353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.301337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.302353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.303754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.304644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.305340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.305931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.384656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.399631 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8db5d51-bffa-4955-b948-bd00670e2c7e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1649 microversion: 2.1 time: 0.206375 Oct 18 13:33:15.403350 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1290/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1649 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:15.473085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.487505 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa5ff1ce-ce20-4ea8-a87a-9f1b58ea132a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.199096 Oct 18 13:33:15.488104 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1280/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:15.495370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.496421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.503376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.503875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.504349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.505116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.505568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.506215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.577983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.601662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.603268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.610349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4554f94-d08e-4a9a-8bb2-e07d613d66d4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.122751 Oct 18 13:33:15.611892 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1291/2571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:16.074651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.075460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.082420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.083408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.083858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.084706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.085301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.085877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.237249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.246086 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-684ebbca-2b35-43ae-9ac7-38dee0882b28 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1472 microversion: 2.1 time: 0.176403 Oct 18 13:33:16.257235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1281/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:16.268273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:16.268812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.275709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.276203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.276641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.277505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.277965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.278418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.303976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lazy-loading 'flavor' on Instance uuid 93c8cffb-3ed5-427d-a019-8beffc139790 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:16.423543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.424160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.431774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.432274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.432720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.433419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.433882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.434350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.563308 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bbd01eba-3bd2-4157-ac21-f3a76e9251c1 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790/action" status: 202 len: 0 microversion: 2.1 time: 0.298157 Oct 18 13:33:16.564591 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1292/2573] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:16 2022] POST /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:33:16.571633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.572359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.579431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.580449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.581177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.581897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.582480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.583206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.604005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.612500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b37ca0f-b0bc-4e42-9aec-fd0d9285b51a tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1649 microversion: 2.1 time: 0.192832 Oct 18 13:33:16.630613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1282/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1649 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:16.638401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.639289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.650387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.651050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.651921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.652870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.663093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.663093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.740120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.750499 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9f8cf0d-05f2-4c16-8ec1-da3c8d254f47 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.184391 Oct 18 13:33:16.751082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1293/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:16.755571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.756238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.762279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.762778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.763227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.763922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.764384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.764958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.840561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.856964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.858661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.865542 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5554afd-c47e-44f0-97da-e6324d1f3ea4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.113063 Oct 18 13:33:16.866631 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1294/2576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:17.028338 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdfdf89e-678c-4ae3-a631-2ac799b15563 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1633 microversion: 2.1 time: 0.396528 Oct 18 13:33:17.031460 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1283/2577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1633 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:17.533022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b6cf85-b480-47cf-94e3-f061378c91ab", "name": "network-vif-deleted", "tag": "d5568670-c3e7-4236-ae86-04532dd4c752"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:17.552636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.553513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.553950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.567017 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] Creating event network-vif-deleted:d5568670-c3e7-4236-ae86-04532dd4c752 for instance a2b6cf85-b480-47cf-94e3-f061378c91ab on n-h1-858383-13 Oct 18 13:33:17.572206 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ae3f5bf2-ba73-49aa-8558-c84c7c8958ae req-11a1b1f2-0de1-4c2d-9425-3e33d380d5e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044527 Oct 18 13:33:17.572789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1295/2578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:17.644493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:17.645126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:17.652774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.653283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.653737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.654485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.654954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.655430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.731154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:17.747224 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73681414-95a1-432a-b893-9797d819e88e tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1469 microversion: 2.1 time: 0.106676 Oct 18 13:33:17.747808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1284/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:17 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:17.774889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:17.775693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:17.783668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.784170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.784682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.785423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.786234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.786704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.895858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:17.897448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:17.907635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.911773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.911773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.911773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.911773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.912184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.981311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:17.994603 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bee5b63f-ab01-41eb-a333-58f17ecddb21 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.225078 Oct 18 13:33:18.000014 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1296/2580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:17 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:18.010411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.022983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.024636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.034787 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0aaa062a-224c-4d2e-a439-7ebd39a31e2b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.138738 Oct 18 13:33:18.034787 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1285/2581] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:17 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:18.041024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "name": "network-vif-plugged", "status": "completed", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.057734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.058429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.063386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:18.064201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.064801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.065247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.065612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.066202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.066734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.067482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.068042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.069086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.077913 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] Creating event network-vif-plugged:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:33:18.082944 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2f3f4f42-2e55-4b37-89d0-ef9dcc1d360a req-6a6ff8d2-5160-4f87-807b-cae9257ca832 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051938 Oct 18 13:33:18.083887 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1297/2582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:18.295219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c94e90ee-de85-47f6-8efe-e2f3fbd93b99 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1616 microversion: 2.1 time: 0.245880 Oct 18 13:33:18.307226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1286/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:18 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1616 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:18.324351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.325371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.332481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.332990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.333439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.334307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.334777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.335210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.362968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] HTTP exception thrown: Cannot 'migrate' instance 93c8cffb-3ed5-427d-a019-8beffc139790 while it is in vm_state suspended Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Request method failure captured: Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790/action HTTP/1.1 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 15 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrsO_ioXSooE_7MMJPydmsbHvxjAMkXHLltsGLzERWcTVsQux0x70NSwmzmp0vxwI6Qo4kmr8O0pq3X9ZMBgR0KKkCbxlwfIeW6KTUZ7YmOhNzJ51FRrUehAb1ARp5HWY8HB2lba7wINE2_wkWCWInnkkv2sfbx0R0N3-m0zRPjscM Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:33:18.364677 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3c382d351ca340848b459676a41d0596 Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: {"migrate": {}} Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:18.366772 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'migrate' instance 93c8cffb-3ed5-427d-a019-8beffc139790 while it is in vm_state suspended Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93c8cffb-3ed5-427d-a019-8beffc139790', 'body': {'migrate': {}}} Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 in vm_state suspended. Cannot resize while the instance is in this state. Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.367875 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 93c8cffb-3ed5-427d-a019-8beffc139790 while it is in vm_state suspended Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.369345 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.370675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:18.370675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:18.370675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 93c8cffb-3ed5-427d-a019-8beffc139790 while it is in vm_state suspended Oct 18 13:33:18.370675 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.371888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Returning 409 to user: Cannot 'migrate' instance 93c8cffb-3ed5-427d-a019-8beffc139790 while it is in vm_state suspended {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:18.372950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ff18fcb-3abc-44b1-b6ea-b097f4bbc37d tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790/action" status: 409 len: 148 microversion: 2.1 time: 0.052975 Oct 18 13:33:18.373725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1298/2584] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790/action => generated 148 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:33:18.385142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-537c535f-a0e2-4ca9-9636-3565cb5b4774 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-537c535f-a0e2-4ca9-9636-3565cb5b4774 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Request method failure captured: Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action HTTP/1.1 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 39 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrsO_ioXSooE_7MMJPydmsbHvxjAMkXHLltsGLzERWcTVsQux0x70NSwmzmp0vxwI6Qo4kmr8O0pq3X9ZMBgR0KKkCbxlwfIeW6KTUZ7YmOhNzJ51FRrUehAb1ARp5HWY8HB2lba7wINE2_wkWCWInnkkv2sfbx0R0N3-m0zRPjscM Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:33:18.389955 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3c382d351ca340848b459676a41d0596 Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: {"os-resetState": {"state": "invalid"}} Oct 18 13:33:18.391146 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '49528696-5eee-43d9-8525-9c6e01aad026', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.391797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:18.393060 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:33:18.394850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.394850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-537c535f-a0e2-4ca9-9636-3565cb5b4774 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:18.394850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-537c535f-a0e2-4ca9-9636-3565cb5b4774 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action" status: 400 len: 144 microversion: 2.1 time: 0.011421 Oct 18 13:33:18.394850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1287/2585] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:18.402193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34dba841-0112-4029-af75-d07a1fbe5483 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34dba841-0112-4029-af75-d07a1fbe5483 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Request method failure captured: Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action HTTP/1.1 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 31 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrsO_ioXSooE_7MMJPydmsbHvxjAMkXHLltsGLzERWcTVsQux0x70NSwmzmp0vxwI6Qo4kmr8O0pq3X9ZMBgR0KKkCbxlwfIeW6KTUZ7YmOhNzJ51FRrUehAb1ARp5HWY8HB2lba7wINE2_wkWCWInnkkv2sfbx0R0N3-m0zRPjscM Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:33:18.405943 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3c382d351ca340848b459676a41d0596 Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: {"os-resetState": {"state": 1}} Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:18.407160 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '49528696-5eee-43d9-8525-9c6e01aad026', 'body': {'os-resetState': {'state': 1}}} Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 1 Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:18.407865 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:33:18.409041 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.410038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34dba841-0112-4029-af75-d07a1fbe5483 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:18.410038 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34dba841-0112-4029-af75-d07a1fbe5483 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action" status: 400 len: 120 microversion: 2.1 time: 0.009308 Oct 18 13:33:18.410038 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1299/2586] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026/action => generated 120 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:33:18.417337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.419814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Failed to fetch instance by id 999 {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:33:18.420406 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Request method failure captured: Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 37 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrsO_ioXSooE_7MMJPydmsbHvxjAMkXHLltsGLzERWcTVsQux0x70NSwmzmp0vxwI6Qo4kmr8O0pq3X9ZMBgR0KKkCbxlwfIeW6KTUZ7YmOhNzJ51FRrUehAb1ARp5HWY8HB2lba7wINE2_wkWCWInnkkv2sfbx0R0N3-m0zRPjscM Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:33:18.427032 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2f795a3bc94c41a2321ec055331ec3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c2f795a3bc94c41a2321ec055331ec3 Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2106311502 Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3c382d351ca340848b459676a41d0596 Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2106311502-project-admin Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: {"os-resetState": {"state": "error"}} Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:18.429267 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 999 could not be found. Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:18.429968 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:18.431911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dda8a38c-b59e-4016-b35f-0ab0703a2d66 tempest-ServersAdminNegativeTestJSON-2106311502 tempest-ServersAdminNegativeTestJSON-2106311502-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.016117 Oct 18 13:33:18.432933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1288/2587] 10.222.0.27 () {60 vars in 1179 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:33:18.440637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.441136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.449291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.449794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.450339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.451078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.451821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.452266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.479944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:18.773408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.774213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.781386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.782417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.783091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.783812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.784313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.784750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.821879 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f07e8c3b-f51d-48e9-b21c-c7c1b376fb53 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 204 len: 0 microversion: 2.1 time: 0.384712 Oct 18 13:33:18.826328 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1300/2588] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:18 2022] DELETE /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:18.836643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.837669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.841708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.842239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.843310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.843783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lazy-loading 'fault' on Instance uuid a2b6cf85-b480-47cf-94e3-f061378c91ab {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:18.845032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.845531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.846177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.847038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.847731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.848379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.889254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bebd1e839f467e981fa5b8d5228ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f11662f8c8f4d15bce1b769946dff4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.901673 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6e257b6-24dd-4ff4-840e-727179649206 tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 200 len: 1306 microversion: 2.1 time: 0.132001 Oct 18 13:33:18.902743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1289/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:18 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:19.009030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.019222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-262fb80c-1121-48e8-94a2-51c9a9406d41 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1469 microversion: 2.1 time: 0.188053 Oct 18 13:33:19.022186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.022312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1301/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:18 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:19.022399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.027443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.028026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.028655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.029453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.030456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.031303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.037874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:19.061500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.062318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.068705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.069331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.069785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.070521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.070988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.071420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.147431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.156708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.158209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.164592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8a651642-a710-4a5a-a35b-06ae4a17b731 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.106792 Oct 18 13:33:19.165436 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1302/2591] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:19.190817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.199754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16adcde9-9a6c-42e4-85b8-4c7439341838 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.185218 Oct 18 13:33:19.200603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1290/2592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:19.931920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.932603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] [instance: a2b6cf85-b480-47cf-94e3-f061378c91ab] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.941879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.943054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.944174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.944911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.945389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.945848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.960383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] HTTP exception thrown: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Request method failure captured: Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab HTTP/1.1 Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqq0NmxW9xw5EIRbELXCf3nZdeHda024SzZ1Vi7X3bAXVruUgPmzAAAd9I3qHwyH4r8eLWjnDmOxmcLfffuV6GvdG2GD1HYPki-ybUR7EBOE2npsNGvLPIs_c4gxRaISeB1JJJNT3YbBwBD2qFowp9lwziO_zlHzKk2m6a958Ocf8fE Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:19.963715 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f11662f8c8f4d15bce1b769946dff4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f11662f8c8f4d15bce1b769946dff4e Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1084701027 Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c3bebd1e839f467e981fa5b8d5228ce5 Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsTestJSON-1084701027-project Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. Oct 18 13:33:19.964983 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'a2b6cf85-b480-47cf-94e3-f061378c91ab'} Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:19.965652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. Oct 18 13:33:19.966730 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:19.967670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Returning 404 to user: Instance a2b6cf85-b480-47cf-94e3-f061378c91ab could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:19.967670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1169a9a-89ee-4d07-b7cc-dabde240255d tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab" status: 404 len: 111 microversion: 2.1 time: 0.039905 Oct 18 13:33:19.967670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1303/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/a2b6cf85-b480-47cf-94e3-f061378c91ab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:19.974002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3695333a-8bad-4104-be9c-d4c06565f2ca tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb330f50310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.044243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.045131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:20.051511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.052220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.052728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.054286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.054779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.055538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.203443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.210535 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58f9258a-3386-442d-91b1-7f4cf3c91bae tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1469 microversion: 2.1 time: 0.169998 Oct 18 13:33:20.211371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1304/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:20 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:20.216979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.217877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:20.224140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.225197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.225758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.227431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.227431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.227881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.232394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:20.322086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.322086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.323059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.323059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41aadafc-e0eb-4ef2-908a-4c0bdbbec838 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.106682 Oct 18 13:33:20.323059 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1305/2595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:20 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:20.324340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.325209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:20.332510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.332999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.333443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.334189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.334651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.335086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.480117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.489092 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2f59b29-28a2-4335-9a6a-51a6be5c78ec tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1323 microversion: 2.1 time: 0.168346 Oct 18 13:33:20.489671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1306/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:20 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:20.531555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3695333a-8bad-4104-be9c-d4c06565f2ca tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ddcfbfc8-2926-4d06-9f75-409782ef56f0" status: 202 len: 0 microversion: 2.1 time: 0.561270 Oct 18 13:33:20.532187 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1291/2597] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:19 2022] DELETE /compute/v2.1/os-security-groups/ddcfbfc8-2926-4d06-9f75-409782ef56f0 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:33:20.544120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23054be4-c8c2-4eb8-bd4a-ce3d988e3b1b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] Calling method '.version_select at 0x7fb33521a670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.807061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23054be4-c8c2-4eb8-bd4a-ce3d988e3b1b tempest-SecurityGroupsTestJSON-1084701027 tempest-SecurityGroupsTestJSON-1084701027-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9380f67f-9baf-4996-95b7-aaecc90be041" status: 202 len: 0 microversion: 2.1 time: 0.265913 Oct 18 13:33:20.807061 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1307/2598] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:33:20 2022] DELETE /compute/v2.1/os-security-groups/9380f67f-9baf-4996-95b7-aaecc90be041 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:33:21.236316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:21.239347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:21.248247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.248991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.249508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.250357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.250888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.251426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.350464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:21.351117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:21.357358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.357814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.358392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.359222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.359705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.360142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.507152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.519540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.523865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.533454 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6709317a-6c17-4e2a-9d1a-b45ae494ceb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.188019 Oct 18 13:33:21.534703 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1308/2599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:21 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:21.541166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:21.541881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:21.548959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.549453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.549979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.556454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.556454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.556454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.694085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.708987 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed9a169f-a793-4960-82b3-94dba993d88f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1469 microversion: 2.1 time: 0.477601 Oct 18 13:33:21.713538 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1292/2600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:21 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1469 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:21.741611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.750346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65e34ac4-cfd6-481e-8c78-4aa0df6afa1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1519 microversion: 2.1 time: 0.214261 Oct 18 13:33:21.751062 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1309/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:21 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:21.776423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4afe2bb1-6f79-4102-b055-ea3f625a8e0b tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'create', calling method: .version_select at 0x7fb331a74700>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:22.572482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:22.573404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:22.581790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.582281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.582736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.583450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.583952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.585087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.671132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:22.687896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:22.697222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:22.707250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ada08e6d-1a27-43c5-b116-1991d90d41bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1558 microversion: 2.91 time: 0.139998 Oct 18 13:33:22.716627 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1310/2602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:22 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1558 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:22.716627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:22.716627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:22.730773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.731375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.731896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.732716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.733264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.734023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.780405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:23.186018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9feb3e15-4bb5-4d5c-9056-83c4249d6ab1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 204 len: 0 microversion: 2.1 time: 0.474613 Oct 18 13:33:23.189682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1311/2603] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:22 2022] DELETE /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:23.199269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:23.200563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:23.207497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.207986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.208432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.209189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.209633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.210998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.269734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.270365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.270840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.271308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lazy-loading 'fault' on Instance uuid 93c8cffb-3ed5-427d-a019-8beffc139790 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:23.320377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.328950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61b1491e-42d8-427c-8bf4-c3f23d977bdd tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1312 microversion: 2.1 time: 0.137489 Oct 18 13:33:23.329530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1312/2604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:23 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:23.334291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c8cffb-3ed5-427d-a019-8beffc139790", "name": "network-vif-deleted", "tag": "ce6391a8-7ac3-46c9-827e-e0ef69b51249"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:23.344764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.345206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.345650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.373819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] Creating event network-vif-deleted:ce6391a8-7ac3-46c9-827e-e0ef69b51249 for instance 93c8cffb-3ed5-427d-a019-8beffc139790 on n-h2-858383-13 Oct 18 13:33:23.378774 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a9ce5bb7-1b1d-4d07-b23e-2526854b0a4d req-29843350-ef17-4e60-85fe-2686f854e36a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048045 Oct 18 13:33:23.379715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1313/2605] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:23.385100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:23.385807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:23.393401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.393917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.394487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.395536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.395709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.396148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.603745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.618489 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c484694-6af4-422b-9232-ab67c4bbf57d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1552 microversion: 2.1 time: 0.236395 Oct 18 13:33:23.621090 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1314/2606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:23 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:23.735519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:23.736636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:23.755250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.757809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.758477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.760342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.760976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.761799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.901010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.913440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.915121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.926501 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a515863c-ff89-408d-8e8a-b1db0b4e7c73 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.194664 Oct 18 13:33:23.927155 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1315/2607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:23 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:24.352583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:24.353995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:24.361625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.362329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.362930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.363799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.364410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.367869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.448571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.449198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.449616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.450138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lazy-loading 'fault' on Instance uuid 93c8cffb-3ed5-427d-a019-8beffc139790 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:24.551462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:24.572778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-418c890b-a691-4789-9963-89dd551fb3d1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1312 microversion: 2.1 time: 0.224029 Oct 18 13:33:24.578129 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1316/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:24 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:24.641877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:24.642516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:24.654471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.655769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.656391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.659157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.660542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.661195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.893633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:24.906478 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b18c2678-a000-4573-abe0-734df5053fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1552 microversion: 2.1 time: 0.268393 Oct 18 13:33:24.913756 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1317/2609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:24 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1552 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:24.934989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4afe2bb1-6f79-4102-b055-ea3f625a8e0b tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.162437 Oct 18 13:33:24.947813 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1293/2610] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:33:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:24.958331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:24.960102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:24.973107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.978764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.978764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.978764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.978764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.980807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:25.042020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1720352726", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:25.091196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:25.155254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:25.170703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:25.174725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:25.191015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] validate_networks() for [('d750ef80-4f0b-4d54-9c5b-98c20b1a10bd', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:25.201563 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80719793-89fd-4888-8677-fb4baf1e3c1b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.247877 Oct 18 13:33:25.213445 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1318/2611] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:24 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:25.609837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:25.610962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:25.622104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:25.623271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:25.630656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:25.632308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:25.633098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:25.633690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:25.691093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:25.692223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:25.692889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:25.694387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lazy-loading 'fault' on Instance uuid 93c8cffb-3ed5-427d-a019-8beffc139790 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:25.807798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:25.819698 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4a89fe9-69ad-4a7c-bf85-b476a77ad3fc tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 200 len: 1312 microversion: 2.1 time: 0.216861 Oct 18 13:33:25.835978 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1319/2612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:25 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:25.931889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:25.947321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:25.955116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:25.955595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:25.956045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:25.956763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:25.957312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:25.957649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.245653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.253547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:26.263690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6acb87d-501d-4362-8b9b-13cde5e42ddc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1552 microversion: 2.1 time: 0.336470 Oct 18 13:33:26.264836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1320/2613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:25 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1552 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:26.277369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.278353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.286712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.287589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.288205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.289080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.290346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.290979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.393546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.403693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.405155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.425619 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95d4144a-1f51-49b9-85f2-ffa509b204d6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.154372 Oct 18 13:33:26.426970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1321/2614] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:26.852864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.857188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 93c8cffb-3ed5-427d-a019-8beffc139790] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.872527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.873506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.874750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.876225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.877539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.878533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.909302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] HTTP exception thrown: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Request method failure captured: Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 HTTP/1.1 Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrrHgkll3r-GqOeVRUPyrb5CThZGHxiw9g30PejcLgepCISE1hmKQX8rw4jwD38vnQMnHdH0ae6OK8WRYZcx1bd9T6zbUMjVcbawWe87vx1IuOcBtDwT1hPaR6lCM3ElqbUyQcN9n556jfeOH5c77bKKopCEPAJQzRbmCR6ClexNFA Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 748285ba5df14278b813bddf805b0f2b Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:26.911649 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_748285ba5df14278b813bddf805b0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 748285ba5df14278b813bddf805b0f2b Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminNegativeTestJSON-1533828880-project Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 873c602253894da88809e4df2664c688 Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533828880-project Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. Oct 18 13:33:26.912854 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93c8cffb-3ed5-427d-a019-8beffc139790'} Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:26.913534 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. Oct 18 13:33:26.914589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:26.915543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Returning 404 to user: Instance 93c8cffb-3ed5-427d-a019-8beffc139790 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:26.915543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-789a9c4b-f81c-4c26-bf5e-c4e1d413eb45 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790" status: 404 len: 111 microversion: 2.1 time: 0.067695 Oct 18 13:33:26.916852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1322/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/93c8cffb-3ed5-427d-a019-8beffc139790 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:26.921449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.921956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.933575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.934109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.934698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.935554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.935977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.936435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.973108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:26.980386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:26.981052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:26.981465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:26.982099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:26.994238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:27.002359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.003242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.003983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.005072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.006328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.007026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.033135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Getting quotas for project 963d4b082d364d08a0d20f49f2085f1b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:27.039213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Getting quotas for user 04584b0879e6499285f815007b4e8e1b and project 963d4b082d364d08a0d20f49f2085f1b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:27.056847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:27.060524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:27.235808 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c83a78aa-fabc-432d-9486-436d9a24a05d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.200409 Oct 18 13:33:27.236600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1294/2616] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:27.254891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-170273fc-3135-4363-9bd7-99f1756562e5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.256738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-170273fc-3135-4363-9bd7-99f1756562e5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.364711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-170273fc-3135-4363-9bd7-99f1756562e5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.378700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-170273fc-3135-4363-9bd7-99f1756562e5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1224 microversion: 2.1 time: 0.129741 Oct 18 13:33:27.379838 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1295/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:27 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:27.412099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.415933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.438601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7899afce-e92b-4c1b-b0b2-3a79f7ef00a1 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 204 len: 0 microversion: 2.1 time: 0.520367 Oct 18 13:33:27.438799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.439768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.440338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.441942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.442728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1323/2618] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:26 2022] DELETE /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:27.444824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.446222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.475866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d833f2c-718a-469c-ad77-88641f826647", "name": "network-vif-deleted", "tag": "d6e40e43-a741-422e-aabd-238235873c51"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:27.500513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.501015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.501644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.521449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] Creating event network-vif-deleted:d6e40e43-a741-422e-aabd-238235873c51 for instance 7d833f2c-718a-469c-ad77-88641f826647 on n-h2-858383-13 Oct 18 13:33:27.528727 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40877ff9-39cd-42c4-b6c2-a437cbec395e req-41ab757f-b6cc-4ec3-b191-331b9e7ae1d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082966 Oct 18 13:33:27.529656 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1324/2619] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:27.538527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.544373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.588494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.589885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.591662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.593975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.596211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.597989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.599094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.647970 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c33482e-ed51-467a-bbb1-fb9d444ddcb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1510 microversion: 2.1 time: 0.264326 Oct 18 13:33:27.648605 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1296/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:27 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:27.658731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.662995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.682217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.684068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.686245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.688582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.689864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.691401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.795616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.808570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.813240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.821585 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7976d55-8e95-48d0-9093-be7888a1f810 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.170788 Oct 18 13:33:27.822526 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1297/2621] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:27 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:28.006136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.023414 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ffcc17ba-f511-4787-a3fb-92bb691c96e3 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1477 microversion: 2.1 time: 0.490327 Oct 18 13:33:28.024392 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1325/2622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:27 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1477 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:28.409252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdd7f83d-40a0-4404-b4e6-c46492f6eca0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.410144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdd7f83d-40a0-4404-b4e6-c46492f6eca0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.534499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdd7f83d-40a0-4404-b4e6-c46492f6eca0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.558164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdd7f83d-40a0-4404-b4e6-c46492f6eca0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1224 microversion: 2.1 time: 0.150995 Oct 18 13:33:28.563675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1298/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:28.675994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.677117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.690924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.692960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.701908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.701908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.701908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.708699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.835130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.846927 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f228993b-44a3-4da3-a36f-d2b892a9e176 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.175702 Oct 18 13:33:28.874422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.875283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.878533 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1326/2624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:28.894205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.895004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.895613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.896539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.897152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.897732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.061143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.062440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.076017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.076684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.078566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.080411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.081765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.083143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.170831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.210568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.213381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.235762 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a35947b0-52c3-41ba-952e-6f0394d2ff24 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.356511 Oct 18 13:33:29.237078 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1299/2625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:29.360257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.374589 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9d67e4a-ff51-4336-b8d0-6ad3ce9089da tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1477 microversion: 2.1 time: 0.317073 Oct 18 13:33:29.377237 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1327/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:29.595752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.630649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.630649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.630649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.630649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.666319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.666319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.666319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.719595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.728403 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2801c899-49b6-4daa-a769-1008d803aea9 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1228 microversion: 2.1 time: 0.137114 Oct 18 13:33:29.728980 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1300/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1228 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:29.878873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.879791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.911539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.912670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.913745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.915042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.925089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.925605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.042064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.051337 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-466de281-879a-46a0-9b94-104178b420ff tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.176855 Oct 18 13:33:30.052990 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1328/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:30.268077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:30.268953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:30.288552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.291018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.292854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.295179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.297653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.298348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.388385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49528696-5eee-43d9-8525-9c6e01aad026", "name": "network-vif-deleted", "tag": "5c734cf3-a187-46a0-ba56-a9eebb7288f9"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:30.409884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.411294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.414110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.447831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.459215 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] Creating event network-vif-deleted:5c734cf3-a187-46a0-ba56-a9eebb7288f9 for instance 49528696-5eee-43d9-8525-9c6e01aad026 on n-h2-858383-13 Oct 18 13:33:30.460694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.462457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.470145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eeee73eb-c246-412a-bd98-d838e504dd9e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.206716 Oct 18 13:33:30.476003 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1301/2629] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:30 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:30.476129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f7ff0bcc-4d59-4f6f-a4af-d4e899e695ff req-0b78db70-abf8-4de1-b74a-bdb2dc213faf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088525 Oct 18 13:33:30.476129 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1329/2630] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:30.482645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:30.483517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:30.491114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.491962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.492937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.493922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.494536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.495108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.570270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.579264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12f6d5c6-fa54-4897-abd4-b315c75c4eca tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1435 microversion: 2.1 time: 0.106313 Oct 18 13:33:30.580141 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1302/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:30 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1435 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:30.760775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:30.761536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:30.769018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:30.778794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.783815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.784498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.786792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.797029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.797763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.938132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.938132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57e97f79-f04b-45a3-87d1-e8fb3fba741f tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1276 microversion: 2.1 time: 0.177102 Oct 18 13:33:30.938132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1330/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:30 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:31.077010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:31.077557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:31.085013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.085502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.085942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.086690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.087145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.087575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.154255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.163995 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84bd3d0b-eec2-44d6-b385-d8598cf7613c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.091031 Oct 18 13:33:31.164661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1303/2633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:31 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:31.524907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:31.527820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:31.546626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.549858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.551551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.552835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.554889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.557478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.603766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:31.604828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:31.616805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.618164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.619178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.621869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.622557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.624047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.711231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.712583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.715284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.717941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lazy-loading 'fault' on Instance uuid 49528696-5eee-43d9-8525-9c6e01aad026 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:31.737184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.769732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.772828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.779555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '873c602253894da88809e4df2664c688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748285ba5df14278b813bddf805b0f2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.779960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d105cad4-948b-4722-8353-bab4a051122c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.282431 Oct 18 13:33:31.800067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01f99600-4837-491b-88b7-1a8ed4ea373f tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 200 len: 1311 microversion: 2.1 time: 0.194622 Oct 18 13:33:31.800067 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1304/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:31 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 1311 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:31.808626 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1331/2635] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:31 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:31.954962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:31.956314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:31.962991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.967103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.967896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.969322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.969942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.971056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.069011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:32.084422 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ee6c10c-ad64-4857-9596-3d843ec7500a tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1294 microversion: 2.1 time: 0.133369 Oct 18 13:33:32.096960 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1305/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:31 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1294 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:32.197849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:32.198616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:32.213859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.221913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.221913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.221913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.221913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.222309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.310684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:32.322015 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa021fbd-89f8-47ee-9cbf-b216aa12ee2c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.127892 Oct 18 13:33:32.322659 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1332/2637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:32 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:32.814689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:32.815607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:32.820731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:32.821369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] [instance: 49528696-5eee-43d9-8525-9c6e01aad026] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:32.825756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.829098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.829098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.829098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.829098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.831307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.835885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.836394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.836837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.848053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.848909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.881357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.887708 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] HTTP exception thrown: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Request method failure captured: Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 HTTP/1.1 Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrrHgkll3r-GqOeVRUPyrb5CThZGHxiw9g30PejcLgepCISE1hmKQX8rw4jwD38vnQMnHdH0ae6OK8WRYZcx1bd9T6zbUMjVcbawWe87vx1IuOcBtDwT1hPaR6lCM3ElqbUyQcN9n556jfeOH5c77bKKopCEPAJQzRbmCR6ClexNFA Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 748285ba5df14278b813bddf805b0f2b Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:32.891289 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/748285ba5df14278b813bddf805b0f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_748285ba5df14278b813bddf805b0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 748285ba5df14278b813bddf805b0f2b Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533828880 Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminNegativeTestJSON-1533828880-project Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 873c602253894da88809e4df2664c688 Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533828880-project Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. Oct 18 13:33:32.892883 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '49528696-5eee-43d9-8525-9c6e01aad026'} Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:32.894515 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. Oct 18 13:33:32.896251 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:32.907743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] Returning 404 to user: Instance 49528696-5eee-43d9-8525-9c6e01aad026 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:32.909411 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d171e445-d5d2-4802-add6-93dd135d9169 tempest-ServersAdminNegativeTestJSON-1533828880 tempest-ServersAdminNegativeTestJSON-1533828880-project] 10.222.0.27 "GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026" status: 404 len: 111 microversion: 2.1 time: 0.094065 Oct 18 13:33:32.910657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1333/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:32 2022] GET /compute/v2.1/servers/49528696-5eee-43d9-8525-9c6e01aad026 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:33.076819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.100208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.101911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.110929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:33.111592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:33.127414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.133981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.133981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.134235 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc0dc455-cedd-4528-8a38-be6768150358 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.320114 Oct 18 13:33:33.134235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1306/2639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:32 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:33.142443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.142977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.159156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.350329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:33.351151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:33.361893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.367792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.369462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.370406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.372385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.376330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.492502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.503742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61c2add8-7fac-4c1d-9a15-f4f6601695f0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.396582 Oct 18 13:33:33.507478 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1334/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:33 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:33.581878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.594911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26b1956e-dd14-4a29-9b77-7097d855e627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.246663 Oct 18 13:33:33.597214 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1307/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:33 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:34.167677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.168320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.185061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.188429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.195856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.198688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.206797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.207896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.477905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.486644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.488111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.500953 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40e642c2-d9a6-45f7-b9fe-ed9e6069ea71 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.337551 Oct 18 13:33:34.506694 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1335/2642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:34.536252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.537096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.545316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.546138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.546671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.547624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.548540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.549197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.620169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.621176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.635098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.635852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.636711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.640748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.641558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.642198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.906932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.912870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.931467 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c48bf0e6-b66d-4df5-b1ef-a7faf76588b0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.400786 Oct 18 13:33:34.933151 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a9c5e74e-d87c-44ca-99cc-7ef27f27e9fc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1345 microversion: 2.1 time: 0.313054 Oct 18 13:33:34.933353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1308/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:34.934690 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1336/2644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1345 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:35.048875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe01ef0-6401-48d1-8754-416fbfa55486", "tag": "956d65cd-ae92-4b3c-95ab-17260646c9d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:35.070615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.071622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.072892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.102358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] Creating event network-changed:956d65cd-ae92-4b3c-95ab-17260646c9d0 for instance 3fe01ef0-6401-48d1-8754-416fbfa55486 on n-h2-858383-13 Oct 18 13:33:35.109599 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-055f96d5-9b7c-45f5-99d7-b02b646495a7 req-08dffb16-b42c-4e50-a5c8-cf45fff78eed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084635 Oct 18 13:33:35.111147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1309/2645] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:35.531995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:35.533414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:35.541400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.542203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.542811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.543831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.544541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.545141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.712681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.723603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.729273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.742543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-916df09b-f6dc-4ab7-96d1-f3420490623f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.214095 Oct 18 13:33:35.746444 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1337/2646] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:35 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:35.985481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:35.986411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:35.990989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:35.991712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:35.995002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.996294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.998232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.999601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.001462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.002434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.003639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.007842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.007842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.007842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.007842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.009897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.042069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:36.063104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.064049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.064673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.065298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 7d833f2c-718a-469c-ad77-88641f826647 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:36.117401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.136255 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f1675bf-f609-4798-974f-4c58f2898abf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1350 microversion: 2.1 time: 0.152800 Oct 18 13:33:36.139288 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1338/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:35 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:36.387104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.397366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e08ed5d-51ea-4e1f-9ed9-6b44edba73d0 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.421456 Oct 18 13:33:36.401326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1310/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:35 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:36.782775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:36.787668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:36.808535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.812667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.812667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.813849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.815611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.816247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.971419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.984459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.987405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.996844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-494c09a7-d699-43e4-b81a-531c0a16cc01 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.218335 Oct 18 13:33:37.012759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1339/2649] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:36 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:37.168688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:37.169445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:37.181907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.186521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.189033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.190185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.192112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.193602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.196249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.284406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.284917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.285369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.285832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 7d833f2c-718a-469c-ad77-88641f826647 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:37.289636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.428542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:37.430228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:37.441494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:37.455927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.457294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.462694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17f31c52-1110-40fe-9beb-6ff5d7503aa3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1350 microversion: 2.1 time: 0.298262 Oct 18 13:33:37.480060 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1311/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:37 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1350 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:37.481079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.481079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.481079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.481079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.678178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:37.690884 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-26df7391-3532-494e-9227-6a357bd969c5 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.266455 Oct 18 13:33:37.712836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1340/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:37 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:38.031938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:38.032682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:38.040105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.040694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.041217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.042098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.042651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.043210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.118140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.128925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.130459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.136958 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a1d2d25-f277-47cc-b01e-72f9685783f2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.109312 Oct 18 13:33:38.148342 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1312/2652] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:38 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:38.503832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:38.504512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:38.533856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.534392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.540171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.540171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.540171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.540171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.631943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.638688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.643684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.643684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 7d833f2c-718a-469c-ad77-88641f826647 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:38.718209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:38.718209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:38.721971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:38.752034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.753012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.756734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.757786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.758312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.758759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.773091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.790763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2bd98ac-1bf8-4044-8689-8098198cead4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 200 len: 1304 microversion: 2.1 time: 0.290931 Oct 18 13:33:38.792888 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1341/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:38 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 1304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:39.165353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:39.166300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:39.180732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.180732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.180732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.180732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.181136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.181136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.350148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:39.359158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:39.360819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:39.369155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e61465a1-ff78-4d13-85e1-a60a87d00600 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.208185 Oct 18 13:33:39.382752 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1342/2654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:39 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:39.397372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-172394667", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1d39c162-1076-4759-b728-c0f93d172f89"}], "block_device_mapping_v2": [{"uuid": "186a72f8-3245-49b7-95d8-f68564df4221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:39.450131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:39.461559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-218ed8ab-0dc9-46ed-8974-82b2c6da2139 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.745768 Oct 18 13:33:39.475399 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1313/2655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:38 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:39.507253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] validate_networks() for [('1d39c162-1076-4759-b728-c0f93d172f89', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:39.822378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:39.823013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:39.834435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.838148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.838843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.839639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.840103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.840540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.884782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 HTTP/1.1 Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:39.896665 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:39.904882 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7d833f2c-718a-469c-ad77-88641f826647'} Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:39.905735 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:39.907960 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:39.909725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:39.909725 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e932312-c416-4239-820a-e5cb3c0dc598 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 404 len: 111 microversion: 2.1 time: 0.084691 Oct 18 13:33:39.909725 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1314/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:39 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:40.051035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:40.053743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:40.066543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.072684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.072684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.072684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.074451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.075412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.094988 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647/os-volume_attachments HTTP/1.1 Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:40.107015 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:40.108497 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '7d833f2c-718a-469c-ad77-88641f826647'} Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:40.109268 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:33:40.113397 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:40.114785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:40.114785 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ef3bcd3-565b-4998-b296-e8df8ca31b0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065461 Oct 18 13:33:40.114785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1315/2657] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:33:40 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:40.131543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe01ef0-6401-48d1-8754-416fbfa55486", "name": "network-vif-plugged", "status": "completed", "tag": "956d65cd-ae92-4b3c-95ab-17260646c9d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:40.143176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.145474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.146649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.166371 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] Creating event network-vif-plugged:956d65cd-ae92-4b3c-95ab-17260646c9d0 for instance 3fe01ef0-6401-48d1-8754-416fbfa55486 on n-h2-858383-13 Oct 18 13:33:40.175197 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-43825ac5-105d-4307-ba40-90a59cbc0545 req-1d5b66a4-ed87-473c-9e88-d3a7daaefd35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055808 Oct 18 13:33:40.177397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1316/2658] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:40.404704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:40.406321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:40.422469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.425086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.425742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.429303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.430924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.433558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.758478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:40.759036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:40.759709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:40.760141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:40.760564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:40.780316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.780316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.780756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.781826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.785239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.786151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.830447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:40.848403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Getting quotas for user d5ed601492e2486bad8ba5b09515d52a and project 9395a050de444357956d4ac79adefee6. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:40.890917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.908499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.913789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.918848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-204b558e-bf20-4c13-a3cb-0f76ab757254 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.521299 Oct 18 13:33:40.920022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1317/2659] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:40 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:40.927990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:40.928847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:40.937302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.938390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.939017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.940147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.940830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.941622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.973303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:40.975992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='186a72f8-3245-49b7-95d8-f68564df4221',volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:41.314625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.352526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21c57588-9d2d-4d3a-8216-5955579abff6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1324 microversion: 2.1 time: 0.431039 Oct 18 13:33:41.355241 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1318/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:40 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:41.360533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2052906874", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:41.470502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:41.686519 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89922f27-adad-4989-8d40-ec6126777096 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302219 Oct 18 13:33:41.687346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1343/2661] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:41.699904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afa50aaf-a667-44db-9c87-dd66d1a4caab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.701378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afa50aaf-a667-44db-9c87-dd66d1a4caab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.855792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afa50aaf-a667-44db-9c87-dd66d1a4caab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.864436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afa50aaf-a667-44db-9c87-dd66d1a4caab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1052 microversion: 2.1 time: 0.169168 Oct 18 13:33:41.883442 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1344/2662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1052 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:41.953167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.954134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.969889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.973695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.974620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.976996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.986480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.996757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.188668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.208829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.208829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.220009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-517e36fe-d518-4e21-ad41-a5cd0b28cfec tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.268082 Oct 18 13:33:42.221053 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1345/2663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:42.272350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:42.273344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:42.274362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:42.274993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:42.275758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:42.293790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.295594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.297232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.298660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.301483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.303141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.343144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:42.354279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:42.371511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:42.374788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:42.382906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.383548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.400563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.406603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.407314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.408230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.409623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.411969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.534401 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbe1994a-1335-43f2-8e2e-09686d548627 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177672 Oct 18 13:33:42.538194 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1319/2664] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:42.561928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cdac3a0-bdae-4fde-a4d0-a45202e14cb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.564093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3cdac3a0-bdae-4fde-a4d0-a45202e14cb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.583120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:42.696456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3cdac3a0-bdae-4fde-a4d0-a45202e14cb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.708319 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cdac3a0-bdae-4fde-a4d0-a45202e14cb7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e" status: 200 len: 1215 microversion: 2.1 time: 0.159665 Oct 18 13:33:42.709172 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1320/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:42.732568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5c5fe08-5913-455f-9fec-4ee02ef5c9b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.734443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5c5fe08-5913-455f-9fec-4ee02ef5c9b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.785514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5c5fe08-5913-455f-9fec-4ee02ef5c9b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:43.200773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.212557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90befca1-1757-40be-8209-7e5150a125dd tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 200 len: 1521 microversion: 2.1 time: 0.834002 Oct 18 13:33:43.226544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1346/2666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 1521 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:43.255141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db983028-90bc-42f5-9051-9f779239888f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.256708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db983028-90bc-42f5-9051-9f779239888f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.399428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db983028-90bc-42f5-9051-9f779239888f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.431363 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db983028-90bc-42f5-9051-9f779239888f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1052 microversion: 2.1 time: 0.189871 Oct 18 13:33:43.432044 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1347/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1052 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:43.445786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: .version_select at 0x7fb332dbb790>, body: {"addFloatingIp": {"address": "172.25.7.151"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:43.452495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.469367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.469891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.470377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.474312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.475037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.477149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.586768 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5c5fe08-5913-455f-9fec-4ee02ef5c9b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e" status: 204 len: 0 microversion: 2.1 time: 0.859238 Oct 18 13:33:43.587778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1321/2668] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:42 2022] DELETE /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:43.595165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.596521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.633204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.633693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.647250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.648309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.653636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.654396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.678398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:33:43.678800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquired lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:33:43.872342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.896119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.898698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.913912 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-623085aa-53d0-4a5b-82ec-a3b74c9cb6ed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.324651 Oct 18 13:33:43.934039 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1322/2669] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:43.948804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.960934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.976099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e HTTP/1.1 Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:33:43.985454 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:33:43.987064 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'f57958d7-f34a-4fce-a28b-3511e4b9ac0e'} Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:43.987861 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:33:43.989160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:43.990865 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5eb7c5da-81e1-4878-98a0-effe0c93f0d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e" status: 404 len: 111 microversion: 2.1 time: 0.046350 Oct 18 13:33:43.990865 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1323/2670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:44.146005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-633277843", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:44.272545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:45.321422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:45.323086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:45.323725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:45.324327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:45.324991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:45.343525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.344572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.347644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.348685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.349382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.350757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.405750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:45.425475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:45.468060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:45.509295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:45.831750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27465a54-e23a-4585-9afd-696692d9fe1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682443 Oct 18 13:33:45.835368 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1324/2671] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:33:45.859545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:45.862147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:45.870825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.875079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.875079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.875079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.875079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.875521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.075212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.091215 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac9614ba-6a70-4b90-ba48-3cc13d4c3d45 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1158 microversion: 2.1 time: 0.254395 Oct 18 13:33:46.092658 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1325/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:45 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1158 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:46.105662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:46.106641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:46.115923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.116784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.117770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.121110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.136007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.141603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.385999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.412015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.413649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.435954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc097c1a-1131-4d65-99e5-12349728ce08 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.341573 Oct 18 13:33:46.446440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1326/2673] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:46 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:46.475462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47a27f2d-bb94-4033-b047-c055508fe2a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:46.476396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47a27f2d-bb94-4033-b047-c055508fe2a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:46.548510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-47a27f2d-bb94-4033-b047-c055508fe2a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.559743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47a27f2d-bb94-4033-b047-c055508fe2a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1214 microversion: 2.1 time: 0.096355 Oct 18 13:33:46.559743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1327/2674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:46 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:47.060789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-886483205", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "cef0cbfb-1988-4749-8e65-d036f42d323b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:47.184941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] validate_networks() for [('cef0cbfb-1988-4749-8e65-d036f42d323b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:47.205978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:33:49.215967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:49.217067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:49.219870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:49.220971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:49.221775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:49.234024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.234972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.235610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.237399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.238145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.238894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.278257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Getting quotas for project be4076eed4bf4278a4cbf18296bc66f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:49.290811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Getting quotas for user 2516c291f2ea471abedff1b8338c9ee4 and project be4076eed4bf4278a4cbf18296bc66f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:49.316213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:49.319883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:49.440282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Updating instance_info_cache with network_info: [{"id": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478", "address": "fa:16:3e:30:35:14", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefa8e2d6-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:33:49.579278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1ab30dc-a07d-4d9c-ba4f-9cf165e2b5a6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.781628 Oct 18 13:33:49.591182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1328/2675] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:49.599473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:49.602028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:49.608483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Releasing lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:33:49.609630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d59980c9-6f49-4bf0-bf6a-33aa21a3bb65 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action" status: 202 len: 0 microversion: 2.1 time: 6.176607 Oct 18 13:33:49.610456 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1348/2676] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:43 2022] POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action => generated 0 bytes in 6178 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:33:49.615925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:49.653766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.658772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.658772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.665066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.667534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.668292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.670619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.672358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.674345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.707918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] Creating event network-changed:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:33:49.722046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d0cee3f6-4939-4683-a36c-be2d1dab3aca req-e3a17979-2167-4bbc-8843-cb243deca4ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109058 Oct 18 13:33:49.723980 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1349/2677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:49.770682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:49.776613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:49.811804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.811804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.830306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.834335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.836640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.837929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.000322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.023170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.026810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.059437 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6eb40426-a7de-438c-a375-50260f84cfc0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1535 microversion: 2.91 time: 0.333024 Oct 18 13:33:50.061585 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1350/2678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:49 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1535 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:50.079404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.087885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.098134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.101400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.103293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.106762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.110095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.110693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.206837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.220594 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f10e58b1-32c8-400e-8a25-edcc938fdf4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1210 microversion: 2.1 time: 0.627553 Oct 18 13:33:50.226106 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1329/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:49 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1210 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.230971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9266b018-45ba-48e3-a51d-78d9da7225a5 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.235586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9266b018-45ba-48e3-a51d-78d9da7225a5 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.361553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9266b018-45ba-48e3-a51d-78d9da7225a5 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.374264 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:33:50.374660 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 13:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 (ip 10.222.0.27) !!! Oct 18 13:33:50.381398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9266b018-45ba-48e3-a51d-78d9da7225a5 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1224 microversion: 2.1 time: 0.153599 Oct 18 13:33:50.388199 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1330/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:50 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.389386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: .version_select at 0x7fb332dbe700>, body: {"addFloatingIp": {"address": "172.25.7.151"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:50.392803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.417976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.421421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.422693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.423820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.424980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.427871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.466122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.490813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-acdf6761-bdb1-42dc-8046-b267fbae4003 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1266 microversion: 2.1 time: 0.425048 Oct 18 13:33:50.492836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1351/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:50 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.677705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:33:50.680477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquired lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:33:51.097658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.099444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.107011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:51.127333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.129022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.134432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.139288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.139288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.140514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.356360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.375627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.381241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.401969 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82f65cf3-d051-444a-bc38-9b7161e1ae8a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1535 microversion: 2.91 time: 0.308735 Oct 18 13:33:51.443412 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1352/2682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1535 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:51.453946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.456971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.466795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.468454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.471778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.472860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.473505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.475237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.874332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.889373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a858114-5912-402a-a78b-8782be512a6d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1210 microversion: 2.1 time: 0.443282 Oct 18 13:33:51.920582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1353/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1210 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:51.936674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.938193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.957392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.958818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.961961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.962946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.963645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.964281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.512956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.537600 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29026e92-afdc-4758-8add-1df8b4a31065 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1228 microversion: 2.1 time: 0.610981 Oct 18 13:33:52.550089 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1354/2684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1228 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:52.571531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:52.576161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:52.589730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.590805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.594417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.597247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.599277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.601102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.887052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.903813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54deb8bb-adc8-4d27-8619-1faf78617d3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1284 microversion: 2.1 time: 0.350842 Oct 18 13:33:52.921447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1355/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:52 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1284 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:52.930033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a12835-770c-415c-b9fa-1d83441ed180", "tag": "41f383b6-17db-4923-99ca-cb04dd940d82"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:52.961333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.961822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.962299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.013242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] Creating event network-changed:41f383b6-17db-4923-99ca-cb04dd940d82 for instance 77a12835-770c-415c-b9fa-1d83441ed180 on n-h2-858383-13 Oct 18 13:33:53.054615 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-898f0cd5-080e-40aa-af06-8428ed255f3d req-ab6bd168-44c7-4150-aebc-eb37b7bafd37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133982 Oct 18 13:33:53.084228 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1356/2686] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:53.096137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:53.097936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:53.107065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.107829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.108901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.109847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.110639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.111712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.410914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:54.222125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.228846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:54.241383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.243345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.263077 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf3fa35e-0a11-4a5d-a3dc-c37b294e684b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1538 microversion: 2.91 time: 1.175117 Oct 18 13:33:54.274561 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1357/2687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:53 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1538 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:54.291209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.291406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.300262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.301255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.301255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.302532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.303095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.303423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.871864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.880904 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e82d4e1-ce53-4164-a034-60be518ecf40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1210 microversion: 2.1 time: 0.616151 Oct 18 13:33:54.886017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1358/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1210 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:54.890974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.896857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.914825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.915555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.916187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.917112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.917744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.918611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.939065 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.neutron [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] re-assign floating IP 172.25.7.151 from instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 Oct 18 13:33:55.060122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Building network info cache for instance {{(pid=121010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:33:55.607803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.620681 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-87e1c144-440a-488a-a00d-4c17c90ed4c2 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1284 microversion: 2.1 time: 0.731049 Oct 18 13:33:55.621318 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1359/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1284 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:55.633876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.634880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.649742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:55.651942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.652890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.653613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.654568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.655223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.655842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.894565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Updating instance_info_cache with network_info: [{"id": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478", "address": "fa:16:3e:30:35:14", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefa8e2d6-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:33:55.918945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.926774 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-000ba6d7-3097-4eb7-a2ae-f303bcdf2484 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1272 microversion: 2.1 time: 0.304043 Oct 18 13:33:55.927942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1360/2690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:55 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:55.933100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:55.936411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.943285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.943780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.944233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.944938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.945497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.945841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.009095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Building network info cache for instance {{(pid=121010) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:33:56.047857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-13". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:33:56.500073 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c1bec7d-0291-4de8-b1e0-9e0fa68c0d24 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action" status: 202 len: 0 microversion: 2.91 time: 0.569484 Oct 18 13:33:56.502382 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1361/2691] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:33:55 2022] POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:56.520434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}, {"name": "network-changed", "server_uuid": "3fe01ef0-6401-48d1-8754-416fbfa55486", "tag": "956d65cd-ae92-4b3c-95ab-17260646c9d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:56.546734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.547059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.555759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.612790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Creating event network-changed:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:33:56.612790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] Creating event network-changed:956d65cd-ae92-4b3c-95ab-17260646c9d0 for instance 3fe01ef0-6401-48d1-8754-416fbfa55486 on n-h2-858383-13 Oct 18 13:33:56.615817 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-513d5c4e-e115-4c00-8605-164c5ae0c001 req-1e986eed-1a1d-49a6-aee7-442920532a97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112007 Oct 18 13:33:56.617948 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1362/2692] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:56.626289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.638601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.648687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.649533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.650972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.651985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.662851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.663528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.016371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Updating instance_info_cache with network_info: [{"id": "956d65cd-ae92-4b3c-95ab-17260646c9d0", "address": "fa:16:3e:ce:10:b3", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap956d65cd-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:33:57.073375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.094441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd4a6a67-4934-4a5c-b98b-1d06fbb382d6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.473023 Oct 18 13:33:57.113791 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1363/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:56 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:57.134188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Releasing lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:33:57.137813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1080812d-1a6e-4819-9da8-c3f80066a0d4 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486/action" status: 202 len: 0 microversion: 2.1 time: 6.751466 Oct 18 13:33:57.138191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.138961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.140290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1331/2694] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:50 2022] POST /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486/action => generated 0 bytes in 6757 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:33:57.148061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.150576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.164214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.164747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.166713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.167481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.168123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.171672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.184408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.196570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.197648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.199080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.201521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.204194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.404562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.426466 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0324f22-dfc5-4c54-9159-9fac0873ef22 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1282 microversion: 2.1 time: 0.272875 Oct 18 13:33:57.446263 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1332/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:57.503776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.506623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.530742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.537666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.539142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.542736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.544687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.545181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.550348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.553747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.554770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.557344 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e28ece2-e701-48ac-8517-01d7253da5a1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.441808 Oct 18 13:33:57.561191 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1364/2696] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:57.571229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: .version_select at 0x7fb332dbb040>, body: {"removeFloatingIp": {"address": "172.25.7.151"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:57.945445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.952785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.953615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.954902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.955712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.961250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.962599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.116104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.132882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35432651-1139-41c3-934d-4c962eddafc2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.682760 Oct 18 13:33:58.152174 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1333/2697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:58.157330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.158615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.166884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.167694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.168320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.169223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.170197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.170814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.417537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.421465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:58.431368 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0cdcce6-b026-4183-b2f2-d8a8746f50c2 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.277660 Oct 18 13:33:58.432638 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1334/2698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:58.472873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.473502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.481069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.482137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.482841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.483776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.484323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.484972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.749189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.764856 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62b3f102-3837-491a-96e4-b7c259253c7a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.295787 Oct 18 13:33:58.766839 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1335/2699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:58.772396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.773229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.780498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.781241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.787530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.787530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.787530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.787530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.902325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.930368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.932541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.941957 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9dd052d-9bdd-40a9-8e02-632ace7958e1 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1488 microversion: 2.91 time: 0.173788 Oct 18 13:33:58.963584 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1336/2700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:59.159846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.165579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.170578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.171445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.171905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.172664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.173118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.173743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.264213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:59.275959 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] HTTP exception thrown: Floating IP 172.25.7.151 is not associated with instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610. Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Request method failure captured: Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action HTTP/1.1 Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 49 Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqsJmBig3sxRFLF9uSQ8i3rGLS7O1pGY0nru6aGxPHMeaA2gRIjBRR2KT6781t4L_d-OSyKbOSg7jY1sDts58jMxFN1Med9IFWwtFyy2pDUuH9ns4kByOkYKChYsG6UytEPvBBtXXqvWD1oo7ulwKiL95SC4xuSN3uNDHYbNeVPgJFM Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:33:59.284835 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 04584b0879e6499285f815007b4e8e1b Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: {"removeFloatingIp": {"address": "172.25.7.151"}} Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:33:59.286310 n-d-858383-13 devstack@n-api.service[121009]: exception: Floating IP 172.25.7.151 is not associated with instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610. Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '99ac7e83-8a00-4a6c-8dfc-94e0a635f610', 'body': {'removeFloatingIp': {'address': '172.25.7.151'}}} Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.151 is not associated with instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610. Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:59.287158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.151 is not associated with instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610. Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Returning 409 to user: Floating IP 172.25.7.151 is not associated with instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2214c912-6e65-4216-98f8-a47960075b1d tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action" status: 409 len: 146 microversion: 2.1 time: 1.717977 Oct 18 13:33:59.288604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1365/2701] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:57 2022] POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action => generated 146 bytes in 1722 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:33:59.295699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.151"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:59.415831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.424305 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-86cd4b75-d85f-4b9b-8922-96731d3dd621 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.269581 Oct 18 13:33:59.438105 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1337/2702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:59.456504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.456617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.468601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.468601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.468601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.468601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.469329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.469329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.614152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.625699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.626799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.627487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.628622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.629299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.631188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.654347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.664980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2dd73cf-7516-4cd3-b082-4c0360619319 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.210826 Oct 18 13:33:59.665990 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1338/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:59.790677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.791758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.798828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.800277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.805517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.805517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.805517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.805517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.006384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.015055 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19c33f21-e24b-4cf7-b41d-4969e6ff6748 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.228737 Oct 18 13:34:00.015657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1339/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:00.021953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.023661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.038964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.039722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.040433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.054416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.055304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.057228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.135173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.144633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.147451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.154475 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81769aaf-fe0d-46d6-b80a-43794ce92ad4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.137101 Oct 18 13:34:00.155382 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1340/2705] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:00.241419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5c8991-f839-43be-986d-84d1a2a0162e", "tag": "0ffba97f-103c-460f-a4bb-c0584010e717"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:00.259588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.268648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.268648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.273923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] Creating event network-changed:0ffba97f-103c-460f-a4bb-c0584010e717 for instance 3a5c8991-f839-43be-986d-84d1a2a0162e on n-h1-858383-13 Oct 18 13:34:00.280009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e486af8a-21ad-49e4-926f-a0150ee530a3 req-47144717-6505-41a4-a713-07728b66b8dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050617 Oct 18 13:34:00.281892 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1341/2706] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:00.450025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.451073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.453632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=26 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:00.462511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.721641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.721641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.721641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.721641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.722871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.725105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:34:00.725105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquired lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:34:00.735394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.745531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75466d92-a6c4-4741-a364-12f78792159b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.299798 Oct 18 13:34:00.748892 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1342/2707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:00.751631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.752394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.754744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:00.773486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.773486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.773486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.774522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.775252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.775842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.975506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.991143 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6797286-6a55-429c-b6d4-8fe0ee247f17 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.243640 Oct 18 13:34:00.994279 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1343/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:01.041932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.042652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.051317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.052575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.053371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.054596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.055488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.068433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.293394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.305628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a947f13-551f-4c7c-b772-02e47829e65c tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.267646 Oct 18 13:34:01.307581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1344/2709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:01.319905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.322602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.327227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.327725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.328366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.329084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.329546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.329983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.425130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.436748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.438686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.447100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29eb27bb-c999-4a54-97e3-407218648fed tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.138082 Oct 18 13:34:01.448251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1345/2710] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:01.775468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.776064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.791077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.791575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.792203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.793093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.793710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.794342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.314933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.324978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-874be800-a822-43b8-958b-ef12c447ce35 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.553244 Oct 18 13:34:02.326109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1346/2711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:02.330910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.334662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:02.352739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.352854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.353640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.354713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.355258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.356364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.571574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.585571 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-051f2ad5-d07a-44b7-b0d1-571ebf4cbe2d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.256498 Oct 18 13:34:02.598089 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1347/2712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:02.598089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.598089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:02.600328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.604555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.604555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.604555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.604555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.608097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.150640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.161897 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52801fd7-7d5b-472d-bfd9-07ab86c948cb tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.573105 Oct 18 13:34:03.163197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1348/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:03.187050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.187923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.194784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.195562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.196728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.198100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.198993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.199648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.335024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.344715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.349952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.364685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af1358e4-1ba8-4306-b529-4d082e612396 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.183401 Oct 18 13:34:03.365496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1349/2714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:03.372291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c3ce823-ba54-4b1d-b7bd-a171bb090988", "tag": "afb1ec0f-36fc-48ea-9c44-3ab7653aaec7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:03.383587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.384448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.385084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.397901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] Creating event network-changed:afb1ec0f-36fc-48ea-9c44-3ab7653aaec7 for instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 on n-h1-858383-13 Oct 18 13:34:03.403347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fa671ba3-1d1a-4479-8b03-078dd51f8b76 req-12525efd-13ee-46b1-be14-e28f2a25ddb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035741 Oct 18 13:34:03.404226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1350/2715] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:03.410944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.420583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.420583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.420583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.420583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.421881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.422417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.422853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.510794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:34:03.665608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.675485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5be575b2-0227-4bb8-aaf9-2b955d6b5af0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.269282 Oct 18 13:34:03.676378 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1351/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:03.682671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.683376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.689934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.700707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.700707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.700707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.700707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.701052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.003198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.007608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:04.013398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4900ecc2-4b52-4378-981d-a6850953b7fd tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.335869 Oct 18 13:34:04.014253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1352/2717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:04.103414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Updating instance_info_cache with network_info: [{"id": "956d65cd-ae92-4b3c-95ab-17260646c9d0", "address": "fa:16:3e:ce:10:b3", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap956d65cd-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:34:04.186374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Releasing lock "refresh_cache-3fe01ef0-6401-48d1-8754-416fbfa55486" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:34:04.188118 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b43e38f6-155d-408d-a2f8-df660c8f5599 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486/action" status: 202 len: 0 microversion: 2.1 time: 4.896235 Oct 18 13:34:04.189678 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1366/2718] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:59 2022] POST /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486/action => generated 0 bytes in 4899 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:34:04.194678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.195494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.199906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.200622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.203733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.204755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.206089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.208314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.208670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.209208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.209471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.210010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.210212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.211131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.211815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.213097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.248238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:04.493649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.511557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-896008e1-f4c2-47f2-9e93-48cc7db49dd0 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.327292 Oct 18 13:34:04.526853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1353/2719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:04 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:04.540037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.540898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.555606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.556294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.556887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.557985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.561915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.562505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.707274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.725832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.727909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.749134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73d7d7ef-f346-420a-9c90-ac4013e88f2a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.219778 Oct 18 13:34:04.750147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1354/2720] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:04 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:04.755201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.756144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.763089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.766989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.766989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.766989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.766989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.767329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.775143 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4940306d-b9ba-474e-a066-23a287f82f48 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 204 len: 0 microversion: 2.1 time: 0.579838 Oct 18 13:34:04.776507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1367/2721] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:04 2022] DELETE /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:04.788513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.151"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:04.802197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.822076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.822576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.823023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.823720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.824347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.824784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.860532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:34:04.861142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquired lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:34:05.306782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.319419 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcf41c22-f631-4421-90c6-ec919c16d0e2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.567919 Oct 18 13:34:05.323140 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1355/2722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:04 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:05.331423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.339905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.354783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.356432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.360530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.360530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.360530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.360530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.827248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.840121 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6186694-0bf6-4352-b2f4-2b6f401ab373 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.515505 Oct 18 13:34:05.850711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1356/2723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:05.866160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe01ef0-6401-48d1-8754-416fbfa55486", "tag": "956d65cd-ae92-4b3c-95ab-17260646c9d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:05.877671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.878189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.878625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.893813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] Creating event network-changed:956d65cd-ae92-4b3c-95ab-17260646c9d0 for instance 3fe01ef0-6401-48d1-8754-416fbfa55486 on n-h2-858383-13 Oct 18 13:34:05.900438 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c35eb1c7-a1ed-4d1c-b555-2ad93da8ce10 req-b3d78eaa-9334-4057-848f-88ad34f008c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048371 Oct 18 13:34:05.901616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1357/2724] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:05.909163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.915158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.917187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.917994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.918563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.919320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.919787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.920247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.695576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.718038 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-228d29a6-0f44-48f1-8982-59b9043f0a65 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.806774 Oct 18 13:34:06.719826 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1358/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:06.726732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:06.727823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:06.743610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.744447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.745369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.746944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.748398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.749002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.845378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.856809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.858311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.870938 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ddfa842a-0388-476d-a54e-ce874b875492 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.149542 Oct 18 13:34:06.886142 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1359/2726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:06 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:06.886142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:06.886142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:06.887835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.888499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.888953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.889747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.896072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.896072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.171300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.193455 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a3c41ab-def3-4211-8a24-16a40151f7ef tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.307235 Oct 18 13:34:07.214671 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1360/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:06 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:07.220960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a12835-770c-415c-b9fa-1d83441ed180", "name": "network-vif-plugged", "status": "completed", "tag": "41f383b6-17db-4923-99ca-cb04dd940d82"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:07.241745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.244833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.245542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.272801 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] Creating event network-vif-plugged:41f383b6-17db-4923-99ca-cb04dd940d82 for instance 77a12835-770c-415c-b9fa-1d83441ed180 on n-h2-858383-13 Oct 18 13:34:07.289602 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a68e949d-5169-48d0-af56-961c4d6e1e34 req-c3a26010-16de-4543-9cd8-dff8b046058b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073174 Oct 18 13:34:07.291124 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1361/2728] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:07.296556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:07.301475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:07.318175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.319023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.321485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.334415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.334944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.339109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.875932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.902551 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0a3e659-23d0-46b2-9f99-3c4eeb668478 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.608583 Oct 18 13:34:07.909827 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1362/2729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:07 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:07.917954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:07.918862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:07.935118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.935902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.936523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.937511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.938231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.938904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.185713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.194750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f190810-b772-4d67-8cdc-1249cc461a38 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.286079 Oct 18 13:34:08.195647 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1363/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:07 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:08.202890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:08.208185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.219179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.222911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.224289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.225347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.227214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.229351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.363146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:34:08.418858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.431342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.432952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.449918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-389c6d4a-b4cc-47aa-b582-1b6ead1c272a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.252945 Oct 18 13:34:08.458840 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1364/2731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:08 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:08.487133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:08.487954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.511977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.512671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.513251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.514313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.514909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.518788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.170967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:09.181268 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25a784ff-3c31-4325-9361-4d60d9c06aa9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.719768 Oct 18 13:34:09.188316 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1365/2732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:08 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:09.218541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe01ef0-6401-48d1-8754-416fbfa55486", "name": "network-vif-deleted", "tag": "956d65cd-ae92-4b3c-95ab-17260646c9d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:09.251017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.252351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.253504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.309015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] Creating event network-vif-deleted:956d65cd-ae92-4b3c-95ab-17260646c9d0 for instance 3fe01ef0-6401-48d1-8754-416fbfa55486 on n-h2-858383-13 Oct 18 13:34:09.315721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-01ed41f2-3469-40fc-aafb-8cb32077a176 req-21f76bbe-ddbe-47f7-9006-8ff06799e5de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125582 Oct 18 13:34:09.327001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1366/2733] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:09.335584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:09.342293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:09.362409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.367881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.367881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.367881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.367881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.368302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.795466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Updating instance_info_cache with network_info: [{"id": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478", "address": "fa:16:3e:30:35:14", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefa8e2d6-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:34:09.875196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Releasing lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:34:09.875196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c868194-3020-48f0-a290-8a641cf58781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action" status: 202 len: 0 microversion: 2.1 time: 5.090125 Oct 18 13:34:09.875196 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1368/2734] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:04 2022] POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action => generated 0 bytes in 5092 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 18 13:34:09.884524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:09.885471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:09.904072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.906839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.909624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.913071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.914398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.917184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.220363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.240804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c2b44c6-b9a5-4576-9ef6-fbe55ecb009a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1198 microversion: 2.1 time: 0.911906 Oct 18 13:34:10.258208 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1367/2735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:09 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1198 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:10.274343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:10.275001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:10.297327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.298257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.299459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.300458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.301968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.307732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.421808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.432284 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ca3b817-c849-41fd-89c8-6977104732ff tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.552272 Oct 18 13:34:10.433751 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1369/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:09 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:10.445178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.454157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd855336-45fb-42d8-bfb8-c856c1854645 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '.version_select at 0x7fb3305d29d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:10.475280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.481284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.497013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4e7e580-3a6d-4b71-9f0a-5efc1d863a1f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.237315 Oct 18 13:34:10.512547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1368/2737] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:10 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:10.533722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:10.534416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:10.547716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.551667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.552353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.553275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.553910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.554382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.899198 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd855336-45fb-42d8-bfb8-c856c1854645 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/513f00b4-fda7-4c5e-96b8-f75444396865" status: 200 len: 184 microversion: 2.1 time: 0.462889 Oct 18 13:34:10.902848 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1370/2738] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:34:10 2022] GET /compute/v2.1/os-floating-ips/513f00b4-fda7-4c5e-96b8-f75444396865 => generated 184 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:10.929461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.151"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:10.945879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.955426 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e598e1eb-13af-4d3c-aa8c-7ae635a98f6c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.441203 Oct 18 13:34:10.980238 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1369/2739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:10 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:11.138951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.151171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.152188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.152880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.154077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.154769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.155418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.266702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:11.267930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.286564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.287076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.287521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.295508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.300253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.300253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.519031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:34:11.519447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquired lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:34:11.717699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.729409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab6c358e-970c-4d1a-a66d-68451fb138ad tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1382 microversion: 2.1 time: 0.468183 Oct 18 13:34:11.739367 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1370/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:11 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1382 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:11.751305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:11.780587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.785062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.786521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.822736 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] Creating event network-changed:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:34:11.831567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bde06974-73a2-44fe-a235-eee37ac33964 req-8434a252-d565-4add-8283-b017baeddde6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090101 Oct 18 13:34:11.833633 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1371/2741] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:11.863199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:11.864621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.876424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.877673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.878417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.879411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.881120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.881965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.889845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:11.894483 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:34:11.894697 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 13:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action (ip 10.222.0.27) !!! Oct 18 13:34:12.459104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:12.472338 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da5fd8d8-699a-44df-a273-b98e0f734eb9 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.631761 Oct 18 13:34:12.473348 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1372/2742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:11 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:12.481525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:12.482297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:12.497470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.501675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.503353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.503353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.504100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.505912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.691080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:34:12.694533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:12.801384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:12.845558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:12.851803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:12.873274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69d80112-dca4-47d7-846a-0bf06e877dd0 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.398273 Oct 18 13:34:12.882104 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1373/2743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:12 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:13.147384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:13.148151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:13.157946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.158812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.159416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.160832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.161464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.162046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.421197 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e15715b-3d53-4451-864a-e19764eca640 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1535 microversion: 2.1 time: 0.542290 Oct 18 13:34:13.423363 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1374/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:12 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1535 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:13.432110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:13.433925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:13.473063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.480013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.481003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.482099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.482811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.484114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.995784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.036769 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e46d3a25-75e8-452b-813b-d35588378692 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.594022 Oct 18 13:34:14.038917 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1375/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:13 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:14.058711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5c8991-f839-43be-986d-84d1a2a0162e", "name": "network-vif-plugged", "status": "completed", "tag": "0ffba97f-103c-460f-a4bb-c0584010e717"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:14.107334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.111137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.112485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.153113 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] Creating event network-vif-plugged:0ffba97f-103c-460f-a4bb-c0584010e717 for instance 3a5c8991-f839-43be-986d-84d1a2a0162e on n-h1-858383-13 Oct 18 13:34:14.171535 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-886dc101-c3e9-4622-a545-c3c926d5aaf8 req-d8e3e9dc-e758-4e3c-8b51-726db9794f3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128732 Oct 18 13:34:14.173284 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1376/2746] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:14.173456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Updating instance_info_cache with network_info: [{"id": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478", "address": "fa:16:3e:30:35:14", "network": {"id": "d750ef80-4f0b-4d54-9c5b-98c20b1a10bd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1696299251-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "963d4b082d364d08a0d20f49f2085f1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefa8e2d6-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:34:14.192491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Releasing lock "refresh_cache-99ac7e83-8a00-4a6c-8dfc-94e0a635f610" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:34:14.193731 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d061f88-deb6-47d8-bba2-e9b1e6714749 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action" status: 202 len: 0 microversion: 2.1 time: 3.282813 Oct 18 13:34:14.194707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1371/2747] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:10 2022] POST /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610/action => generated 0 bytes in 3285 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:34:14.196992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.197973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.202363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.203116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.207278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.223918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.223918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.223918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.223918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.224328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.224417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.224417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.227409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.228179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.228612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.229229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.479182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bf9b1e2-1b89-4c3c-9f37-6a7e9e46b24f tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1535 microversion: 2.1 time: 0.291217 Oct 18 13:34:14.501435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1377/2748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1535 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:14.517737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.517737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.533246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.540572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.540572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.540572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.540572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.541131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.629905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.641697 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5246f04b-b42e-45be-9c5c-e0c08c0ced70 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.445664 Oct 18 13:34:14.666587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1372/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:14.718921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:14.728008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.741653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.743930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.744639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.746079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.747553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.761479 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ece4022-fcad-4e9b-aace-7966b161a60e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.257162 Oct 18 13:34:14.763681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1378/2750] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:14.772968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] Creating event network-changed:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:34:14.776425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.779265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.784252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c9f05ae2-282a-409b-aa71-095fbade15e0 req-0963e28e-554b-4409-b76e-544ee6ec9168 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116301 Oct 18 13:34:14.787667 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1373/2751] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:14.797337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.798452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.799139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.802714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.803460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.804177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.828784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.850833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.851424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.857343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.858609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.859165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.859658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.871458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] HTTP exception thrown: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Request method failure captured: Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 HTTP/1.1 Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqsJmBig3sxRFLF9uSQ8i3rGLS7O1pGY0nru6aGxPHMeaA2gRIjBRR2KT6781t4L_d-OSyKbOSg7jY1sDts58jMxFN1Med9IFWwtFyy2pDUuH9ns4kByOkYKChYsG6UytEPvBBtXXqvWD1oo7ulwKiL95SC4xuSN3uNDHYbNeVPgJFM Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:34:14.883484 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 04584b0879e6499285f815007b4e8e1b Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:14.885023 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3fe01ef0-6401-48d1-8754-416fbfa55486'} Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:14.885864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:14.887279 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.889116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Returning 404 to user: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:14.897363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4cd9f923-a58e-4c0c-8fa7-f551964298e8 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 404 len: 111 microversion: 2.1 time: 0.128872 Oct 18 13:34:14.902805 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1379/2752] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:14 2022] DELETE /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:14.922962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.931027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 3fe01ef0-6401-48d1-8754-416fbfa55486] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.963195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.965628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.968787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.969923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.976250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.980390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.043048 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cac57bb4-7791-48d5-ab9e-55820aaf7274 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.256613 Oct 18 13:34:15.044727 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1374/2753] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:15.051087 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] HTTP exception thrown: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Request method failure captured: Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 HTTP/1.1 Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqsJmBig3sxRFLF9uSQ8i3rGLS7O1pGY0nru6aGxPHMeaA2gRIjBRR2KT6781t4L_d-OSyKbOSg7jY1sDts58jMxFN1Med9IFWwtFyy2pDUuH9ns4kByOkYKChYsG6UytEPvBBtXXqvWD1oo7ulwKiL95SC4xuSN3uNDHYbNeVPgJFM Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:34:15.056212 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 04584b0879e6499285f815007b4e8e1b Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:15.057694 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3fe01ef0-6401-48d1-8754-416fbfa55486'} Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:15.058538 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. Oct 18 13:34:15.059763 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.060844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-13", "block_migration": false, "disk_over_commit": false}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:15.066864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Returning 404 to user: Instance 3fe01ef0-6401-48d1-8754-416fbfa55486 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:15.071513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.074239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcb38248-d728-49c1-8814-bf9e8b3be8f1 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486" status: 404 len: 111 microversion: 2.1 time: 0.168253 Oct 18 13:34:15.075404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1380/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/3fe01ef0-6401-48d1-8754-416fbfa55486 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:15.089910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:15.100195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.121743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.136346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.136346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.136346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.136346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.137031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.137031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.147916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.148770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.149909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.150836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.151431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.288249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lazy-loading 'flavor' on Instance uuid 77a12835-770c-415c-b9fa-1d83441ed180 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:15.397852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Going to try to live migrate instance to n-h1-858383-13 {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:34:15.681857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.683922 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc1a9020-1251-44f4-8947-c06837a2eaf1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1314 microversion: 2.1 time: 0.607132 Oct 18 13:34:15.698090 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1381/2755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:15 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:15.698090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee288cff-481b-4109-830e-33864e7fb4c6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '.version_select at 0x7fb3310d4e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.885230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee288cff-481b-4109-830e-33864e7fb4c6 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/513f00b4-fda7-4c5e-96b8-f75444396865" status: 202 len: 0 microversion: 2.1 time: 2.198866 Oct 18 13:34:17.886577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1382/2756] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:34:15 2022] DELETE /compute/v2.1/os-floating-ips/513f00b4-fda7-4c5e-96b8-f75444396865 => generated 0 bytes in 2201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:17.891414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.892291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:17.900616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.903304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.903304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.903304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.903304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.904066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.122175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.137669 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69cbee0b-5f0e-4a02-b776-9b4c634d4fba tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.249791 Oct 18 13:34:18.138707 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1383/2757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:17 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:18.144853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.145950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.154575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.155362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.156013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.156937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.157588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.158254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.280856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.294267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.296484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.304876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7dc055cb-ecad-408a-9085-c6fcd7687ca2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.164497 Oct 18 13:34:18.306534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1384/2758] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:18.311615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3ce823-ba54-4b1d-b7bd-a171bb090988", "name": "network-vif-plugged", "status": "completed", "tag": "afb1ec0f-36fc-48ea-9c44-3ab7653aaec7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:18.323498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:18.326692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.327517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.328195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.345397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] Creating event network-vif-plugged:afb1ec0f-36fc-48ea-9c44-3ab7653aaec7 for instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 on n-h1-858383-13 Oct 18 13:34:18.351485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2b925b49-a19f-47bd-8d02-f27e5f4627d5 req-de641ad3-e4eb-4ed9-b9a3-8a6be0a86baa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043439 Oct 18 13:34:18.352660 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1385/2759] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:18.359166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.359918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.369163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.369935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.370630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.371528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.372507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.372642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.556398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.565021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f640d17-db9c-498c-9c03-7aa6d41ddf51 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1501 microversion: 2.1 time: 0.210766 Oct 18 13:34:18.566234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1386/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:18.571413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.572144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.579239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.583522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.583522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.583522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.583522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.583924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.612762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:19.002832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16f10891-4510-4aff-971c-7850678f61ff tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 204 len: 0 microversion: 2.1 time: 0.435014 Oct 18 13:34:19.010029 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1387/2761] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:18 2022] DELETE /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:19.017061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:19.017889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.025873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.026477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.026948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.027660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.028130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.028566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.324746 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-591a6050-082d-4255-84eb-01aae526cc2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e/action" status: 202 len: 0 microversion: 2.1 time: 0.312855 Oct 18 13:34:19.326172 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1388/2762] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:19 2022] POST /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:19.334633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.337005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.359015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.359638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.360087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.360837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.361398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.361842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.993090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.997103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:20.002830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-559ff1fe-1a9e-495c-8c14-1a22ad26a013 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1525 microversion: 2.1 time: 0.675322 Oct 18 13:34:20.022127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1389/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1525 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:20.027523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.027523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.037509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.037930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.039966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.039966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.039966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.040242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.269390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.282478 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69bd99da-90b9-4da2-9ce4-f2c2474d8d7e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.268844 Oct 18 13:34:20.290335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1390/2764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:20.290335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.290335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.302633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.303123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.303563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.304281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.304740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.305173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.457098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.472784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58becee0-12b8-44a7-906c-7f9f3092411a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1506 microversion: 2.1 time: 0.188210 Oct 18 13:34:20.474888 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1391/2765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:20.480515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.481203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.488284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.491044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.491044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.491044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.491044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.491793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.589623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.599683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.601719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.605190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b0c0f983-835a-45da-8f76-15ab4959f8a0 tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180/action" status: 202 len: 0 microversion: 2.1 time: 5.551582 Oct 18 13:34:20.609934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b534e1f8-4f75-488f-9619-67640f5df5bb tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.133492 Oct 18 13:34:20.610163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1375/2766] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:15 2022] POST /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180/action => generated 0 bytes in 5557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:20.611220 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1392/2767] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:20.617860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.630889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.647657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.648316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.648811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.649576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.650652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.651444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.829391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.839627 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02161751-c0e1-4e64-894d-0140fdaf8b5d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.226368 Oct 18 13:34:20.846906 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1376/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:21.035128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.036749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.044379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.045100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.045787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.046438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.046913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.047484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.189603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.202116 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ed06511-6edc-4f60-b01b-7c9b32936781 tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1483 microversion: 2.1 time: 0.171098 Oct 18 13:34:21.203069 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1393/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1483 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:21.311690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.311956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.329836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.331133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.333236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.337409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.337901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.338595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.387325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ac7e83-8a00-4a6c-8dfc-94e0a635f610", "name": "network-vif-deleted", "tag": "efa8e2d6-44cb-4fe8-bc5d-ff6329699478"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:21.408509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.409344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.410014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.435206 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] Creating event network-vif-deleted:efa8e2d6-44cb-4fe8-bc5d-ff6329699478 for instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 on n-h2-858383-13 Oct 18 13:34:21.452063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4c5f14ab-d7b5-4aa9-938d-b5fe71d608f4 req-f99f115f-18ef-45ab-b846-9af63e4f1d68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199604 Oct 18 13:34:21.453146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1377/2770] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:21.507523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.508332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.540363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.540363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.540363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.540363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.540720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.550305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.651782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.674149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50732716-d379-4709-bf70-5a690946b850 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1324 microversion: 2.1 time: 0.369370 Oct 18 13:34:21.684266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1394/2771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:21.696977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.698012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.712785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.713569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.718504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.719521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.744366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.745801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.861436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.871190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.880208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.880368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8368b19c-66ae-41b1-8f0f-fdef7c5240a1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1486 microversion: 2.1 time: 0.378956 Oct 18 13:34:21.881668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.888790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-709376d4-2558-473d-abef-8370ee3b49cf tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.202435 Oct 18 13:34:21.888925 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1378/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:21.897438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1395/2773] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:21.909195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.911200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.918221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.918728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.929670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.930592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.930750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.930835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.931307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.931415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.931803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.932233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.933302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.936486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.937018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.937496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.963174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:22.180750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.191246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4083cf7-f0db-447f-92f4-67c6db5df496 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.300980 Oct 18 13:34:22.192302 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1379/2774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:22.233412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.234145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.241450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.241450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.241840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.244018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.244018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.244018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.305759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.306459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.307082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.307730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lazy-loading 'fault' on Instance uuid 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:22.409192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04584b0879e6499285f815007b4e8e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963d4b082d364d08a0d20f49f2085f1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.419107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-883db47f-c7a2-482f-839d-de057cada22e tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 200 len: 1313 microversion: 2.1 time: 0.189950 Oct 18 13:34:22.423556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1380/2775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:22.465822 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a63b12ba-1e83-4856-9104-d379670ef480 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 204 len: 0 microversion: 2.1 time: 0.557441 Oct 18 13:34:22.472932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1396/2776] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:21 2022] DELETE /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:22.481214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.481832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.494822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.495666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.496390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.497715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.499815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.500762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.713661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.720491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.734973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.741318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.744083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.745495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.746368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a920f03e-e698-488d-b36d-24ce88b436e8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1492 microversion: 2.1 time: 0.268994 Oct 18 13:34:22.747699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.755109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.755295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1381/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1492 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:22.762006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.927753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.929105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.957383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.960296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.963723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.966072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.967609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.969085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.999822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.012249 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-721ca13f-97df-42ae-ad5c-f4cb6cd90e82 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1519 microversion: 2.1 time: 0.303016 Oct 18 13:34:23.013698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1397/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:23.058516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.059063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.067599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.068095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.068574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.069854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.070355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.070810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.087091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.096627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.098770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.104797 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] HTTP exception thrown: Instance is not a member of specified network Oct 18 13:34:23.105782 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb882675-276e-42b0-91fc-894d4863cd97 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.184110 Oct 18 13:34:23.106830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1382/2779] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Request method failure captured: Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988/ips/invalid HTTP/1.1 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqs6-Ln9axLLqxofX8s5bMe-UmOXg60oYP9sxOWz46rj9hDzda1uTpB5NzSMWUci8GCMhLwYAVAxkraHDLYrxnq2ONUHpAIUE-_CRdoVeUCOOxflAkTZs1DRihs8vygyzxSPeFJlRjCSoT82Gy53ujFiUf-RRUtjz2FMZkAeXoVK-UQ Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:34:23.110423 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2516c291f2ea471abedff1b8338c9ee4 Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance is not a member of specified network Oct 18 13:34:23.120806 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '8c3ce823-ba54-4b1d-b7bd-a171bb090988', 'id': 'invalid'} Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 18 13:34:23.121557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.122863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:23.122863 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63be20dd-b1c0-43f6-805b-422fbd0d360e tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.061992 Oct 18 13:34:23.125012 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1398/2780] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988/ips/invalid => generated 91 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:23.129787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.130596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Failed to fetch instance by id 999 {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:34:23.131495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] HTTP exception thrown: Instance 999 could not be found. Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Request method failure captured: Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqs6-Ln9axLLqxofX8s5bMe-UmOXg60oYP9sxOWz46rj9hDzda1uTpB5NzSMWUci8GCMhLwYAVAxkraHDLYrxnq2ONUHpAIUE-_CRdoVeUCOOxflAkTZs1DRihs8vygyzxSPeFJlRjCSoT82Gy53ujFiUf-RRUtjz2FMZkAeXoVK-UQ Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:34:23.134173 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2516c291f2ea471abedff1b8338c9ee4 Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 999 could not be found. Oct 18 13:34:23.146381 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': '999'} Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 18 13:34:23.147114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77e76b92-be2c-4960-9493-f604f2c9531f tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010775 Oct 18 13:34:23.148569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1383/2781] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:23.153363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.153871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.160233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.161392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.161808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.162586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.163052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.163488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.192152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:23.215462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.217069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.224825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.225689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.226860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.228107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.229383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.231420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.392043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.402670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61b915eb-f8eb-4d91-8e33-dd8e7fbbec4a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.191501 Oct 18 13:34:23.407788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1384/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:23.461834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.462751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] [instance: 99ac7e83-8a00-4a6c-8dfc-94e0a635f610] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.470449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.471250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.472132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.474010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.474689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.475305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.492346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] HTTP exception thrown: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Request method failure captured: Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 HTTP/1.1 Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqsJmBig3sxRFLF9uSQ8i3rGLS7O1pGY0nru6aGxPHMeaA2gRIjBRR2KT6781t4L_d-OSyKbOSg7jY1sDts58jMxFN1Med9IFWwtFyy2pDUuH9ns4kByOkYKChYsG6UytEPvBBtXXqvWD1oo7ulwKiL95SC4xuSN3uNDHYbNeVPgJFM Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:34:23.494831 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_963d4b082d364d08a0d20f49f2085f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 963d4b082d364d08a0d20f49f2085f1b Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-26063420 Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 04584b0879e6499285f815007b4e8e1b Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-26063420-project Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. Oct 18 13:34:23.496353 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '99ac7e83-8a00-4a6c-8dfc-94e0a635f610'} Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:23.497860 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. Oct 18 13:34:23.500540 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:23.501881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] Returning 404 to user: Instance 99ac7e83-8a00-4a6c-8dfc-94e0a635f610 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:23.503585 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27c6f5af-5f05-4464-b59e-3b766e49b28c tempest-FloatingIPsAssociationTestJSON-26063420 tempest-FloatingIPsAssociationTestJSON-26063420-project] 10.222.0.27 "GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610" status: 404 len: 111 microversion: 2.1 time: 0.053910 Oct 18 13:34:23.504158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1385/2783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/99ac7e83-8a00-4a6c-8dfc-94e0a635f610 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:34:23.504786 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5eb2113d-2e41-477f-8489-cb2e41c52f08 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 204 len: 0 microversion: 2.1 time: 0.354384 Oct 18 13:34:23.513972 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1399/2784] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:23 2022] DELETE /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:23.515177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.516002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.524545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.525035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.525480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.526304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.526919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.527354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.686735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.698100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3c08561-9956-497b-a6db-d8b8568472d3 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1525 microversion: 2.1 time: 0.187338 Oct 18 13:34:23.699099 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1386/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1525 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:23.781601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.782353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.789189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.789698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.790174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.791204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.791684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.792190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.064041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.086734 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5af9e609-f830-4f66-b384-f83442eda9d0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1492 microversion: 2.1 time: 0.309623 Oct 18 13:34:24.088057 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1400/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1492 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:24.145328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:24.145936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.153816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.154362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.155033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.155835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.156290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.156815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.266812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.279697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.281517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.289305 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1d4672c-1858-4792-b88e-fde7257b3e15 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1531 microversion: 2.91 time: 0.152434 Oct 18 13:34:24.290646 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1387/2787] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:24 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1531 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:24.329386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:24.330036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.337672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.338428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.338892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.339616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.340085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.340516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.428784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:24.429863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.437259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.438122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.438720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.439783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.440389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.441171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.606540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lazy-loading 'services' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:24.631106 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59c31b5f-075e-4c59-902a-020d338c05fa tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1938 microversion: 2.91 time: 0.305583 Oct 18 13:34:24.632655 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1401/2788] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:24 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1938 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:24.673903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:24.674739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.684881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.686200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.687117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.688941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.689565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.690192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.695544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.700324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:24.711804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9808abc-fbf1-4a2e-906c-88d0113449ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.288138 Oct 18 13:34:24.719134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1388/2789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:24 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:24.734450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:24.735118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.747551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.748957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.749411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.750425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.750896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.751328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.753955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lazy-loading 'flavor' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:24.800546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:24.925681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:24.941425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.952638 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a15b10ea-01fb-453b-bf80-30b8a643158a tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1525 microversion: 2.1 time: 0.231834 Oct 18 13:34:24.965931 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1389/2790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:24 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:25.120270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.122839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.151281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.151965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.159058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.160048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.163586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.164974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.576367 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a370435-8cb1-4801-9c3f-7d6b7b9f1ba9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action" status: 202 len: 0 microversion: 2.91 time: 0.907027 Oct 18 13:34:25.577674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1402/2791] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:34:24 2022] POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:25.594976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.596208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.611606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.614688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.618024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.619270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.622037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.622832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.743039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.760121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.764598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.778316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b441cf27-bebb-41cb-aea8-7c74a3c638f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.195585 Oct 18 13:34:25.781396 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1403/2792] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:25.792442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.795009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.806350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.820913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.821867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.825241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.826088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.827287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.846602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.865493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99b3414e-1a06-4d27-839c-d3c0b6412787 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1492 microversion: 2.1 time: 0.755404 Oct 18 13:34:25.876106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1390/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1492 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:25.985485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.986757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.989689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:26.008423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.009286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.011378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.015443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.017301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.024774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.449945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.458799 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43f0058d-79fa-47c6-befd-76cb7cc9c7e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.676022 Oct 18 13:34:26.484692 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1404/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:26.839125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:26.839759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:26.857495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.857907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.863728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.864298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.864792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.865240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.406452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.415721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.417271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.463295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a062779b-48b2-4883-a320-f6272714cf03 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.627937 Oct 18 13:34:27.486847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1405/2795] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:26 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:27.549119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:27.549831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:27.563474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.564045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.564654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.566272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.566973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.568573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.767008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.776315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-caff75bd-c90e-4980-9b43-a46c9bc95388 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1525 microversion: 2.1 time: 1.795601 Oct 18 13:34:27.780604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1391/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1525 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:27.790837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:27.793366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:27.813843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.820715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.825806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.833014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.833014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.833014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.936121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.946832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e682c44-1f5e-432f-b67c-f39afa47217c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1450 microversion: 2.1 time: 0.458377 Oct 18 13:34:27.947829 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1406/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:27 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1450 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:27.956772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5c8991-f839-43be-986d-84d1a2a0162e", "name": "network-vif-deleted", "tag": "0ffba97f-103c-460f-a4bb-c0584010e717"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:27.972239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.985264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.985264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.007613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] Creating event network-vif-deleted:0ffba97f-103c-460f-a4bb-c0584010e717 for instance 3a5c8991-f839-43be-986d-84d1a2a0162e on n-h1-858383-13 Oct 18 13:34:28.058258 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a8c81441-ffcd-4816-b30b-3adde6b5a1cb req-4b956332-d3f1-4b79-b8bb-5daaacc2cf83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109038 Oct 18 13:34:28.068490 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1407/2798] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:28.143041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.155123 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-437fc84d-b505-4dca-a350-5e11256a2b54 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.372375 Oct 18 13:34:28.155914 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1392/2799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:27 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:28.525193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.526189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.548873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.551865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.553535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.555415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.556153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.556602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.661534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.671828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.674203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.680957 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a70274a-d81d-4a3d-9db8-47d02a3315b8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.171280 Oct 18 13:34:28.682211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1408/2800] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:28 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:28.808709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.810100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.820586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.821427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.822279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.823719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.824474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.825406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.922852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.923725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.924323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.924933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lazy-loading 'fault' on Instance uuid 8c3ce823-ba54-4b1d-b7bd-a171bb090988 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:28.975001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.975651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.986342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.988515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.988515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.989711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.990809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.991748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.064276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.066696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.067214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.067615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.067758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 3a5c8991-f839-43be-986d-84d1a2a0162e {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:29.083862 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-384dc29a-bd8b-4a30-ad3a-736f11d5cff6 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1314 microversion: 2.1 time: 0.277228 Oct 18 13:34:29.087360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1393/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:28 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:29.144038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.154564 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01ce0a19-e771-46d9-b958-7246ba50d8c7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 200 len: 1304 microversion: 2.1 time: 0.185461 Oct 18 13:34:29.157762 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1409/2802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:28 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:29.184935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:29.185814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:29.196494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.197248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.201773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.201773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.201773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.201773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.490312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.508081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c740e1a-2fdc-468d-8014-87bd79dc6753 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.324685 Oct 18 13:34:29.525524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1394/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:29 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:29.716028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:29.717660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:29.733572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.741810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.742899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.745228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.746190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.746946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.846324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.859154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.861278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.867462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ada2392-5ffd-4895-824c-10db42cd83de tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.158089 Oct 18 13:34:29.868852 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1410/2804] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:29 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:30.111216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.112016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.136420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.136420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.136584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.137257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.137721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.146565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.149714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c3ce823-ba54-4b1d-b7bd-a171bb090988", "name": "network-vif-deleted", "tag": "afb1ec0f-36fc-48ea-9c44-3ab7653aaec7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:30.171626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.172459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.173822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.190936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.191469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.192758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.193900 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] Creating event network-vif-deleted:afb1ec0f-36fc-48ea-9c44-3ab7653aaec7 for instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 on n-h1-858383-13 Oct 18 13:34:30.194347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lazy-loading 'fault' on Instance uuid 8c3ce823-ba54-4b1d-b7bd-a171bb090988 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:30.203951 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-23ec3d8e-e561-4b3c-90ac-6e2bad0df755 req-06c47052-7577-4c62-b308-2fff43a4a30a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059531 Oct 18 13:34:30.205384 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1411/2805] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:30.213986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.215170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.225448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.226569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.227796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.228759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.229881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.230568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.264528 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:34:30.265249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2516c291f2ea471abedff1b8338c9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4076eed4bf4278a4cbf18296bc66f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e HTTP/1.1 Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:34:30.267420 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:34:30.268689 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3a5c8991-f839-43be-986d-84d1a2a0162e'} Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:30.269375 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:34:30.270884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:30.274555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:30.275885 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-282749f8-076c-46f0-8064-004afb4dbf3e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 404 len: 111 microversion: 2.1 time: 0.069095 Oct 18 13:34:30.281338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1412/2806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:30.293286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff61ecd1-81a8-4ce5-a5d6-fe7efab5e373 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 200 len: 1314 microversion: 2.1 time: 0.186631 Oct 18 13:34:30.296401 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1395/2807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:30.489197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1624009735", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:30.539873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.540738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.549994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.551820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.564368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.565373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.566483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.569031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.587887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:34:30.774206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.782843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76ecf922-e148-41c5-bae7-ad0375806847 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.248000 Oct 18 13:34:30.784196 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1396/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:30.902097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.903014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.919007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.919147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.919601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.920499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.920966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.923357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.024973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.040941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.044609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.059938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57451da1-f109-4de1-a173-0aea28ccb922 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.163055 Oct 18 13:34:31.061594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1397/2809] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:31.326505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.328408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] [instance: 8c3ce823-ba54-4b1d-b7bd-a171bb090988] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.340133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.341062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.342312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.343346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.344108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.344747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.362702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] HTTP exception thrown: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Request method failure captured: Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 HTTP/1.1 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqs6-Ln9axLLqxofX8s5bMe-UmOXg60oYP9sxOWz46rj9hDzda1uTpB5NzSMWUci8GCMhLwYAVAxkraHDLYrxnq2ONUHpAIUE-_CRdoVeUCOOxflAkTZs1DRihs8vygyzxSPeFJlRjCSoT82Gy53ujFiUf-RRUtjz2FMZkAeXoVK-UQ Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:34:31.364380 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be4076eed4bf4278a4cbf18296bc66f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: be4076eed4bf4278a4cbf18296bc66f8 Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-800731502 Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2516c291f2ea471abedff1b8338c9ee4 Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-800731502-project Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. Oct 18 13:34:31.365651 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '8c3ce823-ba54-4b1d-b7bd-a171bb090988'} Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:31.366390 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. Oct 18 13:34:31.367498 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.368741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] Returning 404 to user: Instance 8c3ce823-ba54-4b1d-b7bd-a171bb090988 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:31.368741 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-714a3023-9a7e-4ebd-b53b-45596e745b26 tempest-ServerAddressesNegativeTestJSON-800731502 tempest-ServerAddressesNegativeTestJSON-800731502-project] 10.222.0.27 "GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988" status: 404 len: 111 microversion: 2.1 time: 0.051591 Oct 18 13:34:31.376087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1398/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/8c3ce823-ba54-4b1d-b7bd-a171bb090988 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:31.823762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.823762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.823762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.824025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.824461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.826986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.830273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.831422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.138983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:32.138983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:32.138983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:32.138983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:32.138983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:32.141627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.141627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.141627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.141627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.141931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.141931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.141931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:34:32.141931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:34:32.141931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:32.142297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:34:32.142297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:34:32.142449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.142449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e030bd1-f9b6-4daf-813b-f76d8e8fa2b0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.268409 Oct 18 13:34:32.142449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1399/2811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:32.142449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:32.142740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:32.142740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.142740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.142740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.143012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.143012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.143012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.231349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.254450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.257373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.270603 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9e2c096-aec9-4499-85a5-8916a6357a25 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.182972 Oct 18 13:34:32.281814 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1400/2812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:32 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:32.367368 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f52c20e-4532-4228-b389-2512e83422b5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883405 Oct 18 13:34:32.380869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-04bff85a-1a88-4d2b-a65e-e66a45f9673c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:32.381496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-04bff85a-1a88-4d2b-a65e-e66a45f9673c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:32.386469 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1413/2813] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:34:32.466233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-04bff85a-1a88-4d2b-a65e-e66a45f9673c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.481176 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-04bff85a-1a88-4d2b-a65e-e66a45f9673c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1215 microversion: 2.1 time: 0.104696 Oct 18 13:34:32.498159 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1401/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:32 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:33.168472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:33.169038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:33.182513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.183353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.184169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.185448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.189302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.190496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.315274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:33.316353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:33.338267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.338828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.339691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.340416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.345718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.346418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.461270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.478668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.480626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.482777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.489698 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22ce9d89-d506-4058-8eba-2e64569c7114 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.182314 Oct 18 13:34:33.503515 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cfa3b39-acce-4094-92a0-057ed62bbac6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.340411 Oct 18 13:34:33.526224 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1414/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:33 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:33.526224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c7305cf-5225-47ef-a78d-1562c317d6ac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:33.526224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c7305cf-5225-47ef-a78d-1562c317d6ac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:33.526732 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1402/2816] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:33 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:33.621936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c7305cf-5225-47ef-a78d-1562c317d6ac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.629573 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c7305cf-5225-47ef-a78d-1562c317d6ac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1215 microversion: 2.1 time: 0.122587 Oct 18 13:34:33.633251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1415/2817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:33 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:34.525292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:34.525920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:34.538505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.539005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.539453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.541217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:34.541945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:34.542723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.546014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.546498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.578166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.578972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.584011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.587442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.592077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.592077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.724728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.778109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.780282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.787808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-771690b7-d2ca-4a8a-9bd8-a9510040739b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.266798 Oct 18 13:34:34.788723 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1403/2818] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:34 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:34.802791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:34.803709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:34.813919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.814465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.814922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.815643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.816112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.823029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.120606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.140504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.148950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be46aab4-8a37-4636-99b8-2dace7e68b48 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1211 microversion: 2.1 time: 0.358984 Oct 18 13:34:35.149497 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1404/2819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:34 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1211 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:35.149934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-162aaab4-c4f7-49fa-8e7a-2324edd49967 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.613072 Oct 18 13:34:35.155821 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1416/2820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:34 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:35.823566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:35.824872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:35.842422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.844153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.846007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.850435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.853024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.853936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.994814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.007890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.013807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.023235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eeb5c9b9-03fd-4be6-8cc9-0123aedb7cbd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.208209 Oct 18 13:34:36.038922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1405/2821] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:35 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:36.188135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:36.191107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:36.196203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:36.198667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:36.214622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.215299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.215917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.216054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.216493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.217123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.220928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.221856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.233659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.235337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.239716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.240486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.271034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:36.447456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.466246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e7d43029-ada3-42eb-8728-d761fcaee01e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1275 microversion: 2.1 time: 0.280990 Oct 18 13:34:36.468574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1406/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:36 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:36.771089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.783160 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f94cb535-eaa5-43d3-8f8a-2c1682e368e3 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.598301 Oct 18 13:34:36.784055 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1417/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:36 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:37.061549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.064243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.088899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.093128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.096221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.098268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.098777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.099232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.299142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.299142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.318395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.339578 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4462e176-ffe3-46e4-a8a5-e80a1e6f005c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.284184 Oct 18 13:34:37.341054 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1407/2824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:37.501278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.501278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.518135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.519139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.520359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.521256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.521912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.522536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.687873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.698891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7984ff0-76e6-4a15-8a14-9865da66897c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1273 microversion: 2.1 time: 0.206386 Oct 18 13:34:37.700241 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1418/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:37.813630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.814637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.827898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.829864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.833648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.833648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.834381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.836204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.386182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.388172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.394306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.411390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.414467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.414467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.414467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.414467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.416073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.430784 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ebcde5f-f111-4b0c-922e-fc78cb43dd40 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.616318 Oct 18 13:34:38.474544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1408/2826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:38.561221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.572878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.585014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.607919 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a0b3854-d1d7-4b67-9d0a-741ee3d6da84 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.226121 Oct 18 13:34:38.613295 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1419/2827] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:38.731169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.731643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.741983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.743159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.750398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.750398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.750398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.750398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.468695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.468695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.486559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.487063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.487504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.488251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.488714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.489142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.760348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.769045 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-483c4b51-c58c-4a69-961e-03f0787cb329 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 1.044836 Oct 18 13:34:39.782870 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1409/2828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:39.795517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.796397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.805345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.806178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.806812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.807690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.808340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.808932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.913688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.940477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-185be6de-1dd6-4a61-ba2b-a72a66398717 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.485207 Oct 18 13:34:39.942320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1420/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:39.945826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.948678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a12835-770c-415c-b9fa-1d83441ed180", "name": "network-vif-unplugged", "status": "completed", "tag": "41f383b6-17db-4923-99ca-cb04dd940d82"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:39.961470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.962640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.963237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.968469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.969459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:39.973097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.985695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6740529b-1ddc-484d-ba81-fe19992e3bfe tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.201255 Oct 18 13:34:39.996642 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] Creating event network-vif-unplugged:41f383b6-17db-4923-99ca-cb04dd940d82 for instance 77a12835-770c-415c-b9fa-1d83441ed180 on n-h2-858383-13 Oct 18 13:34:39.997476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1410/2830] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:40.013645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cc7f25aa-1cab-43a0-a7d8-115dda79da57 req-08e690cb-c0cd-417c-88b7-19ceb540ee5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069874 Oct 18 13:34:40.014705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1421/2831] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:40.800525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:40.801323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:40.821760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.823860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.825085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.829214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.830934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.833268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.971388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:40.972254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:40.998517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.004735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.008445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.012447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.018439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.021851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.414167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.424232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6b6e3e14-5289-4077-a968-705e5d0105d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.628250 Oct 18 13:34:41.430753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1411/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:40 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:41.444173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:41.449415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:41.464352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.465183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.466004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.466947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.469872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.470558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.598717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.607564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.614650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.627313 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a10d25d5-e0da-41b6-8395-8e44710c0f87 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.195039 Oct 18 13:34:41.630800 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1412/2833] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:41 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:41.865275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.895406 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ddc39bba-344f-47d3-adac-4886b69be61f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.928703 Oct 18 13:34:41.898993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1422/2834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:40 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:42.444132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a12835-770c-415c-b9fa-1d83441ed180", "tag": "41f383b6-17db-4923-99ca-cb04dd940d82"}, {"name": "network-changed", "server_uuid": "32e53d5f-47cd-451c-a1b8-c23e38bbd79b", "tag": "f6a02608-3703-414b-b2de-ba571a97a3e2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:42.455090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.456753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.476882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:42.488299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.489338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.489807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:42.491310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.497858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.502221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.505310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.508464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.513833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.516193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.563061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Creating event network-changed:41f383b6-17db-4923-99ca-cb04dd940d82 for instance 77a12835-770c-415c-b9fa-1d83441ed180 on n-h2-858383-13 Oct 18 13:34:42.564431 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] Creating event network-changed:f6a02608-3703-414b-b2de-ba571a97a3e2 for instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b on n-h1-858383-13 Oct 18 13:34:42.583643 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40c43a5d-442e-44b7-a773-66bd3c0694c5 req-e72d8c74-a4bd-4e7c-b0f9-876545027956 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.498401 Oct 18 13:34:42.584905 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1413/2835] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:42.672656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.675213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.689448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.698936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.699827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.701619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.703254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.704134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.875242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.890550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.892891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.905341 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f15934c-efd6-418a-8774-b82dec2a849c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.243949 Oct 18 13:34:42.907724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1414/2836] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:42.937564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.938309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.951081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.951594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.952079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.952753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.953212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.953641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.196435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.206270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-04f7c321-1250-4966-8ca3-61660188cc4e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.284860 Oct 18 13:34:43.210950 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1415/2837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:43.229016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.254144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c363378-d5c1-442f-bcc9-784b9d6626de tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.789347 Oct 18 13:34:43.255475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1423/2838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:43.941082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.941763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.944912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:43.969128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.969954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.970595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.971803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.972554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.973734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.086719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.102968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.105896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.121547 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ecd7023-d74e-4df8-9044-b3430a4a147a tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.185970 Oct 18 13:34:44.122672 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1424/2839] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:44.136136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46378136-fada-4806-8bb8-d9c80531e513 tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Calling method '.version_select at 0x7fb33054e040>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.235163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.236029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.242461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.243709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.244327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.245229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.245853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.246357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.274137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46378136-fada-4806-8bb8-d9c80531e513 tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.594685 Oct 18 13:34:44.276345 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1416/2840] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:34:44.282033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.282705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.296238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.297280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.298146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.299185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.299870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.300624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.445670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.457498 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-219989f0-2ac1-457d-9ce3-b2b998c3b1f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.227021 Oct 18 13:34:44.473441 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1425/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:44.476651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-037b6619-b2a1-4808-b48c-4592fc518e9f tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Action: 'create', calling method: .version_select at 0x7fb335432c10>, body: {"pool": "non_exist_pool"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:44.510397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-037b6619-b2a1-4808-b48c-4592fc518e9f tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] HTTP exception thrown: Floating IP pool not found. Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-037b6619-b2a1-4808-b48c-4592fc518e9f tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Request method failure captured: Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 26 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqtzgTTcT8cxxCvmGnNAb_SGywRHse7iJs39dVKvQqckvrnRvUDaNsuG2nd3zB7ouiupQgNHKLbKxRyP1w9VmPSm4XBOjf-l70xUaQBi0RCJbHGvNQT38tXb3KOtsyePXBo0s5AkAfq6hGtYJa-B0WAFX0Tvv9t2_3vLzoWsI11T3UI Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fe0519cdc60d4673bed0904aa677e230 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:34:44.512384 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fe0519cdc60d4673bed0904aa677e230 Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsNegativeTestJSON-24330241-project Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8b815207c9b44c53bbe617384fbed8c6 Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-24330241-project Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: {"pool": "non_exist_pool"} Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: exception: Floating IP pool not found. Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 18 13:34:44.513906 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:44.515373 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-037b6619-b2a1-4808-b48c-4592fc518e9f tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Returning 404 to user: Floating IP pool not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:44.516903 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-037b6619-b2a1-4808-b48c-4592fc518e9f tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.054343 Oct 18 13:34:44.519671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.520704 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1426/2842] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:34:44 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:44.525917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.531618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.532430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Searching by: {'deleted': False, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:34:44.539303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.539888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.540477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.541367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.541900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.542325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07db709f-6c5f-4659-823c-10543e538b3c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.263191 Oct 18 13:34:44.542467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.543658 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1417/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:44.566090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Calling method '.version_select at 0x7fb330642790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.595593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:34:44.646914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c98f98d9-3f3c-406c-8673-b55087c0bfa2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.125056 Oct 18 13:34:44.647709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1427/2844] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:44.662117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.667563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.668363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Searching by: {'deleted': False, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:34:44.682557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.682557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.683070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.683734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.684199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.684731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.688084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d420e53-81d9-4d43-ba1a-26df33b0f681 could not be found", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:34:44.689854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] HTTP exception thrown: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Request method failure captured: Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-floating-ips/1d420e53-81d9-4d43-ba1a-26df33b0f681 HTTP/1.1 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqtzgTTcT8cxxCvmGnNAb_SGywRHse7iJs39dVKvQqckvrnRvUDaNsuG2nd3zB7ouiupQgNHKLbKxRyP1w9VmPSm4XBOjf-l70xUaQBi0RCJbHGvNQT38tXb3KOtsyePXBo0s5AkAfq6hGtYJa-B0WAFX0Tvv9t2_3vLzoWsI11T3UI Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fe0519cdc60d4673bed0904aa677e230 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:34:44.697729 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0519cdc60d4673bed0904aa677e230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fe0519cdc60d4673bed0904aa677e230 Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-24330241 Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsNegativeTestJSON-24330241-project Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 8b815207c9b44c53bbe617384fbed8c6 Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-24330241-project Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: exception: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681 Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1d420e53-81d9-4d43-ba1a-26df33b0f681'} Oct 18 13:34:44.699385 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:34:44.700344 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1d420e53-81d9-4d43-ba1a-26df33b0f681 could not be found Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ead74b1c-74f4-4c50-8f0e-ec102ed43a2e'] Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681. Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:44.701613 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681 Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:44.702938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:44.704277 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681 Oct 18 13:34:44.704277 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:34:44.707531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] Returning 404 to user: Floating IP not found for ID 1d420e53-81d9-4d43-ba1a-26df33b0f681 {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:44.711057 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f07ea9cb-a90b-44b8-8c85-6baa1278e1ac tempest-FloatingIPsNegativeTestJSON-24330241 tempest-FloatingIPsNegativeTestJSON-24330241-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/1d420e53-81d9-4d43-ba1a-26df33b0f681" status: 404 len: 111 microversion: 2.1 time: 0.164728 Oct 18 13:34:44.714517 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1418/2845] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:34:44 2022] DELETE /compute/v2.1/os-floating-ips/1d420e53-81d9-4d43-ba1a-26df33b0f681 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:44.755747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:34:44.942598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.958074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.962013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.962693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.156566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.157536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.181169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.185729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.185729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.185729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.185729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.188187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.258850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cee56714-f6b8-441e-9a1e-524682033f82 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.600703 Oct 18 13:34:45.259465 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1428/2846] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:45.294598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90ca2370-aea8-402d-8c65-b58c8f2fb090 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.305951 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90ca2370-aea8-402d-8c65-b58c8f2fb090 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015226 Oct 18 13:34:45.324870 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1429/2847] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:45.488504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.488699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.488831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.497050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.502017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.507677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.508192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.508678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.516147 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23eafc85-59a8-4580-9782-9ac15ddcd098 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.365130 Oct 18 13:34:45.520981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1419/2848] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:45.522615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.523759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.523872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.574047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.575165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.589805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.595934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.596736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.598776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.599862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.602969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.944473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.960339 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01c04e7b-75b3-44c1-9ef1-fbc896f812f4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.480772 Oct 18 13:34:45.977376 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1430/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:45.998079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.998441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.999362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.010519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.010846 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3058e88f-a52e-4cd9-9583-b1568040c610 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.438240 Oct 18 13:34:46.012644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1420/2850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:46.016659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.021749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.024767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.025378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.025841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.097841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:46.515883 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfed5ad4-4bb4-4204-9af0-6943d5fa4e89 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 204 len: 0 microversion: 2.1 time: 0.536700 Oct 18 13:34:46.517723 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1431/2851] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:45 2022] DELETE /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:46.525782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.526962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.539615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.540700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.541098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.541960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.554262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.555245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.557733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.559418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.571387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.575147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.575923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.577656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.580094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.583526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.741075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.754459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.756237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.769948 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-231385c2-9abc-457f-9674-44bb95345c5b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.220119 Oct 18 13:34:46.793963 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1432/2852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:46.892410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.903052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c8a57aa-3f6d-489b-bd15-b9814a5d918e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1607 microversion: 2.1 time: 0.380875 Oct 18 13:34:46.916306 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1421/2853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1607 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:46.991658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.992281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.000276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.000776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.001221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.001929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.007296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.009899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.040465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.041156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.074041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.076403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.077031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.080245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.080921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.085772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.310676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.320961 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58b1248b-b415-46a2-bd5b-2db5490a0444 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.285524 Oct 18 13:34:47.322362 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1422/2854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:47.438757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.449203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00257cee-66db-45bf-a00d-3642b311e35d tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.461612 Oct 18 13:34:47.463595 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1433/2855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:47.800704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.801937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.809050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.809973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.810163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.810906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.811353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.811791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.890155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.935559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.936358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.940170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.949393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.963721 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b647233e-889e-42cb-b1b3-65ce6b2f1b7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.166881 Oct 18 13:34:47.970028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.971397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.974108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.975531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1423/2856] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:47.976114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.978271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.979789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.344763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:48.345389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:48.357703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.358706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.359153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.359879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.360339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.360771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.058655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.083018 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f34e0cd-462c-45fc-9efd-0bc9a5d3168b tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1607 microversion: 2.1 time: 1.154377 Oct 18 13:34:49.091078 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1434/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1607 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:49.099878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:49.104302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:49.130828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.134106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.134106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.134106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.135006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.135695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.263103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.275191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e2556cbf-f7c1-43f3-8e39-ec5b07b22635 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.934206 Oct 18 13:34:49.296686 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1424/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:48 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:49.302637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:49.306084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:49.325681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.336923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.343810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.348650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.350993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.357626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.517568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.521718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:49.528453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.530316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.538919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34cf4369-669c-4e24-b10d-c367d0da8380 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.240656 Oct 18 13:34:49.582960 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1425/2859] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:49 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:49.659795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.688268 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed7081ba-730d-4970-aacd-191d29156815 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.595174 Oct 18 13:34:49.689207 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1435/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:49 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:49.727715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e53d5f-47cd-451c-a1b8-c23e38bbd79b", "name": "network-vif-plugged", "status": "completed", "tag": "f6a02608-3703-414b-b2de-ba571a97a3e2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:49.744052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.745328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.745966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.766112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] Creating event network-vif-plugged:f6a02608-3703-414b-b2de-ba571a97a3e2 for instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b on n-h1-858383-13 Oct 18 13:34:49.773274 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-aed47dc2-5db8-449c-9151-42de093cad1d req-ff855125-b134-44bb-9819-192254d3ffdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183578 Oct 18 13:34:49.774601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1426/2861] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:50.120847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.121829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.135941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.138040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.139283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.143734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.144344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.145696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.277786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9449e095-733e-4b47-955d-617283ec5534 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Action: 'create', calling method: .version_select at 0x7fb335369040>, body: {"keypair": {"name": "tempest-keypair-968000777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHytTT6t1m15Q75+nnKvAniLJpaOW1i8q3mi9/hYaMxjgObZIEYDHLN0vBRIeo2dAmldh8IqFRrb9jY7zxjQ9P2DqP8cF1K+mMhHQFKvwpJUNWsl9C3uGPPnDgwh/yFdeQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:50.306829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9449e095-733e-4b47-955d-617283ec5534 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Getting quotas for project fa2e6c5545cd41cc99079ee7f2a9ff6c. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:34:50.323132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9449e095-733e-4b47-955d-617283ec5534 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Getting quotas for user 3fd1e93724564bf18a8d3a15c12169dc and project fa2e6c5545cd41cc99079ee7f2a9ff6c. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:34:50.465982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9449e095-733e-4b47-955d-617283ec5534 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.408516 Oct 18 13:34:50.467905 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1436/2862] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:34:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:50.477546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.479010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.490220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.491286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.496495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.496495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.496495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.496495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.601735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.614599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-229cc146-84d5-4472-a3f1-91e85a7bd2e7 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1607 microversion: 2.1 time: 0.496455 Oct 18 13:34:50.615214 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1427/2863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1607 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:50.620316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.626749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.640261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:50.644198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.644855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.645350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.650182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.650182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.650182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.786148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.795830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.802331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.819931 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b626e236-d33c-4e4f-af14-63ade7e04a3b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.203448 Oct 18 13:34:50.820917 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1428/2864] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:50.835476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.836404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.849054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.849829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.850717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.856918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.856918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.856918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.933069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.944193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54454a15-5942-4499-9433-22aa260165cc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1315 microversion: 2.1 time: 0.474576 Oct 18 13:34:50.955333 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1437/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:51.098736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.108678 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-efce39c5-114b-4e59-bc7e-4a34ac8a957f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.286930 Oct 18 13:34:51.123446 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1429/2866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:51.644333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:51.646869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:51.653380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.653883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.654381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.655086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.655540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.656141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.853715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:51.854546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:51.861962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.862946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.864813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.866199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.866672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.867260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.896720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.903151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:51.933971 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b055cb51-5a12-4095-9010-51434646326a tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1539 microversion: 2.1 time: 0.272733 Oct 18 13:34:51.934746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1438/2867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:51 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:51.972117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:51.977244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:51.987540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.989524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.990307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.991258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.992926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.993864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.051907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.061977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.063919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.070329 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a203cea8-3064-432d-87ac-90dd9ea58d7d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1558 microversion: 2.91 time: 0.222127 Oct 18 13:34:52.071692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1430/2868] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:51 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:52.141336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:52.142278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.154149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.164907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.166253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.168781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.176834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.176834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.402768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.415693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f5ceeb2-93c5-4c3d-85fb-00efe1da06d8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1502 microversion: 2.1 time: 0.450212 Oct 18 13:34:52.423147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1439/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:51 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1502 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:52.449155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:52.451712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.463473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.463998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.464454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.465189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.465664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.467611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.515008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'flavor' on Instance uuid 32e53d5f-47cd-451c-a1b8-c23e38bbd79b {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:52.653714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.672303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6381a781-8dd2-4185-9ece-e31b42df1506 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.536715 Oct 18 13:34:52.677736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1431/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:52 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:52.786309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a812b4b0-8e2a-4e46-8443-a0e0dc36a742", "name": "network-vif-deleted", "tag": "e9e05584-8df4-45a0-8270-f3a4e0084472"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:52.799779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.801111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.801760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.833412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] Creating event network-vif-deleted:e9e05584-8df4-45a0-8270-f3a4e0084472 for instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 on n-h1-858383-13 Oct 18 13:34:52.839617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-dee4f6d8-f1c1-49eb-9c31-150d168a17e0 req-92ba6b38-59ce-45a8-84a6-11088e9690f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056614 Oct 18 13:34:52.840925 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1432/2871] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:52.961134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:52.961765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.983054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.984022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.984501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.987856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.989042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.989479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.263590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.285799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4266b5d5-e103-48da-870b-3d1c37919c22 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.329589 Oct 18 13:34:53.288798 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1433/2872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:52 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:53.305959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.310479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.322935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.323448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.323902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.324619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.329744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.338802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.614221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.626169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.633196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.646808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-87c51671-a9e8-4649-ac5b-169b88664e3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1558 microversion: 2.91 time: 0.356345 Oct 18 13:34:53.658346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1434/2873] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1558 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:53.666134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bfd4dbeb-01b3-43fc-a448-c2282d0e289a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b/action" status: 202 len: 0 microversion: 2.1 time: 1.223574 Oct 18 13:34:53.667208 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1440/2874] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:52 2022] POST /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:53.680654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.681756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.692406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.694891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.696799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.698467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.705752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.707404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.711918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.714016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.734280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.734991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.735968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.739883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.743225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.748916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.129984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.141507 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f418fb3-7200-497d-8279-a87633114b1a tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.440317 Oct 18 13:34:54.143456 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1441/2875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:54.315214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.316164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.332014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.350771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.359079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.360129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.360568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.361355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.473240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.510105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07d58cd9-069b-42b7-b97a-09a424aa9265 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.829255 Oct 18 13:34:54.514736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1435/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:54.591252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.607648 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02ebd0c8-e1b6-404c-b39b-4202ce02fae5 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.297925 Oct 18 13:34:54.613495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1442/2877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:54.685563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.686677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.702788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.703570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.704309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.705222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.705975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.706600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.850948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.860636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.865485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.877458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1f163dbd-c984-403b-80e8-4ab673e64377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.196573 Oct 18 13:34:54.882239 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1436/2878] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:55.173741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.174993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.178298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:55.194976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.198590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.199389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.200740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.203966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.204445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.549016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.549963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.567845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.570434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.571531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.575808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.576619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.581342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.690432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.704879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b1336fd-e620-4bb3-b37a-14a8ee614d2e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1392 microversion: 2.1 time: 0.534870 Oct 18 13:34:55.706872 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1443/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:55.722801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.723484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.736730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.739447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.740881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.743533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.744556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.745440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.964708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.977001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24c8314e-c9cd-4aae-8254-c5838d75ae2d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.441539 Oct 18 13:34:55.980455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1437/2880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:56.025843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.028889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.053619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.054291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.054820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.059787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.060734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.061379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.218520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.234277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.240345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.247581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f092e697-a968-4c6b-834b-9b19295a93f7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.235648 Oct 18 13:34:56.270652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1438/2881] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:56 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:56.681117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.690496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8ce0a29-3e84-4b90-97b5-3ee75c937345 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.982445 Oct 18 13:34:56.694362 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1444/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:56.742631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.748078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.778155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.780443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.780443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.780443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.781456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.782081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.009387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.010116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.025717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.026497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.027220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.028143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.028819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.029465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.099328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.111586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2fe353a8-c462-4d1b-a00e-5a18c4290ab7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1382 microversion: 2.1 time: 0.381060 Oct 18 13:34:57.114394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1439/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:56 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1382 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:57.141617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5d13f39-fb27-479a-8fce-8fc8381c605e tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '.version_select at 0x7fb3305ac790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.146032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d13f39-fb27-479a-8fce-8fc8381c605e tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.146558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d13f39-fb27-479a-8fce-8fc8381c605e tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.148165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d13f39-fb27-479a-8fce-8fc8381c605e tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.168551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5d13f39-fb27-479a-8fce-8fc8381c605e tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.026904 Oct 18 13:34:57.170022 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1440/2884] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:57.192179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.195260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.221115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.226281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.226817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.230525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.231037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.232883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.539282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36ed6849-8f92-4ffd-b069-01b8e4e3275c tempest-LiveMigrationTest-762036868 tempest-LiveMigrationTest-762036868-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1535 microversion: 2.1 time: 0.356524 Oct 18 13:34:57.558083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1441/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1535 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:57.558083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.558083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.581100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.583791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.584317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.585076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.585559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.587070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.673379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.684045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.686228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.692141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d87e1e92-33ad-4960-91ab-8216a61688e4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.148432 Oct 18 13:34:57.693178 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1442/2886] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:57.698548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.699036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.705403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.705904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.706394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.707232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.709211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.709689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.752615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:57.811462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:57.851053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.864687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a9fb2cd-08ff-4354-98b2-756ad37d92e7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.859220 Oct 18 13:34:57.867576 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1445/2887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:57.876890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.877503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.886606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.887286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.887891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.888964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.889605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.890233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.087905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0441b4ae-caae-4c16-bd46-66bf7bdbb442 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 204 len: 0 microversion: 2.1 time: 0.393449 Oct 18 13:34:58.098308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.099087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1443/2888] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:57 2022] DELETE /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:58.108388 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e72fe42-8830-4e0f-95c5-ec8cf0f02cc2 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.237451 Oct 18 13:34:58.118894 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1446/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:58.119812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:58.122661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:58.147086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.151869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.152635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.153884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.154564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.157034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.157560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1382741738", "imageRef": "4d2b8f46-0f5a-46ef-ac03-cd4d685967b6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "085bb2f3-4770-4ddb-a215-106df08c3058"}], "security_groups": [{"name": "tempest-securitygroup--1229147217"}], "key_name": "tempest-keypair-968000777", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:58.430922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] validate_networks() for [('085bb2f3-4770-4ddb-a215-106df08c3058', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:34:58.567796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.576028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3cfeb99a-6984-4669-85ed-9a7d59adb9cc tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1388 microversion: 2.1 time: 0.470984 Oct 18 13:34:58.590635 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1444/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:58 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1388 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:58.723897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:58.724612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:58.739487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.740162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.740691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.741397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.742095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.742560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.986816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.996730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.006379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.013336 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80c48ec5-76ee-4adc-a74f-bbcdecbbf9be tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.293414 Oct 18 13:34:59.027358 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1445/2891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:58 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:59.036670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:59.036670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:59.061671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.068510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.069049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.069815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.070325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.070819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.912352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:59.913318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:59.914303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:59.915023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:59.915640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:59.921035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:59.937790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.943984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.943984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.945033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.951436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.952233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.997175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Getting quotas for project fa2e6c5545cd41cc99079ee7f2a9ff6c. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:00.018154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Getting quotas for user 3fd1e93724564bf18a8d3a15c12169dc and project fa2e6c5545cd41cc99079ee7f2a9ff6c. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:00.062749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:35:00.065546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2b8f46-0f5a-46ef-ac03-cd4d685967b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:35:00.274357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.283378 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d7577e16-107e-4467-982f-7ac566bbaad4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 1.261455 Oct 18 13:35:00.299805 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1446/2892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:59 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:00.342092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.344482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.349306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c3ec1de-aed1-46de-ba1b-780294086e72 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.196174 Oct 18 13:35:00.357595 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1447/2893] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:35:00.363632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.366805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.368358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.368589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.369351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.369474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.371977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.373186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.378600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.379857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.381051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.382329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.385179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.385782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.600552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.616598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a258ce0-c58d-4281-a50b-9c636ca5d3df tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.309446 Oct 18 13:35:00.633555 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1447/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:00.644073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.649629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.652942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.665498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.667518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.669068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.670023 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc91d7ec-2a6e-4c4d-aba8-caad47e219cf tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1346 microversion: 2.1 time: 0.310881 Oct 18 13:35:00.670454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.672336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.672843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.680750 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1448/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1346 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:00.698720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a12835-770c-415c-b9fa-1d83441ed180", "name": "network-vif-deleted", "tag": "41f383b6-17db-4923-99ca-cb04dd940d82"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:00.720678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.721163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.721604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.761054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] Creating event network-vif-deleted:41f383b6-17db-4923-99ca-cb04dd940d82 for instance 77a12835-770c-415c-b9fa-1d83441ed180 on n-h1-858383-13 Oct 18 13:35:00.773236 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d836a5dd-6224-43a1-b290-7b08f543b243 req-b3c3d661-3532-49c6-9365-b538c18fb83b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090593 Oct 18 13:35:00.776846 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1449/2896] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:00.789228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c981bc3-1ecc-4e45-b239-edc90b287eaa tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.789956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c981bc3-1ecc-4e45-b239-edc90b287eaa tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.851683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.866225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.868325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.875081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82815e02-1263-4119-b702-05642f848bc6 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.240064 Oct 18 13:35:00.876050 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1448/2897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:00.922603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c981bc3-1ecc-4e45-b239-edc90b287eaa tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.936383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c981bc3-1ecc-4e45-b239-edc90b287eaa tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1245 microversion: 2.1 time: 0.159373 Oct 18 13:35:00.936988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1450/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:01.314005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.317267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.330102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.331703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.332171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.337197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.339225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.341713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.600568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.610482 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6b9861de-f20b-4679-80ad-8467ca1ad9b4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.301523 Oct 18 13:35:01.616746 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1449/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:01.648446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.649430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.662785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.666089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.673734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.673734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.673734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.673734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.700296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.701522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.723447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.723447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.723447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.723447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.723750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.723750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.929867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.945966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd6ab1d4-cab4-4496-9e90-042a2f83cf50 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.309921 Oct 18 13:35:01.953429 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1451/2900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:01.966442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.966442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.989085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.990067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.990557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.991753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.992245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.992688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.079627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.101188 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ae5d64ca-307d-4fa0-bb0f-2c4803663b66 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.404674 Oct 18 13:35:02.106985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.113684 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1450/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:02.136238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.137804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.142459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:02.143240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:02.155819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d64b2f4-1a17-41e2-8cf9-7d28fe83884e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.207675 Oct 18 13:35:02.156890 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1452/2902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:02.158336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.158854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.159310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.160076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.160552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.161073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.321711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.334915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41ff01d7-1b74-47d6-956e-1f4b440ec6b7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1249 microversion: 2.1 time: 0.220608 Oct 18 13:35:02.335503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1451/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:02 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1249 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:02.652149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:02.653158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:02.677979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.678639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.679524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.681302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.692540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.692540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.998750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.998750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d51b2d8-7680-40ae-b80e-508daad99ee4 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.340097 Oct 18 13:35:02.998750 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1453/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:02 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:03.008766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.009393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.023437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.023947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.025895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.031091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.032580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.035583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.088539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2047287739", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "7534b0cb-c028-44a3-9aad-292767e83412"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:03.167077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb4fc39da53465d9bf6262a60b9c922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a43ee032d0f403db4cb4223c63b7f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.179697 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40f21033-0473-4d57-89cd-3229b0556355 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 200 len: 1251 microversion: 2.1 time: 0.177203 Oct 18 13:35:03.190508 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1454/2905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:02 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 1251 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:03.226835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.227464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.236284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] validate_networks() for [('7534b0cb-c028-44a3-9aad-292767e83412', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:35:03.257839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.258371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.258820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.259524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.259985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.260414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.477878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.490152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:03.515001 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4169dde5-ba74-4895-b08f-5f225567ed84 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.310743 Oct 18 13:35:03.515001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1455/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:03.515001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.515001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.544420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.545059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.545789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.546871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.547536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.548429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.855051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.866795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.869121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.870889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cac655c6-1fd4-4a67-8b91-56cf07ff6b9b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2937 microversion: 2.32 time: 0.363492 Oct 18 13:35:03.871575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1456/2907] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2937 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:03.877307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.878530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.887231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.888045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.888865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.889804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.890703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.891954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.989559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.001702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.005221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.012851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78bc0533-f5fb-422d-930b-788804fd6b39 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.140136 Oct 18 13:35:04.013784 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1457/2908] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:04.031749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.032852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.056123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.059492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.059492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.059492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.059492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.059875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.179339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.193708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1256e57-8cf2-4951-b555-75d3349078f4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1297 microversion: 2.1 time: 0.178014 Oct 18 13:35:04.196073 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1458/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:04.199855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.200537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.207898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.208850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.209513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.210634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.211662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.212363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.524575 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c3463c3-6196-4fe5-b9fb-0a52f9dc5fca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.328871 Oct 18 13:35:04.525669 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1459/2910] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524/os-interface => generated 1830 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:04.530854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.531668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.548358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.568134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.568134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.568134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.572210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.573001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.001377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.022640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f489a557-35c1-4c42-b71c-5baa82ff9bc1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.495596 Oct 18 13:35:05.029125 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1460/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:05.040390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.052328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] [instance: a812b4b0-8e2a-4e46-8443-a0e0dc36a742] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.073997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.076097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.076670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.079551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.082222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.084820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.110251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:35:05.110251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:35:05.110700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:35:05.111039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:35:05.111651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:35:05.127420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] HTTP exception thrown: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Request method failure captured: Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 HTTP/1.1 Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqq9oeQI8CmFQqULeBCCpG9tkA-x_z_aEyfcVJyp2fkzYeK-rPWXOI88AVSRx3KEy5ShW-JKNbBocghDXWujOVdpNZcOuNVkwWeAKTihnr2mgwGi5Wmevgv3wrIWID8tLi-LE690ZLmpfMgeKzsgZrKxAFahz909jZmFY1ZNCFQKark Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9a43ee032d0f403db4cb4223c63b7f2e Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestBootFromVolume-269710658 Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:05.131126 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a43ee032d0f403db4cb4223c63b7f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a43ee032d0f403db4cb4223c63b7f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a43ee032d0f403db4cb4223c63b7f2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a43ee032d0f403db4cb4223c63b7f2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestBootFromVolume-269710658 Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9a43ee032d0f403db4cb4223c63b7f2e Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestBootFromVolume-269710658 Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestBootFromVolume-269710658-project Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: cfb4fc39da53465d9bf6262a60b9c922 Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestBootFromVolume-269710658-project Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. Oct 18 13:35:05.139930 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a812b4b0-8e2a-4e46-8443-a0e0dc36a742'} Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:05.141472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. Oct 18 13:35:05.143385 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:05.145408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Returning 404 to user: Instance a812b4b0-8e2a-4e46-8443-a0e0dc36a742 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:05.145408 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-776a8ec5-252d-41ab-bb4a-45db49b27b6e tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742" status: 404 len: 111 microversion: 2.1 time: 0.104604 Oct 18 13:35:05.145408 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1461/2912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/a812b4b0-8e2a-4e46-8443-a0e0dc36a742 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:05.150841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.151604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.166351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.167063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.167632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.168629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.169215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.169759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.179267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.182529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.186637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.187787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.189796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.192145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.235336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Getting quotas for project 50333c729f8742e4b78d007d13fe66a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:05.247962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Getting quotas for user 63497dd52a5c4cd58e8916d3ea348479 and project 50333c729f8742e4b78d007d13fe66a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:05.278613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:35:05.297528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:35:05.382561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.398642 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83de073c-3fb4-46c5-a396-afeaa8d54b28 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.252149 Oct 18 13:35:05.403683 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1462/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:05.405891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.417997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.437886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.437886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.437886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.437886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.438748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.438748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.547347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.562335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.564570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.582758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26ba7dd5-c186-4542-b258-2b9ee176af27 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.174925 Oct 18 13:35:05.582758 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1463/2914] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:05.598613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a6addee-60ea-4c6d-acf7-5afb40d1dac6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] Calling method '.version_select at 0x7fb3353694c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.626728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59208f81-ec01-4e4e-a718-bc222b24af3e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.849118 Oct 18 13:35:05.633665 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1452/2915] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:35:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:35:05.661662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.686338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.714447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.719309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.720964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.721835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.723381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.728436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.780639 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a6addee-60ea-4c6d-acf7-5afb40d1dac6 tempest-ServersTestBootFromVolume-269710658 tempest-ServersTestBootFromVolume-269710658-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109810894" status: 202 len: 0 microversion: 2.1 time: 0.198042 Oct 18 13:35:05.781783 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1464/2916] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109810894 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:35:05.787857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72123b91-fbe5-4e26-872f-0bc841cdb260 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.791636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72123b91-fbe5-4e26-872f-0bc841cdb260 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.967804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72123b91-fbe5-4e26-872f-0bc841cdb260 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.975637 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72123b91-fbe5-4e26-872f-0bc841cdb260 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1216 microversion: 2.1 time: 0.192647 Oct 18 13:35:05.976229 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1465/2917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:06.057209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:06.058010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.059202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:06.074703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8e3c269-6181-4fa2-bc8f-06074768e84a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1303 microversion: 2.1 time: 0.429363 Oct 18 13:35:06.077718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.081670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1453/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1303 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:06.091339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.091854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.093045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.093531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.095784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.428229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:06.430552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:06.446742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.448657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.450675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.451751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.454259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.460113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.803822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.826468 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3fba5c46-a679-41e8-a6db-d02d976f246c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.404258 Oct 18 13:35:06.829519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1454/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:06 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:06.843044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:06.845099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:06.857033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.863412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.863412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.863412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.863412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.863827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.968866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.983733 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0a53528-2a92-4984-bb9b-ff5ab8a13564 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.933334 Oct 18 13:35:07.013318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1466/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:06 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:07.030732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5b06242-4965-4892-95b8-0c6f93b9acb4 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:07.031840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5b06242-4965-4892-95b8-0c6f93b9acb4 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:07.097698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.124322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.135882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.170925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa2ec6b4-cac7-4adf-99d3-a5af1429a8c2 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.337941 Oct 18 13:35:07.188285 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1455/2921] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:06 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:07.204913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:07.218492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:07.248610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.251722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.253567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.256422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.257176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.261632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.352252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5b06242-4965-4892-95b8-0c6f93b9acb4 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.371532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5b06242-4965-4892-95b8-0c6f93b9acb4 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1216 microversion: 2.1 time: 0.355539 Oct 18 13:35:07.378884 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1467/2922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:07 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1216 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:07.861841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:07.864573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:07.898827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.902694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.904298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.908371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.912558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.916131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.401094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.427160 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad33d925-b3d1-40ef-97de-ea88e92729d7 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 1.233789 Oct 18 13:35:08.431893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1456/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:07 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:08.439583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:08.450155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:08.479000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.496240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.499615 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0536c2ef-b10e-4696-b06a-fb2422d5bb7f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.642508 Oct 18 13:35:08.505140 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1468/2924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:07 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:08.514106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.514106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.514106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.525683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.533116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:08.533116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:08.533369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.545339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.546135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.548264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.554220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.555027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.559242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.962004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.971790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.973822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:09.011269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ffa4ef6-2cf0-4264-9eb5-8b4b9345a42e tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.495006 Oct 18 13:35:09.024203 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1469/2925] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:08 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:09.052543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:09.053799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.090082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.090600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.091066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.091794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.092259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.092691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.295666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:09.310636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f151eb10-6da6-450f-84ec-365f459f0d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.871020 Oct 18 13:35:09.323964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1457/2926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:08 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:09.459982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:09.460838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.479321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.479321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.482401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.483567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.486229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.486871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.669954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:09.684036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e6594a3-9ddc-4a0f-8964-dc76467dc657 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1268 microversion: 2.1 time: 0.652184 Oct 18 13:35:09.689497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1470/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:09 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1268 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:09.696268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:09.710235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.750763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.763474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.770977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.773887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.799736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.800617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.971504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:10.082903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.106620 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5c63b1d-54fb-4a07-b6aa-f57defedd005 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.401329 Oct 18 13:35:10.111061 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1471/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:09 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:10.167823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:10.168933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:10.199539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.205378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.207432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.208683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.210018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.213750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.759492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.780216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d50c9960-99e9-4a34-acd6-9f84214e0e8d tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 1.325239 Oct 18 13:35:10.788286 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1458/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:09 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:10.799582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:10.810494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:10.821060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.823569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.824194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.825106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.826630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.828724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.834762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.891429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.939842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.999235 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3adac766-7aba-429b-be6c-0180e7cef387 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 1.876639 Oct 18 13:35:12.019574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1472/2930] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:10 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:12.032423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:12.033549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:12.042354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.043584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.045692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.046997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.047666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.051550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.224882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.234803 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a294a042-ffb8-4ba3-bafc-257d9bcd7883 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1274 microversion: 2.1 time: 0.213672 Oct 18 13:35:12.247742 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1473/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:12 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:12.260755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:12.261889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:12.270318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.271148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.271914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.274549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.275731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.278310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.458888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.465180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.471637 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4478efd9-8af1-4a4a-be2a-d0b06e4f17c9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1183 microversion: 2.1 time: 0.222433 Oct 18 13:35:12.473118 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1474/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:12 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:12.477214 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e292d217-d331-413f-86be-0c4c19116732 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 1.687597 Oct 18 13:35:12.480480 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1459/2933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:10 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:12.488633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:12.489567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:12.497486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.498237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.498836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.502690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.502690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.502690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.035699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:13.037041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:13.046421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:13.064074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.065904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.067642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.070077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.074008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.075179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.090113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:13.115720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:13.140161 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa83520b-9792-4363-911f-6783059e5ba8 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.665025 Oct 18 13:35:13.158081 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1475/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:12 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:13.266230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:13.267350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:13.283017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.289167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.294204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.295265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.302382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.303149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.393032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:13.720411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:13.735720 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1910e23e-a1f8-4e5a-a3cb-49c00d892167 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1274 microversion: 2.1 time: 0.469737 Oct 18 13:35:13.750902 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1476/2935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:13 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1274 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:13.764791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:13.769909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:13.783087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.786806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.787631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.788551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.795069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.795069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.875079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:13.875836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:13.876435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:13.879413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lazy-loading 'fault' on Instance uuid 77a12835-770c-415c-b9fa-1d83441ed180 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:14.004737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.013840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2d815ae-0fa2-4ddc-98fd-4095c33b0bb4 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 200 len: 1142 microversion: 2.1 time: 0.261517 Oct 18 13:35:14.016472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1477/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:13 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 1142 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:14.044733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:14.053967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:14.062463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.068072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.068759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.069929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.070572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.071186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.205577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.223368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.225353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.246933 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b96a47fb-eef9-4976-9724-ff66364f36a7 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 1.216417 Oct 18 13:35:14.248217 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1460/2937] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:13 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:14.267600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:14.270139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:14.276332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.283434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.284257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.285752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.286478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.287461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.627080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.641293 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a71b043f-7c76-4fdd-bc33-68a8fcb9783e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.604631 Oct 18 13:35:14.647722 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1478/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:14 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:14.777836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:14.778523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:14.794160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.794954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.796395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.797479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.799342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.801330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.964485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.982216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8da89819-4133-4543-890d-6fee3edb2de4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.727225 Oct 18 13:35:14.984206 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1461/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:14 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:15.046461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.047478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 77a12835-770c-415c-b9fa-1d83441ed180] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.070177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.073362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.074161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.077426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.081968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.081968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.116724 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] HTTP exception thrown: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Request method failure captured: Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 HTTP/1.1 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqnuQZAQ-_BY7C-Ef--ouNx3UGhvBIuV-o5aGz8VWnqZZls9Sg_A5101tVT3rx3D0XRtSw7PUZCgKMW6H4K8t5M3tMXBCLD1JdvYCQTX91Ij0KBKnOfvgBBh7RBRMmi3eHW0OqEJQUPuQ-KhRdOV5XjsygU7LJFomX-t3UuVnn804Xw Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:15.120480 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9395a050de444357956d4ac79adefee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9395a050de444357956d4ac79adefee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d5ed601492e2486bad8ba5b09515d52a Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. Oct 18 13:35:15.122048 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '77a12835-770c-415c-b9fa-1d83441ed180'} Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:15.122947 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. Oct 18 13:35:15.124898 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:15.130855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Returning 404 to user: Instance 77a12835-770c-415c-b9fa-1d83441ed180 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:15.148638 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d587e015-fe95-47fd-b7e1-4aab436a24ce tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180" status: 404 len: 111 microversion: 2.1 time: 0.089675 Oct 18 13:35:15.153048 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1462/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/77a12835-770c-415c-b9fa-1d83441ed180 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:15.285788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.287235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.296448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:15.302083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:15.304040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.304787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.305428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.306604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.315036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.317294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.526453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.542234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.544223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.575975 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aefce804-3f34-4ba2-b0fb-02e8477c68dd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.294821 Oct 18 13:35:15.584879 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1463/2941] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:15.605552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2048d25-dd63-4e1b-bece-34daba9cd37f", "tag": "d05a5554-e40a-4beb-a64c-81512dad8dac"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:15.677076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.694362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.698358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.763418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] Creating event network-changed:d05a5554-e40a-4beb-a64c-81512dad8dac for instance f2048d25-dd63-4e1b-bece-34daba9cd37f on n-h2-858383-13 Oct 18 13:35:15.788477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1451f59c-0fbb-420f-8f29-b1b51e4b2577 req-8f6b4207-7d28-4d9c-91bd-82d467ca3dce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201071 Oct 18 13:35:15.794325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1464/2942] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:15.827815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.833441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.855380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.859298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.865209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.865209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.865209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.877566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.535710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.546559 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-916caf0a-09b6-4dbf-998a-24f865887fbb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.750823 Oct 18 13:35:16.558951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1465/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:16.586199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:16.587012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:16.608129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.614455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.616161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.619677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.621752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.626412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.896634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.918855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e8356f4-ebe6-4f0b-a2a7-bbb210224e3d tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 2.146691 Oct 18 13:35:16.946593 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1479/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:14 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:16.966292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:16.967895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:16.991417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.994885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.994885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.001101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.006088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.006981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.357329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.364726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=18 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:17.381909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.385905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.428905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:17.458523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8a9ee9b-1cd3-4126-b9e0-de5f2568748c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.494298 Oct 18 13:35:17.486909 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1480/2945] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:16 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:17.585442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:17.586347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:17.597393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.600520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.602698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.603658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.605156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.605776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.798020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.842995 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47f902e8-a97d-40f5-8ac0-239e959dc108 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 1.282264 Oct 18 13:35:17.850016 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1466/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:16 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:17.961797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:17.962628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:17.977791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.989373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.004720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.006365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.011907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.020080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.435037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.460778 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d8d5b5c-6fea-46d8-a1de-1d6acec4557f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.886184 Oct 18 13:35:18.462216 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1481/2947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:17 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:18.495955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:18.496822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:18.509024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.509867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.524934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.526033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.528701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.535197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.982929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.000842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.005390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.035766 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d6b6282-e010-4fad-986f-a610011bd13f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.524229 Oct 18 13:35:19.041086 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1482/2948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:18 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:19.048916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:19.050667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:19.064780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.066699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.067918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.070272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.074989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.075682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.139088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.153556 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c9f771a-b12d-4ed2-84a0-39e425f7985b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 1.195194 Oct 18 13:35:19.154813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1467/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:17 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:19.490386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:19.491184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:19.517595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.523992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.529423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.533945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.536389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.537890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.233646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.252740 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4c68f20-21b7-4659-8c3d-e58c7bd7d4b8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.765113 Oct 18 13:35:20.253910 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1468/2950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:19 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:20.289013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50308cb3-bd0c-4deb-a7c9-6d858b0e32b6", "tag": "4ae9e7bf-4145-4369-8b8b-34f0ca0877e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:20.344723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.349362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.349823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.390368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] Creating event network-changed:4ae9e7bf-4145-4369-8b8b-34f0ca0877e7 for instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 on n-h2-858383-13 Oct 18 13:35:20.407684 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-80b0d5dc-8133-4b29-aa16-3bf2bbb2d158 req-fe95e3fa-abac-4675-8d88-ac6508d32c15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143872 Oct 18 13:35:20.415049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1469/2951] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:20.442331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.448128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.455209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.455990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.456883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.457945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.462325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.463577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.775272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.799304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.801358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.858223 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-039dc349-b69f-4efa-9677-90646053d377 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.429987 Oct 18 13:35:20.861503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1470/2952] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:20.872839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.873049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.947963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.948583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.954562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.955412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.955874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.959713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:21.130813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:21.139414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17e1ba70-1910-48a6-94fb-520da520f6cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 2.096869 Oct 18 13:35:21.151743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1483/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:19 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:21.356257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] Calling method '.version_select at 0x7fb3352fadc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:21.871660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 29eedeb5-cebf-4073-a881-aef64318672d could not be found", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:35:21.872351 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] HTTP exception thrown: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] Request method failure captured: Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-floating-ips/29eedeb5-cebf-4073-a881-aef64318672d HTTP/1.1 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTquY84vsjjNWkfe8nhJpuQi5mFO65ymED07ATB8Fc-GyngJg2SjZg85nbaRw8fe1csvmcwjEAOYgFkuX3Ino_53CsAKEMzWGAwP7_qkzC53ySadmyehKfQUMbXy-iFXD43R-TZJrgZtOwyJdOfzvBbt0ylKaKmnEd04CRKMDs3NcWj4 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e09a0c5590a3483fb44face4a6c7c9c1 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-658075328 Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:21.874264 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e09a0c5590a3483fb44face4a6c7c9c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e09a0c5590a3483fb44face4a6c7c9c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e09a0c5590a3483fb44face4a6c7c9c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e09a0c5590a3483fb44face4a6c7c9c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-658075328 Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e09a0c5590a3483fb44face4a6c7c9c1 Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-658075328 Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-658075328-project Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c98c85ffb28f4aba959a76d828e7c79e Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-658075328-project Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: exception: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d Oct 18 13:35:21.876333 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '29eedeb5-cebf-4073-a881-aef64318672d'} Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:35:21.877265 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 29eedeb5-cebf-4073-a881-aef64318672d could not be found Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e113d41a-f662-4dce-9db8-381bf5ca7acd'] Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d. Oct 18 13:35:21.879516 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:21.880965 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:21.882512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:21.882512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d Oct 18 13:35:21.882512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:21.882512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] Returning 404 to user: Floating IP not found for ID 29eedeb5-cebf-4073-a881-aef64318672d {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:21.882512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd7e10e5-935c-41a9-93ec-2f63fa2bfff5 tempest-FloatingIPDetailsNegativeTestJSON-658075328 tempest-FloatingIPDetailsNegativeTestJSON-658075328-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/29eedeb5-cebf-4073-a881-aef64318672d" status: 404 len: 111 microversion: 2.1 time: 0.722476 Oct 18 13:35:21.882928 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1484/2954] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:35:21 2022] GET /compute/v2.1/os-floating-ips/29eedeb5-cebf-4073-a881-aef64318672d => generated 111 bytes in 730 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:21.888718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:21.889350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:21.928150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.936393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.938609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:21.939543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.949881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.950425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.110222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.121418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be17ee3f-71db-41de-a6bf-8e0951115c46 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 1.260119 Oct 18 13:35:22.132187 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1471/2955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:22.138250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:22.142384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:22.159998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.163210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.163869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.166525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.168585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.170239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.317250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.332023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.333922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.351322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a04c836a-ad93-4aee-84a6-6c2488078cdd tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.217668 Oct 18 13:35:22.351918 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1472/2956] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:22 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:22.361874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:22.365791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:22.380180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.380937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.381541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.383364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.386679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.387524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.714928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.727907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88f3d0cb-9e11-442d-a5c8-cbd35f9b01be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.370615 Oct 18 13:35:22.729096 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1473/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:22 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:22.780849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.796497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33ef4a23-fd79-4aa9-9236-5f803e195fdf tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 0.910172 Oct 18 13:35:22.818457 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1485/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:21 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:23.161064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.161693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.193355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.199579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.200635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.210825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.214169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.215995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.384857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.385383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.410047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.414763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.415265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.416063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.416545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.416990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.710548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.750657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.762745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.808404 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad7bbe82-532c-4e2c-8fd2-4df831a6a29f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1553 microversion: 2.91 time: 0.425547 Oct 18 13:35:23.818548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1486/2959] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:23.845287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.849029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.876298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.881166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.881737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.882535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.888720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.889308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.186932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.198719 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bff8d9c-297b-4ab9-9383-d77c603e1000 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 1.047786 Oct 18 13:35:24.207704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1474/2960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:24.217683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.223758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.235169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.236317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.236983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.244263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.245006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.246511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.861224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.880810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79dabde4-3938-4654-a4a5-20a6869bdecb tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 1.059493 Oct 18 13:35:24.881413 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1487/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:24.943734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.944576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.993327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.993840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.994382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.995110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.995579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.996070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.327611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.342251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.350885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.361464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1d7cfb4-f820-4c68-932f-95c2d52d668f tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1535 microversion: 2.91 time: 0.478929 Oct 18 13:35:25.382631 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1488/2962] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1535 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:25.395756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:25.396576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:25.412199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.412783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.413269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.414002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.414502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.414941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.006792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.016273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e17dee6b-2c29-4fa8-8c9d-0f6933d8baeb tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 0.629103 Oct 18 13:35:26.024100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1489/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:25 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:26.039125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.052300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.075199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.084438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.096376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.100620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.121879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.122666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.248143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.258926 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b30fe6af-7d58-44e7-9b40-bc535abd790b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1508 microversion: 2.1 time: 2.049674 Oct 18 13:35:26.262527 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1475/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1508 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:26.285519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.287665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.323003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.323968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.324657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.325624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.326336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.327022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.391816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:26.821064 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-467e34e6-f2f7-4e5a-abf6-b09ea1d92e2f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 204 len: 0 microversion: 2.1 time: 0.553018 Oct 18 13:35:26.826580 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1476/2965] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:26 2022] DELETE /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:26.828645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.829525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.847041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.858747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.860997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.861761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.864310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.864825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.883858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:26.991494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.002572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.004951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.020331 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-625089a4-0f6f-4c42-b8a6-f9538bd1b656 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1535 microversion: 2.91 time: 0.196382 Oct 18 13:35:27.046368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1477/2966] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1535 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:27.052492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.053311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.066748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.071367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.072116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.076138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.076834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.078570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.200528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.213895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-817e8b86-9601-4fbd-bd10-3f8442337311 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 1.187389 Oct 18 13:35:27.220528 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1490/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:27.234846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.236172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.251450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.252326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.256742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.257860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.258584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.259345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.789691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.817608 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a10aced5-10b5-4a3e-873e-329732ab833f tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1668 microversion: 2.1 time: 0.769382 Oct 18 13:35:27.829762 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1478/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:27.847873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.864646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.895726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.905612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.906444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.909978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.913656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.914559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.926451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.938571 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3925f197-3dd8-4060-ade1-4d167c63ea07 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 1.106973 Oct 18 13:35:28.953802 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1479/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:28.953802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50308cb3-bd0c-4deb-a7c9-6d858b0e32b6", "name": "network-vif-plugged", "status": "completed", "tag": "4ae9e7bf-4145-4369-8b8b-34f0ca0877e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:28.982413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.984437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.985076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.023808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] Creating event network-vif-plugged:4ae9e7bf-4145-4369-8b8b-34f0ca0877e7 for instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 on n-h2-858383-13 Oct 18 13:35:29.029653 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-808a0032-043a-459b-9887-e230b4b6833e req-c0f5d1cb-8487-4dd4-ba9d-f00933bbe60a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084046 Oct 18 13:35:29.036059 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1480/2970] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:29.045311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:29.052191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.065159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.066526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.067900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.068658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.069123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.069755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.324658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.339353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.340949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.365096 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54298ff0-159f-47b8-b1d9-a4d7c1e972da tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1478 microversion: 2.91 time: 0.321470 Oct 18 13:35:29.368381 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1481/2971] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:29 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1478 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:29.384331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:29.385926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.401835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.404953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.408115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.412965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.414108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.414813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.528862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.550444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eca23da4-6cd8-4466-9a95-b8cf211a5c0f tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 2.327609 Oct 18 13:35:29.551810 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1491/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:29.573002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:29.573002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.588613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.592526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.592526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.596083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.597167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.597824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.792219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.806299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6517b7c-3c40-4824-873f-6de9543ab589 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.432583 Oct 18 13:35:29.806942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1482/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:29 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:29.847824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:29.855646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.874720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.876465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.880238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.881222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.883704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.884459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.976273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-13". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:35:30.293486 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-589fc71a-5b56-41bd-9f63-293b429852c7 tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action" status: 202 len: 0 microversion: 2.91 time: 0.446877 Oct 18 13:35:30.294759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1483/2974] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:35:29 2022] POST /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:30.313727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.326400 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bbe4c54-fa0a-4c5b-a49f-9274b874950b tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1668 microversion: 2.1 time: 0.771212 Oct 18 13:35:30.328820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.329691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.336798 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1492/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:29 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1668 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:30.356552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.357077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.357544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.358244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.362816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.362816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.362816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.363066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.377362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.379397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.381263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.383476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.386922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.391846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.856563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.861579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:30.881757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.886139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.886139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.892083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1399785d-ed10-4e8d-8ee8-094ac1e1ec1e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.595923 Oct 18 13:35:30.892667 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1484/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:30.905907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.923936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-470243ec-6843-43f0-8c6e-a92177dc34db tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.584556 Oct 18 13:35:30.930091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.931186 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1493/2977] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:30.944017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.950632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.951802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.955545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.956896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.960781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad", "name": "network-vif-deleted", "tag": "ba51ce05-b880-4caf-b6dd-207bbf905289"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:30.961447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.011323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.012314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.012795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.054264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] Creating event network-vif-deleted:ba51ce05-b880-4caf-b6dd-207bbf905289 for instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad on n-h1-858383-13 Oct 18 13:35:31.084553 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-845cdd33-040c-4222-b769-39f0dbeb2203 req-9bcc9182-42e0-4789-9d50-9a0c86060e10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147135 Oct 18 13:35:31.093360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1494/2978] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:31.131400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.135951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.164479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.170956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.181314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.182483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.183175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.183812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.351241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.365785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58030df7-865d-445d-8fb2-9fe11fcabef2 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1316 microversion: 2.1 time: 0.465627 Oct 18 13:35:31.380692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1485/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:31.391562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e53d5f-47cd-451c-a1b8-c23e38bbd79b", "name": "network-vif-plugged", "status": "completed", "tag": "f6a02608-3703-414b-b2de-ba571a97a3e2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:31.418603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.419107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.420421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.450968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] Creating event network-vif-plugged:f6a02608-3703-414b-b2de-ba571a97a3e2 for instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b on n-h1-858383-13 Oct 18 13:35:31.466919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-26e6da38-c046-49e6-81e1-35567a311a95 req-b03dde9c-091e-4e5f-9578-1103306f8b86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081771 Oct 18 13:35:31.472668 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1486/2980] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:31.482542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.483312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.501870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.502380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.503591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.504124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.504576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.505013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.604389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.610846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.611548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.612724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lazy-loading 'fault' on Instance uuid 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:31.714092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.727986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-894c5225-d871-4bfc-90cc-3fc428d740f7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 200 len: 1324 microversion: 2.1 time: 0.253559 Oct 18 13:35:31.732709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1487/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:31.875431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.889246 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6eecd5a5-c434-4c57-910f-785dc959dea1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.792480 Oct 18 13:35:31.889847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1495/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:31.922866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.923950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.936302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.937678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.938300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.939173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.939873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.941173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.957155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.958273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.986185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.986926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.988237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.990354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.991513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.005230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.175903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.190092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.200553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.222264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-569c018b-af81-4134-8a6f-e6f885047b5c tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.264896 Oct 18 13:35:32.224340 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1496/2983] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:32.392186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.392952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.409646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.413618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.414270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.415056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.422668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.427249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.542946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.561456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f46608c-ee5e-4fa7-99b3-d832c71878c9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.643152 Oct 18 13:35:32.568211 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1488/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:32.754494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.755667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.763743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.767742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.767742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.767742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.767742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.768067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.785727 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] HTTP exception thrown: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Request method failure captured: Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad HTTP/1.1 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqnuQZAQ-_BY7C-Ef--ouNx3UGhvBIuV-o5aGz8VWnqZZls9Sg_A5101tVT3rx3D0XRtSw7PUZCgKMW6H4K8t5M3tMXBCLD1JdvYCQTX91Ij0KBKnOfvgBBh7RBRMmi3eHW0OqEJQUPuQ-KhRdOV5XjsygU7LJFomX-t3UuVnn804Xw Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:32.788730 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9395a050de444357956d4ac79adefee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9395a050de444357956d4ac79adefee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d5ed601492e2486bad8ba5b09515d52a Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. Oct 18 13:35:32.790111 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad'} Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:32.790849 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. Oct 18 13:35:32.792039 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:32.796989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Returning 404 to user: Instance 7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:32.798001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83cdffea-cc53-444a-8256-db4c04866dab tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad" status: 404 len: 111 microversion: 2.1 time: 0.047654 Oct 18 13:35:32.799148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1489/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/7fb5fd71-08c3-43a8-bc85-8c5cc945e0ad => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:35:32.822404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b76baa56-ea68-4c6b-bf27-a8da342bf1ed tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '.version_select at 0x7fb3304d80d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.910393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.922516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-344609c6-f6b8-42aa-a2d5-17acad046c9e tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1504 microversion: 2.1 time: 0.534421 Oct 18 13:35:32.941064 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1497/2986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:32.969446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.970522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.995527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.005558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.005558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.005558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.005558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.005944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.012815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b76baa56-ea68-4c6b-bf27-a8da342bf1ed tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914678800" status: 202 len: 0 microversion: 2.1 time: 0.205575 Oct 18 13:35:33.026207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1490/2987] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914678800 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:35:33.040699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.046385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.070327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.071128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.073351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.078199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.080568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.084400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.301922 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-555fc8dc-24e5-4328-a69c-5927e35ca278 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.273628 Oct 18 13:35:33.304592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1491/2988] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:35:33 2022] DELETE /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6/os-server-password => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:33.314184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.334517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.359234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.364943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.364943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.364943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.370452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.376314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.471266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.486680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5859dd0b-0636-4cfd-8b0e-15c7378df565 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.530322 Oct 18 13:35:33.495462 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1498/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:33.500614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.501125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.525891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.525891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.525891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.525891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.526815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.526815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.601238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-824a661f-2f4e-4ed2-bdfd-14c110c5d8c3 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.104608 Oct 18 13:35:33.608320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1499/2990] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6/os-server-password => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:35:33.613533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.614506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.621846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.622497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.623063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.623863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.624439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.624978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.704073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.720096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.740779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.756551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c94395a1-b528-4c4e-aebf-1c6bc954af38 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.450111 Oct 18 13:35:33.759326 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1492/2991] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:33.769958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.774893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.804977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.806628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.807080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.807801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.808828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.809476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.844614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:33.850761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:34.014567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.032766 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb4fbb1b-5b79-4413-8362-669c3463f18b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.423014 Oct 18 13:35:34.033383 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1500/2992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:34.102434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:34.152121 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37f4f810-a268-4105-88d7-fc85b968b679 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 204 len: 0 microversion: 2.1 time: 0.388825 Oct 18 13:35:34.153229 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1493/2993] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:33 2022] DELETE /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:34.161335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.162406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.181873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.182424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.187616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.188790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.191068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.191758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.511897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.513963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.515059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.521879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b407f26-0c7f-4c46-9a40-25a636bb5469 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1510 microversion: 2.1 time: 0.364584 Oct 18 13:35:34.525537 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1501/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:34.529701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.529701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.529701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.535420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.536698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.537472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.792898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.792898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.811561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.812484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.820764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.824017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.825963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.826684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.915694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.925620 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-910e7469-fac2-434d-b8d5-ea9b39b04c45 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.416116 Oct 18 13:35:34.932203 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1494/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:34.997846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.010773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.012403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.028831 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-269e96c5-992d-4e02-bc03-e0b3c6992cf3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.241895 Oct 18 13:35:35.032338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1502/2996] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:35.043350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.043870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.056926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.058031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.062326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.062886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.067567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.067567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.067567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.067567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.069208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.069984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.071776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.073086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.075258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.075972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.162889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:35.373494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.386805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9262f787-14e8-49ad-a58d-deb40ef7abda tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.334208 Oct 18 13:35:35.391111 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1503/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:35.522619 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62ca41be-2716-4828-b723-8e23d2bcd6c0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 204 len: 0 microversion: 2.1 time: 0.483099 Oct 18 13:35:35.524069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1495/2998] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:35 2022] DELETE /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:35.533355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.534591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.547245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.548685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.568481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.575334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.577854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.578433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.578808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.579517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.579965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.580432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.580545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.582007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.582521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.582976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.869373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.869373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2e1f4ad9-499b-454b-a112-5aa3109cc4a1 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1510 microversion: 2.1 time: 0.269534 Oct 18 13:35:35.869373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1496/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:35.879682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.887848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1fbdfe76-b078-4578-8da6-eb9d14fca4a9 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1485 microversion: 2.1 time: 0.359352 Oct 18 13:35:35.888482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1504/3000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1485 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:35.955624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.957581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.963757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.964335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.964840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.965767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.966331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.966830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.073823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.074499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.087153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.087651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.088093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.088799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.089263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.089695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.158743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.167919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.169354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.175053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cab47a59-ba5d-47c4-9cb5-6bd190b7c0e8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1486 microversion: 2.91 time: 0.113776 Oct 18 13:35:36.176180 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1505/3001] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1486 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:36.234902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.250961 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e489eb84-b733-4254-8ad3-476bf72d43cc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.297328 Oct 18 13:35:36.293023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1497/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:36.420886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.421198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.461191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.485249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.489452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.492961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.499565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.501814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.841085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.842201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.857070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.858660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.860143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.867012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.867843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.869825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.912969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.927417 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db54315f-96ea-4d4d-92ad-d028d775b083 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.511229 Oct 18 13:35:36.941852 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1506/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:36.941852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.941852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.953209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.953712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.954198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.954922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.955391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.966630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.178130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.187453 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b682572-d480-4221-8ab5-738bc51edc56 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1443 microversion: 2.1 time: 0.257454 Oct 18 13:35:37.192641 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1507/3004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1443 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:37.216559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.217198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.227417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.227933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.228393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.229125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.229597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.230035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.398461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.408603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.409996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.437112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7817f5bc-0dba-4b71-8179-5c7671083d4d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.233074 Oct 18 13:35:37.441514 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1508/3005] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:37.453819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.460748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.479004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.486121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.489493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.490423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.491025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.491569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.686491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.701786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc72a62b-4c5d-4f44-b744-e117ef14a719 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1510 microversion: 2.1 time: 0.864315 Oct 18 13:35:37.727280 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1498/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1510 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:37.754452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af6a1ce-a052-4fbd-958b-2d08be742e47", "name": "network-vif-deleted", "tag": "ff2e1c71-d505-46dc-bdcb-09a1b6faa975"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:37.797452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.802150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.802870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.831052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] Creating event network-vif-deleted:ff2e1c71-d505-46dc-bdcb-09a1b6faa975 for instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 on n-h1-858383-13 Oct 18 13:35:37.839163 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-585f381e-1a8f-4d4b-bc91-ddaa341f14ad req-b1a91d40-7a86-4f06-948c-b96a2fb9e5d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109935 Oct 18 13:35:37.841401 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1499/3007] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:37.958180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.960481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.961432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.967542 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b085fab-e6d8-4b5b-bd6f-df4ba33a6bda tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.524461 Oct 18 13:35:37.975151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.975983 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1509/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:37.976723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.977746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.979099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.980792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.982390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.221250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.227574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.244862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.249847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.249847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.249847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.249847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.250280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.301176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.302287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.303727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.303727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lazy-loading 'fault' on Instance uuid 5af6a1ce-a052-4fbd-958b-2d08be742e47 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:38.364289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.375060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab3cf3e6-df47-45fe-be07-64695c570aa0 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 200 len: 1300 microversion: 2.1 time: 0.164062 Oct 18 13:35:38.375986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1510/3009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 1300 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:38.481338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.482388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.492883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.494217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.495265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.496301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.497138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.498610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.507788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:38.591602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.605440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.607361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.615449 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-026bef59-eea4-4676-a146-ce88493c8c74 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.145076 Oct 18 13:35:38.631180 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1511/3010] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:38.735997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.737727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.755103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.756462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.756931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.767426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.768361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.769063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.858425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.882239 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89b715c4-ef0f-40c5-845e-38f36e8bd46c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.912668 Oct 18 13:35:38.883207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1500/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:39.009304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.009856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.023441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.023941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.024377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.032101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.033661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.035327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.061185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.080273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19684903-77ca-4f1c-bb5b-5f18c9772742 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1468 microversion: 2.1 time: 0.347024 Oct 18 13:35:39.110414 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1512/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:39.180409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2048d25-dd63-4e1b-bece-34daba9cd37f", "name": "network-vif-plugged", "status": "completed", "tag": "d05a5554-e40a-4beb-a64c-81512dad8dac"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:39.211260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.214814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.215262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.249207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] Creating event network-vif-plugged:d05a5554-e40a-4beb-a64c-81512dad8dac for instance f2048d25-dd63-4e1b-bece-34daba9cd37f on n-h2-858383-13 Oct 18 13:35:39.272477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bea020f2-770f-4780-a106-e757f6393e6e req-6f006d51-dde9-4780-87c2-b3a688c42a7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099651 Oct 18 13:35:39.273139 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1513/3013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 13:35:39.369599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.378837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f65d4625-67de-439f-abde-24235bb1c46a tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.375362 Oct 18 13:35:39.379439 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1501/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:39.402944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.403660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 5af6a1ce-a052-4fbd-958b-2d08be742e47] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.414221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.414719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.415157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.422280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.422280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.422280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.483419 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] HTTP exception thrown: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Request method failure captured: Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 HTTP/1.1 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqnuQZAQ-_BY7C-Ef--ouNx3UGhvBIuV-o5aGz8VWnqZZls9Sg_A5101tVT3rx3D0XRtSw7PUZCgKMW6H4K8t5M3tMXBCLD1JdvYCQTX91Ij0KBKnOfvgBBh7RBRMmi3eHW0OqEJQUPuQ-KhRdOV5XjsygU7LJFomX-t3UuVnn804Xw Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:39.489274 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9395a050de444357956d4ac79adefee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9395a050de444357956d4ac79adefee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d5ed601492e2486bad8ba5b09515d52a Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. Oct 18 13:35:39.490834 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5af6a1ce-a052-4fbd-958b-2d08be742e47'} Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:39.491548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. Oct 18 13:35:39.492682 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:39.495397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Returning 404 to user: Instance 5af6a1ce-a052-4fbd-958b-2d08be742e47 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:39.495397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f159ec7-c9ea-49e4-b2c6-71e96d930ed6 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47" status: 404 len: 111 microversion: 2.1 time: 0.096849 Oct 18 13:35:39.500820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.502114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.511026 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1514/3015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/5af6a1ce-a052-4fbd-958b-2d08be742e47 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:39.513052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.513729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.514387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.515310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.516015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.516676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.544248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:39.647826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.648529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.655997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.664649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.665134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.666408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.666408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.666806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.792696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.811298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.819722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.827058 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5be7e50f-7ae6-4683-87fd-b16a81223911 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.183572 Oct 18 13:35:39.828299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1515/3016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:39.884397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50308cb3-bd0c-4deb-a7c9-6d858b0e32b6", "name": "network-vif-deleted", "tag": "4ae9e7bf-4145-4369-8b8b-34f0ca0877e7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:39.905987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.906758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.907216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.941241 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] Creating event network-vif-deleted:4ae9e7bf-4145-4369-8b8b-34f0ca0877e7 for instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 on n-h2-858383-13 Oct 18 13:35:39.955032 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d6deb5f5-4c28-40df-8845-6e250df2cc4c req-a5a97d11-fe0d-4800-8675-a623ae4e86ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075008 Oct 18 13:35:39.956052 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1516/3017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:35:39.966535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.967278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.000161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.001463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.001463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.007518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.008036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.008524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.058632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a3056c5-51f2-4b5e-8f5c-95cfc9ff6b88 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 204 len: 0 microversion: 2.1 time: 0.561271 Oct 18 13:35:40.059875 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1502/3018] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:39 2022] DELETE /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:40.069461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.071402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.094013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.096838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.100562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.100562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.100562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.108795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.427009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.439715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84566b03-b80c-4db1-b9a4-acc65dfb87b0 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.482348 Oct 18 13:35:40.440356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1517/3019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:40.481288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.481919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.489345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.489540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.489798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.490545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.491497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.492058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.492564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.515502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-367a22ef-eb10-4585-9071-dd984d356eeb tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1500 microversion: 2.1 time: 0.445330 Oct 18 13:35:40.516181 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1503/3020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:40.534450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.538886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.566342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.566342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.566342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.566744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.567525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.568345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.573525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.574405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.574825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.575303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lazy-loading 'fault' on Instance uuid 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:40.699175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.719115 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d699c47-c1fb-4e2c-ab98-b84b72c4185b tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1306 microversion: 2.1 time: 0.242368 Oct 18 13:35:40.719937 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1518/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1306 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:40.868876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.869721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.876604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:40.879035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.879926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.880476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.883196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.886037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.891175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.036655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.052110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.057010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.078151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82e08519-9a87-4458-9988-c066dda0e460 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.215418 Oct 18 13:35:41.082766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1519/3022] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:41.331724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.344266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee692948-10a1-4dbe-b0a2-4ec14dfd9152 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1371 microversion: 2.1 time: 0.825715 Oct 18 13:35:41.351986 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1504/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1371 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:41.471047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.472271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.483726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7339438d-6124-4f81-83bc-172215faec02 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Calling method '.version_select at 0x7fb3352cb940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.485829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.486367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.486863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.488064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.504402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.506860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.359002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.366779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39fdefa8-a567-49f7-a500-311ecd5a6dc8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.899786 Oct 18 13:35:42.367362 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1505/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:42.372345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.372982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.379465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.379969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.380416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.381138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.381603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.382043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.386528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:42.647034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.655032 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ee69423-a8e5-4512-820b-c32993ac5f4c tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1500 microversion: 2.1 time: 0.286608 Oct 18 13:35:42.655609 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1506/3025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1500 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:42.660090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.660709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.681166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.681777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.682573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.693947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.693947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.693947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.725912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.726447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.727003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.727526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lazy-loading 'fault' on Instance uuid 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:42.841565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63497dd52a5c4cd58e8916d3ea348479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50333c729f8742e4b78d007d13fe66a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.863262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ade3c42c-4c7d-4fe8-b2b9-0035b26e4eb9 tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 200 len: 1306 microversion: 2.1 time: 0.206502 Oct 18 13:35:42.866763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1507/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 1306 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:42.889484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.889987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.910596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.911144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.911613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.916938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.917535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.919161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.137351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.156465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.170991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.178186 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35fcde43-8d59-4263-aa35-67d44e7a2f1d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.310265 Oct 18 13:35:43.179312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1508/3027] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:43.185311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:43.189518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:43.205271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.213884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.216321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.216321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.216321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.216789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.791264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.803493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9893db76-c056-43e0-8e34-8078e783c91b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1557 microversion: 2.1 time: 0.622941 Oct 18 13:35:43.810382 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1509/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:43 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1557 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:43.813820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:43.815790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:43.848356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.849349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.851415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.852967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.853673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.855827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.407531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.426802 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99e26071-de6c-47bc-9d80-885aadcd0a60 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.616307 Oct 18 13:35:44.429772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1510/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:43 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:44.445903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.447003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.464596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.465404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.466221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.475815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.477549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.478421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.562029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.563865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.564874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.569752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lazy-loading 'fault' on Instance uuid 65fbacee-ee4f-438c-80f4-1877607c129c {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:44.687025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ed601492e2486bad8ba5b09515d52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9395a050de444357956d4ac79adefee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.694199 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7d565c5-4f3b-4029-8036-19a9d198ceb7 tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 200 len: 1301 microversion: 2.1 time: 0.260979 Oct 18 13:35:44.701072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1511/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 1301 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:44.705832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fbacee-ee4f-438c-80f4-1877607c129c", "name": "network-vif-deleted", "tag": "1fb8e507-e9c0-4985-87dd-2c732d7a53c0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:44.722293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.722782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.723221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.746397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] Creating event network-vif-deleted:1fb8e507-e9c0-4985-87dd-2c732d7a53c0 for instance 65fbacee-ee4f-438c-80f4-1877607c129c on n-h2-858383-13 Oct 18 13:35:44.765847 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d2aea708-f6d4-4713-aba2-ff11e6564e9b req-fa6cf879-5ced-42bd-b8af-7e2420ac99eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063458 Oct 18 13:35:44.766776 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1512/3031] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:44.795012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.795633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.803214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.804217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.804676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.805402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.805857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.806317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.932142 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32c26688-9048-4d93-96e3-e9a952b4ae59 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164041 Oct 18 13:35:44.933194 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1513/3032] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:44.947316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.947943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] [instance: 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.956286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.957338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.957808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.958576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.959043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.959477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.984465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] HTTP exception thrown: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Request method failure captured: Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 HTTP/1.1 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTquGsBsUNAbXvWSLDAFzxzHoi31fgz20j0DYZK0r49-zWZ26UkqmSsgtPlLr1uyF0r319lWp2yWHQSAtF5lV46xdBqBLmxv3ippF2dvIFZRkwLY-ze4leYGaV0xHhxTQQKGMwXYU2AH2AB0VUa_tnYh88HUzkvL9Wg0otr_7XLXJL8Q Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 50333c729f8742e4b78d007d13fe66a8 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerPasswordTestJSON-833299127 Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:45.003797 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50333c729f8742e4b78d007d13fe66a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50333c729f8742e4b78d007d13fe66a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50333c729f8742e4b78d007d13fe66a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50333c729f8742e4b78d007d13fe66a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerPasswordTestJSON-833299127 Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 50333c729f8742e4b78d007d13fe66a8 Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerPasswordTestJSON-833299127 Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerPasswordTestJSON-833299127-project Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 63497dd52a5c4cd58e8916d3ea348479 Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerPasswordTestJSON-833299127-project Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. Oct 18 13:35:45.005171 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '50308cb3-bd0c-4deb-a7c9-6d858b0e32b6'} Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:45.005999 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. Oct 18 13:35:45.007247 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:45.008410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] Returning 404 to user: Instance 50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:45.008410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6697bbe1-1eac-44f9-99e7-4e4767f673ca tempest-ServerPasswordTestJSON-833299127 tempest-ServerPasswordTestJSON-833299127-project] 10.222.0.27 "GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6" status: 404 len: 111 microversion: 2.1 time: 0.045068 Oct 18 13:35:45.008410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1514/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/50308cb3-bd0c-4deb-a7c9-6d858b0e32b6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:45.008410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:45.008410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:45.008774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.008774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.008774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.008774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.009086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.044237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.394641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.415564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.417500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.435372 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b333389-4d30-4d3f-86c2-ea7c282bf324 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.445841 Oct 18 13:35:45.439303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1515/3034] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:45.462620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:45.463668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:45.475362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.479470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.480190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.481820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.484671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.495743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.586834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.598872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-484dc18d-baab-40f7-93ef-61d8235255f6 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 1.141449 Oct 18 13:35:46.599911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1516/3035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:45 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:46.609634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.612253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] [instance: 65fbacee-ee4f-438c-80f4-1877607c129c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.627219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.633079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.633079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.633079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.633079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.633510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.664479 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] HTTP exception thrown: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Request method failure captured: Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c HTTP/1.1 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqnuQZAQ-_BY7C-Ef--ouNx3UGhvBIuV-o5aGz8VWnqZZls9Sg_A5101tVT3rx3D0XRtSw7PUZCgKMW6H4K8t5M3tMXBCLD1JdvYCQTX91Ij0KBKnOfvgBBh7RBRMmi3eHW0OqEJQUPuQ-KhRdOV5XjsygU7LJFomX-t3UuVnn804Xw Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:46.670605 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9395a050de444357956d4ac79adefee6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9395a050de444357956d4ac79adefee6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9395a050de444357956d4ac79adefee6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9395a050de444357956d4ac79adefee6 Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-LiveMigrationTest-1969276186 Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d5ed601492e2486bad8ba5b09515d52a Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-LiveMigrationTest-1969276186-project Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. Oct 18 13:35:46.676206 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '65fbacee-ee4f-438c-80f4-1877607c129c'} Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:46.677166 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. Oct 18 13:35:46.679402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.680675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] Returning 404 to user: Instance 65fbacee-ee4f-438c-80f4-1877607c129c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:46.680675 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6e9a24e-567e-4c28-820e-2b8c87fca10e tempest-LiveMigrationTest-1969276186 tempest-LiveMigrationTest-1969276186-project] 10.222.0.27 "GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c" status: 404 len: 111 microversion: 2.1 time: 0.070029 Oct 18 13:35:46.680675 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1517/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:46 2022] GET /compute/v2.1/servers/65fbacee-ee4f-438c-80f4-1877607c129c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:46.689112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.694665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.708020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.708687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.709255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.710713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.713166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.713734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.047667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:47.065459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:47.075255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:47.088663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4857c73-5e9b-4a7e-a1ff-ab75fad79439 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.405495 Oct 18 13:35:47.090855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1518/3037] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:46 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:47.649051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.649051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.697866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.699072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.699638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.701848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.705363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.706867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.187869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.199398 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-538af283-4bf5-4a9a-9376-38e7639e5bfd tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.565345 Oct 18 13:35:48.206763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1519/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:48.216326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2048d25-dd63-4e1b-bece-34daba9cd37f", "tag": "d05a5554-e40a-4beb-a64c-81512dad8dac"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:48.227274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:48.228123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:48.228798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.240394 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] Creating event network-changed:d05a5554-e40a-4beb-a64c-81512dad8dac for instance f2048d25-dd63-4e1b-bece-34daba9cd37f on n-h2-858383-13 Oct 18 13:35:48.245919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-364daff7-d287-441a-b9ef-2a53e9dbffba req-a0790dcb-7552-4cad-a12a-8c58efa9783f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035260 Oct 18 13:35:48.246929 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1520/3039] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:48.255617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:48.256439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:48.263503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:48.264235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:48.264801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.265629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:48.269214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:48.269214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.413892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.427701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.429184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.443860 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94f02d0e-9db1-48a1-bf36-afa08cc77b3d tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.195853 Oct 18 13:35:48.444574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1521/3040] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:48 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:49.226044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:49.227587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:49.242598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.243358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.278860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.289176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.292974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.293639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:50.512180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.524496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ed6ecdb-8280-49eb-96e9-ee6a841ad347 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 1.301066 Oct 18 13:35:50.531783 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1522/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:49 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:50.539059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:50.545271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:50.566423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:50.571397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:50.572095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:50.574974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:50.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:50.576659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:50.804218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.818434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.826422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.836031 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0e11140-d21e-46fe-8a76-199ad4ba5e77 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.302886 Oct 18 13:35:50.843250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1523/3042] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:50 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7339438d-6124-4f81-83bc-172215faec02 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7339438d-6124-4f81-83bc-172215faec02 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/images/e8706eac-4b38-401a-841e-0c47b71de6dd/metadata/os_distro HTTP/1.1 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:50.962144 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'image_id': 'e8706eac-4b38-401a-841e-0c47b71de6dd', 'id': 'os_distro'} Oct 18 13:35:50.963896 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:50.964797 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e8706eac-4b38-401a-841e-0c47b71de6dd Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:50.966627 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8706eac-4b38-401a-841e-0c47b71de6dd could not be found. Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:50.967853 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:50.969099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7339438d-6124-4f81-83bc-172215faec02 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:50.973447 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7339438d-6124-4f81-83bc-172215faec02 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "DELETE /compute/v2.1/images/e8706eac-4b38-401a-841e-0c47b71de6dd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 9.889330 Oct 18 13:35:50.974637 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1520/3043] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:35:41 2022] DELETE /compute/v2.1/images/e8706eac-4b38-401a-841e-0c47b71de6dd/metadata/os_distro => generated 62 bytes in 9891 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:50.984608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad199ee2-37ee-4a7c-8ebe-0648b9b642d4 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Calling method '.version_select at 0x7fb33071c700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.055633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-ad199ee2-37ee-4a7c-8ebe-0648b9b642d4 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad199ee2-37ee-4a7c-8ebe-0648b9b642d4 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/images/76abca16-2e73-4d64-b868-0ecbfd3acb9e/metadata/os_version HTTP/1.1 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:51.059096 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'image_id': '76abca16-2e73-4d64-b868-0ecbfd3acb9e', 'id': 'os_version'} Oct 18 13:35:51.060364 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.061110 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 76abca16-2e73-4d64-b868-0ecbfd3acb9e Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.062142 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76abca16-2e73-4d64-b868-0ecbfd3acb9e could not be found. Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:51.063258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:51.064317 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.067225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad199ee2-37ee-4a7c-8ebe-0648b9b642d4 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:51.069105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad199ee2-37ee-4a7c-8ebe-0648b9b642d4 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "GET /compute/v2.1/images/76abca16-2e73-4d64-b868-0ecbfd3acb9e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.088185 Oct 18 13:35:51.069900 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1524/3044] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:35:50 2022] GET /compute/v2.1/images/76abca16-2e73-4d64-b868-0ecbfd3acb9e/metadata/os_version => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:51.084665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6133d0e-1526-4831-a278-8696c17c59da tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Calling method '.version_select at 0x7fb3352fa040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.090130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=42 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:51.100910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:51.121698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e6133d0e-1526-4831-a278-8696c17c59da tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6133d0e-1526-4831-a278-8696c17c59da tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/images/c98a5f47-3217-47d0-b6b4-86623870868e/metadata HTTP/1.1 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:51.123790 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'image_id': 'c98a5f47-3217-47d0-b6b4-86623870868e'} Oct 18 13:35:51.125089 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.125852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c98a5f47-3217-47d0-b6b4-86623870868e Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.127011 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c98a5f47-3217-47d0-b6b4-86623870868e could not be found. Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:51.128941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.131530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6133d0e-1526-4831-a278-8696c17c59da tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:51.133387 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6133d0e-1526-4831-a278-8696c17c59da tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "GET /compute/v2.1/images/c98a5f47-3217-47d0-b6b4-86623870868e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049738 Oct 18 13:35:51.133387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1521/3045] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:35:51 2022] GET /compute/v2.1/images/c98a5f47-3217-47d0-b6b4-86623870868e/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:51.141651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c236907c-1467-49c6-adbe-2b5b47427b13 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Action: 'update_all', calling method: .version_select at 0x7fb330471d30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:51.176046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c236907c-1467-49c6-adbe-2b5b47427b13 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c236907c-1467-49c6-adbe-2b5b47427b13 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/images/500ced34-cd07-4058-9fab-496780d1578d/metadata HTTP/1.1 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 57 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:51.179199 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:35:51.180542 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'image_id': '500ced34-cd07-4058-9fab-496780d1578d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.182192 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 500ced34-cd07-4058-9fab-496780d1578d Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.185529 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 500ced34-cd07-4058-9fab-496780d1578d could not be found. Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:51.187080 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:51.188643 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.190911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c236907c-1467-49c6-adbe-2b5b47427b13 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:51.190911 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c236907c-1467-49c6-adbe-2b5b47427b13 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "PUT /compute/v2.1/images/500ced34-cd07-4058-9fab-496780d1578d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045054 Oct 18 13:35:51.190911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1525/3046] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:51 2022] PUT /compute/v2.1/images/500ced34-cd07-4058-9fab-496780d1578d/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:51.192818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49cbc90c-4d47-4929-ab74-8c7dda24e431 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Action: 'update', calling method: .version_select at 0x7fb33535d700>, body: {"meta": {"os_distro": "alt"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:51.235045 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-49cbc90c-4d47-4929-ab74-8c7dda24e431 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49cbc90c-4d47-4929-ab74-8c7dda24e431 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/images/c01b2cac-6479-4c99-8d19-07746ab4362f/metadata/os_distro HTTP/1.1 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 30 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:51.237430 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: {"meta": {"os_distro": "alt"}} Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:35:51.239321 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'image_id': 'c01b2cac-6479-4c99-8d19-07746ab4362f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.240146 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c01b2cac-6479-4c99-8d19-07746ab4362f Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.241154 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c01b2cac-6479-4c99-8d19-07746ab4362f could not be found. Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:51.243925 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:51.246911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.251040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49cbc90c-4d47-4929-ab74-8c7dda24e431 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:51.251040 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49cbc90c-4d47-4929-ab74-8c7dda24e431 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "PUT /compute/v2.1/images/c01b2cac-6479-4c99-8d19-07746ab4362f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.052415 Oct 18 13:35:51.251040 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1522/3047] 10.222.0.27 () {60 vars in 1310 bytes} [Tue Oct 18 13:35:51 2022] PUT /compute/v2.1/images/c01b2cac-6479-4c99-8d19-07746ab4362f/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:51.256860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4217267-1d87-44cc-91f9-ec6ce4c75061 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Action: 'create', calling method: .version_select at 0x7fb3304eff70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:51.328129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d4217267-1d87-44cc-91f9-ec6ce4c75061 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] HTTP exception thrown: Image not found. Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4217267-1d87-44cc-91f9-ec6ce4c75061 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Request method failure captured: Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/images/88953ce1-4ed8-4cbd-8526-f851989b5960/metadata HTTP/1.1 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 57 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqushWwBvzR45P4vfUDLSu0jVGhqk_KpcBFvDkQGXzKJZDkAr5-8jC4wEsdVTUUk-pKZDSxy723xh3nWqjYEvE_MyQm5ocbIxQxoQJmO_MDyqvYk8A6ArBaXqbLsS_ysA6e6N9qm411Nu9QHy0dBL5AUBqBOGkwQ0F1yE5JwzthIUYc Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:51.331371 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fdd43b90ae4862bb1658e6c08cfb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c1fdd43b90ae4862bb1658e6c08cfb02 Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-189057201 Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 641f79ec2f6d4507a4c6a18b80e714b4 Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-189057201-project Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:35:51.333308 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'image_id': '88953ce1-4ed8-4cbd-8526-f851989b5960', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.335314 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 88953ce1-4ed8-4cbd-8526-f851989b5960 Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:35:51.336971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88953ce1-4ed8-4cbd-8526-f851989b5960 could not be found. Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:51.339036 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:35:51.342876 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:51.345208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4217267-1d87-44cc-91f9-ec6ce4c75061 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:51.345208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4217267-1d87-44cc-91f9-ec6ce4c75061 tempest-ImagesMetadataNegativeTestJSON-189057201 tempest-ImagesMetadataNegativeTestJSON-189057201-project] 10.222.0.27 "POST /compute/v2.1/images/88953ce1-4ed8-4cbd-8526-f851989b5960/metadata" status: 404 len: 62 microversion: 2.1 time: 0.085961 Oct 18 13:35:51.345208 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1526/3048] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Oct 18 13:35:51 2022] POST /compute/v2.1/images/88953ce1-4ed8-4cbd-8526-f851989b5960/metadata => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:51.553871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.554575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:51.561965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.564437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.565366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.566395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.566873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.567318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.872344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.878727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:51.902160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.903064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.903727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.904961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.911581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.915567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.935544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.963715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee0225b4-8a25-47c1-8093-e9f818ba11f2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1524 microversion: 2.1 time: 0.406325 Oct 18 13:35:51.974298 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1523/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:51 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1524 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:52.493747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:52.510705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:52.541503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:52.567759 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c34e0b08-f924-4093-9ab4-3f84800d6419 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.699403 Oct 18 13:35:52.568922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1527/3050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:51 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:52.991630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:52.994807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:53.005227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:53.006291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:53.006980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:53.007978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:53.008668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:53.009631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:53.353856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:53.362938 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8537718-61fa-4003-a4c2-e078c8b96cb1 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1506 microversion: 2.1 time: 0.378214 Oct 18 13:35:53.367018 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1524/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:52 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:53.608957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:53.610954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:53.639864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:53.640363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:53.649486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:53.660695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:53.661699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:53.665313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:53.672569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:54.400574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:54.401350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:54.417711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.418539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.419939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.420870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.422676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.425294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.628854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:54.639331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:54.645308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:54.657950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d43ed7a-122f-402d-9207-3c73c2464de8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 1.061961 Oct 18 13:35:54.660919 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1528/3052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:53 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:54.841475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:54.855728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca91533d-e483-4136-bb2e-63459bdad40d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1506 microversion: 2.1 time: 0.459606 Oct 18 13:35:54.872947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1525/3053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:54 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:54.881366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e53d5f-47cd-451c-a1b8-c23e38bbd79b", "name": "network-vif-unplugged", "status": "completed", "tag": "f6a02608-3703-414b-b2de-ba571a97a3e2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:54.897515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.898597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.899285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.915968 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] Creating event network-vif-unplugged:f6a02608-3703-414b-b2de-ba571a97a3e2 for instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b on n-h1-858383-13 Oct 18 13:35:54.921949 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-473bb92f-d739-4449-b0c0-46eb2f86bb95 req-590b6bd4-256b-4bf9-9d8f-b1839f1cb250 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047132 Oct 18 13:35:54.923207 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1526/3054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:55.019526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13e092ed-a0e5-433b-ad7c-069c21750d12 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb330642310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWU+APjy4v5I2egrvZGMyJ9715al2GUUDTN7lICLdkPWl+em5XnsfObdKTIm0Z6Ktxq8mlmwOOz4dfSyKzlQe7rOXFqHIhqIHQIYMRJwK8KqUdBWnWR2tKCKfexA61p3Q=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13e092ed-a0e5-433b-ad7c-069c21750d12 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 257 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:55.023733 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:35:55.025117 n-d-858383-13 devstack@n-api.service[121009]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWU+APjy4v5I2egrvZGMyJ9715al2GUUDTN7lICLdkPWl+em5XnsfObdKTIm0Z6Ktxq8mlmwOOz4dfSyKzlQe7rOXFqHIhqIHQIYMRJwK8KqUdBWnWR2tKCKfexA61p3Q=="}} Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWU+APjy4v5I2egrvZGMyJ9715al2GUUDTN7lICLdkPWl+em5XnsfObdKTIm0Z6Ktxq8mlmwOOz4dfSyKzlQe7rOXFqHIhqIHQIYMRJwK8KqUdBWnWR2tKCKfexA61p3Q=='}}} Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.025791 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.026964 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:35:55.034526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:35:55.036066 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:35:55.036066 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.036066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13e092ed-a0e5-433b-ad7c-069c21750d12 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.036066 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13e092ed-a0e5-433b-ad7c-069c21750d12 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.212212 Oct 18 13:35:55.036066 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1529/3055] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:54 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:55.040683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb3352fa4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-404840724", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.060737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:55.066657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for user dfe5957406304879a1adde2aa2c93c5c and project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:55.088772 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 2166 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-404840724", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:55.101268 n-d-858383-13 devstack@n-api.service[121010]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-404840724', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.103655 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.108632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e9d7d9f-6417-449c-960c-d10ecd92c100 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068009 Oct 18 13:35:55.111262 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1527/3056] 10.222.0.27 () {60 vars in 1160 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:55.118019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd82494c-d753-4c40-bdd2-90f8714d24b4 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb3304ef550>, body: {"keypair": {"name": "tempest-keypair-528887317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAhZYxKVup28xPdQ6LgBwpjfJfc2/DIKGlPhCIVEjofUFUiFFsi8N8d5x+c2PsTVQ17VDjO3sB0OsNa6h1xLlIiwqxQksroG4QGWgr1AuUDKrwxH5P6Wxurnsh/q8tucQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.138630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cd82494c-d753-4c40-bdd2-90f8714d24b4 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:55.140090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:55.145437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cd82494c-d753-4c40-bdd2-90f8714d24b4 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for user dfe5957406304879a1adde2aa2c93c5c and project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:55.236203 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd82494c-d753-4c40-bdd2-90f8714d24b4 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122947 Oct 18 13:35:55.237938 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1530/3057] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:55.252897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb3352c08b0>, body: {"keypair": {"name": "tempest-keypair-528887317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSIVMg/bMuO1ZUAK0uME653t1X9nlakKIAG9/QAFynYfSmfH2Gb977E5TM+cn11RKpeW0kRxHVSXdEVJOps7WR4849Mp4auuUT/BCN30pfojeJP0co1sam9ZdnxrjQmLA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.277917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:55.284212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for user dfe5957406304879a1adde2aa2c93c5c and project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:55.356760 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] HTTP exception thrown: Key pair 'tempest-keypair-528887317' already exists. Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 272 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: {"keypair": {"name": "tempest-keypair-528887317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSIVMg/bMuO1ZUAK0uME653t1X9nlakKIAG9/QAFynYfSmfH2Gb977E5TM+cn11RKpeW0kRxHVSXdEVJOps7WR4849Mp4auuUT/BCN30pfojeJP0co1sam9ZdnxrjQmLA=="}} Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: exception: Key pair 'tempest-keypair-528887317' already exists. Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-528887317', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSIVMg/bMuO1ZUAK0uME653t1X9nlakKIAG9/QAFynYfSmfH2Gb977E5TM+cn11RKpeW0kRxHVSXdEVJOps7WR4849Mp4auuUT/BCN30pfojeJP0co1sam9ZdnxrjQmLA=='}}} Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'dfe5957406304879a1adde2aa2c93c5c-tempest-keypair-528887317' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 13:35:55.377165 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:35:55.382621 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'dfe5957406304879a1adde2aa2c93c5c-tempest-keypair-528887317' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 35, 55, 302151), 'updated_at': None, 'name': 'tempest-keypair-528887317', 'user_id': 'dfe5957406304879a1adde2aa2c93c5c', 'fingerprint': '06:2a:47:88:ca:ba:16:9e:02:0b:17:fb:db:3b:7e:56', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSIVMg/bMuO1ZUAK0uME653t1X9nlakKIAG9/QAFynYfSmfH2Gb977E5TM+cn11RKpeW0kRxHVSXdEVJOps7WR4849Mp4auuUT/BCN30pfojeJP0co1sam9ZdnxrjQmLA==', 'type': 'ssh'}] Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi keypair.create() Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._create() Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-528887317' already exists. Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 18 13:35:55.390555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-528887317' already exists. Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-528887317' already exists. Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 409 to user: Key pair 'tempest-keypair-528887317' already exists. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bd63bb2-1944-4aff-91aa-0ca574b83f13 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.138567 Oct 18 13:35:55.396277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1528/3058] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:55.405056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-616ca713-9932-4956-8e0e-927f5bdb1072 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Calling method '.version_select at 0x7fb3304efe50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:55.499494 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-616ca713-9932-4956-8e0e-927f5bdb1072 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528887317" status: 202 len: 0 microversion: 2.1 time: 0.099599 Oct 18 13:35:55.500206 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1531/3059] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528887317 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:35:55.513409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-374bdc51-794b-431b-9bb9-b62e1c186043 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb3304a2310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO0d9ThkNYdV7jp+ajcgsKs3Sax+1E712PQ5BaU/Gvi1j3w9NXAA+9yAOsP68d6rnSyA6d2a9hz0dK7TB7QLsGIVA4jggugmDfblo5sVHjLKIPVr2tKSdR2ZQ+DrSpEUA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-374bdc51-794b-431b-9bb9-b62e1c186043 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 247 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO0d9ThkNYdV7jp+ajcgsKs3Sax+1E712PQ5BaU/Gvi1j3w9NXAA+9yAOsP68d6rnSyA6d2a9hz0dK7TB7QLsGIVA4jggugmDfblo5sVHjLKIPVr2tKSdR2ZQ+DrSpEUA=="}} Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO0d9ThkNYdV7jp+ajcgsKs3Sax+1E712PQ5BaU/Gvi1j3w9NXAA+9yAOsP68d6rnSyA6d2a9hz0dK7TB7QLsGIVA4jggugmDfblo5sVHjLKIPVr2tKSdR2ZQ+DrSpEUA=='}}} Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:35:55.519555 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-374bdc51-794b-431b-9bb9-b62e1c186043 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.523751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-374bdc51-794b-431b-9bb9-b62e1c186043 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012888 Oct 18 13:35:55.533396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb33071c820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1592536860", "public_key": " "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.534385 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1529/3060] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:55.551064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:55.561858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for user dfe5957406304879a1adde2aa2c93c5c and project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:55.582356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 95 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1592536860", "public_key": " "}} Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1592536860', 'public_key': ' '}}} Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.584968 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.589891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f66a64a-1a4d-4095-b7e1-2173d00aa4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058567 Oct 18 13:35:55.595405 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1532/3061] 10.222.0.27 () {60 vars in 1158 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 18 13:35:55.601121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0118f2db-2186-487e-8f3d-b378a9ee9550 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb335249940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7py674OrcVmdDKZ5pH252uo/BbxCedtA7DTdpjtHtRemRSQygBK4qmfsDxK0qdf+bWK7ezUrazzwiLhnvYDiEJNP46ts+EPPOVM5fuUGelcolPzDGfETuMmGdHPcZ6Xg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0118f2db-2186-487e-8f3d-b378a9ee9550 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 507 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7py674OrcVmdDKZ5pH252uo/BbxCedtA7DTdpjtHtRemRSQygBK4qmfsDxK0qdf+bWK7ezUrazzwiLhnvYDiEJNP46ts+EPPOVM5fuUGelcolPzDGfETuMmGdHPcZ6Xg=="}} Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7py674OrcVmdDKZ5pH252uo/BbxCedtA7DTdpjtHtRemRSQygBK4qmfsDxK0qdf+bWK7ezUrazzwiLhnvYDiEJNP46ts+EPPOVM5fuUGelcolPzDGfETuMmGdHPcZ6Xg=='}}} Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 13:35:55.605282 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0118f2db-2186-487e-8f3d-b378a9ee9550 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0118f2db-2186-487e-8f3d-b378a9ee9550 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009591 Oct 18 13:35:55.608518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1530/3062] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:35:55.616876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Action: 'create', calling method: .version_select at 0x7fb3352d6160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1680987208", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:55.637037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:55.642800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Getting quotas for user dfe5957406304879a1adde2aa2c93c5c and project c069d291000f4cf1943ed424c176b956. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:55.662151 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 118 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1680987208", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1680987208', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:35:55.668404 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ffaed74-a9b3-4427-ae11-4274c7360eea tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.053027 Oct 18 13:35:55.672178 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1533/3063] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:55.675508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dfdc6ca-e928-4337-8f5a-2cbdadb6a4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Calling method '.version_select at 0x7fb3304ac5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:55.694661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:55.695498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:55.697675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7dfdc6ca-e928-4337-8f5a-2cbdadb6a4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dfdc6ca-e928-4337-8f5a-2cbdadb6a4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Request method failure captured: Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2050998255 HTTP/1.1 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu6nU0AQWGTxYqb0ySeK6mPyU3TP6qwBsVd5UcabTbPE3Rt2xe3L93vnrzmJlRq-Yj0hp7fYuJ4uCtm_pLJgRDzzCtGRwSPcHFHrRRB4DS80RCxyFbJipkm1VintaaalX7px9tYRqSFWeUrakiO2iGV07vFWpE1RSY9lGWhIgJzAIE Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c069d291000f4cf1943ed424c176b956"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c069d291000f4cf1943ed424c176b956"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c069d291000f4cf1943ed424c176b956"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: c069d291000f4cf1943ed424c176b956 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-832246731 Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-KeyPairsNegativeTestJSON-832246731-project Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: exception: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'tempest-keypair-non-existent-2050998255'} Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.702890 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dfdc6ca-e928-4337-8f5a-2cbdadb6a4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2050998255 not found for user dfe5957406304879a1adde2aa2c93c5c {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7dfdc6ca-e928-4337-8f5a-2cbdadb6a4a3 tempest-KeyPairsNegativeTestJSON-832246731 tempest-KeyPairsNegativeTestJSON-832246731-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2050998255" status: 404 len: 145 microversion: 2.1 time: 0.029681 Oct 18 13:35:55.707753 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1531/3064] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2050998255 => generated 145 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:55.710297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:55.710821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:55.712178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:55.713653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:55.714318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:55.714920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:55.880546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:55.881627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:55.886252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:55.889484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:55.891914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:55.891914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:55.891914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:55.892465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:55.893049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:55.901052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:55.902931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:55.909582 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2b3dbf83-cf47-4e94-a880-83c41d446a53 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.225157 Oct 18 13:35:55.923728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1534/3065] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:55 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:56.161097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:56.173877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4995e77-e444-486b-8a19-30c65f4ee53a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1506 microversion: 2.1 time: 0.296950 Oct 18 13:35:56.174711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1532/3066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:55 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:56.942200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:56.942829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:56.949901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.950458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.950965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:56.951694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.952170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.952604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.197828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:57.198737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:57.209607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.210679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.211352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.212402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.214526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.215163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.364684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.403923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.417767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f019ac8a-a40b-4774-8888-55e2d92be401 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1506 microversion: 2.1 time: 0.224748 Oct 18 13:35:57.418994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1533/3067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:57 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:57.429343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.439687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.465463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27426eca-5d2a-4cf7-a1fd-9c577343bdb3 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.527699 Oct 18 13:35:57.473098 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1535/3068] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:56 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:58.443879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:58.447017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.459649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.475789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.475789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.475789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.476272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.481081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.504896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:58.505552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.528357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.529454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.529922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.530707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.531165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.531607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.733057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:58.752485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:58.755778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:58.776791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b780cbbc-0562-4e29-b0a0-00785ace71a8 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.279787 Oct 18 13:35:58.777384 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1536/3069] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:58 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:59.213558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:59.217695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d171fdf-6887-4e82-8878-d195fa952b39 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 200 len: 1449 microversion: 2.1 time: 0.779501 Oct 18 13:35:59.230422 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1534/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:58 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 1449 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:59.241788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:59.242562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:59.249284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.249997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.250619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.251510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.252774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.253425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.263566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:59.266494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.267240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.267898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.269355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.270181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.270788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.296567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:59.304463 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Working on deleting snapshot 9cf145ca-7eb8-442f-a17f-f93b27437a48 from shelved instance... Oct 18 13:35:59.306097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30376801-291d-41ce-82ae-9d0557fb2dc6 tempest-AZV2TestJSON-116424287 tempest-AZV2TestJSON-116424287-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.292120 Oct 18 13:35:59.307320 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1537/3071] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 18 13:35:59 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:35:59.814622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:59.816084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:59.826868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.827374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.832022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.832978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.833562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.833998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:00.099348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:00.111340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:00.112842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:00.140615 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35894189-3d30-4780-9fd8-fc5490e834f4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1544 microversion: 2.91 time: 0.331995 Oct 18 13:36:00.144480 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1538/3072] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:59 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1544 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:01.161940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Doing local delete in cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121010) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 13:36:01.162624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.163124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.163744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.164187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 13:36:01.175133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] deallocate_for_instance() {{(pid=121010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 13:36:01.186012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:01.187343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:01.207361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.208117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.208733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.209654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.210451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.211044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.390208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:01.403255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:01.405221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:01.411375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1090042-93e3-4a1d-a02e-49b3b2cb1413 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1531 microversion: 2.91 time: 0.236624 Oct 18 13:36:01.412647 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1539/3073] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:01 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1531 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:01.472912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:01.476687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:01.498043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.498752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.512755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.518623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.527317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.528908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.880566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] Lazy-loading 'services' on Instance uuid 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:01.900233 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f913911d-5d78-4cc0-8f16-fe23884e1b8a tempest-UnshelveToHostMultiNodesTest-88137336 tempest-UnshelveToHostMultiNodesTest-88137336-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1938 microversion: 2.91 time: 0.463358 Oct 18 13:36:01.928026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1540/3074] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:01 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1938 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:01.978847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:01.979388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.007052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.076128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:02.600793 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2653e96d-2a0c-49bc-adc4-0a35f54d4ad9 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 204 len: 0 microversion: 2.91 time: 0.645036 Oct 18 13:36:02.602544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1541/3075] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:36:01 2022] DELETE /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:36:02.614272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e53d5f-47cd-451c-a1b8-c23e38bbd79b", "name": "network-vif-deleted", "tag": "f6a02608-3703-414b-b2de-ba571a97a3e2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:02.641434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.641924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.642388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.664743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_external_events [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] Unable to find a host for instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b. Dropping event network-vif-deleted {{(pid=121009) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 13:36:02.671410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2bef0aba-5cab-415c-9a84-c49e31c4f10d req-aea9dc40-1cb0-4ce1-b48d-17ab84829798 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.058172 Oct 18 13:36:02.671410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1542/3076] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 13:36:02.679644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:02.683356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:02.697397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.703224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.703224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.703224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.703965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.704914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.719707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Updating instance_info_cache with network_info: [] {{(pid=121010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:36:03.241558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:03.260599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:03.262131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:03.292910 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de2015e5-5dad-4ff2-86c7-41a27eb8875b tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.620061 Oct 18 13:36:03.294732 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1543/3077] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:02 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:03.452490 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-118cb0dd-84ef-4165-b20d-d8517e8bf061 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 204 len: 0 microversion: 2.1 time: 4.215056 Oct 18 13:36:03.454427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1535/3078] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:59 2022] DELETE /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 0 bytes in 4218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:36:03.467829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:03.467829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:03.485716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.486769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.487261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.494674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.495285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.495755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.527291 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b HTTP/1.1 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '32e53d5f-47cd-451c-a1b8-c23e38bbd79b'} Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:03.534942 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:36:03.539596 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:03.540895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:03.543022 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-394b94e4-01ad-4e03-b2ee-c5bf979eb5b2 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 404 len: 111 microversion: 2.1 time: 0.082624 Oct 18 13:36:03.543601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1544/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:03 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:03.764362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2011407216", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:04.258553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:04.323663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:04.324486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:04.337244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:04.337957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:04.338567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:04.339425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:04.340113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:04.340696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:04.484656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:04.494888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:04.496646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:04.502501 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e7f3129-209c-4f3b-8e86-9fc3fd7d1df5 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.185469 Oct 18 13:36:04.503286 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1545/3080] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:04 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:36:05.291813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:05.538355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:05.538355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:05.539979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:05.540969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:05.541684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:05.542366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:05.542822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:05.549712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.550313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.552210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.554985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.555662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.556336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.558402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.563290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.563965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.567092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.567905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.568750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.613403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:05.629904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:05.651938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:05.657404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:05.661896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:05.810322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.820018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.823800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e1b26675df4407a678af7ac54892fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82cf578b2864ab381b613144be6b00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.835989 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0673ad46-e7b1-4d46-b31a-31f2f3c24bc4 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 200 len: 1537 microversion: 2.91 time: 0.308299 Oct 18 13:36:05.840571 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1546/3081] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:05 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:05.884723 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-191d35a2-f4fe-4275-a15d-a9a2cedb34bc tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.127119 Oct 18 13:36:05.887013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1536/3082] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:05.899685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7aa5802-7113-4b7b-9b9b-9225dddd909b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:05.900564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7aa5802-7113-4b7b-9b9b-9225dddd909b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:06.065490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7aa5802-7113-4b7b-9b9b-9225dddd909b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:06.075281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7aa5802-7113-4b7b-9b9b-9225dddd909b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1215 microversion: 2.1 time: 0.180000 Oct 18 13:36:06.092661 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1547/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:05 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:06.873536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:06.874777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] [instance: 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:06.893070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:06.893938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:06.894724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:06.895649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:06.900270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:06.900270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:06.960710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] HTTP exception thrown: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Request method failure captured: Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 HTTP/1.1 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqr0uVda_XiT-CovSxXL7R6m3cCcOGcIjph-PrUCVxvJFHpfG7lsE--yPixTuOwBudMdS4HTMbPdviXpuxIhZPkFkyR0hclXAvyxcLdS2aY25AjA6LGl91NFqGmF6HcA-ehfQdT-NWR-6WxCqGOsY06anPUkJwvc1LAnhUXDKmOhoWI Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.91 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d82cf578b2864ab381b613144be6b00b Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-949787784 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d82cf578b2864ab381b613144be6b00b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d82cf578b2864ab381b613144be6b00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d82cf578b2864ab381b613144be6b00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d82cf578b2864ab381b613144be6b00b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-949787784 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d82cf578b2864ab381b613144be6b00b Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-949787784 Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-UnshelveToHostMultiNodesTest-949787784-project Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d0e1b26675df4407a678af7ac54892fe Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-949787784-project Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '316ee54d-6679-49b2-8d3e-cb80d8d6c5f8'} Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:06.969030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. Oct 18 13:36:06.973402 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:06.977382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] Returning 404 to user: Instance 316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:06.985230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3dc964c-45ba-426e-a929-c0ef2f179e06 tempest-UnshelveToHostMultiNodesTest-949787784 tempest-UnshelveToHostMultiNodesTest-949787784-project] 10.222.0.27 "GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8" status: 404 len: 111 microversion: 2.91 time: 0.115158 Oct 18 13:36:06.985230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1537/3084] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:06 2022] GET /compute/v2.1/servers/316ee54d-6679-49b2-8d3e-cb80d8d6c5f8 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:36:07.100239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dff3035f-4a9b-4887-b1a6-4e3c7283b582 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:07.100937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dff3035f-4a9b-4887-b1a6-4e3c7283b582 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:07.927200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dff3035f-4a9b-4887-b1a6-4e3c7283b582 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:07.948083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dff3035f-4a9b-4887-b1a6-4e3c7283b582 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1215 microversion: 2.1 time: 0.850394 Oct 18 13:36:07.949835 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1548/3085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:07 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1215 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:08.980873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:08.980873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:08.995991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:08.996506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:08.996953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:08.997672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:08.998222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:08.998658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.134594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:09.172427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a51abf2-2be2-4c07-83a9-bbfaf872f8b9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1275 microversion: 2.1 time: 0.201457 Oct 18 13:36:09.184362 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1538/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:08 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:10.199066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:10.203570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:10.203570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:10.219534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:10.220042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:10.220587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:10.227170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:10.227671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:10.228358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:10.514387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:10.526219 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8e336d4-7952-4895-bfc5-d16f07ac8a47 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1273 microversion: 2.1 time: 0.331175 Oct 18 13:36:10.528902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1549/3087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:10 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:11.555550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:11.556776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:11.586534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.588129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.589187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.590568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.591551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.592388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.773324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:11.784960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0f33f17-9cd4-480a-bfb7-cabbc9b9da87 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1273 microversion: 2.1 time: 0.232967 Oct 18 13:36:11.786597 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1539/3088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:11 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:12.813240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:12.813868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:12.827336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:12.827850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:12.828476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:12.829382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:12.830593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:12.831191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.320586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2040291096", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:13.389048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:13.389240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:13.409397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b779e47f-f8a3-42e1-b654-f7c8b8592f27 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.599169 Oct 18 13:36:13.411341 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1550/3089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:12 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:13.617863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:13.618791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:13.619720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:13.620143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:13.620628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:13.631163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:13.631815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:13.634547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.634547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:13.634547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:13.634547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.641977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:13.659045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Getting quotas for project bd7c3553f1f34f86ad2a6fa9e4bb214a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:13.668535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Getting quotas for user 195f89e4994b4c0ebc19dead688b7ba1 and project bd7c3553f1f34f86ad2a6fa9e4bb214a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:13.686363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:13.688563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:13.906863 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60861f56-bd13-47fe-bbe5-48cf36e1ed32 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725961 Oct 18 13:36:13.917679 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1540/3090] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:36:13.922950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a97385a6-d797-4ed0-96d7-4021688f5270 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:13.922950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a97385a6-d797-4ed0-96d7-4021688f5270 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:14.309315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1761595462", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "c2cb59db-500f-4d04-8672-d91433bb6a2b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:14.335522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a97385a6-d797-4ed0-96d7-4021688f5270 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:14.342491 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a97385a6-d797-4ed0-96d7-4021688f5270 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1217 microversion: 2.1 time: 0.425422 Oct 18 13:36:14.363521 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1551/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:13 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:14.375813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] validate_networks() for [('c2cb59db-500f-4d04-8672-d91433bb6a2b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:14.437350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:14.438182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:14.458288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.472158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.474493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.478319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.479756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.480544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.481301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.783306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:14.793219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.807267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1c616cf-6207-4c14-bad4-98a496880914 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.371233 Oct 18 13:36:14.808024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1552/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:14 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:14.930867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:14.931769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:14.932285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:14.932945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:14.933539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:14.947391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.948173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.948853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.949822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.950970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.951417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.977083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Getting quotas for project 9c460a082fe34e6b9d2f3b73044d76e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:14.984511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Getting quotas for user f4e090dfe8fc4621b5446053eb2cc5f3 and project 9c460a082fe34e6b9d2f3b73044d76e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:14.999277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:15.002587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:15.042630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:15.169988 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-456c9e64-7f00-4acd-ae01-6b4563073e2f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047480 Oct 18 13:36:15.173215 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1541/3093] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:36:15.188749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c905e94-2eed-4ac9-91f2-80c87494a3c0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:15.188749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c905e94-2eed-4ac9-91f2-80c87494a3c0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:15.367788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f455f2-cbe5-4459-8bb4-458624111284 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:15.368945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9f455f2-cbe5-4459-8bb4-458624111284 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:15.402129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c905e94-2eed-4ac9-91f2-80c87494a3c0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.415715 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c905e94-2eed-4ac9-91f2-80c87494a3c0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1228 microversion: 2.1 time: 0.230077 Oct 18 13:36:15.418725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1553/3094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:15 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1228 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:15.486441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9f455f2-cbe5-4459-8bb4-458624111284 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.498372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9f455f2-cbe5-4459-8bb4-458624111284 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1217 microversion: 2.1 time: 0.135534 Oct 18 13:36:15.506162 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1542/3095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:15 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:15.735790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953577c5-1944-47a0-b848-1b365708a649", "tag": "1d1c3bec-877a-4296-8a80-ef3facbc2eb2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:15.763363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.772502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.772502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.797484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] Creating event network-changed:1d1c3bec-877a-4296-8a80-ef3facbc2eb2 for instance 953577c5-1944-47a0-b848-1b365708a649 on n-h1-858383-13 Oct 18 13:36:15.815657 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4b5113c8-ca05-4b23-89a4-9741caf3d4c2 req-e27085c2-3dff-40e7-b98a-b9bedbda5ed0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087458 Oct 18 13:36:15.818038 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1554/3096] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:15.841407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:15.843263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:15.868140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.869208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.871290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.873344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.875626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.876287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.500149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1572490-a82c-456f-92d5-63829561c02a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:16.500149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1572490-a82c-456f-92d5-63829561c02a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:16.644147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1572490-a82c-456f-92d5-63829561c02a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:16.660810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1572490-a82c-456f-92d5-63829561c02a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1228 microversion: 2.1 time: 0.212842 Oct 18 13:36:16.665425 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1555/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:16 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1228 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:16.682580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:16.683440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:16.698988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:16.701627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:16.701627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.710909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:16.711763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:16.712493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.896213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:16.905139 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8d8b265-a9dd-4988-b706-487d167cdd38 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1269 microversion: 2.1 time: 0.236940 Oct 18 13:36:16.909110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1556/3098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:16 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1269 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:16.959746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:16.968086 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e870cb41-a0bd-4808-ab04-86ce4b88da34 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 1.140096 Oct 18 13:36:16.968684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1543/3099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:15 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:17.690467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:17.691147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:17.713533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.713533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.713533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.726020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.726654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.727989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.938684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:17.939514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:17.959903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.960540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.960860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.961579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.962469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:17.964372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.964817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.974812 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38dfd2a8-732f-45bb-89b9-534179abb9e1 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1224 microversion: 2.1 time: 0.288533 Oct 18 13:36:17.976147 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1557/3100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:17 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:18.007887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:18.008987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:18.024237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.025019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.027517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.030119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.032395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.034740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.255610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:18.264109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5e3b860-df46-416d-aaa0-164ec53ee31c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1287 microversion: 2.1 time: 0.329186 Oct 18 13:36:18.264687 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1544/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:17 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1287 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:18.443474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:18.460915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e72074c0-f90f-45c1-a8b8-a1016c55a81e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.467618 Oct 18 13:36:18.461953 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1558/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:17 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:19.004668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:19.005391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:19.016057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.016653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.017159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.018210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.018843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.019335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.201103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:19.231465 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c839f6d4-f62c-4e80-b9f1-a156fc3c707f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1288 microversion: 2.1 time: 0.231761 Oct 18 13:36:19.238349 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1545/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:18 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1288 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:19.294544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:19.295366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:19.307243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.308049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.309201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.310165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.310854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.311478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.430703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:19.439065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f326e300-76e3-4ad1-93c5-89e401905894 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1275 microversion: 2.1 time: 0.152555 Oct 18 13:36:19.440072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1559/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:19 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:19.492371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:19.493008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:19.502906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.503645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.504108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.504831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:19.505308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:19.505749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:19.972078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:19.990033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eac835f7-2367-4f48-862d-777a1698ea49 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.502088 Oct 18 13:36:19.992373 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1546/3105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:19 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:20.263633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:20.264605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:20.278155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.279561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.280019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.281014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.283419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.286389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.377350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:20.392901 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d2726ee-562d-4fb5-a283-eba2248ac831 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1286 microversion: 2.1 time: 0.132859 Oct 18 13:36:20.395035 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1560/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:20 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:20.473992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:20.473992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:20.480075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.480579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.481028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.481743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.485250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.486308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.958047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:20.972902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.975931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.977175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.005213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] Creating event network-changed:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:36:21.019250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-dcb42c8a-88fa-48ea-b7a5-0a093aaa32f6 req-d1f11a05-eb14-488c-97e7-64f345833ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062551 Oct 18 13:36:21.019629 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1561/3107] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:21.033582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:21.034549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:21.052180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:21.052900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:21.053351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.054303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:21.054835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:21.055605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.138189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:21.150348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5da54fe6-bda9-4318-87bc-893793ba3ee6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1317 microversion: 2.1 time: 0.684039 Oct 18 13:36:21.152864 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1547/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:20 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:21.313753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:21.323952 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1ed4d77-2dfe-49e9-8de8-5e4d9faacceb tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.302918 Oct 18 13:36:21.333597 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1562/3109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:21 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:21.418797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:21.419477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:21.425922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:21.426465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:21.427098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.431835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:21.431835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:21.431835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.787807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:21.796090 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5a502a7-f571-46d9-811a-c976c267ba9e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1286 microversion: 2.1 time: 0.381332 Oct 18 13:36:21.797358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1548/3110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:21 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1286 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:22.179396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:22.187198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:22.214749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.214749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.214749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:22.219130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.221021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.222504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:22.437793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:22.448088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07bafa2f-caf6-4df3-994d-523ac51a1fec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1317 microversion: 2.1 time: 0.275118 Oct 18 13:36:22.464549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1563/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:22 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:22.492601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:22.493236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:22.521308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.522585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.523449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:22.525748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.526933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.527557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:22.651014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1425900651", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "707abdc1-393e-48fd-8130-5e953a30e299"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:22.762624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] validate_networks() for [('707abdc1-393e-48fd-8130-5e953a30e299', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:22.864741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:22.873758 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-daff50f1-3534-457e-99de-eb939c6cb846 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.397334 Oct 18 13:36:22.874385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1564/3112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:22 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:22.986532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-515861255", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:23.097390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] validate_networks() for [('88731a66-75b4-44e9-9d7e-50afbe0fb192', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:24.430129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:24.431546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:24.432234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:24.439750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:24.439750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:24.441469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:24.442495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:24.443306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:24.444110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:24.444789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:24.453379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.456333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.457636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.460574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.462566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.464122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.465738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.466559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.467272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.468315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.469708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.470549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.504775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Getting quotas for project 6f06a13e0abd49e7a23ba3ce837418bd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:24.512375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Getting quotas for user 95ebb57f540241b49112abdc3e90431a and project 6f06a13e0abd49e7a23ba3ce837418bd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:24.530313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:24.530511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Getting quotas for project ef289ee4f9954fc1bceaee4b381c3d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:24.533500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:24.539624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Getting quotas for user a857437becf14392bd1332824d86111c and project ef289ee4f9954fc1bceaee4b381c3d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:24.565166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:24.568583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:24.746549 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d0aa00f-3452-40c9-9649-80de20622893 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414026 Oct 18 13:36:24.747213 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1549/3113] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:36:24.755008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.755907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:24.762563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.763068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.763521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.764234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.764958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.765398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.888851 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74260285-2cc6-4799-b494-8785e65b3028 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.002985 Oct 18 13:36:24.898849 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1565/3114] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:24.985163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.997973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:25.056181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.065157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.065157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.068607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.073219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.074465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.417774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.427307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c138a61-4a09-47c4-88f9-6817de49e59d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1317 microversion: 2.1 time: 0.525159 Oct 18 13:36:25.428698 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1566/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.447617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:25.448270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:25.455298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.455805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.462755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.463713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.464370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.467273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.586271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.599332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b366c96b-dc5a-4e7f-b81f-e5bd71889ed6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.849974 Oct 18 13:36:25.601309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1550/3116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.620049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953577c5-1944-47a0-b848-1b365708a649", "name": "network-vif-plugged", "status": "completed", "tag": "1d1c3bec-877a-4296-8a80-ef3facbc2eb2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:25.656782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.657288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.657770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.740090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.740775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] Creating event network-vif-plugged:1d1c3bec-877a-4296-8a80-ef3facbc2eb2 for instance 953577c5-1944-47a0-b848-1b365708a649 on n-h1-858383-13 Oct 18 13:36:25.740775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d3ec41f9-cd1f-4ea6-a25b-1df267458d4f req-bf64e29d-739c-482c-aeab-0200e0c0a711 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130306 Oct 18 13:36:25.740775 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1551/3117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:25.754279 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5e5c204-b3f6-4dd3-9701-5b75513e6106 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.317507 Oct 18 13:36:25.755406 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1567/3118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:25 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.755823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4ebbe65-51a1-4856-8727-3ed97d0f6cd8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:25.756863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4ebbe65-51a1-4856-8727-3ed97d0f6cd8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:25.761860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdddcd2a-f3e0-4e18-acb0-a87515d7eeca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:25.762750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cdddcd2a-f3e0-4e18-acb0-a87515d7eeca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:25.827945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdddcd2a-f3e0-4e18-acb0-a87515d7eeca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.836303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdddcd2a-f3e0-4e18-acb0-a87515d7eeca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1213 microversion: 2.1 time: 0.079469 Oct 18 13:36:25.846562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1568/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:25 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.871016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad0e3f1-9346-4e15-af49-c6b646afe404", "tag": "b655477f-67cf-47ee-8395-c9b1b5eb2824"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:25.873736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4ebbe65-51a1-4856-8727-3ed97d0f6cd8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.889202 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4ebbe65-51a1-4856-8727-3ed97d0f6cd8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1217 microversion: 2.1 time: 0.140066 Oct 18 13:36:25.907143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1552/3120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:25 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.929316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:25.932194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:25.935608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.953221 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] Creating event network-changed:b655477f-67cf-47ee-8395-c9b1b5eb2824 for instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 on n-h2-858383-13 Oct 18 13:36:25.961636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f568a694-96b4-4ea3-a920-871a464ea0a1 req-11e2f555-dbb5-4c89-a1bf-835f5bc23fb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113472 Oct 18 13:36:25.962881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1569/3121] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:26.269589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cb613f4-263f-4761-8e4f-1583bb6a1cf0"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:26.273336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:26.287068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.288993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.288993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.291538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.295054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.297707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.373416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6b78365-b58f-41a3-a956-2ab8452bfa6e tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] Action: 'create', calling method: .version_select at 0x7fb3352ddc10>, body: {"security_group": {"name": "tempest-securitygroup-1160599295", "description": "tempest-description-1991090274"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:27.020506 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6b78365-b58f-41a3-a956-2ab8452bfa6e tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.032390 Oct 18 13:36:27.021534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1553/3122] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:36:25 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:27.026667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.027655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.035892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.036386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.036992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.037771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.038347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.038802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.187118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.195803 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63970dd3-b36b-4188-99c3-da461be6d31e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1317 microversion: 2.1 time: 0.173160 Oct 18 13:36:27.196384 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1554/3123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.201527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.202314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.209006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.209716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.210536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.211498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.211961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.212807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.370416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.381031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4569658-07b6-423a-8fcc-8237df9be77e tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.183346 Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1555/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.395151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.395895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.396010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.398609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.629882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.639632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9bb5fb59-6a04-4e39-bc7a-a5ef09d0ce4d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1315 microversion: 2.1 time: 0.256636 Oct 18 13:36:27.640505 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1556/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.653405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.654259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.662232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.663119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.663772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.664541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.665015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.665625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.836207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.849230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-504bdfb9-d6a2-4dae-a7b4-3da64c270cd3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1209 microversion: 2.1 time: 0.207468 Oct 18 13:36:27.849814 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1557/3126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1209 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.854375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.854987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.867380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.867889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.868340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.869321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.869783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.870417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.968123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.979185 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca879020-071f-4138-93a9-0c52bf97f75d tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1269 microversion: 2.1 time: 0.126204 Oct 18 13:36:27.981561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1558/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1269 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.992483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bc763f7-b336-43ac-845b-c28dfda6a663 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] Action: 'create', calling method: .version_select at 0x7fb335369af0>, body: {"security_group": {"name": "tempest-securitygroup-610144821", "description": "tempest-description-1698842997"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:28.358508 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b54d50b4-f79d-47cb-a976-e239f7e3924e tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "POST /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.094286 Oct 18 13:36:28.359132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1570/3128] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:36:26 2022] POST /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments => generated 194 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:28.364740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-plugged", "status": "completed", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:28.376326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.376824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.379939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.388061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] Creating event network-vif-plugged:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:36:28.393169 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c147b95c-5c57-4350-a604-56a5f4d0fbd3 req-f2d1706e-ea46-483a-9fb5-ab82f4b3a2fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Oct 18 13:36:28.393756 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1571/3129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:28.398979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:28.399954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:28.406909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.407421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.407866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.409121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.409587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.410028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.667670 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bc763f7-b336-43ac-845b-c28dfda6a663 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.679761 Oct 18 13:36:28.667670 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1559/3130] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:36:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:28.677743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:28.678467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:28.691787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.692338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.692790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.693546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.694014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.694478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.964663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:28.983141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29e6c143-8296-4f63-a8a6-b31dacbe232c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.316566 Oct 18 13:36:28.984101 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1560/3131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:28 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.086124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.098505 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d7d7a3d3-ca05-46e8-8977-3a5d9c6f03c2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1317 microversion: 2.1 time: 0.699039 Oct 18 13:36:29.099714 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1572/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:28 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.104706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:29.105324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:29.129537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15debed8-62ba-48f3-a263-ccba73d1b6bf tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] Action: 'create', calling method: .version_select at 0x7fb3352bec10>, body: {"security_group": {"name": "tempest-securitygroup-1429597872", "description": "tempest-description-2098032575"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:29.133965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.144620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.145194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.146267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.146900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.149615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.475978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.490665 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85085e0a-3e32-4bd0-b02d-dbfc114cd284 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1501 microversion: 2.1 time: 0.389563 Oct 18 13:36:29.510651 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1573/3133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:29 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1501 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.519577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:29.520580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:29.526859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.527408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.532978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.532978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.532978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.532978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.561464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:29.644505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.654423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2e4f6fb-e816-4521-adc7-bdebed900fba tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1273 microversion: 2.1 time: 0.145579 Oct 18 13:36:29.671385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1574/3134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:29 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.682328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:29.683170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.694538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.812520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.832702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4a048f3-6150-4801-9dfd-3084bcf20460 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1275 microversion: 2.1 time: 0.159986 Oct 18 13:36:29.833325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1575/3135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:29 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.856108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:29.892089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.894832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.895649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.933747 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15debed8-62ba-48f3-a263-ccba73d1b6bf tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.934049 Oct 18 13:36:29.944474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1561/3136] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:36:28 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:29.950394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5b31923-ec18-4523-99fc-99a032686b8c tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] Action: 'create', calling method: .version_select at 0x7fb33535e3a0>, body: {"security_group": {"name": "tempest-securitygroup-1858018279", "description": "tempest-description-2108831853"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:30.048071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Going to try to stop instance {{(pid=121009) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:36:30.459702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8205e3b0-2d55-43f2-bd4d-b8e0633bef92 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649/action" status: 202 len: 0 microversion: 2.1 time: 0.615763 Oct 18 13:36:30.463242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1576/3137] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:29 2022] POST /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:30.476523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:30.479629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:30.488764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.489572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.490029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.490770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.491266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.491908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.531752 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5b31923-ec18-4523-99fc-99a032686b8c tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.585449 Oct 18 13:36:30.532391 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1562/3138] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:36:29 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:30.542576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:30.543700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:30.552910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.553885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.554529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.555439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.556065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.558437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.750223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:30.759175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2e1da8d-95ab-4335-b54e-6a27db72e279 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1466 microversion: 2.1 time: 0.224200 Oct 18 13:36:30.759956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1563/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1466 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:30.771670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:30.772513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:30.784526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.785138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.785672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.786664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.791732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.794254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.848790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:30.867997 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a7c49d78-2628-4d14-aa6a-df618350f91a tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.402860 Oct 18 13:36:30.888605 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1577/3140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:30.895988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6d77b3a-c1b3-407f-9860-71c3fcb74ad0 tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] Calling method '.version_select at 0x7fb330b34670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:31.057311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:31.070655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3caab183-f1f2-487d-8bb5-39d55c2b7535 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.309375 Oct 18 13:36:31.082170 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1564/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:31.082170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:31.082170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:31.084679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.085424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.086806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.094432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.097961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.097961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.144128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:31.306832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:31.316748 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-122cea72-2122-4fae-8cda-699d9101fef9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.243850 Oct 18 13:36:31.336570 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1565/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:31 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:31.342718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-19949886", "metadata": {"image_type": "test"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:31.345525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:31.352933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.353682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.364658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.364658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.364658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.364658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.395626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Getting quotas for project bd7c3553f1f34f86ad2a6fa9e4bb214a. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:31.401384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Getting quotas for user 195f89e4994b4c0ebc19dead688b7ba1 and project bd7c3553f1f34f86ad2a6fa9e4bb214a. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:31.911873 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a500308b-8925-4f27-b5a5-ccd229ae36d8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "POST /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a/action" status: 202 len: 0 microversion: 2.1 time: 0.573292 Oct 18 13:36:31.912777 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1566/3143] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:31 2022] POST /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:36:31.918769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:31.919494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:31.927109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.927617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.928167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.928955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.929430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.929872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.106269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.116229 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc8bee4e-b8b8-4e54-808f-68b5de905193 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.202034 Oct 18 13:36:32.117017 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1567/3144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:31 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:32.121895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad0e3f1-9346-4e15-af49-c6b646afe404", "name": "network-vif-plugged", "status": "completed", "tag": "b655477f-67cf-47ee-8395-c9b1b5eb2824"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:32.132526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.133150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.133604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.147402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] Creating event network-vif-plugged:b655477f-67cf-47ee-8395-c9b1b5eb2824 for instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 on n-h2-858383-13 Oct 18 13:36:32.153537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cc7d09c2-5a5f-4682-b10a-b49b0d17cdf9 req-39953a73-dd7b-450a-9087-0402b9d15b03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035435 Oct 18 13:36:32.157306 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1568/3145] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:32.164532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.165781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:32.176485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.176974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.177447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.178308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.179316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.179612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.354138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.367173 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5e216b0-6838-4479-8ae5-68af0b32e7f8 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.208577 Oct 18 13:36:32.369042 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1569/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:32.375486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-735d44a7-f429-451f-ae17-65f674c1bde5 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352f20d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.436382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-735d44a7-f429-451f-ae17-65f674c1bde5 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.064677 Oct 18 13:36:32.437247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1570/3147] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:32.441845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.442645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.456523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.628579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.638640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab3aa0c8-414f-4b22-affd-c79f4a727870 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.200033 Oct 18 13:36:32.639904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1571/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:32.646689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.648213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:32.655485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.658010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.658010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.658010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.658010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.658953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.823825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.837837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62b283f9-c30c-4449-bb29-68effe0419f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.196237 Oct 18 13:36:32.838881 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1572/3149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:33.089216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658caf01-42bf-4ba6-8cad-e9a69b3e2919", "tag": "2e072e0d-0dfc-42d0-8f02-b0d6e53ded39"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:33.100114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.100539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.101544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.114767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] Creating event network-changed:2e072e0d-0dfc-42d0-8f02-b0d6e53ded39 for instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 on n-h1-858383-13 Oct 18 13:36:33.120337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-52b87b23-3262-41a4-a4e3-5d4f08721d1e req-659f60d0-c46e-4a75-8833-96899e4ce6e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035073 Oct 18 13:36:33.121253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1573/3150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:33.144109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.145136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.152687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.153324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.154090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.155339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.155339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.156003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.322278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:33.332446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77076b3d-e38f-4822-bd74-b14e3c3f36d8 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.195629 Oct 18 13:36:33.334091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1574/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:33.400178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.400977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.410480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.410994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.411636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.412745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.413221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.413665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.564262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:33.586832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa9e4ca7-dbdb-4415-8213-3d632302f1a2 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1328 microversion: 2.1 time: 0.190714 Oct 18 13:36:33.587651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1575/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:33.596031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-540306b7-a165-411c-8102-18e25840398f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352cb550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.657014 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-540306b7-a165-411c-8102-18e25840398f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.068177 Oct 18 13:36:33.657719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1576/3153] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:33.662979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.664739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.674402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.674402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.674402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.675264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.676225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.676921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.884136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:33.893593 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0b94915-b559-489f-848c-75123d952161 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.234543 Oct 18 13:36:33.894430 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1577/3154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:33.915712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.916344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.922902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.923452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.924400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.925325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.925800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.926355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.087256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:34.097484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15d9b568-72fd-40ea-8834-65f558e420b3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.189792 Oct 18 13:36:34.113439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1578/3155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:34.357195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.357850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:34.365620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.366293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.367542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.368367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.369218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.369761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.489138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:34.492299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:34.525966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:34.535093 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-86e29f76-43a7-4641-ba22-6c20f94222ab tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.182095 Oct 18 13:36:34.538109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1579/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:34.609138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.609769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:34.617155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.617888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.618372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.619354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.619870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.620311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.761819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:34.775020 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f0f7cc5-7d66-4739-a4d2-0e050704b6fa tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1527 microversion: 2.1 time: 0.169802 Oct 18 13:36:34.776094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1580/3157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1527 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:34.781576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a0759bd-41f2-4155-99c7-4352c088fd28 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352fee50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.832322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a0759bd-41f2-4155-99c7-4352c088fd28 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.054710 Oct 18 13:36:34.832928 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1581/3158] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:34.838236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.838464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:34.845399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.846753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.847213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.847946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.848422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.849347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.001293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.010919 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ed1668d-382e-4a4b-b2c0-15c436ceba4d tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1527 microversion: 2.1 time: 0.176960 Oct 18 13:36:35.011539 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1582/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.017406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.019151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.026032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.026750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.027357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.028414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.029078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.029531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.047282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6d77b3a-c1b3-407f-9860-71c3fcb74ad0 tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12362 microversion: 2.1 time: 4.155798 Oct 18 13:36:35.048522 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1578/3160] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12362 bytes in 4158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:35.178249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.178824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.194112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.194622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.195066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.196048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.198094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.202297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.209935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.219199 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-015eea93-b352-4e7e-9bc3-1bff75a4217a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.206380 Oct 18 13:36:35.230711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1583/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.230711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc9fd73c-cd75-4099-b1a6-cd468f1c9137 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] Calling method '.version_select at 0x7fb3352f21f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.246124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] HTTP exception thrown: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Request method failure captured: Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 HTTP/1.1 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqvN2V8lk2DAoSxMkhdDGyN6tT_fmZ38Zt928CKtUfmrLwm6TnpShq4zpBNg7W1ITGcqFFHTXMUMf5utgftDpncuDQDfVMuTfcSgMwXe-rP25laoO9OkO203fNaWB6VK9acAUiWTmgoul6f-_YuWjHGeP3KVQOwUFEMfCtAFUrVPcgc Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b201693e6af64739b3ff64ae0b938f91 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b201693e6af64739b3ff64ae0b938f91 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1801692095-project Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2ba6838531ce4d16a36ea3ef1fecb0b7 Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095-project Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5ad0e3f1-9346-4e15-af49-c6b646afe404'} Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:35.247997 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Returning 404 to user: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-728d3352-55e9-4917-9659-c6ab00ab9633 tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 404 len: 111 microversion: 2.1 time: 0.200112 Oct 18 13:36:35.254097 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1579/3162] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:35 2022] DELETE /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:35.263136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.263771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.272930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.273547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.274005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.274831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.275287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.275731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.442596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.457736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-628f05e2-bf52-4877-807a-8b1e56f08e3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.200621 Oct 18 13:36:35.458630 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1580/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.468306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc9fd73c-cd75-4099-b1a6-cd468f1c9137 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.236897 Oct 18 13:36:35.468306 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1584/3164] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.468306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.468306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.478081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76ced1b-9fbd-4d2f-8201-91288e5f7894", "tag": "4bc38e37-c557-42ec-9ba0-06654cefe66a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:35.478301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.478301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.478301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.478301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.488029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.488029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.488029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.493273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.493273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.493273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.502709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] Creating event network-changed:4bc38e37-c557-42ec-9ba0-06654cefe66a for instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 on n-h1-858383-13 Oct 18 13:36:35.508344 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40176693-3ff1-4d3f-9809-44c40f35716f req-5e4ad5ca-4478-4db9-ad8f-17fe2006b94d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048564 Oct 18 13:36:35.512002 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1581/3165] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:35.517048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-356e77bb-1c13-43c4-ab24-668bbe1c4f22 tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] Calling method '.version_select at 0x7fb330acddc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.520902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.656885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.665776 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-709de0e9-106f-48e7-b933-2b209871714c tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1527 microversion: 2.1 time: 0.204850 Oct 18 13:36:35.666626 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1585/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.671445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.672409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.679512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.680389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.680846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.681559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.682026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.682492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.830046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-356e77bb-1c13-43c4-ab24-668bbe1c4f22 tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/02bed64b-8982-426a-98ca-f35b9c3152bd" status: 202 len: 0 microversion: 2.1 time: 0.314841 Oct 18 13:36:35.830046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1582/3167] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:36:35 2022] DELETE /compute/v2.1/os-security-groups/02bed64b-8982-426a-98ca-f35b9c3152bd => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:35.836426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Action: 'update', calling method: >, body: {"server": {"name": "5ad0e3f1-9346-4e15-af49-c6b646afe404_new"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:35.843020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.846212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.860708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.863715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.866119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.866731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.867191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.867635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.879727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=28 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.883489 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] HTTP exception thrown: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Request method failure captured: Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 HTTP/1.1 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 64 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqvN2V8lk2DAoSxMkhdDGyN6tT_fmZ38Zt928CKtUfmrLwm6TnpShq4zpBNg7W1ITGcqFFHTXMUMf5utgftDpncuDQDfVMuTfcSgMwXe-rP25laoO9OkO203fNaWB6VK9acAUiWTmgoul6f-_YuWjHGeP3KVQOwUFEMfCtAFUrVPcgc Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b201693e6af64739b3ff64ae0b938f91 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b201693e6af64739b3ff64ae0b938f91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b201693e6af64739b3ff64ae0b938f91 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1801692095-project Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2ba6838531ce4d16a36ea3ef1fecb0b7 Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1801692095-project Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "5ad0e3f1-9346-4e15-af49-c6b646afe404_new"}} Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5ad0e3f1-9346-4e15-af49-c6b646afe404', 'body': {'server': {'name': '5ad0e3f1-9346-4e15-af49-c6b646afe404_new'}}} Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:35.885286 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] Returning 404 to user: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05645f9d-bf0b-4e4a-a058-e6270e7f8a7e tempest-ServersNegativeTestMultiTenantJSON-1801692095 tempest-ServersNegativeTestMultiTenantJSON-1801692095-project] 10.222.0.27 "PUT /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 404 len: 111 microversion: 2.1 time: 0.056863 Oct 18 13:36:35.891530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1583/3168] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:36:35 2022] PUT /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:35.896685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24ce36fc-85ae-4258-89c9-dcdf2b49181f tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] Calling method '.version_select at 0x7fb3352d6f70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.902420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.913229 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69ec0731-bec9-4bb0-a959-206120426347 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.245487 Oct 18 13:36:35.914224 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1586/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.919405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6616d46-d4bc-4387-b243-b0b523f5d000 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352f0940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.979485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6616d46-d4bc-4387-b243-b0b523f5d000 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.063660 Oct 18 13:36:35.987238 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1587/3170] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.997675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.998317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.006878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.007489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.008365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.009571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.010015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.010485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.047001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:36.163664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24ce36fc-85ae-4258-89c9-dcdf2b49181f tempest-SecurityGroupsTestAdminJSON-65834502 tempest-SecurityGroupsTestAdminJSON-65834502-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1f117022-4b06-4409-bc2e-73caaf4318ab" status: 202 len: 0 microversion: 2.1 time: 0.275212 Oct 18 13:36:36.164263 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1584/3171] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:36:35 2022] DELETE /compute/v2.1/os-security-groups/1f117022-4b06-4409-bc2e-73caaf4318ab => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:36.172116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b8fd46cb-859c-48d8-8742-33a5ab55a6f1 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] Calling method '.version_select at 0x7fb330590940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.388534 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f37ee1c9-5bad-4534-a550-8e1316e792c6 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 204 len: 0 microversion: 2.1 time: 0.398031 Oct 18 13:36:36.390780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1588/3172] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:35 2022] DELETE /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:36:36.397729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.398554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.408613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.410093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.410473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.411283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.412475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.412475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.587478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:36.602405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6442d07a-be4e-4a70-8085-8c4fd8d9d1a8 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.209868 Oct 18 13:36:36.606625 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1589/3173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:36 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:36.614850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.615950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.624496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.625109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.625640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.626567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.627143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.627654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.803051 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b8fd46cb-859c-48d8-8742-33a5ab55a6f1 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6f9e8710-e2d6-4230-bf35-33087d612ffb" status: 202 len: 0 microversion: 2.1 time: 0.634481 Oct 18 13:36:36.809714 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1585/3174] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:36:36 2022] DELETE /compute/v2.1/os-security-groups/6f9e8710-e2d6-4230-bf35-33087d612ffb => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:36.810495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.812205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.825761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:36.835491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.836983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.837457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.838380 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb0b81de-3c0c-4348-ba10-64488417545f tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1533 microversion: 2.1 time: 0.228808 Oct 18 13:36:36.840143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1590/3175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:36 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1533 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:36.841622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.842497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.843176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.860389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28c12522-6c43-4fa0-a10f-e33e0d1c7ab1 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] Calling method '.version_select at 0x7fb3353c4dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.214378 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28c12522-6c43-4fa0-a10f-e33e0d1c7ab1 tempest-SecurityGroupsTestAdminJSON-978362164 tempest-SecurityGroupsTestAdminJSON-978362164-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/076ead97-a4d5-4155-9b65-a1881530ab41" status: 202 len: 0 microversion: 2.1 time: 0.372894 Oct 18 13:36:37.214966 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1591/3176] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:36:36 2022] DELETE /compute/v2.1/os-security-groups/076ead97-a4d5-4155-9b65-a1881530ab41 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:37.230119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.230684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:37.237318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.238142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.241444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.241444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.241444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.241444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.263211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:37.279459 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e71980f-8319-41fa-8f3f-960359f8323c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.473822 Oct 18 13:36:37.280053 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1586/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:36 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:37.302450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34a769d9-236b-4223-bb05-5b35d26283ae tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3305900d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.373997 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34a769d9-236b-4223-bb05-5b35d26283ae tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.076795 Oct 18 13:36:37.374945 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1587/3178] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:37.385488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-plugged", "status": "completed", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:37.418362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.419090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.424676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.444659 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] Creating event network-vif-plugged:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:36:37.477181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fc90ece2-2718-4160-bf6b-143252e21cb7 req-53f4dff4-0068-436c-a079-1f570cf711ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099162 Oct 18 13:36:37.478215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1588/3179] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:37.498954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:37.515256 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-927ef18e-f4e8-40a4-a5d1-f80ebf434e2f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.293121 Oct 18 13:36:37.515256 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1592/3180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:37.628133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.628988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:37.653111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.653870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.657067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.659069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.659713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.663486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.862941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:37.867413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.868817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:37.875943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35ee08e9-b787-4a87-93de-caba45dcae8a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.252561 Oct 18 13:36:37.878222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.878924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.879716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.881461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.882126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.882731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.901467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1589/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.098334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.111826 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88601913-8f2c-489a-baf4-3b256b3ff760 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1533 microversion: 2.1 time: 0.248936 Oct 18 13:36:38.116711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1593/3182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1533 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.306426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.307468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.321453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.323764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.327196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.328246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.329081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.334094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.391044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-534af9ad-5f27-4496-bea3-22a6a3bc816e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352dd430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.466611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-534af9ad-5f27-4496-bea3-22a6a3bc816e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.075005 Oct 18 13:36:38.471003 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1594/3183] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.537842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.538569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.546847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.556461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3499dbce-24ba-4582-a378-9b4279ea4f6b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.254139 Oct 18 13:36:38.557049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1590/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.558595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.559120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.559557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.560280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.560744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.561186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.725525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad0e3f1-9346-4e15-af49-c6b646afe404", "name": "network-vif-deleted", "tag": "b655477f-67cf-47ee-8395-c9b1b5eb2824"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:38.742595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.744365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.745054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.763160 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] Creating event network-vif-deleted:b655477f-67cf-47ee-8395-c9b1b5eb2824 for instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 on n-h2-858383-13 Oct 18 13:36:38.770373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fbd780e9-5218-4966-99b5-edf73813ad5e req-7a31211e-12b9-4013-b236-8457e4afa155 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048312 Oct 18 13:36:38.771784 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1591/3185] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:38.847464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.859153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23252975-c0de-4fb0-ba88-320dad73f386 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.326214 Oct 18 13:36:38.874095 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1595/3186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:38.904540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.905226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.918465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.919411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.920039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.920932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.921776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.922404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.137565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.138952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.143050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:39.149387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.149895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.150634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.151090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.151562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.152004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.153749 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bc363f2-5e2a-4864-b343-c545660192a9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.254205 Oct 18 13:36:39.154571 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1592/3187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:39.198354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.198805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.199444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.200075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lazy-loading 'fault' on Instance uuid 5ad0e3f1-9346-4e15-af49-c6b646afe404 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:39.247076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e090dfe8fc4621b5446053eb2cc5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c460a082fe34e6b9d2f3b73044d76e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:39.259538 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6094608-3eb3-41b2-9ceb-cba8c64aa4a0 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 200 len: 1318 microversion: 2.1 time: 0.126473 Oct 18 13:36:39.260823 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1596/3188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:39.478811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c1c2f7d-d367-4924-adf9-f0713c6008bd tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352d6ca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.507611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76ced1b-9fbd-4d2f-8201-91288e5f7894", "name": "network-vif-plugged", "status": "completed", "tag": "4bc38e37-c557-42ec-9ba0-06654cefe66a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:39.525087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.525806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.526618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.543838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] Creating event network-vif-plugged:4bc38e37-c557-42ec-9ba0-06654cefe66a for instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 on n-h1-858383-13 Oct 18 13:36:39.545907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c1c2f7d-d367-4924-adf9-f0713c6008bd tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.071177 Oct 18 13:36:39.546741 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1593/3189] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:39.552267 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2cde983d-db92-4a4d-8369-629cb1637adc req-258fed0e-07bf-43c3-bfe2-af99b966abbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048205 Oct 18 13:36:39.552267 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1597/3190] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:39.590306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.590953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.614778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.615448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.615935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.625835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.625835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.625835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.887777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.888642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.889080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:39.897164 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b64e6c24-d437-4777-8f1f-86c81767179b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.313554 Oct 18 13:36:39.897755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1594/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:39.901875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.902666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.903612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.908562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.913146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.913922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.079496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:40.090921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-498a6fbb-5026-4fbe-9046-453dad01b6b3 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.209954 Oct 18 13:36:40.091518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1598/3192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:40.181340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:40.182030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:40.192442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.193027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.199249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.200378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.200959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.201653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.284554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:40.285123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] [instance: 5ad0e3f1-9346-4e15-af49-c6b646afe404] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:40.291867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.292638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.293306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.294029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.294775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.295226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.326415 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] HTTP exception thrown: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Request method failure captured: Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 HTTP/1.1 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqu9s3Iw93jo2DFYacGmsMTadaCiUI3d0YNnwds57_GZ-vxBJDCgK3lSWYXNnGmziSPd6BOsmrw072LrTOyfekLYY60EkLz--84X__utaYHPGneGvvmo57P9jPAmMAvJ-mS8o1De3yE2q5DeFS8uVEAXKtJ7LPUBWBc8RLRMQhRGXiw Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c460a082fe34e6b9d2f3b73044d76e4 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-924777226 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c460a082fe34e6b9d2f3b73044d76e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c460a082fe34e6b9d2f3b73044d76e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c460a082fe34e6b9d2f3b73044d76e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c460a082fe34e6b9d2f3b73044d76e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-924777226 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c460a082fe34e6b9d2f3b73044d76e4 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-924777226 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestMultiTenantJSON-924777226-project Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f4e090dfe8fc4621b5446053eb2cc5f3 Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-924777226-project Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5ad0e3f1-9346-4e15-af49-c6b646afe404'} Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:40.328325 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] Returning 404 to user: Instance 5ad0e3f1-9346-4e15-af49-c6b646afe404 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:40.332051 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98a7792c-ef8e-4b8d-adb1-2f387d5ccdb5 tempest-ServersNegativeTestMultiTenantJSON-924777226 tempest-ServersNegativeTestMultiTenantJSON-924777226-project] 10.222.0.27 "GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404" status: 404 len: 111 microversion: 2.1 time: 0.051257 Oct 18 13:36:40.334502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1599/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:40 2022] GET /compute/v2.1/servers/5ad0e3f1-9346-4e15-af49-c6b646afe404 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:36:40.399025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:40.399515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9306e37c-492b-4715-a096-1aad06f1e441 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.221516 Oct 18 13:36:40.400392 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1595/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:40 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:40.570184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ff7fbc3b-92e0-4813-8d36-1214a82412f3 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353f19d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:40.816917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ff7fbc3b-92e0-4813-8d36-1214a82412f3 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.069958 Oct 18 13:36:40.816917 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1600/3195] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:40 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:40.927875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:40.928950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:40.950493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.951505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.952180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.953276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.953999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.954663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.113480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.115339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.132374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.132887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.133349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.134088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.134728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.135330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.257821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:41.269502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63843051-0e73-41bc-9303-69102ed7467f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1313 microversion: 2.1 time: 0.348374 Oct 18 13:36:41.271975 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1596/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:40 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.423721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.424990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.433188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.433701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.434189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.434914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.435416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.435825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.486689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:41.502848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97b4897c-1266-438b-a9dd-184e67dc95e1 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.393753 Oct 18 13:36:41.518093 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1601/3197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.566190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658caf01-42bf-4ba6-8cad-e9a69b3e2919", "name": "network-vif-plugged", "status": "completed", "tag": "2e072e0d-0dfc-42d0-8f02-b0d6e53ded39"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:41.592209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.592209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.592209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.605464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] Creating event network-vif-plugged:2e072e0d-0dfc-42d0-8f02-b0d6e53ded39 for instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 on n-h1-858383-13 Oct 18 13:36:41.634753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-60d5746a-a333-41e3-ae52-da2bbf9b429e req-1f53f51d-cdaa-4faf-9fce-5154b374d258 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072094 Oct 18 13:36:41.636054 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1602/3198] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:41.749405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:41.758767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b644bd37-bef7-4063-8738-ee896463d7d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.338915 Oct 18 13:36:41.759357 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1597/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.844855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4b71e7d-250e-41d1-a249-a50eac836967 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb335335280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.845088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.849373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.864504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:41.867243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.868243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.869134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.870273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.870906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.872180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.929533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4b71e7d-250e-41d1-a249-a50eac836967 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.100271 Oct 18 13:36:41.930233 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1603/3200] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.952813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7a020823-943f-4ede-9e67-7d46403f5ba4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117853 Oct 18 13:36:41.956578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1598/3201] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:41.966417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.967234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.977177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.978399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.979085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.980089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.980653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.981319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.085388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lazy-loading 'services' on Instance uuid f2048d25-dd63-4e1b-bece-34daba9cd37f {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:42.278906 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a090c321-79e3-45ba-b915-31ebb1aa97a4 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments/6cb613f4-263f-4761-8e4f-1583bb6a1cf0" status: 202 len: 0 microversion: 2.1 time: 0.316313 Oct 18 13:36:42.280387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1604/3202] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:36:41 2022] DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments/6cb613f4-263f-4761-8e4f-1583bb6a1cf0 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:42.304847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:42.307469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.325519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.327645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.328923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.331090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.334492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.335720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.370978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:42.531989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:42.532720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.546796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.547299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.548235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.550451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.552416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.552917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.687243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:42.696849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1835a27b-c558-45b3-b803-f0cc87575771 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1500 microversion: 2.1 time: 0.402007 Oct 18 13:36:42.698236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1599/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:42 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1500 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:42.722431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:42.725491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.734827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.735740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.736859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.737720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.738352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.739155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.771717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lazy-loading 'flavor' on Instance uuid b76ced1b-9fbd-4d2f-8201-91288e5f7894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:42.951894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:42.963141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c88cf16f-0ad7-42de-8b21-fb4529e07a4c tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1317 microversion: 2.1 time: 0.435139 Oct 18 13:36:42.966464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1605/3204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:42 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:42.971237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:42.971864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.988392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.988910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.989391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.991918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.991918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.991918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.051020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:43.245935 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-996f8939-8504-468a-8f1a-4bb6476f8f57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "POST /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894/action" status: 200 len: 32 microversion: 2.1 time: 0.528812 Oct 18 13:36:43.246830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1600/3205] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:42 2022] POST /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894/action => generated 32 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:36:43.255929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3fd3b8f8-317e-407c-a73f-ee235b197d7e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330c00310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:43.369425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3fd3b8f8-317e-407c-a73f-ee235b197d7e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.121194 Oct 18 13:36:43.379699 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1601/3206] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:43 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:43.394232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:43.399153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:43.450934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:43.464055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:43.464953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:43.466155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.466730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b5bccf3-da66-45c3-997c-099e9584dc00 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.498160 Oct 18 13:36:43.470120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:43.471195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1606/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:42 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:43.474430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:43.476413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.989379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:43.990122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.016292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.016816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.017311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.022826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.023571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.024227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.230350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:44.249888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20c3c065-fad5-4018-9d07-28c603177389 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.863966 Oct 18 13:36:44.249888 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1602/3208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:43 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:44.394232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d1cfdcb-b0b6-4287-b6f9-b21607c61940 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3305d2790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.468086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d1cfdcb-b0b6-4287-b6f9-b21607c61940 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.078273 Oct 18 13:36:44.469216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1603/3209] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:44.494370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.497133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.519184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.520542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.523281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.524214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.524854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.525487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.567744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:44.585496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0606c2f6-6519-4034-8cca-039adb4cf7dc tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1505 microversion: 2.1 time: 0.601010 Oct 18 13:36:44.588924 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1607/3210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:43 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:44.614972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.616544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.640321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.640878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.642886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.648302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.648834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.649303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.717311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-096a2d5d-d8cf-4165-900f-060d21832260 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips" status: 200 len: 108 microversion: 2.1 time: 0.103943 Oct 18 13:36:44.728635 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1608/3211] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips => generated 108 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:44.736970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.737521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.755686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.756207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.756671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.761841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.762426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.765972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.828628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b4906de-0b15-4fa3-a84d-e6066bc0315f tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips" status: 200 len: 108 microversion: 2.1 time: 0.099288 Oct 18 13:36:44.831373 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1609/3212] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips => generated 108 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:44.844176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.847405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.857044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.857862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.861256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.861256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.861256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.861256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.893317 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccddf8da-a773-40b3-b551-71234850f752 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips/tempest-ServerAddressesTestJSON-410396618-network" status: 200 len: 93 microversion: 2.1 time: 0.053531 Oct 18 13:36:44.894694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1610/3213] 10.222.0.27 () {58 vars in 1398 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919/ips/tempest-ServerAddressesTestJSON-410396618-network => generated 93 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:36:44.907556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.908430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.915766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.917361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.918767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.919705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.922851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.923629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.936831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:44.950208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d6a006c-4902-432a-81ae-a48b9f1bf44b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.461593 Oct 18 13:36:44.967018 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1604/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:44.983962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:45.283774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.285939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.322462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.325410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.329129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.337461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.339566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.340280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.442479 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29d25f2d-489e-4232-89d8-6e0574e8de10 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "DELETE /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 204 len: 0 microversion: 2.1 time: 0.539589 Oct 18 13:36:45.443792 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1611/3215] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:44 2022] DELETE /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:36:45.472468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.474848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.483251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.484016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.484622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.485494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.486782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.487437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.959996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:45.974009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf497d83-70d7-461d-ab5a-ac110b3e2792 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.709952 Oct 18 13:36:45.975715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1605/3216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:45.982703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2aece691-c3ab-461b-944b-4857fb7e48c4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330471d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.993230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:46.002601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb0e1521-438a-409b-809c-86427d2eb845 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1511 microversion: 2.1 time: 0.544775 Oct 18 13:36:46.008243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1612/3217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:46.013153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:46.013790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:46.053361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:46.053885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:46.054374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.059337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:46.065226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:46.065730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.068494 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2aece691-c3ab-461b-944b-4857fb7e48c4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.091454 Oct 18 13:36:46.086336 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1606/3218] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:46.496319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:46.507825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da004431-1be2-4edd-9b37-7ad9f9afeeac tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.498420 Oct 18 13:36:46.522082 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1613/3219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:46 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:47.009270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.010816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:47.029115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.033991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:47.045227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.045916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.047422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.047735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.049951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.050504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.051132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.053088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.054984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.055244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.056280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.059959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.309049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.321418 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4faf8ebe-5055-48a9-a880-3f214f0ce996 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1511 microversion: 2.1 time: 0.297370 Oct 18 13:36:47.335549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1614/3220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:47 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:47.341533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6114bdd2-217e-4b80-b960-d9fc3baa6b9b tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353358b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.433286 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6114bdd2-217e-4b80-b960-d9fc3baa6b9b tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.097443 Oct 18 13:36:47.433881 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1615/3221] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:47 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:47.538315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.539211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:47.551689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.558070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.558917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.559862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.571028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.571774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.600380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.611879 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5644aa13-a2dc-43bc-9cff-a97aba0d43c8 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.612167 Oct 18 13:36:47.614166 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1607/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:46 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:47.822915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.857580 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c94c2458-51fe-4b24-87fe-132224f5dc82 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.322742 Oct 18 13:36:47.868129 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1616/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:47 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:48.378725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.433552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.458483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51f83352-a66e-4645-8141-0bc8a23cfadb tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d6c10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.518997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51f83352-a66e-4645-8141-0bc8a23cfadb tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.065962 Oct 18 13:36:48.528176 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1617/3224] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:48.639490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.640348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.653778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.654733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.655429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.656465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.657163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.658385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.847685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:48.858344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f23b7c26-f55d-4293-a349-1f1bd5242248 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.225452 Oct 18 13:36:48.860527 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1618/3225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:48.894228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.895639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.903626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.904506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.905224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.906734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.907595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.908963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.113056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:49.123381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09f88fd9-4466-45ef-a64b-4dc307d14e64 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.234229 Oct 18 13:36:49.140467 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1619/3226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:49.546785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17409eec-613c-4bdb-9863-67d53bc9c9a6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352f0430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:49.615482 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17409eec-613c-4bdb-9863-67d53bc9c9a6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.081262 Oct 18 13:36:49.615482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1620/3227] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:49 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:49.664994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:49.678254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01971e77-49ab-49ee-87be-efdc1ed227d4 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1511 microversion: 2.1 time: 1.320945 Oct 18 13:36:49.678849 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1608/3228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1511 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:49.884764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:49.885677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:49.895936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.900832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.901513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.902475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.903097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.905593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.122101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658caf01-42bf-4ba6-8cad-e9a69b3e2919", "name": "network-vif-deleted", "tag": "2e072e0d-0dfc-42d0-8f02-b0d6e53ded39"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:50.147964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.148465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.155342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.203779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] Creating event network-vif-deleted:2e072e0d-0dfc-42d0-8f02-b0d6e53ded39 for instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 on n-h1-858383-13 Oct 18 13:36:50.253589 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7684995a-8243-4bd4-ade4-165f7fae178a req-5f13e70e-7d74-47e0-9b18-cefbb3a3c6fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132774 Oct 18 13:36:50.260464 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1609/3229] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:50.295120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.297216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.315168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.318220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.318707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.325964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.327098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.328290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.483461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:50.515323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7dcff9cd-9baa-4f4f-a45f-9c031ad73e07 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.634365 Oct 18 13:36:50.519842 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1621/3230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:49 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:50.639540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7747db66-61e1-426b-986b-a19e5e83de0e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352f2a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.725343 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7747db66-61e1-426b-986b-a19e5e83de0e tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.100200 Oct 18 13:36:50.727696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1622/3231] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:50.733045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.733971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.748508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.750456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.753899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.755199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.755851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.756545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.812734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.813279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.813740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.817368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lazy-loading 'fault' on Instance uuid 658caf01-42bf-4ba6-8cad-e9a69b3e2919 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:50.912621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ebb57f540241b49112abdc3e90431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f06a13e0abd49e7a23ba3ce837418bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:50.931427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b79834c-015a-4a8e-bf15-a67c5e205d85 tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 200 len: 1307 microversion: 2.1 time: 0.202276 Oct 18 13:36:50.938340 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1623/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:51.025608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:51.054664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-584e8809-ea76-4819-82af-0a995f480b95 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.790617 Oct 18 13:36:51.055138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1610/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:51.536390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.537822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.546830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.547743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.552520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.553131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.553490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.554256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.554732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.555438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.560743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.564446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.565126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.566323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.568120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.570294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.627309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd89a3bc-7456-42c7-93bd-54a36a0ec148 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096079 Oct 18 13:36:51.637159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1624/3234] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:36:51.757445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10f1eacf-175f-41b5-bb4e-56159b678398 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353f15e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.871272 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10f1eacf-175f-41b5-bb4e-56159b678398 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.134285 Oct 18 13:36:51.871862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1625/3235] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:51.886826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.894178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.918361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.922242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.922242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.922242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.922242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.922242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.964210 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-842aa631-d007-44b8-ac54-445d21add6bc tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081067 Oct 18 13:36:51.971238 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1626/3236] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:36:51.976612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.977447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] [instance: 658caf01-42bf-4ba6-8cad-e9a69b3e2919] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.987020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.987912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.988532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.989437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.990112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.990713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.036111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:52.038985 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] HTTP exception thrown: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Request method failure captured: Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 HTTP/1.1 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqvW_L0eqCmmmm83zVR8w7ifSabUxarF3MsHEK4-N4CWntSA1IqBo0jqwAqbH9rw_rBfMjxT_PuyuUAWa8yr8zfvq5z1cwkdi7wMdfA2kWwxiLRLwxvZmEtNwIWI0_44aXLjcozI35f6p-SDJjcNLeO4yxmVvXEYaZuaoGxxkwtJf5g Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6f06a13e0abd49e7a23ba3ce837418bd Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerAddressesTestJSON-1164215074 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f06a13e0abd49e7a23ba3ce837418bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6f06a13e0abd49e7a23ba3ce837418bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6f06a13e0abd49e7a23ba3ce837418bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6f06a13e0abd49e7a23ba3ce837418bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerAddressesTestJSON-1164215074 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6f06a13e0abd49e7a23ba3ce837418bd Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1164215074 Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerAddressesTestJSON-1164215074-project Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 95ebb57f540241b49112abdc3e90431a Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerAddressesTestJSON-1164215074-project Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '658caf01-42bf-4ba6-8cad-e9a69b3e2919'} Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:52.050949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] Returning 404 to user: Instance 658caf01-42bf-4ba6-8cad-e9a69b3e2919 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:52.055789 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e33e7c97-a479-4a0b-81ca-79e77c31307e tempest-ServerAddressesTestJSON-1164215074 tempest-ServerAddressesTestJSON-1164215074-project] 10.222.0.27 "GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919" status: 404 len: 111 microversion: 2.1 time: 0.074208 Oct 18 13:36:52.057226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1627/3237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/658caf01-42bf-4ba6-8cad-e9a69b3e2919 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:52.078262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:52.096800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.113249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.116880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.117293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.120997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.121560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.122014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.388815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:52.400946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83800998-d039-4ff7-8e37-62188c42b48f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.858000 Oct 18 13:36:52.422397 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1611/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:52.498828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:52.502717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.530750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.531554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.532324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.533506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.534168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.536126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.596221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:53.079592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02613f68-98f0-4dd9-99af-2e665b39f101 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 204 len: 0 microversion: 2.1 time: 0.648251 Oct 18 13:36:53.079592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1612/3239] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:52 2022] DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:36:53.087456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f5d5da10-41f2-4d34-852f-6930bda88092 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330cac4c0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.172657 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f5d5da10-41f2-4d34-852f-6930bda88092 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.096791 Oct 18 13:36:53.179465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1613/3240] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:53.186715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.187466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:53.213198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.214293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.215320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.218610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.221986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.224770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.261961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:53.272414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12d93cbf-f5f1-4cd4-90be-7afc0e5985d9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 1.198465 Oct 18 13:36:53.273004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1628/3241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:52 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:53.429227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.429853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:53.436543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.442613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.443528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.444559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.450831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.451613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.540860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:53.549422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c08a3694-5195-4659-a24f-0d191934309b tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1682 microversion: 2.1 time: 0.368762 Oct 18 13:36:53.550017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1614/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:54.190550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c0bd41c-544c-489f-9c42-83eab37230ec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521a160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.252063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:54.266216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c0bd41c-544c-489f-9c42-83eab37230ec tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.080915 Oct 18 13:36:54.266497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3cb2df4-2bc3-4570-b87c-df85885aab54 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.835810 Oct 18 13:36:54.267645 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1615/3243] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:54.268576 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1629/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:54.303358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.304875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:54.321980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.322531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.329395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.330994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.331475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.331928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.575211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.575833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:54.590640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.597027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.597027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.597027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.597027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.597027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.862203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:54.880328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afecc877-d95c-4cc0-bec4-0d27199f5541 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.585231 Oct 18 13:36:54.899766 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1616/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:55.289854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b697b507-1c75-4299-a75e-c52aaa16a816 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521aa60>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.391176 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b697b507-1c75-4299-a75e-c52aaa16a816 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.112703 Oct 18 13:36:55.392530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1617/3246] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:55.405939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.410780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:55.429157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.434833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.435686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.436676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.437385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.438049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.635191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:55.649378 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4696934-27ab-4c1f-b72d-244558e33c13 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1682 microversion: 2.1 time: 1.078053 Oct 18 13:36:55.649959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1630/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1682 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:55.910824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.912596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:55.938290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.940309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.941425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.943974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.945346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.948228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.971522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:55.989326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-595d8522-3a18-4938-8673-cf9499ee6b49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.595436 Oct 18 13:36:56.008116 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1618/3248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:56.410092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd118c14-d227-4afd-ab51-ca8555ed58d3 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3305d2b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.537960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd118c14-d227-4afd-ab51-ca8555ed58d3 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.133696 Oct 18 13:36:56.539720 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1619/3249] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:56.678952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.687512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:56.697254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.702892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.703435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.708522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.709094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.709553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.726354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:56.759227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:56.774073 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd0cd13b-6f58-453a-be75-f851cb65017a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1511 microversion: 2.1 time: 0.868917 Oct 18 13:36:56.774797 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1631/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1511 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:56.932982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:56.943633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6156b94-7c61-403c-8e64-33e10fc15f75 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1614 microversion: 2.1 time: 0.270033 Oct 18 13:36:56.945010 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1620/3251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1614 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:57.013320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.014318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.032894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.033772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.034467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.035448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.036128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.036782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.385093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:57.397060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0853d027-5717-4b9e-a472-35267cd3ca7b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.387916 Oct 18 13:36:57.406661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1632/3252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:57.557760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f5cad786-d041-4dd6-9f0b-acd8195b9292 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3305900d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.668445 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f5cad786-d041-4dd6-9f0b-acd8195b9292 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1420 microversion: 2.1 time: 0.117360 Oct 18 13:36:57.669654 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1621/3253] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:57.803841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.804474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.820417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.821035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.824278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.825044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.830076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.839180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.879115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2048d25-dd63-4e1b-bece-34daba9cd37f", "name": "network-vif-deleted", "tag": "d05a5554-e40a-4beb-a64c-81512dad8dac"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:57.929014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.931386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.937702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.972474 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] Creating event network-vif-deleted:d05a5554-e40a-4beb-a64c-81512dad8dac for instance f2048d25-dd63-4e1b-bece-34daba9cd37f on n-h2-858383-13 Oct 18 13:36:57.986912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7faf9610-e60b-4092-bd38-681eb0286e87 req-3244fc50-c2fa-4318-a158-baeb623d87b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112494 Oct 18 13:36:57.988182 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1622/3254] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:57.996704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.003021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.016738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.018289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.019002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.021833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.022800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.025411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.372661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:58.388520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97e381aa-28ca-4c5a-b2a4-620bd52adb65 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1614 microversion: 2.1 time: 0.396004 Oct 18 13:36:58.397106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1623/3255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1614 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.432603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.433249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.443406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.449695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.449695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.449695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.449695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.450116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.687032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:58.698412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8afe157a-b13f-4460-b250-59accae13896 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.270209 Oct 18 13:36:58.713822 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1624/3256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.716305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75029a9b-29ff-478a-805e-659d3710fea4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3305901f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.730710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:58.742217 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e1b0dc5-33d3-40dc-b735-e152f2e5bc0d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1488 microversion: 2.1 time: 0.943614 Oct 18 13:36:58.742812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1633/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1488 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.768138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.768650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.786511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.786999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.787450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.788168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.788632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.789149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.797871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75029a9b-29ff-478a-805e-659d3710fea4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1429 microversion: 2.1 time: 0.086169 Oct 18 13:36:58.801424 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1625/3258] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.826879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39b971ab-e86f-4df6-a922-e08d9c3aaef8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330cacb80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.853216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:58.963987 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39b971ab-e86f-4df6-a922-e08d9c3aaef8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 200 len: 1429 microversion: 2.1 time: 0.154595 Oct 18 13:36:58.985254 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1626/3259] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 1429 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:59.004676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.007492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.039384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.040125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.042195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.044365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.044937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.046563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.224872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:59.314925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c82a66d-952a-4f40-9a72-2a0515d53fb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 204 len: 0 microversion: 2.1 time: 0.550414 Oct 18 13:36:59.315785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1634/3260] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:58 2022] DELETE /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:36:59.333984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.335097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.360166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.362711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.364347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.365495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.367222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.370319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.882476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:59.895867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7695c719-bcea-416f-9809-60a93c25d98a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1494 microversion: 2.1 time: 0.571466 Oct 18 13:36:59.898121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1635/3261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1494 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:59.906384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.907245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.936011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.939878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.940577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.941511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.952494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.952494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.055754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.056259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.058203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.058706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lazy-loading 'fault' on Instance uuid f2048d25-dd63-4e1b-bece-34daba9cd37f {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:00.161308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.174306 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b06091f-5746-4f05-afe9-c88874476482 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1466 microversion: 2.1 time: 1.177062 Oct 18 13:37:00.175939 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1627/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1466 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.200476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.201021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.233051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.233541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.234007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.234761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.235220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.236193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.315948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd1e93724564bf18a8d3a15c12169dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.326651 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aaa45a1e-d81c-41c7-ab57-ac2742d4f970 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 200 len: 1331 microversion: 2.1 time: 0.427087 Oct 18 13:37:00.327253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1636/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 1331 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.351623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b74eb43-d6e8-4d85-aa9b-86ec72fc3448 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33535d1f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.479729 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b74eb43-d6e8-4d85-aa9b-86ec72fc3448 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6" status: 200 len: 784 microversion: 2.1 time: 0.151127 Oct 18 13:37:00.480373 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1637/3264] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/images/8cd3436a-01fb-4325-a6ee-cd057c374be6 => generated 784 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:00.505778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd0448b3-4b53-4a84-8ce5-de8d4f5e8de2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.540002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd0448b3-4b53-4a84-8ce5-de8d4f5e8de2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038954 Oct 18 13:37:00.541000 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1638/3265] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:00.562691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf8db7af-1f4a-442d-b605-ed8f650da9f2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3310aaa60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.878349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.899773 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-229c9243-4127-4a51-aaa8-181f01af59fd tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.696053 Oct 18 13:37:00.900511 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1628/3266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.926351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.927135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.953393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.953912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.963041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.966556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.967064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.973159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.717910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.748342 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2fd4670-b516-49a4-901f-08a753bd1e7c tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1494 microversion: 2.1 time: 0.809335 Oct 18 13:37:01.755383 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1629/3267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1494 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:01.808056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:01.816661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:01.834249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.834800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.837636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.862880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.862880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.862880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.895766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] HTTP exception thrown: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Request method failure captured: Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f HTTP/1.1 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqtEGKHN-NfXvLxM-kdfkTqKklpnso2u_z4UN17B2kKA30iwuTvOT_jTRx3rnJ1GJhxHQlKASyhiVQ1XSXserHWqMbOgztF0AFnZ6v2dA8C8pwJ4_a7ZzYFilqbzhgWTqpAdGj_JxhTRwHuHSOMV3fOtjv0kI22CWSe4DRWTsGG79bA Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3fd1e93724564bf18a8d3a15c12169dc Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f2048d25-dd63-4e1b-bece-34daba9cd37f'} Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:01.898938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Returning 404 to user: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:01.903118 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4b4ef6c7-6b52-4e72-9f21-e22711ea0045 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 404 len: 111 microversion: 2.1 time: 0.143342 Oct 18 13:37:01.909087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1630/3268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:01 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:01.914314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-unplugged", "status": "completed", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:01.942950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.946860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.947505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.980930 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] Creating event network-vif-unplugged:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:37:01.995161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0724861f-439b-4f8f-a945-be61ce73fb86 req-d04165cf-9226-4f2d-816a-010fb8e2933b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084607 Oct 18 13:37:01.997919 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1631/3269] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:02.013197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad6fd3f9-53e9-4701-be5c-c6901023cd1c tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '.version_select at 0x7fb335291280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.128042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad6fd3f9-53e9-4701-be5c-c6901023cd1c tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968000777" status: 202 len: 0 microversion: 2.1 time: 0.128014 Oct 18 13:37:02.132783 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1632/3270] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968000777 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:02.145056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.146324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.172495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.173521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.174538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.175634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.177101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.178162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.399245 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf8db7af-1f4a-442d-b605-ed8f650da9f2 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "DELETE /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 204 len: 0 microversion: 2.1 time: 1.846217 Oct 18 13:37:02.399823 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1639/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:00 2022] DELETE /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 0 bytes in 1848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:02.409130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0de7a735-ce1b-4be7-95d3-2c512e1a3571 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33543e0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.440893 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0de7a735-ce1b-4be7-95d3-2c512e1a3571 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] HTTP exception thrown: Image not found. Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0de7a735-ce1b-4be7-95d3-2c512e1a3571 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Request method failure captured: Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 HTTP/1.1 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqvN3A2Xnowlr2Hr6v9u5ObI3CLzt_NRcK9-SUo1rAmSQks6KQnW6xtdaGwmYPAmn92xMZBh8oXEk8lE3AZ3tdNFIhlrYF6QIRjK_mI6joEcdP3XR-AZq_ct-JhnufmZHcufIQvcuWSuSf0zrfA18uWmsBs738oMz_kpz6X_axJVFC4 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 195f89e4994b4c0ebc19dead688b7ba1 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0527d44d-2eaf-4576-9eb1-cb5e031eb232'} Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0527d44d-2eaf-4576-9eb1-cb5e031eb232 Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:37:02.453108 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0527d44d-2eaf-4576-9eb1-cb5e031eb232 could not be found. Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0de7a735-ce1b-4be7-95d3-2c512e1a3571 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0de7a735-ce1b-4be7-95d3-2c512e1a3571 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 404 len: 62 microversion: 2.1 time: 0.052816 Oct 18 13:37:02.457532 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1640/3272] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:37:02.490393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953577c5-1944-47a0-b848-1b365708a649", "name": "network-vif-deleted", "tag": "1d1c3bec-877a-4296-8a80-ef3facbc2eb2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:02.523351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.526045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.526526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.566655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] Creating event network-vif-deleted:1d1c3bec-877a-4296-8a80-ef3facbc2eb2 for instance 953577c5-1944-47a0-b848-1b365708a649 on n-h1-858383-13 Oct 18 13:37:02.577696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9790141d-34d7-40ee-9a1a-d98942459536 req-96520249-14d4-4d7d-8f05-beb4e3f64814 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118833 Oct 18 13:37:02.581785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1641/3273] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:02.595104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-271019353"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:02.605978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.622888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.623424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.623888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.624631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.625152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.630888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.716198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.726827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ec2896e-38a8-41d1-bb86-90a15493e143 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.591617 Oct 18 13:37:02.729904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1633/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.780126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.781333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.828736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.830394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.831951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.832709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.833195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.837993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.904770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.904770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.905101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.905947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 953577c5-1944-47a0-b848-1b365708a649 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:03.029691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.046617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47ce094a-f9de-474f-b3ca-7427e7468607 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1305 microversion: 2.1 time: 0.268749 Oct 18 13:37:03.048770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1634/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:03.285056 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f794f389-a164-4755-8277-9365eed20e67 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "POST /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a/action" status: 202 len: 0 microversion: 2.1 time: 0.699927 Oct 18 13:37:03.293811 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1642/3276] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:02 2022] POST /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:37:03.299600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22fa4cf2-b491-45ae-8e48-2cd8787ddcd7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33528f820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.362452 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22fa4cf2-b491-45ae-8e48-2cd8787ddcd7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.067586 Oct 18 13:37:03.363811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1635/3277] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:03.754416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.756475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:03.776284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.777056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.777612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.778589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.779262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.779899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.052443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.076505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.082215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:04.082357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b720af3d-dd56-4bea-95b2-3faba2a2ff96 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.331836 Oct 18 13:37:04.082357 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1643/3278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:04.108447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.109243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.110821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.112365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.113558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.116146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.198767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.199280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.201931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.202624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid 953577c5-1944-47a0-b848-1b365708a649 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:04.261315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.272936 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08217104-118c-4a9b-80cd-c89454c1cc3d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 200 len: 1305 microversion: 2.1 time: 0.204142 Oct 18 13:37:04.280670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1636/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 1305 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:04.383118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40f25108-c1df-4107-b02d-cd840682199f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33543ee50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.437483 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40f25108-c1df-4107-b02d-cd840682199f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.062182 Oct 18 13:37:04.438715 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1644/3280] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.106664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.107304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:05.115820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.116618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.117230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.122304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.122304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.122304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.306046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.307272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:05.315281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.316031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.316674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.317550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.318103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.318697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 HTTP/1.1 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '953577c5-1944-47a0-b848-1b365708a649'} Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:05.340270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:05.345983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:05.350075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:05.359690 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcdde77c-4a50-4e3c-8897-cd56900a59db tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 404 len: 111 microversion: 2.1 time: 0.055139 Oct 18 13:37:05.362655 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1645/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:37:05.366498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6eed4e3-79c7-4bfc-b616-50236a6b67d4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.261449 Oct 18 13:37:05.367074 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1637/3282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.456236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9b5caa8-9e94-4de2-9666-a05509d7390a tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3352feaf0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.544508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1352557412", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "25f85b90-66e2-4d1d-9034-1695be1ac0d9"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:05.545596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9b5caa8-9e94-4de2-9666-a05509d7390a tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.094902 Oct 18 13:37:05.547095 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1646/3283] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.621023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] validate_networks() for [('25f85b90-66e2-4d1d-9034-1695be1ac0d9', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:06.391854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.392389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:06.404292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.410597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.411102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.411463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:06.411926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.412040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:06.412350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.412458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:06.412759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:06.412859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.413822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:06.427738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.428238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.428687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.429413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.429874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.430327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.513385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:06.538622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Getting quotas for user 1d5d823540f041a283fe2c9b283514d1 and project ec92fae78dea4886be2b6988e6eb1edb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:06.564443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:06.567349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:06.741593 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-194b3e21-1868-4a22-9a96-0b6f921b2ae9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195454 Oct 18 13:37:06.741593 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1638/3284] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:06.749596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-acd6c951-2f7d-414c-afb9-dbf56a148c0d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521f8b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.855857 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-acd6c951-2f7d-414c-afb9-dbf56a148c0d tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.112570 Oct 18 13:37:06.856404 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1639/3285] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:06.874695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d394cb6-4773-43b6-aa0c-50fe980a6111 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.875371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d394cb6-4773-43b6-aa0c-50fe980a6111 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:07.014578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d394cb6-4773-43b6-aa0c-50fe980a6111 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.025456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d394cb6-4773-43b6-aa0c-50fe980a6111 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1215 microversion: 2.1 time: 0.160334 Oct 18 13:37:07.026951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1640/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.054027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.071298 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b00a2e4-93b4-4b16-b19f-acbbf62863b1 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.684572 Oct 18 13:37:07.089619 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1647/3287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.874262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea006ff8-b2eb-4113-8d0c-4cf627bda69b tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330cac790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:07.969512 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea006ff8-b2eb-4113-8d0c-4cf627bda69b tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.101031 Oct 18 13:37:07.974202 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1641/3288] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:07 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:08.054717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a21e966-1a02-4bd4-b2e6-276b9f99bc68 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:08.056274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a21e966-1a02-4bd4-b2e6-276b9f99bc68 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:08.106257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:08.106887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:08.117052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.117566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:08.122739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:08.123833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.124479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:08.125111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:08.161689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a21e966-1a02-4bd4-b2e6-276b9f99bc68 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:08.171994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a21e966-1a02-4bd4-b2e6-276b9f99bc68 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1215 microversion: 2.1 time: 0.121858 Oct 18 13:37:08.175347 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1648/3289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:08.566340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:08.574304 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-718199b1-8f91-42a4-b093-766db919a190 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 0.473617 Oct 18 13:37:08.578173 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1642/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:08.986666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb8d0845-26ca-421c-9f5d-3dc67d60e281 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d6e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:09.099601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb8d0845-26ca-421c-9f5d-3dc67d60e281 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.117461 Oct 18 13:37:09.101551 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1649/3291] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:09.203337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:09.203968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:09.215972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.216476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.230753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.233465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.233978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.234470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.520591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:09.531574 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6990e259-192a-41d9-a250-9404d9540ea9 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1211 microversion: 2.1 time: 0.332773 Oct 18 13:37:09.534558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1643/3292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:09 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1211 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:09.609749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:09.626396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:09.649962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.650518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.650988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.651724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.652196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.652637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.718924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:10.118179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e136d3f-5256-4f21-a648-f05608e8e6e4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb335269b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.210873 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e136d3f-5256-4f21-a648-f05608e8e6e4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.097605 Oct 18 13:37:10.212640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1644/3293] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:10.225752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-plugged", "status": "completed", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:10.285542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.286475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.287166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.316612 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] Creating event network-vif-plugged:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:37:10.341125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-70cd1b6d-b346-4349-a9ff-d85deaa53985 req-483f0f07-3ca5-487f-b4b9-59b1fd75a3fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123310 Oct 18 13:37:10.344099 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1645/3294] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:10.567757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.568901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.603831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.605334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.608159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.612381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.623961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.625859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.765150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.783299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fcfa09f-edd5-487b-a0cf-5db9e13e2d69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1285 microversion: 2.1 time: 0.217295 Oct 18 13:37:10.789137 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1646/3295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.234334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb8c6102-d573-4294-97c4-ca4f2e2a5921 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb331ff5940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.316932 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb8c6102-d573-4294-97c4-ca4f2e2a5921 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.091991 Oct 18 13:37:11.328006 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1647/3296] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.480174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:11.492498 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-644d8729-f245-4cd1-b886-60a6199348a0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1506 microversion: 2.1 time: 1.894973 Oct 18 13:37:11.495773 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1650/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:09 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1506 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.812974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.816421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.832615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.833680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.834588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.835814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.836554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.837341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.984247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:11.996629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb0e31b9-4bbc-4b4c-b9f8-e4fc23b4802f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1273 microversion: 2.1 time: 0.188833 Oct 18 13:37:11.997834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1648/3298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:12.333391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed1de1af-dfc0-4ee3-a259-e67524aca7b9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d60d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.414297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed1de1af-dfc0-4ee3-a259-e67524aca7b9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.084884 Oct 18 13:37:12.415005 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1651/3299] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:12.521228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.521994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.526862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:12.539566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.542159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.543383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.547635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.548927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.558193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.609927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:12.826803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.827318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.847732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:12.847860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.847860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.847860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.848927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.849444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.849888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.859996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-501cc8db-f3fd-48ff-b498-baa73ffda245 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1486 microversion: 2.1 time: 0.346145 Oct 18 13:37:12.862048 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1649/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1486 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:12.944296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] HTTP exception thrown: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Request method failure captured: Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f HTTP/1.1 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqtEGKHN-NfXvLxM-kdfkTqKklpnso2u_z4UN17B2kKA30iwuTvOT_jTRx3rnJ1GJhxHQlKASyhiVQ1XSXserHWqMbOgztF0AFnZ6v2dA8C8pwJ4_a7ZzYFilqbzhgWTqpAdGj_JxhTRwHuHSOMV3fOtjv0kI22CWSe4DRWTsGG79bA Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3fd1e93724564bf18a8d3a15c12169dc Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'f2048d25-dd63-4e1b-bece-34daba9cd37f'} Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:12.946448 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:12.952852 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.957064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Returning 404 to user: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:12.958738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e5d0218-8a06-4293-b28d-d013d402c3be tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 404 len: 111 microversion: 2.1 time: 0.136021 Oct 18 13:37:12.963164 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1652/3301] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:12 2022] DELETE /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:37:12.972308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.973279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] [instance: f2048d25-dd63-4e1b-bece-34daba9cd37f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.984072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.987399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.988102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.989091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.989753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.991194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.021200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] HTTP exception thrown: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Request method failure captured: Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f HTTP/1.1 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqtEGKHN-NfXvLxM-kdfkTqKklpnso2u_z4UN17B2kKA30iwuTvOT_jTRx3rnJ1GJhxHQlKASyhiVQ1XSXserHWqMbOgztF0AFnZ6v2dA8C8pwJ4_a7ZzYFilqbzhgWTqpAdGj_JxhTRwHuHSOMV3fOtjv0kI22CWSe4DRWTsGG79bA Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e6c5545cd41cc99079ee7f2a9ff6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fa2e6c5545cd41cc99079ee7f2a9ff6c Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-748608988 Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3fd1e93724564bf18a8d3a15c12169dc Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-748608988-project Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'f2048d25-dd63-4e1b-bece-34daba9cd37f'} Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:13.025537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. Oct 18 13:37:13.030208 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:13.033934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] Returning 404 to user: Instance f2048d25-dd63-4e1b-bece-34daba9cd37f could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:13.036800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec825a11-4722-41fc-9d6b-04cc3b8ed5b1 tempest-AttachSCSIVolumeTestJSON-748608988 tempest-AttachSCSIVolumeTestJSON-748608988-project] 10.222.0.27 "GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f" status: 404 len: 111 microversion: 2.1 time: 0.070514 Oct 18 13:37:13.040790 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1653/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/servers/f2048d25-dd63-4e1b-bece-34daba9cd37f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:13.059359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.060288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:13.081941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.083920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.085121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.085882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.087960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.092748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.386730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.387475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:13.403710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.408599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.409307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.412808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.414895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:13.415213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.415825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.437502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcc3a28a-edff-4a46-b9bf-4e1ae823706d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1273 microversion: 2.1 time: 0.390675 Oct 18 13:37:13.439175 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1654/3303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:13 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:13.459396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-647402922", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:13.556029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:13.575928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] validate_networks() for [('88731a66-75b4-44e9-9d7e-50afbe0fb192', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:14.131096 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3d4e1c4-2c5e-4413-a00e-af869aa79a93 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 204 len: 0 microversion: 2.32 time: 1.266405 Oct 18 13:37:14.131706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1650/3304] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:37:12 2022] DELETE /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:37:14.137206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e38c62a-f8c2-4899-8f53-9c08e6e383f7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb331ff5940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:14.273922 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e38c62a-f8c2-4899-8f53-9c08e6e383f7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.133669 Oct 18 13:37:14.286300 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1651/3305] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:14 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:14.599652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b25e000-67b2-4d98-a172-c61983d4c7e1 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Action: 'create', calling method: .version_select at 0x7fb33521f820>, body: {"keypair": {"name": "tempest-keypair-444200607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/BvhoeKEYliOj1DEGjYVFqhVrr380rWlDS2ukd1x78/b3wp+EoYucNE8s6I4nb7zmEzmv6BATEhMITnSt/LqU77KrWOmZr2+l25QBRrn1URGKCUPVeb/LK4GaMMvG/ug=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:14.631446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3b25e000-67b2-4d98-a172-c61983d4c7e1 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for project 500c1691c5bb4729ba86089d20dedf27. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:14.645630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3b25e000-67b2-4d98-a172-c61983d4c7e1 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for user 97fcf7685853432ab0173f0cfac41863 and project 500c1691c5bb4729ba86089d20dedf27. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:14.796473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b25e000-67b2-4d98-a172-c61983d4c7e1 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.508395 Oct 18 13:37:14.797961 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1652/3306] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:37:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:14.804331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:14.808140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:14.833093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.833972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.834674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:14.835640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.836340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.836996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.119285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:15.120614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:15.121254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:15.121868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:15.122465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:15.145240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.145747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.146221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.148095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.148788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.149471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.200984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Getting quotas for project ef289ee4f9954fc1bceaee4b381c3d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:15.211929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Getting quotas for user a857437becf14392bd1332824d86111c and project ef289ee4f9954fc1bceaee4b381c3d3b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:15.227457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:15.230888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:15.350187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.361998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.371678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.377018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-066cd7e6-ca04-4e84-9699-cc652c406ac9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2943 microversion: 2.32 time: 0.577974 Oct 18 13:37:15.380169 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47ab5f5c-f810-4d68-96ce-103fb855eefe tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.939155 Oct 18 13:37:15.381011 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1655/3307] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:15.387028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.388274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:15.396724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1653/3308] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:14 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2943 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:15.399221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.400307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.400911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.401873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.402569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.403204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.419828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f79552c7-75c2-4c51-b417-2ec673d557aa tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb335291af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.512934 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f79552c7-75c2-4c51-b417-2ec673d557aa tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.113966 Oct 18 13:37:15.513695 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1654/3309] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:15.525996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2540af10-2057-484a-8b9a-a56f8d0e7c95 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.526885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2540af10-2057-484a-8b9a-a56f8d0e7c95 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:15.801149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2540af10-2057-484a-8b9a-a56f8d0e7c95 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.812321 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2540af10-2057-484a-8b9a-a56f8d0e7c95 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1213 microversion: 2.1 time: 0.293667 Oct 18 13:37:15.812321 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1655/3310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1213 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:16.425374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:16.432920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:16.440660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.441168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.441995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.442362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.442832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.443267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.537826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:17.181257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.196888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f67ffd2-d3e0-4552-9949-5d6c202123d5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 1.814028 Oct 18 13:37:17.202453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1656/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.278174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39c60f38-959e-4b3d-a2c0-85ddec121e48 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d0ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.369211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39c60f38-959e-4b3d-a2c0-85ddec121e48 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.155304 Oct 18 13:37:17.384013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1657/3312] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.389754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.391107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:17.420139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.421481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.422149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.423614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.424398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.425171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.675440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.690141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53ce1597-1d88-4923-b52a-262ebb1b4fbf tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1217 microversion: 2.1 time: 0.304634 Oct 18 13:37:17.691004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1658/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.704516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.722335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.724218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.726029 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-885d808c-df5a-491d-9514-3d1cf828baa4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2943 microversion: 2.32 time: 1.305414 Oct 18 13:37:17.730998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1656/3314] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:16 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2943 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:17.981858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06e89b4-d42e-40e7-bb3c-51e3ee75b598", "tag": "9f11feea-46ef-43ca-9604-87ab8c15fcd8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:18.010485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.011444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.016115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.041134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] Creating event network-changed:9f11feea-46ef-43ca-9604-87ab8c15fcd8 for instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 on n-h2-858383-13 Oct 18 13:37:18.053146 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-02f20163-432b-4c65-94d8-05c142ad838e req-597a3908-c02f-4735-92d9-ded54c1bc69f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076900 Oct 18 13:37:18.056410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1659/3315] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:18.231911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.232530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.264516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.265773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.266701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.268651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.271693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.275368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.389835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42551c41-931c-4636-a9c5-afc69775ff37 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330c26280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.453370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42551c41-931c-4636-a9c5-afc69775ff37 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.071052 Oct 18 13:37:18.453991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1660/3316] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:18.715471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.715809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.738228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.738749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.739204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.740003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.741821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.744674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.078465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:19.089795 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14e11ad6-dede-4dbb-a32f-ab50ebe5c9ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1265 microversion: 2.1 time: 0.378193 Oct 18 13:37:19.103073 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1661/3317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1265 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:19.113326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:19.118272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:19.148554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.152717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.155257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.160363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.161067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.164870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.090426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.115125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63b5f3b7-feba-4c7c-be41-53e704765a9a tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 1.886223 Oct 18 13:37:20.118729 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1657/3318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.134734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b16dfc64-d3df-4c75-9a86-4918cb2b73bf tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521f820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.247579 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b16dfc64-d3df-4c75-9a86-4918cb2b73bf tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.129083 Oct 18 13:37:20.250341 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1658/3319] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.263643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.283882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.286191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.287494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.293578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.294110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.294622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.295338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.295874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.296308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.296736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.298366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16a00350-aa52-4450-bd2a-edd2da38d95b tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2943 microversion: 2.32 time: 1.193990 Oct 18 13:37:20.310288 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1662/3320] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:19 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2943 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:20.939214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.947015 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b9767a3-3150-450f-9af3-d494671412e6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1271 microversion: 2.1 time: 0.694967 Oct 18 13:37:20.947941 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1659/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1271 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:21.146301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.147249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:21.154730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.155491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.156099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.157749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.158424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.159014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.265742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a93787bc-52ca-485d-92be-14861b07b837 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521ff70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.350464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a93787bc-52ca-485d-92be-14861b07b837 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.088412 Oct 18 13:37:21.351519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1660/3322] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:21.365479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.366166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:21.379520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.380012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.380467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.383541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.384035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.384488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.196176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:22.212225 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b67665b7-5aef-48b3-976b-847122a3d55b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 1.067664 Oct 18 13:37:22.214357 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1663/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:22.230868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:22.231706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:22.247742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.256142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.256142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.257724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.259452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.260117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.209673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.221671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ff1c926-a6f2-4958-967a-6c06e173ad1d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1271 microversion: 2.1 time: 1.005075 Oct 18 13:37:23.222972 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1664/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:22 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1271 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:23.231006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe9140b-8dcf-48c2-a74d-9e2d29acff9f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:23.277945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.280244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.280955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.319413 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] Creating event network-vif-unplugged:4fe9140b-8dcf-48c2-a74d-9e2d29acff9f for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:23.333658 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b52a07ea-2808-4c3c-a115-32aa40e1fd8e req-0ef1b80d-3d32-4b17-9ac8-4c12229de482 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104529 Oct 18 13:37:23.334732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1665/3325] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:23.352068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-161d243c-a00b-4e12-9b6b-f1747c17a7e4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353c4670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.454888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-161d243c-a00b-4e12-9b6b-f1747c17a7e4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.116430 Oct 18 13:37:23.457613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1666/3326] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:23.472092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.473693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:23.494730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.497306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.499865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.502039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.502635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.503736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.940878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.953215 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19cf73c0-2cf1-4c6c-90d9-6705f1f36d0f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 0.493324 Oct 18 13:37:23.958439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1667/3327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:24.252593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.253926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:24.268926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.272915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.275441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.278447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.279762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.285301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.491640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.520867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.526618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.526618 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b03de1f0-1056-4b41-91d7-3e967068c5f9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2922 microversion: 2.32 time: 3.171574 Oct 18 13:37:24.534156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1661/3328] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2922 bytes in 3182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:24.549214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a34798e1-1031-471c-b6f7-516c695dc8f1 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb331271af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.695984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a34798e1-1031-471c-b6f7-516c695dc8f1 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.160291 Oct 18 13:37:24.696873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1662/3329] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:24.925200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.937043 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0159e322-cb6e-496b-a537-2d8ad4332ea2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.689883 Oct 18 13:37:24.939292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1668/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:24.986884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.994564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:25.014259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.020283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.022321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.027490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.031893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.035213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.500172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "be74ac22-ab15-4d00-9974-0c19505e3929"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "b6196777-36fd-4ea6-9393-e0693c5210e1"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "da60ea4f-7615-4adc-8662-808ebb5bb0e0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:25.511213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:25.511492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:25.515641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.518837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.519633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.542224 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Creating event network-vif-unplugged:be74ac22-ab15-4d00-9974-0c19505e3929 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:25.545627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Creating event network-vif-unplugged:b6196777-36fd-4ea6-9393-e0693c5210e1 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:25.545627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] Creating event network-vif-unplugged:da60ea4f-7615-4adc-8662-808ebb5bb0e0 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:25.557510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a2d9df73-7815-4fd7-bc60-fb7c41ebdcb9 req-ebae585e-20f3-4d61-9073-0920c2064d99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.061493 Oct 18 13:37:25.558772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1669/3331] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:25.570998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:25.578904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:25.583130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.583842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.584485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.586393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.591767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.592536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.808248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:26.072902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.085449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65dd130e-278f-47b9-9f13-01a414fe4c2f tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 1.104323 Oct 18 13:37:26.095045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1663/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:26.113638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-696557513", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "3eaa622f-5075-43c6-bf8c-81e792567a8b"}], "security_groups": [{"name": "tempest-securitygroup--1485556459"}], "key_name": "tempest-keypair-444200607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:26.779966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.799004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.800917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.805126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1789e8a-ac30-4857-9011-dd7c88b38b04 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2922 microversion: 2.32 time: 1.243952 Oct 18 13:37:26.808369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1670/3333] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:25 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2922 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:26.816256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd0d622f-50ec-4f64-a079-ceb9d42f2e5c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb331ef6310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.839952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] validate_networks() for [('3eaa622f-5075-43c6-bf8c-81e792567a8b', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:26.898013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd0d622f-50ec-4f64-a079-ceb9d42f2e5c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.088327 Oct 18 13:37:26.898648 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1671/3334] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:26.904628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.905528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:26.912942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.913745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.914406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.915365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.916028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.916649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.362348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.371328 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90805b9e-d247-4950-8396-cf696b8e20e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.470703 Oct 18 13:37:27.372619 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1672/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:27.378295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:27.379151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:27.396498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.398666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.399363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.401505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.403019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.403803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.964140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.984630 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9eaaaab-738b-4b1d-9d1d-d81f808e5412 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 0.610645 Oct 18 13:37:28.009586 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1673/3336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:27 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.015878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "0a2abc3c-716f-417d-8562-5e0b82309599"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-unplugged", "status": "completed", "tag": "a8cd0da4-8c52-4382-853b-1e381dc48b82"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:28.041478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.044486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.045160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.067911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Creating event network-vif-unplugged:0a2abc3c-716f-417d-8562-5e0b82309599 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:28.077466 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] Creating event network-vif-unplugged:a8cd0da4-8c52-4382-853b-1e381dc48b82 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:28.090089 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-28961b66-d308-428e-8e1c-403298c15403 req-58198a9e-5b56-48dc-9dd2-e026f0799c95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.078667 Oct 18 13:37:28.093771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1674/3337] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:28.108384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.109407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.127009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.128669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.130923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.131701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.132184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.132642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.630590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.644285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.649473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.654128 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b6a34f9-aeb0-4c17-b6bb-4c96c0bba319 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2901 microversion: 2.32 time: 0.555513 Oct 18 13:37:28.658549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1675/3338] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2901 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:28.671082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8541a63a-edf6-474b-8706-4ee310efea29 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330b60d30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.774618 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8541a63a-edf6-474b-8706-4ee310efea29 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.114340 Oct 18 13:37:28.775451 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1676/3339] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.790009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.790673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.805913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.806583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.807057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.821572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.829578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.832366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.844733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:28.845377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:28.845652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:28.846147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:28.847677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:28.870446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.870973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.872012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.872821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.873302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.879787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.930570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for project 500c1691c5bb4729ba86089d20dedf27. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:28.947693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for user 97fcf7685853432ab0173f0cfac41863 and project 500c1691c5bb4729ba86089d20dedf27. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:28.964734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:28.970431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:29.157376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.163004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:29.173768 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.397129 Oct 18 13:37:29.176883 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1677/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:29.191720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.198346 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e730de8-3e5f-4d0d-9143-a19644a92c09 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006633 Oct 18 13:37:29.198693 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1678/3341] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:37:29.225678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.226439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.236141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.236652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.237109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.237224 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-87c2ad04-8433-45bb-97a0-a329142b6869 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.140517 Oct 18 13:37:29.244834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1664/3342] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:29.247809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.248948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.249564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.299507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c92bae8-e070-49fe-b2ee-723d7eff906a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.301007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c92bae8-e070-49fe-b2ee-723d7eff906a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.557040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c92bae8-e070-49fe-b2ee-723d7eff906a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.567534 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c92bae8-e070-49fe-b2ee-723d7eff906a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1240 microversion: 2.1 time: 0.314252 Oct 18 13:37:29.583255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1665/3343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1240 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:29.690884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.691510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.701944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.706587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.707005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.707764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.708238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.723241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.797270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.810398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e97071a-5723-4dde-8422-5548b8bb0920 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 0.597375 Oct 18 13:37:29.811008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1679/3344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:29.839791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ebe3e5fc-7c1d-43bf-ae27-d501d5d02f0a tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330ca1f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.915307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ebe3e5fc-7c1d-43bf-ae27-d501d5d02f0a tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.089689 Oct 18 13:37:29.915901 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1680/3345] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:30.205117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:30.206507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.218318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:30.223281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.228881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.231893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.232673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.233154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.233606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.246639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.263738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.265324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.280062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc50d6dc-ba5a-4348-bd5b-09e7b9030acf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2901 microversion: 2.32 time: 0.591930 Oct 18 13:37:30.282451 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1666/3346] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2901 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:30.595346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c26dd8c-ecba-4c5b-b0c5-eff9ce5afef9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:30.596437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c26dd8c-ecba-4c5b-b0c5-eff9ce5afef9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.742106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.754726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c26dd8c-ecba-4c5b-b0c5-eff9ce5afef9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.758026 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f706293-a309-4140-a17e-9983d656e0f3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.557037 Oct 18 13:37:30.777324 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c26dd8c-ecba-4c5b-b0c5-eff9ce5afef9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1240 microversion: 2.1 time: 0.181099 Oct 18 13:37:30.782221 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1681/3347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:30.786451 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1667/3348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1240 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:30.790873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06e89b4-d42e-40e7-bb3c-51e3ee75b598", "name": "network-vif-plugged", "status": "completed", "tag": "9f11feea-46ef-43ca-9604-87ab8c15fcd8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:30.806626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.807594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.808411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.828812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] Creating event network-vif-plugged:9f11feea-46ef-43ca-9604-87ab8c15fcd8 for instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 on n-h2-858383-13 Oct 18 13:37:30.839419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:30.840266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.843743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-db4bcda2-db90-4179-8f2a-36acf53fb6ab req-ad2e0f5e-c754-4e2e-83f0-36f1a1955516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058957 Oct 18 13:37:30.845578 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1682/3349] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:30.868049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.874101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.874688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.875598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.876199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.876782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.932502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ab64bf0-5ea4-469a-8adf-35db54792c07 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33543ea60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.036912 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ab64bf0-5ea4-469a-8adf-35db54792c07 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.108541 Oct 18 13:37:31.038083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1683/3350] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:31.237181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b243d6d6-4092-4f65-9394-ffbfd1808cd3", "tag": "38e24bcf-43aa-4b9a-a707-4461165ce091"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:31.280306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.280910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.281387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.306269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] Creating event network-changed:38e24bcf-43aa-4b9a-a707-4461165ce091 for instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 on n-h2-858383-13 Oct 18 13:37:31.326297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c6974aed-5ec2-4e68-8be9-4879a3e17a3e req-32dd7212-658d-43ad-9755-b0633d21bb9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092912 Oct 18 13:37:31.329531 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1684/3351] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:31.352315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.353469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.377342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.378173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.380952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.381677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.383820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.384280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.686869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.701035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90a2056d-1831-4cbd-8d49-6d3198385601 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 0.865416 Oct 18 13:37:31.705566 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1668/3352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:31.712316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.727223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.731961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.737028 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5121066e-6fd8-4338-97c9-2a73457cf3ca tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2856 microversion: 2.32 time: 0.402068 Oct 18 13:37:31.737028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1685/3353] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2856 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:31.783390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.784661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.799813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.801896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.803193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.803668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.804039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.804416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.815168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.815827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.816244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.820545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.820545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.825536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.826299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.826915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.007005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.022087 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bae7b979-19a9-41ee-942a-8ee5439208ad tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1292 microversion: 2.1 time: 0.224008 Oct 18 13:37:32.024231 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1686/3354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:32.053791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0faf8de4-77a3-46e8-8c5c-5822c9a729a8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33535d160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.136373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0faf8de4-77a3-46e8-8c5c-5822c9a729a8 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.085150 Oct 18 13:37:32.148035 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1687/3355] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.612900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.649788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e91bd6d3-908d-49b8-b75c-c33a4c8020ce tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.869288 Oct 18 13:37:32.651480 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1669/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.726492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.727124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.738269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.741738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.742455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.743404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.744319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.751626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.766690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.769330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.779714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.791658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.794474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.795304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.795813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.800552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.611244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.621054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b45fe7c-d86b-4f93-80c3-9f1b9e3fa89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1315 microversion: 2.1 time: 0.898212 Oct 18 13:37:33.625222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1688/3357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:33.631528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.632517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.641109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.653703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.654661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.655635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.659917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.665817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.816130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.826918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1882786-f181-4bef-aa52-4508f63490bf tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1298 microversion: 2.1 time: 0.199821 Oct 18 13:37:33.827520 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1689/3358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:33.837504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a56e581-ae4d-43ba-ac8b-dc76b1c956a4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33535d040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.938804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a56e581-ae4d-43ba-ac8b-dc76b1c956a4 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.107316 Oct 18 13:37:33.940113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1690/3359] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:33.945476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.946578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.959461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.961924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.963566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.964694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.967265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.967265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.285229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.293920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-983ad7dc-44cc-41e2-aec1-02257df53d28 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.352475 Oct 18 13:37:34.296739 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1691/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:34.304258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-deleted", "tag": "0a2abc3c-716f-417d-8562-5e0b82309599"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:34.318632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.320959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.321620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.375936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] Creating event network-vif-deleted:0a2abc3c-716f-417d-8562-5e0b82309599 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:34.380538 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d809aec6-dc0a-491c-b449-90e4274bb40f req-df1716c3-85ec-4c6c-938f-f79d7311c77b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080269 Oct 18 13:37:34.382481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1692/3361] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:34.655938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.658432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:34.674046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.674946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.675866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.676848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.677546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.678249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.822361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.840375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.848660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.852177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e84e8098-d4a8-4400-939a-f383bb85c36d tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2856 microversion: 2.32 time: 2.087816 Oct 18 13:37:34.854715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1670/3362] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2856 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:34.866398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.869541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:34.884168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.885578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.886682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.887429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.887951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.889027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.025746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.035417 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75bed736-b718-4b08-a82d-5a60a129b38b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1501 microversion: 2.1 time: 0.386175 Oct 18 13:37:35.036670 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1693/3363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:35.047061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa775b23-a72d-4292-af6d-e159e59727a1 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d6160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.126625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa775b23-a72d-4292-af6d-e159e59727a1 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.083941 Oct 18 13:37:35.128528 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1694/3364] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:35.133773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:35.134793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.142599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.143503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.144192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.145263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.145992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.146732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.175773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'flavor' on Instance uuid e06e89b4-d42e-40e7-bb3c-51e3ee75b598 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:35.189409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.242819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e26a320-c223-4748-b274-68f1c9d3f494 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1298 microversion: 2.1 time: 0.386778 Oct 18 13:37:35.243423 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1671/3365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1298 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:35.326136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.326772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.334863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.335654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.336322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.337338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.338049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.338698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.785622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a03f63a2-d0bb-4428-baff-4ae7c54b53e5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "POST /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598/action" status: 202 len: 0 microversion: 2.1 time: 0.655419 Oct 18 13:37:35.786709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1695/3366] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:35 2022] POST /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:35.798798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.799851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.817633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.818177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.825421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.826269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.826764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.827501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.982406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.997171 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36618099-f421-48fd-b000-05f7afa253c5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.671675 Oct 18 13:37:35.998543 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1672/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:36.003912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.004529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:36.027796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.028219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.029376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.032656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.033386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.034002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.193319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.206260 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2240b50e-a726-4e7b-85fc-aa5cebae7715 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1509 microversion: 2.1 time: 0.410755 Oct 18 13:37:36.206915 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1696/3368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:36.235860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-381dd730-0783-47f6-90c3-1d4c40fb4201 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb330ca1040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.313784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-381dd730-0783-47f6-90c3-1d4c40fb4201 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1426 microversion: 2.1 time: 0.105219 Oct 18 13:37:36.323028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1697/3369] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:36.487569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1535514579", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "2961c91d-b961-44ee-b4a8-a349c607f4da"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:36.596591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] validate_networks() for [('2961c91d-b961-44ee-b4a8-a349c607f4da', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:37.043752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:37.063501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:37.065419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:37.069082 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fa58a4d-fc21-41a7-82e2-9fe12027a4dd tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2697 microversion: 2.32 time: 1.069489 Oct 18 13:37:37.083578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1673/3370] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2697 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:37.104281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.107159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.120176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.123807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.124615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.125642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.126356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.134014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.139009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:37.367385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:37.377581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d81223c1-e0be-4cbc-8563-2d434d74c2f6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1298 microversion: 2.1 time: 0.282423 Oct 18 13:37:37.378203 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1674/3371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1298 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:37.416807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-deleted", "tag": "be74ac22-ab15-4d00-9974-0c19505e3929"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:37.474609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.475109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.475567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.502854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] Creating event network-vif-deleted:be74ac22-ab15-4d00-9974-0c19505e3929 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:37.505225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:37.505762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:37.508119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:37.508804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:37.509390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:37.517648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c0c5fff8-cbe5-4bee-bf5e-1abe01ae264c req-40addeb8-78b9-489f-8775-b2429e68ee02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111627 Oct 18 13:37:37.520839 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1675/3372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:37.533428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.534240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.535094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.537372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.539948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.542599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.543148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.545328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.552933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.553733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.554404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.555269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.555937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.556749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.592987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Getting quotas for project d78fb68eedc84dfcb7c5cc2aeaa24f92. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:37.608133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Getting quotas for user 45ab9411460b4292b1ea5719d352ccca and project d78fb68eedc84dfcb7c5cc2aeaa24f92. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:37.631527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:37.633847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:37.864751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3f09acf-9631-48bb-9c5d-ca6b397c2cb7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.539994 Oct 18 13:37:37.866128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1698/3373] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:37:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:37:37.878151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.880145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.889249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.893263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.893263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.893263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.893672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.894382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.017697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.045880 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4025a665-b762-499b-a704-02dd93d07a49 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.522040 Oct 18 13:37:38.051991 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1676/3374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.056918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5f43100-cc1e-438f-a4b3-273851562350 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33521ff70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.154918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5f43100-cc1e-438f-a4b3-273851562350 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1435 microversion: 2.1 time: 0.105544 Oct 18 13:37:38.155884 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1677/3375] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1435 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.168602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.169274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.242581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.258252 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb154a6e-0740-4866-ba03-6bd1e60b9247 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1492 microversion: 2.1 time: 0.386014 Oct 18 13:37:38.263613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1699/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1492 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.270749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.271366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.303127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.303645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.304221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.304821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.313831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.315920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.630175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.646154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.648271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.649511 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-811b4128-cf7e-4854-9373-5f5100a0ad06 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2584 microversion: 2.32 time: 0.388984 Oct 18 13:37:38.650452 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1700/3377] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2584 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:38.655651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41588622-9237-4356-a13b-a743cad34c93 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb3353d0b80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.745491 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-41588622-9237-4356-a13b-a743cad34c93 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 200 len: 1435 microversion: 2.1 time: 0.093202 Oct 18 13:37:38.749659 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1701/3378] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 1435 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.751769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.752330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.760222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.761069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.761791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.762981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.763642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.764244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.796591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:38.853324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:38.880382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.894544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.905287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.905287 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d40de5ac-d731-45dd-ac70-14ad19c43fbf tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1262 microversion: 2.26 time: 0.741531 Oct 18 13:37:38.905287 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1678/3379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1262 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:38.911813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:38.920351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.921259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.940555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.946325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.947024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.947802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.948288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.948731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.289211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5266bca8-74fc-4f03-9e68-f46222aaf405 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 204 len: 0 microversion: 2.1 time: 0.541222 Oct 18 13:37:39.292862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1702/3380] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:38 2022] DELETE /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:39.299392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.300115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:39.309225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.309740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.310221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.310937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.311400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.311834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.557624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:39.595309 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-123bdbcf-d4dd-4c8a-9276-ce9b5c867640 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.690771 Oct 18 13:37:39.599327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1679/3381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.623468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:39.625848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.633349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:39.635458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f90f88f9-9b15-45a0-beb5-d1e8a3e7d1c9 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1466 microversion: 2.1 time: 0.344057 Oct 18 13:37:39.636783 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1703/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1466 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.642703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.643698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:39.650135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.655573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.655573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.655573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.655573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.655573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.682155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.684293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.684293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.684786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.685411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.687097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.860428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:39.869630 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0767d966-c14c-4507-b84e-abcfa6aacf74 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1498 microversion: 2.1 time: 0.231212 Oct 18 13:37:39.870256 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1704/3383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.886754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-deleted", "tag": "b6196777-36fd-4ea6-9393-e0693c5210e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:39.899440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.900240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.900961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.936092 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] Creating event network-vif-deleted:b6196777-36fd-4ea6-9393-e0693c5210e1 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:39.944638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fcd3f4f3-ef3d-4840-aa04-3617eda2b39d req-746571d5-789e-4bc0-a2e6-97be7d703c77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072819 Oct 18 13:37:39.948207 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1705/3384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:39.958692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f233fef-7e94-4809-a29e-d0889537d9f7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb335444dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:40.275326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:40.294272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-72f3ba01-33df-419e-b6bd-2d119291e60a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.687414 Oct 18 13:37:40.294841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1680/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:40.312218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:40.313044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:40.328708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:40.330565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:40.331927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:40.336341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:40.338121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:40.338939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.152687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.171132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.174941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.177778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dcf212c6-061d-40d4-93ed-9f6a02374ebe tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2425 microversion: 2.32 time: 0.881896 Oct 18 13:37:41.197596 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1681/3386] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:40 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2425 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:41.214673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.216394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:41.228140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.228653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.231213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.233126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.233623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.235301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.513751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.524138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f233fef-7e94-4809-a29e-d0889537d9f7 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "DELETE /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581" status: 204 len: 0 microversion: 2.1 time: 1.574503 Oct 18 13:37:41.528519 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1706/3387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] DELETE /compute/v2.1/images/f94beb86-fbee-45b5-845b-8c5934dcc581 => generated 0 bytes in 1577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:41.535548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.535710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.546284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.546464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:41.546565 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0b7bfa1-e157-4e64-85b7-734744c50b61 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1258 microversion: 2.26 time: 0.339771 Oct 18 13:37:41.546565 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1682/3388] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1258 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:41.546565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.546565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:41.559548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.561797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.562423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.564900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.569088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.569603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.570117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.570473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.570778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.571879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.572519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.573118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.954446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.968385 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b3354ef-059f-4180-81d5-63a835a3a2cc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.434315 Oct 18 13:37:41.969561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1707/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:41.991753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.992643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.004299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.005366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.006932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.008509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.009193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.009808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.117132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.132834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7799be2-412a-4212-a4e5-38f7f6dfd642 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1498 microversion: 2.1 time: 0.592309 Oct 18 13:37:42.139432 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1683/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1498 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:42.150628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-636aaabb-3e8c-436e-9357-0143d6d47bf6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '.version_select at 0x7fb33125f1f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.172569 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-636aaabb-3e8c-436e-9357-0143d6d47bf6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] HTTP exception thrown: Image not found. Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-636aaabb-3e8c-436e-9357-0143d6d47bf6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Request method failure captured: Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 HTTP/1.1 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqvN3A2Xnowlr2Hr6v9u5ObI3CLzt_NRcK9-SUo1rAmSQks6KQnW6xtdaGwmYPAmn92xMZBh8oXEk8lE3AZ3tdNFIhlrYF6QIRjK_mI6joEcdP3XR-AZq_ct-JhnufmZHcufIQvcuWSuSf0zrfA18uWmsBs738oMz_kpz6X_axJVFC4 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 195f89e4994b4c0ebc19dead688b7ba1 Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: exception: Image not found. Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0527d44d-2eaf-4576-9eb1-cb5e031eb232'} Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0527d44d-2eaf-4576-9eb1-cb5e031eb232 to delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0527d44d-2eaf-4576-9eb1-cb5e031eb232 could not be found. Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.174677 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:37:42.179801 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:42.182689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-636aaabb-3e8c-436e-9357-0143d6d47bf6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Returning 404 to user: Image not found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:42.183553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-636aaabb-3e8c-436e-9357-0143d6d47bf6 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "DELETE /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232" status: 404 len: 62 microversion: 2.1 time: 0.040920 Oct 18 13:37:42.184317 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1684/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:42 2022] DELETE /compute/v2.1/images/0527d44d-2eaf-4576-9eb1-cb5e031eb232 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:37:42.189505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b243d6d6-4092-4f65-9394-ffbfd1808cd3", "name": "network-vif-plugged", "status": "completed", "tag": "38e24bcf-43aa-4b9a-a707-4461165ce091"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:42.201196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.201691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.202162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.217943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] Creating event network-vif-plugged:38e24bcf-43aa-4b9a-a707-4461165ce091 for instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 on n-h2-858383-13 Oct 18 13:37:42.224373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a61bad43-0eba-4e80-9d9f-58b688379760 req-f0fa0476-4dca-4d1c-9cca-2a9b0ddf1aa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038495 Oct 18 13:37:42.225717 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1685/3392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:42.227535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.235053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.236030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.244750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-302e370a-da12-4173-a638-0956a210b6f7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.264677 Oct 18 13:37:42.246572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:42.262438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1708/3393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:42.262438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.262438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.268811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.269604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.270683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.271643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.272387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.273038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.277229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.277740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.278226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.285348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.286118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.286561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.312032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:42.736720 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b02852d1-8a86-432c-b932-e13278f6a08c tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 204 len: 0 microversion: 2.1 time: 0.507658 Oct 18 13:37:42.738660 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1686/3394] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:42 2022] DELETE /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:42.746155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d963134-c4b3-4561-8f45-302eba5e54c3", "tag": "322a75e6-0c41-4733-a926-69592580298c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:42.806148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.807825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.811361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.871774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.886500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] Creating event network-changed:322a75e6-0c41-4733-a926-69592580298c for instance 5d963134-c4b3-4561-8f45-302eba5e54c3 on n-h1-858383-13 Oct 18 13:37:42.899363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.907581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.911876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9a575ec-e582-4cf3-b91e-3e8bd7cfdebb tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2380 microversion: 2.32 time: 0.661788 Oct 18 13:37:42.913424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1709/3395] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:42 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2380 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:42.922020 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e5df0adc-8db0-442c-b18b-035c694bc2f5 req-aa6b7cd6-da41-4995-bbfa-b2efc78df36f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180369 Oct 18 13:37:42.924136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1687/3396] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:42.932135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.935196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.935889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.936679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.944471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.945190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.945794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.947030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.947669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.948299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.957475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.961558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.962965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.970463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.971218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.971934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.160874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.173085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.174601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.177430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2942f7c1-9410-4afc-a784-696e23fefde9 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1332 microversion: 2.26 time: 0.261259 Oct 18 13:37:43.178583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1710/3397] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:42 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1332 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:43.183672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.184367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.191459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.191971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.192630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.193420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.193895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.194613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.548178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.557698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-959942ab-770b-4c75-8761-9acf31cff1c6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.377791 Oct 18 13:37:43.558302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1711/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.567383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.568257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.587691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.590643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.593671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.597923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.597923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.597923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.690718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.700614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ab0dcb9-d0f5-4de4-8d31-be6fed08854b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1456 microversion: 2.1 time: 0.141009 Oct 18 13:37:43.701540 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1712/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1456 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.707768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.710983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.715537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.717598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.718309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.719415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.720063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.721041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.832114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.844176 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2273e9e2-fa40-44bf-81db-69b4fb03b662 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1472 microversion: 2.1 time: 0.918734 Oct 18 13:37:43.845354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1688/3400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:42 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1472 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.944214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.944842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.957144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.957659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.958136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.960378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.960861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.961308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.054752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.070874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ba85d23-c48a-40e1-a694-108f700b7e55 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.367886 Oct 18 13:37:44.071845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1713/3401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:44.209870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.210523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.222730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.223583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.224533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.225663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.226414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.227062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.298996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.318362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.327874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.332779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-356f1bb8-503f-4e20-a426-c8059b99b782 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 2380 microversion: 2.32 time: 0.391730 Oct 18 13:37:44.335366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1689/3402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 2380 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:44.345495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-unplugged", "status": "completed", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:44.369754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.385258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.387220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.389001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.391328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.391867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.394627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d969e2e9-f66b-4e75-988c-0af22f99988c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1332 microversion: 2.26 time: 0.188049 Oct 18 13:37:44.396593 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1714/3403] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:44.417944 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] Creating event network-vif-unplugged:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:37:44.428703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-af7833cd-610a-4882-ad2b-9c0a813c1ce9 req-f91e6f90-d750-4ae2-a831-7b8ceeb41a4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088575 Oct 18 13:37:44.429394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1690/3404] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:44.588101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.589160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.598818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.599743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.600422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.602306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.603030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.603776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.728006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.728931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.750686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.751898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.758994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.760956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.761786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.762746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.914923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.925484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e8aa593-0560-4dd4-b7a3-8632753182b7 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1456 microversion: 2.1 time: 0.203511 Oct 18 13:37:44.928056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1691/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1456 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:44.938205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.941715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.961086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.961842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.962807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.969601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.971616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.972492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.209828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.216974 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cbfc9edb-b4c5-4205-b430-93a03e02cf2f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1472 microversion: 2.1 time: 0.287475 Oct 18 13:37:45.235549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1692/3406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:45.242507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06e89b4-d42e-40e7-bb3c-51e3ee75b598", "name": "network-vif-deleted", "tag": "9f11feea-46ef-43ca-9604-87ab8c15fcd8"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-deleted", "tag": "4fe9140b-8dcf-48c2-a74d-9e2d29acff9f"}, {"server_uuid": "9719264e-f7cf-40c9-87a5-532305893524", "name": "network-vif-deleted", "tag": "a8cd0da4-8c52-4382-853b-1e381dc48b82"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:45.255701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.256209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.258161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.280025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Creating event network-vif-deleted:9f11feea-46ef-43ca-9604-87ab8c15fcd8 for instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 on n-h2-858383-13 Oct 18 13:37:45.280830 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Creating event network-vif-deleted:4fe9140b-8dcf-48c2-a74d-9e2d29acff9f for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:45.281676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] Creating event network-vif-deleted:a8cd0da4-8c52-4382-853b-1e381dc48b82 for instance 9719264e-f7cf-40c9-87a5-532305893524 on n-h1-858383-13 Oct 18 13:37:45.295352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-53485336-3387-44ec-81c2-dc997d862b70 req-48f3d9c7-f64a-40db-86b8-d129e59a485d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056692 Oct 18 13:37:45.298215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1693/3407] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:45.305721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.306741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.329123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.329757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.330251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.333310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.333942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.334423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.612553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.628687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32e7d4dd-709d-47b6-a307-0c437429c90b tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1313 microversion: 2.1 time: 0.327765 Oct 18 13:37:45.651804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1694/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:45.664335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.664335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.678539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.679045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.681475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.682305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.682783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.683224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.684000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.704440 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4ddcf46-8157-4c15-887a-1ffe0a5e5ea9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 1.127236 Oct 18 13:37:45.709304 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1715/3409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:45.726131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.726772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.742734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:45.745772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.746318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.746790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.747478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.757333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.758345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.858620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.885876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.886493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.889993 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-001fe6d2-3d1b-4a10-afbe-05bce01417f7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.234924 Oct 18 13:37:45.891060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1695/3410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:45.954803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.956195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.971976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.972782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.975283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.976277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.976945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.979520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.048779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.049548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.050973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.051655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lazy-loading 'fault' on Instance uuid e06e89b4-d42e-40e7-bb3c-51e3ee75b598 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:46.122265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d823540f041a283fe2c9b283514d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92fae78dea4886be2b6988e6eb1edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.136221 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1bef0fc-4e27-468c-b6b0-a8dc9e33da73 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 200 len: 1305 microversion: 2.1 time: 0.187118 Oct 18 13:37:46.153662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1696/3411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 1305 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:46.246632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.247811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.256812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.258606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.259311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.261379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.263921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.263921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.538487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.547495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-67f3289b-a42c-47a6-98ae-284928cfcc00 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1472 microversion: 2.1 time: 0.305714 Oct 18 13:37:46.557441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.564307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1697/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:46.571322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.573041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.574297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25a298d5-d1f1-409c-b021-86f6658bc0fd tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.862532 Oct 18 13:37:46.575709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1716/3413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:46.667016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.668040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.679784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.680506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.681125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.682158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.682787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.683390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.732020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.733264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.741173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.741939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.747636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.747636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.747636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.748800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.887576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.900132 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-035c9b80-a44b-44cc-91c0-0cba147f60ad tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1500 microversion: 2.1 time: 0.243243 Oct 18 13:37:46.903312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1698/3414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:46.920708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.921326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.927680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.928376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.931311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.931311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.931311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.931311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.005885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.016646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.019742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.021672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6eb78502-596d-4f5c-afe4-38bfc4c062b1 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.104666 Oct 18 13:37:47.022823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1699/3415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:47.038694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:47.046724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.055814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.056550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.057242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.058234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.058895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.059523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.101371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lazy-loading 'flavor' on Instance uuid b243d6d6-4092-4f65-9394-ffbfd1808cd3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:47.157756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.169921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9a8b68d-4517-4b35-a284-1bb9747de727 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.441196 Oct 18 13:37:47.175944 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1717/3416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:47.180835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.185609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.193722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.194259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.203709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.204771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.205435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.206033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.235664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 HTTP/1.1 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e06e89b4-d42e-40e7-bb3c-51e3ee75b598'} Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.237371 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.241431 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-afc12069-e7ec-4a3f-932f-4c8c38bedcb5 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 404 len: 111 microversion: 2.1 time: 0.061698 Oct 18 13:37:47.248142 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1718/3417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.271626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.272433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.284183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.284971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.285594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.292229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.292229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.292229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.333804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 HTTP/1.1 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e06e89b4-d42e-40e7-bb3c-51e3ee75b598'} Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.336223 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.340405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.343302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.346105 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c741ae4-30ba-4978-86c7-f87b0e25bdb3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 404 len: 111 microversion: 2.1 time: 0.083724 Oct 18 13:37:47.349284 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1719/3418] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:47 2022] DELETE /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.360579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.362046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: e06e89b4-d42e-40e7-bb3c-51e3ee75b598] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.374805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.377271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.380496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.387479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.387479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.387479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.420853 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 HTTP/1.1 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e06e89b4-d42e-40e7-bb3c-51e3ee75b598'} Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.423364 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance e06e89b4-d42e-40e7-bb3c-51e3ee75b598 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0552fc4-0196-4415-bccc-acf51d95a89e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598" status: 404 len: 111 microversion: 2.1 time: 0.071452 Oct 18 13:37:47.431835 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1720/3419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/e06e89b4-d42e-40e7-bb3c-51e3ee75b598 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.434150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.434669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.449266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.450539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.451145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.452603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.453304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.453901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.477685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 HTTP/1.1 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '953577c5-1944-47a0-b848-1b365708a649'} Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.479480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.484024 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.486742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.488012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e197f3a8-102f-4eac-9d67-32ba086bb831 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 404 len: 111 microversion: 2.1 time: 0.057915 Oct 18 13:37:47.496467 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1721/3420] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:47 2022] DELETE /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.504405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.504405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 953577c5-1944-47a0-b848-1b365708a649] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.512253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.513253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.514097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.515345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.516581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.518101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.540584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f96a3798-7b5d-4e8f-87ff-f6f2455b2f00 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "POST /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3/action" status: 200 len: 32 microversion: 2.1 time: 0.516185 Oct 18 13:37:47.541695 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1700/3421] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:47 2022] POST /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:37:47.555005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3794790-c3b5-432e-b7e4-a613c491d78a", "name": "network-vif-deleted", "tag": "902ee365-ca82-4065-88de-5aba2fc91676"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:47.559577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 HTTP/1.1 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '953577c5-1944-47a0-b848-1b365708a649'} Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.563636 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 953577c5-1944-47a0-b848-1b365708a649 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-896e1947-692e-4367-9ef7-d653f42c19d3 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649" status: 404 len: 111 microversion: 2.1 time: 0.067331 Oct 18 13:37:47.571303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1722/3422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/953577c5-1944-47a0-b848-1b365708a649 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.579414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.579911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.587458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.587702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.587702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.587702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.594456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] Creating event network-vif-deleted:902ee365-ca82-4065-88de-5aba2fc91676 for instance a3794790-c3b5-432e-b7e4-a613c491d78a on n-h2-858383-13 Oct 18 13:37:47.595185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.595961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.596601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.597337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.597813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.598287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.601533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a57f2abb-6f2a-4e63-a3a4-674cb21ca712 req-dbd1c818-33cd-429f-89eb-ad1a692c7f1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058102 Oct 18 13:37:47.602860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1701/3423] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:47.610989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.616306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.619830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.620555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.621238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.622353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.623392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.624045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.631293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.636127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.642899 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b HTTP/1.1 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '32e53d5f-47cd-451c-a1b8-c23e38bbd79b'} Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:47.645743 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:47.649565 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:47.651972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:47.653013 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6249556d-637a-40a6-95be-ced00fb6b817 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 404 len: 111 microversion: 2.1 time: 0.049075 Oct 18 13:37:47.657794 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1702/3424] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:47 2022] DELETE /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:47.679375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.680071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.690497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.691009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.696095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.698588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.701477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.703058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.818288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.827957 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5379c43-4716-4ad3-ab64-86a5b0695981 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1430 microversion: 2.1 time: 0.168845 Oct 18 13:37:47.829635 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1703/3425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1430 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:47.836389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.837712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.848247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.849028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.849671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.851078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.851690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.852473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.058363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.082275 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-970393cb-4492-43db-92a7-53fe468424d9 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.490425 Oct 18 13:37:48.082275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1723/3426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:48.089720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.090800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 32e53d5f-47cd-451c-a1b8-c23e38bbd79b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.103314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.104057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.104827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.105926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.107001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.110971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.148513 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b HTTP/1.1 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '32e53d5f-47cd-451c-a1b8-c23e38bbd79b'} Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.153948 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 32e53d5f-47cd-451c-a1b8-c23e38bbd79b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d59fcce-ad3c-4437-b3a0-37ecfc51f616 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b" status: 404 len: 111 microversion: 2.1 time: 0.077300 Oct 18 13:37:48.163588 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1724/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/32e53d5f-47cd-451c-a1b8-c23e38bbd79b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:48.179197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.180494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.197585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.198873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.200339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.201655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.202868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.204220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.325042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.337355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.344591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.358370 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4a809f6-b8ff-4540-9dcf-113d1e9a883a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.514526 Oct 18 13:37:48.358370 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1704/3428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:48.359166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.371338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.371971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.378947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.381352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.382097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.396622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.396622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.397155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.397452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.397452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.397634 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91185a86-051b-4583-a3ac-8f53cfab6eb8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.216524 Oct 18 13:37:48.397634 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1725/3429] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:48.397634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.410913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.430543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.430881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.432113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e HTTP/1.1 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3a5c8991-f839-43be-986d-84d1a2a0162e'} Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:48.432790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83a7570a-b982-4c14-abb6-0ed5b83aaada tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 404 len: 111 microversion: 2.1 time: 0.073665 Oct 18 13:37:48.436986 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1705/3430] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:48 2022] DELETE /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:48.439941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.441220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.448139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.448319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.448418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.448508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 3a5c8991-f839-43be-986d-84d1a2a0162e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.454643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.455156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.455626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.456331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.456801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.457243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.483441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e HTTP/1.1 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3a5c8991-f839-43be-986d-84d1a2a0162e'} Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.485043 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 3a5c8991-f839-43be-986d-84d1a2a0162e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74dda998-ad2d-4e2f-8074-cb90c410265b tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e" status: 404 len: 111 microversion: 2.1 time: 0.047220 Oct 18 13:37:48.496307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1706/3431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/3a5c8991-f839-43be-986d-84d1a2a0162e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:48.508448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.509089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.528994 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e HTTP/1.1 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f57958d7-f34a-4fce-a28b-3511e4b9ac0e'} Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.530614 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82f4f172-6f43-456d-80c3-72643528263d tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e" status: 404 len: 111 microversion: 2.1 time: 0.034275 Oct 18 13:37:48.534925 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1707/3432] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:48 2022] DELETE /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:48.543648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.544746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: f57958d7-f34a-4fce-a28b-3511e4b9ac0e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.553209 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e HTTP/1.1 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f57958d7-f34a-4fce-a28b-3511e4b9ac0e'} Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:48.555272 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance f57958d7-f34a-4fce-a28b-3511e4b9ac0e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4be55bd3-5765-4274-9656-9f6271cb9369 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e" status: 404 len: 111 microversion: 2.1 time: 0.017412 Oct 18 13:37:48.565202 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1708/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/f57958d7-f34a-4fce-a28b-3511e4b9ac0e => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:48.851190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.852179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.860320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.860847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.861237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.861953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.862450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.862891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.899225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:48.910314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.910799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.911241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.911692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lazy-loading 'fault' on Instance uuid a3794790-c3b5-432e-b7e4-a613c491d78a {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:48.964778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195f89e4994b4c0ebc19dead688b7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.974480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25b86629-9ab3-42cd-a54c-6967dabd893f tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 200 len: 1307 microversion: 2.1 time: 0.127224 Oct 18 13:37:48.975768 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1709/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:48.979191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.988921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f7aee8b-44cf-4670-b8c8-abcd3bc968df tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.598729 Oct 18 13:37:48.991314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1726/3435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.112502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.113183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.136894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.138721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.139332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.142343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.142848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.144546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.382406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.383417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.397163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.397673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.399075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.402189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.402901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.408221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.415184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.426001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a14ae730-6062-460e-81c2-1bd10578a527 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.323624 Oct 18 13:37:49.434807 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1710/3436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.447915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.448557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.464243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.466930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.467481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.472255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.472990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.473301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.580190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.598675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.600698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.602481 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94cb2b2f-67a5-4515-83f3-0e57e0f15fa7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.163535 Oct 18 13:37:49.603614 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1711/3437] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:49.611241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d963134-c4b3-4561-8f45-302eba5e54c3", "name": "network-vif-plugged", "status": "completed", "tag": "322a75e6-0c41-4733-a926-69592580298c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:49.644968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.646416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.647154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.663481 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] Creating event network-vif-plugged:322a75e6-0c41-4733-a926-69592580298c for instance 5d963134-c4b3-4561-8f45-302eba5e54c3 on n-h1-858383-13 Oct 18 13:37:49.669230 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-35cf7a9d-5347-4f8b-a003-02fca0f5f719 req-3e712bb8-d36e-4501-bbf3-fa460c33b5ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063993 Oct 18 13:37:49.670282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1712/3438] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:49.678106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35c024c-f179-4833-9cd2-43888b8bf894", "tag": "6bb2599e-c2d4-419e-b736-152e48b9ff44"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:49.691596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.698117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.698117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.721140 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] Creating event network-changed:6bb2599e-c2d4-419e-b736-152e48b9ff44 for instance f35c024c-f179-4833-9cd2-43888b8bf894 on n-h2-858383-13 Oct 18 13:37:49.727573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-611fed7d-fa8c-4936-a738-ec458df7736c req-e19cdfbd-a868-4b93-8c2f-01fb4f557b2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053434 Oct 18 13:37:49.728826 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1713/3439] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:49.822413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.831520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.832993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.836563 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a18f000-640f-4492-a81f-40c5b3221a91 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.459192 Oct 18 13:37:49.844603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1727/3440] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:50.007220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.008261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] [instance: a3794790-c3b5-432e-b7e4-a613c491d78a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.021525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.022637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.025286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:50.034321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.035033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.035699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.036373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.036997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.037614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.038696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.039652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.040835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.040998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.041577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.042192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.084795 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] HTTP exception thrown: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Request method failure captured: Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a HTTP/1.1 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqvN3A2Xnowlr2Hr6v9u5ObI3CLzt_NRcK9-SUo1rAmSQks6KQnW6xtdaGwmYPAmn92xMZBh8oXEk8lE3AZ3tdNFIhlrYF6QIRjK_mI6joEcdP3XR-AZq_ct-JhnufmZHcufIQvcuWSuSf0zrfA18uWmsBs738oMz_kpz6X_axJVFC4 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd7c3553f1f34f86ad2a6fa9e4bb214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: bd7c3553f1f34f86ad2a6fa9e4bb214a Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-577580467 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 195f89e4994b4c0ebc19dead688b7ba1 Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ImagesOneServerTestJSON-577580467-project Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'a3794790-c3b5-432e-b7e4-a613c491d78a'} Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:50.088996 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] Returning 404 to user: Instance a3794790-c3b5-432e-b7e4-a613c491d78a could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:50.094386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9411b53-30e4-4866-9f68-857e1e60ef62 tempest-ImagesOneServerTestJSON-577580467 tempest-ImagesOneServerTestJSON-577580467-project] 10.222.0.27 "GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a" status: 404 len: 111 microversion: 2.1 time: 0.087296 Oct 18 13:37:50.095932 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1714/3441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/a3794790-c3b5-432e-b7e4-a613c491d78a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:50.249324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.265103 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f57618d2-154a-4b6c-ad66-66156e011b23 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.249555 Oct 18 13:37:50.274507 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1728/3442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:50.451953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.452586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.460020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.470404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.470404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.470404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.470404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.470404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.614035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.622963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2685027-794e-4699-b62a-982ec938cf8d tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.174953 Oct 18 13:37:50.623544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1715/3443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:50.643108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.644152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.657337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.663079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.663736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.664793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.670090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.670727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.758930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.771335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.773969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.775245 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8fa97468-7973-4d85-9c33-c34a0a862f6f tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.142515 Oct 18 13:37:50.779550 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1729/3444] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:50.871689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.872322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.878702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.880134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.880819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.882526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.883215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.883863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.918972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:51.139121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.139121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.139121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.139121 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-887c2953-e6fc-4d1a-8f95-b0e38a751a24 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.258655 Oct 18 13:37:51.139121 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1716/3445] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:51.291453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.293029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:51.314742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.322195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.322195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.324580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.325325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.325936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.648808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.649429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:51.656751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.657503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.658306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.659189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.659848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.660537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.701359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.713620 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-769ed800-4bba-4e73-9bb7-1465c7e416eb tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1366 microversion: 2.1 time: 0.426161 Oct 18 13:37:51.737381 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1730/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:51.803793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.804694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:51.813774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.814651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.815332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.817794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.818489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.821374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.932037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.947950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.951097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.953542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.958961 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-231d6c90-788c-47fa-bb75-978e77c350b9 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.157474 Oct 18 13:37:51.958961 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1731/3447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:51.983451 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a993a189-8e06-4c10-9312-b777a5f385e4 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.330984 Oct 18 13:37:51.986795 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1717/3448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:52.156908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.157548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.166465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.167726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.169288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.170241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.170874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.171518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.359811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:52.373087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:52.375612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:52.377142 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e4ff329-98cd-43b6-bbe1-aa93e86bb193 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.225483 Oct 18 13:37:52.378313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1732/3449] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:52.761998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.763295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.779974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.781839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.785045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.786303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.788193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.788847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.989105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.990901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.998959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.999723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.000965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.002109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.002740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.003340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.086387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.099592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.101591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.103467 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e10d55ce-1b74-41b4-b0ff-434cd3da5cb4 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.118923 Oct 18 13:37:53.104433 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1733/3450] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:53.110986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.111877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:53.120162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.120898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.121558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.122484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.123118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.125302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.176106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.187350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8b26ce3-b367-4951-b39e-59ad2574e9d5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1557 microversion: 2.1 time: 0.429157 Oct 18 13:37:53.188740 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1718/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1557 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:53.226130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.227168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:53.255900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.256500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.257031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.257866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.258421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.258929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.398561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.416306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0646e61c-a77c-4001-8b31-65af491e94bc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.310642 Oct 18 13:37:53.418668 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1734/3452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:53.425632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1767bd92-261e-4947-9b5c-19fc441d0053 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215137 Oct 18 13:37:53.426340 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1719/3453] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:53.439921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.444517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:53.465863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.472660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.472660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.472660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.472660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.472660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.700437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64e797d2-af6d-4a0e-a91a-ee1349277831 tempest-ListImageFiltersNegativeTestJSON-72359310 tempest-ListImageFiltersNegativeTestJSON-72359310-project] Calling method '.version_select at 0x7fb33535d0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.731060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-64e797d2-af6d-4a0e-a91a-ee1349277831 tempest-ListImageFiltersNegativeTestJSON-72359310 tempest-ListImageFiltersNegativeTestJSON-72359310-project] HTTP exception thrown: Image not found. Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64e797d2-af6d-4a0e-a91a-ee1349277831 tempest-ListImageFiltersNegativeTestJSON-72359310 tempest-ListImageFiltersNegativeTestJSON-72359310-project] Request method failure captured: Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/images/587997b8-caa2-4edf-b495-1ea5520b0936 HTTP/1.1 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqwxp5kYtouQx5uiMIKEwEn-RCEbGOHs18FLBfnpQixe-_JjPZp1y4T7RilnjARlr_d9QBibyH92wgHhja6G6YJNX7tmVt568OP_O7kcdQ7YO8IjPNU8ehuULsoOXy7Oup61seXF7Vn__3g_rJMUVg8nP_sfzlIOvLEUxOzO6gIwGdY Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 492ae07762e74609848c683e321e505c Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-72359310 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/492ae07762e74609848c683e321e505c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/492ae07762e74609848c683e321e505c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/492ae07762e74609848c683e321e505c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_492ae07762e74609848c683e321e505c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-72359310 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 492ae07762e74609848c683e321e505c Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-72359310 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListImageFiltersNegativeTestJSON-72359310-project Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8d9440081a95401e88b836fca9b85742 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-72359310-project Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: exception: Image not found. Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '587997b8-caa2-4edf-b495-1ea5520b0936'} Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 587997b8-caa2-4edf-b495-1ea5520b0936 Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:37:53.733319 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 587997b8-caa2-4edf-b495-1ea5520b0936 could not be found. Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64e797d2-af6d-4a0e-a91a-ee1349277831 tempest-ListImageFiltersNegativeTestJSON-72359310 tempest-ListImageFiltersNegativeTestJSON-72359310-project] Returning 404 to user: Image not found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64e797d2-af6d-4a0e-a91a-ee1349277831 tempest-ListImageFiltersNegativeTestJSON-72359310 tempest-ListImageFiltersNegativeTestJSON-72359310-project] 10.222.0.27 "GET /compute/v2.1/images/587997b8-caa2-4edf-b495-1ea5520b0936" status: 404 len: 62 microversion: 2.1 time: 0.314425 Oct 18 13:37:53.740464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1735/3454] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/images/587997b8-caa2-4edf-b495-1ea5520b0936 => generated 62 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:37:53.982774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.002653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.004401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.007895 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c0854608-bc73-4ffb-9946-1dd3cc7d7393 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.572747 Oct 18 13:37:54.012060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1720/3455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:54.110890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35c024c-f179-4833-9cd2-43888b8bf894", "name": "network-vif-plugged", "status": "completed", "tag": "6bb2599e-c2d4-419e-b736-152e48b9ff44"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:54.140102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.142665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.143384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:54.144025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:54.144240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.153157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.153748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.154226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.155425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.156117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.157282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.165722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] Creating event network-vif-plugged:6bb2599e-c2d4-419e-b736-152e48b9ff44 for instance f35c024c-f179-4833-9cd2-43888b8bf894 on n-h2-858383-13 Oct 18 13:37:54.172719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a1141911-2db4-4fe3-9fba-f941609c5249 req-d9ae1b6b-7879-4aa9-b9dc-8d9f2e5b218f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066033 Oct 18 13:37:54.172719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1736/3456] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:54.344886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.361056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.364926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.367007 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e81f246-413a-4ae4-b7b2-476013f2dc34 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.228918 Oct 18 13:37:54.371181 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1721/3457] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:54 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:54.446006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:54.447207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:54.458426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.460186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.462191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.462191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.462191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.464519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.045187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.048976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:55.060361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.061458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.064395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.065555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.066289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.066962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.231146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.240329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81d3f6fa-bb84-4123-b40e-7d162ca8b24f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.799020 Oct 18 13:37:55.251108 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1737/3458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:54 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:55.403299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.405067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:55.423331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.423927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.425506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.428491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.429011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.434804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.600144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.621287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.629282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.630960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a6e3eb1-e619-44ab-9069-62e7da39caea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.232774 Oct 18 13:37:55.631548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1738/3459] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:55.858882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.875182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.885019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.888753 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ec2d1be-2dbe-4b8f-8a33-273431325825 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1362 microversion: 2.26 time: 0.851082 Oct 18 13:37:55.908804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1722/3460] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1362 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:56.175005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d963134-c4b3-4561-8f45-302eba5e54c3", "tag": "322a75e6-0c41-4733-a926-69592580298c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:56.196888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.197376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.197823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.236483 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] Creating event network-changed:322a75e6-0c41-4733-a926-69592580298c for instance 5d963134-c4b3-4561-8f45-302eba5e54c3 on n-h1-858383-13 Oct 18 13:37:56.249000 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5358c98e-55dd-4384-853a-c83957fc9989 req-f0c4f27b-6bd9-4aca-a9c5-f7403060abe3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077065 Oct 18 13:37:56.251684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1739/3461] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:56.273305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.275490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.297384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.301788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.302570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.306172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.307477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.308323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.600687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.601785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.613296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.615595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.616989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.622777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.624024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.627353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.659663 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 HTTP/1.1 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7d833f2c-718a-469c-ad77-88641f826647'} Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:56.664523 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:56.668601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:56.674447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:56.677345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f940e0c-0a2c-46b3-90e0-e593d45af3ad tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 404 len: 111 microversion: 2.1 time: 0.081247 Oct 18 13:37:56.682770 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1740/3462] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:56 2022] DELETE /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:56.696349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.699845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.716004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.722832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.722832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.722832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.722832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.722832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.902378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:56.920934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:56.923121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:56.924411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60afb144-f344-4ad8-a2d8-0ed6d3b24709 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.236891 Oct 18 13:37:56.934545 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1741/3463] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:56.941612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.950732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 7d833f2c-718a-469c-ad77-88641f826647] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.967443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.967956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.971050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.971820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.972313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.972758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.016366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 HTTP/1.1 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '7d833f2c-718a-469c-ad77-88641f826647'} Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:57.035251 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.044219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 7d833f2c-718a-469c-ad77-88641f826647 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:57.047688 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-005589ea-f38b-4151-b0bd-61c377c85c7e tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647" status: 404 len: 111 microversion: 2.1 time: 0.101342 Oct 18 13:37:57.047688 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1742/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/7d833f2c-718a-469c-ad77-88641f826647 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:57.064657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:57.065216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:57.079308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.079815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.084058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.085469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.086854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.088367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.539091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:57.550976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:57.564658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:57.569813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1db0d874-47d4-464d-80b2-4db31dcaf154 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1546 microversion: 2.26 time: 0.515503 Oct 18 13:37:57.570676 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1743/3465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:57 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1546 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:57.588038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:57.590340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:57.613179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.614093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.615736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.616717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.617555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.618685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.649665 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 HTTP/1.1 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '23e1e1b1-5ffd-4136-a75a-89425fb70265'} Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:57.653772 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:57.657823 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:57.661468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:57.662596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a209b68-ecf3-4db6-9a01-0be1ecf8b602 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 404 len: 111 microversion: 2.1 time: 0.090322 Oct 18 13:37:57.663861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1744/3466] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:57 2022] DELETE /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:57.670770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3312a6f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:57.682021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.683106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.683994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.684724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:57.693358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.701176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.701176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.701176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.701534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.702378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.756450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:57.774684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.775809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.783647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.804621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.805602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.806673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.935053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:57.977570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d5784fb-25cc-4b5d-b54b-c0964cca1e3a tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1167857925" status: 201 len: 0 microversion: 2.26 time: 0.312376 Oct 18 13:37:57.982696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1745/3467] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Oct 18 13:37:57 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1167857925 => generated 0 bytes in 318 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 13:37:57.994342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:57.998842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] [instance: 23e1e1b1-5ffd-4136-a75a-89425fb70265] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.016575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.018408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.020146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.022195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.028611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.028611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.064723 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] HTTP exception thrown: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Request method failure captured: Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 HTTP/1.1 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqrfna0TxIZOfXpojWc-a348MH4H-lfCv0LblglQcP0t7HGiLkYiBh9Y9zFG8Jo-5JTOS63dstollRgCPeyROXXPwApkXiplb5goi86ELMWCWJVfrdXNgdvGdrsV6JRxui08SDhPyuV1KcwTpcrAXjtgiPYtPitiUqQJbOhkHeSCLVA Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec92fae78dea4886be2b6988e6eb1edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ec92fae78dea4886be2b6988e6eb1edb Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-949687690 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1d5d823540f041a283fe2c9b283514d1 Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-949687690-project Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '23e1e1b1-5ffd-4136-a75a-89425fb70265'} Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:58.069678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. Oct 18 13:37:58.074357 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:37:58.079593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] Returning 404 to user: Instance 23e1e1b1-5ffd-4136-a75a-89425fb70265 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:58.082146 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f020747-8404-445e-8b6f-23b4eac4bc69 tempest-DeleteServersTestJSON-949687690 tempest-DeleteServersTestJSON-949687690-project] 10.222.0.27 "GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265" status: 404 len: 111 microversion: 2.1 time: 0.096802 Oct 18 13:37:58.084037 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1746/3468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:57 2022] GET /compute/v2.1/servers/23e1e1b1-5ffd-4136-a75a-89425fb70265 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:58.110760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.112769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.129548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.131609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.132278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.134956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.136409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.139163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.265943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.273664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.298384 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a295fa56-ffd6-44c2-9e34-fff717bbd6c0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 2.023098 Oct 18 13:37:58.299777 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1723/3469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:58.308110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.316134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.321677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d1e14d3-7adf-40ee-9075-7593f2db48ce tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb330a33820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.321834 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55f4ae39-47ca-4be5-b877-97a44a2e5be7 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.230686 Oct 18 13:37:58.323509 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1747/3470] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:58.344666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d1e14d3-7adf-40ee-9075-7593f2db48ce tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.344666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d1e14d3-7adf-40ee-9075-7593f2db48ce tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.344666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d1e14d3-7adf-40ee-9075-7593f2db48ce tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.377813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d1e14d3-7adf-40ee-9075-7593f2db48ce tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1167857925" status: 204 len: 0 microversion: 2.26 time: 0.076678 Oct 18 13:37:58.383915 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1724/3471] 10.222.0.27 () {60 vars in 1361 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1167857925 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:37:58.393260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb335444550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.412160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.413008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.413774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.414471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.428147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.428911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.429629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.430585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.436327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.436327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.497425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.501192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.501948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.604742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:58.642101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-549fb13b-5275-4b1c-b257-cb21be34bff2 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 204 len: 0 microversion: 2.26 time: 0.253453 Oct 18 13:37:58.643639 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1748/3472] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 18 13:37:58 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 13:37:58.660037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d616b6ed-9fc0-4310-8456-c6da915f1313 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3306af0d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.681408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d616b6ed-9fc0-4310-8456-c6da915f1313 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.683565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d616b6ed-9fc0-4310-8456-c6da915f1313 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.686886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d616b6ed-9fc0-4310-8456-c6da915f1313 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.721742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d616b6ed-9fc0-4310-8456-c6da915f1313 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 12 microversion: 2.26 time: 0.069357 Oct 18 13:37:58.723465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1725/3473] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 12 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:58.739261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb330f50940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.753609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.754151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.754581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.755074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.773805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.774333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.774970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.775851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.776758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.777395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.843649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.844412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.845063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.871444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.872257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.872905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.010887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:59.079984 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd4affe6-6530-4286-a481-98d67b9a37de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1872631460" status: 201 len: 0 microversion: 2.26 time: 0.349412 Oct 18 13:37:59.087277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1749/3474] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Oct 18 13:37:58 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1872631460 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 13:37:59.097849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2817436-0d78-438f-93c7-6e734b3503de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3354449d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.117559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2817436-0d78-438f-93c7-6e734b3503de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.119593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2817436-0d78-438f-93c7-6e734b3503de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.120045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2817436-0d78-438f-93c7-6e734b3503de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.149642 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2817436-0d78-438f-93c7-6e734b3503de tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 36 microversion: 2.26 time: 0.054501 Oct 18 13:37:59.150877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1750/3475] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 36 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:59.166247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3311abaf0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.186314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.189031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.190594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.191265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:59.204482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.208784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.214544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.216218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.216872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.217490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.320584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.321151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.321641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.344395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Calling method '.version_select at 0x7fb33128bdc0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.370262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.370874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.371773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.372682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.373606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.374341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.418396 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc5ac277-9f54-4817-a155-820b3209803c tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.422494 Oct 18 13:37:59.420138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1726/3476] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:59.427108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.428001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:59.433269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:59.436133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.436983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.437912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.438830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.439450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.440083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.477424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e0bbd21-d394-496f-abc9-f58d427efc2f tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1872631460" status: 204 len: 0 microversion: 2.26 time: 0.319780 Oct 18 13:37:59.477987 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1751/3477] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Oct 18 13:37:59 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-1872631460 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:37:59.500994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.507565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:59.533385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.534030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.534422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.535161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.552024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.555646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.742615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.768682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.770229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.790266 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2942f2cc-0e9e-4cf5-bcb6-73290ef61fff tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.299941 Oct 18 13:37:59.791003 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1752/3478] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:59.828390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14967db7-64f5-4430-a180-ca10945eb9f7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb33535d9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.849829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14967db7-64f5-4430-a180-ca10945eb9f7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.850351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14967db7-64f5-4430-a180-ca10945eb9f7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.850794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14967db7-64f5-4430-a180-ca10945eb9f7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.883785 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14967db7-64f5-4430-a180-ca10945eb9f7 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 12 microversion: 2.26 time: 0.079730 Oct 18 13:37:59.887724 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1753/3479] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 12 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:59.897195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-310898599", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:00.025385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:00.424316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.434776 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a8c0d39-f1b4-41b0-b7f8-b039f4d5591a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 1.013193 Oct 18 13:38:00.446501 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1727/3480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.446602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Getting quotas for project 143e7978937c43f6a2cad3c84ad1df82. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:00.454673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3313f6af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.471736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Getting quotas for user aa254131e6f84fedaca07789aeeae097 and project 143e7978937c43f6a2cad3c84ad1df82. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:00.487953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.488649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.489105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.489259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 18 13:38:00.489591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Request method failure captured: Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 1751 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqw2uBhcXmx9b67J5Xb06dmMEL_KLGRS_HEr6KXlu0JQBJOea8-KYlmKuDIrmmL5PC1toCyR22vjy2TmRUjuq31yORZsFUiyUA-OrTvmNyMp-AM-c9-zrFuc8G7IBDn26uiQ0DYrkdGq6gKBvdSq8ROu8EpvT_Pm2usWBrOsbDVIbYA Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 143e7978937c43f6a2cad3c84ad1df82 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1520038579 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/143e7978937c43f6a2cad3c84ad1df82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/143e7978937c43f6a2cad3c84ad1df82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/143e7978937c43f6a2cad3c84ad1df82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_143e7978937c43f6a2cad3c84ad1df82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1520038579 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 143e7978937c43f6a2cad3c84ad1df82 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1520038579 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: aa254131e6f84fedaca07789aeeae097 Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-310898599", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:00.491144 n-d-858383-13 devstack@n-api.service[121010]: exception: Maximum number of metadata items exceeds 128 Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-310898599', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:00.493870 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:00.497444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b1c6d04-da06-4b88-b899-358a94ddfa5e tempest-AbsoluteLimitsNegativeTestJSON-1520038579 tempest-AbsoluteLimitsNegativeTestJSON-1520038579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.605192 Oct 18 13:38:00.503400 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1754/3481] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Oct 18 13:37:59 2022] POST /compute/v2.1/servers => generated 87 bytes in 614 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:00.509631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.515345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.564904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.568212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.568212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.598089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:00.636752 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97cad606-5b26-48c4-b84a-8facf5ecc80c tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 204 len: 0 microversion: 2.26 time: 0.196187 Oct 18 13:38:00.642587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1728/3482] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 18 13:38:00 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:38:00.647884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb330fafdc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.672695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.675442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.676141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.676872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.690912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.690912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.690912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.690912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.697203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.697949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.757385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.759574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.764409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.783745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.785732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.786987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.825797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.826779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.836401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.837587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.838292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.844134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.844134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.876194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.912842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:00.935162 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7afb2ff-d646-4772-8e4f-e599caa3a786 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-504952790" status: 201 len: 0 microversion: 2.26 time: 0.291191 Oct 18 13:38:00.936560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1755/3483] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 18 13:38:00 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-504952790 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 13:38:00.950435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb33535d0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.963740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.964754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.965523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.967557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.972021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.977349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.978410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.979068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.980871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.981551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.982255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.984884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.990599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.995997 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05aca931-e2f3-46a7-94d7-2588dc703de0 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.178221 Oct 18 13:38:00.996641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1729/3484] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:01.049231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.049737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.050369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.097147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.097147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.097147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.126939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:01.222829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:01.297199 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3998f596-3f34-4162-9c97-e5caf9612bb6 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-838752565" status: 201 len: 0 microversion: 2.26 time: 0.354771 Oct 18 13:38:01.299056 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1756/3485] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 18 13:38:00 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-838752565 => generated 0 bytes in 358 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 13:38:01.308896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb335291670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.326649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.328400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.331740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.332434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.345202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.354584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.356200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.380017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.381190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.383830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.439948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.442490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.459878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.462943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.463838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.471875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.472756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.473492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.474861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.475960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.476611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.577757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:01.606942 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4b64a68-7dc5-4fed-871c-ebafca4fd8f8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 204 len: 0 microversion: 2.26 time: 0.301579 Oct 18 13:38:01.609473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1730/3486] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 18 13:38:01 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:38:01.618772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4cb65499-0dfe-4591-8e27-04d943abfca5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb33125f940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.629587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cb65499-0dfe-4591-8e27-04d943abfca5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.631776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cb65499-0dfe-4591-8e27-04d943abfca5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.632602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cb65499-0dfe-4591-8e27-04d943abfca5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.644905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4cb65499-0dfe-4591-8e27-04d943abfca5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 12 microversion: 2.26 time: 0.031060 Oct 18 13:38:01.648198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1731/3487] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:38:01 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:01.659371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb331ad8ee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.688144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.688637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.689082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.689567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.707770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.712037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.712697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.713895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.714547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.715138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.765819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.769980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.770671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.794995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:01.807380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:01.818788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f7d313f-051b-496c-8837-ac370b5b7eec tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.361791 Oct 18 13:38:01.821701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1757/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:01 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:01.827417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ec64e27-188b-4c33-b269-c11628cdc2d8 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 204 len: 0 microversion: 2.26 time: 0.173262 Oct 18 13:38:01.828922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1732/3489] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 18 13:38:01 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 13:38:01.841317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb33121e0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.859961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.869373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.870083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.870739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.886484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.887155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.887774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.888649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.895884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.897694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.951897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.952422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.953417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.981575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.981971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.982858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.025300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.026085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.041265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.041772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.050629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.053897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.053897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.053897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.100545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:02.125953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cae3b0f0-eaa4-4fba-85d6-223b3545c059 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-256236535" status: 201 len: 0 microversion: 2.26 time: 0.288712 Oct 18 13:38:02.127627 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1758/3490] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 18 13:38:01 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-256236535 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 13:38:02.140899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb331947040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.156750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.157446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.158208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.158998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.170869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.209314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.209826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.210310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.244970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.245381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.245827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.266157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.270394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:02.288708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.290515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.293043 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24f3636e-308b-4234-898c-76803b7c739a tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.271434 Oct 18 13:38:02.294325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1733/3491] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:02.385403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:02.422954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75fe0e2a-8513-4bac-8177-e55e674467a5 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-447549399" status: 201 len: 0 microversion: 2.26 time: 0.288845 Oct 18 13:38:02.425441 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1759/3492] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Oct 18 13:38:02 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags/tempest-tag-447549399 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 13:38:02.445252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Action: 'update_all', calling method: .version_select at 0x7fb3312c9b80>, body: {"tags": ["tempest-tag-76524674", "tempest-tag-246895023"]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:02.468613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.470346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.470614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.471126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.501754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.501754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.501754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.501754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.504005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.504464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.554271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.554796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.555253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.666335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:02.703228 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4551ccc-a476-4218-a897-92db62955946 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 59 microversion: 2.26 time: 0.261166 Oct 18 13:38:02.703425 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1734/3493] 10.222.0.27 () {62 vars in 1312 bytes} [Tue Oct 18 13:38:02 2022] PUT /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 59 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.713945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ef6147a-ce11-432b-822a-3381d0c14cb4 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb330feb3a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.727026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ef6147a-ce11-432b-822a-3381d0c14cb4 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.729773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ef6147a-ce11-432b-822a-3381d0c14cb4 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.732918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ef6147a-ce11-432b-822a-3381d0c14cb4 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.745559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ef6147a-ce11-432b-822a-3381d0c14cb4 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 200 len: 59 microversion: 2.26 time: 0.035541 Oct 18 13:38:02.755771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1760/3494] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 59 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.757314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '.version_select at 0x7fb3314d7700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.779557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.780178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.781687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.782831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.809697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.810614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.812038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.814511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.815175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.816419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.844939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.845571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.851220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.852527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.853064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.853466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.853590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.854008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.854756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.855228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.855663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.994809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'flavor' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:03.011477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c8ada68-fe5c-48e7-ad8f-fd1d3d9c561e tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags" status: 204 len: 0 microversion: 2.26 time: 0.258101 Oct 18 13:38:03.012365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1735/3495] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Oct 18 13:38:02 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894/tags => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 13:38:03.022878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.023699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.031571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.032326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.032959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.033830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.034492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.035085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.066499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:03.210228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.222668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d289e5a-144a-4fa0-b86c-fbdb30ac7e22 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.383778 Oct 18 13:38:03.246574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1761/3496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.324285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.324982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.342261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.342776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.343227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.350709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.351234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.352846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.558581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34ad47f2-887a-40cb-8639-4d87de3cf843 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 204 len: 0 microversion: 2.26 time: 0.540154 Oct 18 13:38:03.559314 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1736/3497] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:38:03 2022] DELETE /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:38:03.575798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.576548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.591394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.591921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.595020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.596957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.597462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.597909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.607846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.631491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.638999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.644612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24678dd8-c050-4e17-9413-2136a7d8b7f8 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.320416 Oct 18 13:38:03.644612 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1762/3498] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:03.999092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.013643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.022175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.023443 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c171799b-01bd-44c3-a6d1-4582eabff4a3 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1552 microversion: 2.26 time: 0.459214 Oct 18 13:38:04.025233 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1737/3499] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1552 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:04.255731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.258217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.268283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.268965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.269537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.270394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.271818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.272516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.671255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.672629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.694520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.695331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.703735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.703735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.703735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.703735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.037543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.057494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.059002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.066355 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db0143db-e23f-47d9-906a-a0017800bfa3 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.397431 Oct 18 13:38:05.066355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1738/3500] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:05.067937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:05.068570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:05.091840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:05.092356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:05.092814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.094118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:05.094769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:05.095391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.345940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.359510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ad15ad5-2f6a-4b95-af58-6baccba338f0 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 1.114919 Oct 18 13:38:05.366947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1763/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:05.830611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.839736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.841309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.850850 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aeb0168f-0ba3-4da2-a8a9-c2a4272848ca tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1552 microversion: 2.26 time: 0.786408 Oct 18 13:38:05.854823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1739/3502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:05 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1552 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:06.096549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.097620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.122661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.124478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.130916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.132063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.135410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.138233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.343034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.361464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.365239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.368438 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a1a18e4-5d16-4403-8ba4-a360e2e11a08 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.276708 Oct 18 13:38:06.380765 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1764/3503] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:06.385791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.386495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.402935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.402935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.402935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.418630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.419142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.419595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.588169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35c024c-f179-4833-9cd2-43888b8bf894", "name": "network-vif-deleted", "tag": "6bb2599e-c2d4-419e-b736-152e48b9ff44"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:06.620677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.621258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.621813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.655805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] Creating event network-vif-deleted:6bb2599e-c2d4-419e-b736-152e48b9ff44 for instance f35c024c-f179-4833-9cd2-43888b8bf894 on n-h2-858383-13 Oct 18 13:38:06.674172 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d394ff09-f16e-42d5-99cb-a539a49430a2 req-35fe327a-3110-4774-b562-7b67a83fd29d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087891 Oct 18 13:38:06.677205 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1765/3504] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:06.769886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.795167 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3b42878-bebb-44b6-9422-548f496278c6 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.414583 Oct 18 13:38:06.798928 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1740/3505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:06.888626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.891653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.930256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.932982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.948626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.949642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.958933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.959637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.054730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:07.059667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.060180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.060805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.061442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lazy-loading 'fault' on Instance uuid f35c024c-f179-4833-9cd2-43888b8bf894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:07.312619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.332504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.334564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ab9411460b4292b1ea5719d352ccca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.336046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4dbd8a7-41e4-4369-9ed2-abffb708e219 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 200 len: 1352 microversion: 2.26 time: 0.460144 Oct 18 13:38:07.336985 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1766/3506] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 1352 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:07.398470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:07.399098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:07.422286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.423172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.423789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.424837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.425446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.426286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.561712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.575883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.582227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.583561 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd992a79-6c1c-4849-b7cd-28bf0f3aa745 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.191001 Oct 18 13:38:07.584502 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1741/3507] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:07 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:07.645440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1964230207", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "3133b4f7-0bf3-4805-91bd-3fea21fc44dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:07.752574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] validate_networks() for [('3133b4f7-0bf3-4805-91bd-3fea21fc44dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:07.825937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:07.826637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:07.845932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.849638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.849977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.854460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.856197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.857506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.116638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.127307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b04a78b-e83e-4ef3-a462-a9cca4afa02a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.306578 Oct 18 13:38:08.128277 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1742/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:07 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:08.372895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.373694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] [instance: f35c024c-f179-4833-9cd2-43888b8bf894] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:08.386689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.386689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.396872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.397773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.398406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.398997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.438922 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] HTTP exception thrown: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Request method failure captured: Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 HTTP/1.1 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqwf5KMag-WRKHmJOlwfGXhOltz7OY7ihUqdnN9EVZ40JuZYW-Zqq49z73eKo-iF6Ba0IdmwDksRfd2y-983NO94oL8FeK0gAjKzZUOkoiy83kIcYJvdn0fa4t9G-lgzEv8ZONSiwrrOOB102aKpgEwmVfcreLpvGAFog4aUSUZ7FYU Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.26 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d78fb68eedc84dfcb7c5cc2aeaa24f92 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerTagsTestJSON-1504240605 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d78fb68eedc84dfcb7c5cc2aeaa24f92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d78fb68eedc84dfcb7c5cc2aeaa24f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d78fb68eedc84dfcb7c5cc2aeaa24f92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d78fb68eedc84dfcb7c5cc2aeaa24f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerTagsTestJSON-1504240605 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d78fb68eedc84dfcb7c5cc2aeaa24f92 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerTagsTestJSON-1504240605 Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerTagsTestJSON-1504240605-project Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 45ab9411460b4292b1ea5719d352ccca Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerTagsTestJSON-1504240605-project Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f35c024c-f179-4833-9cd2-43888b8bf894'} Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:08.444101 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] Returning 404 to user: Instance f35c024c-f179-4833-9cd2-43888b8bf894 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:08.448636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12b9ad5f-20ea-4cd3-ac0d-a971962de570 tempest-ServerTagsTestJSON-1504240605 tempest-ServerTagsTestJSON-1504240605-project] 10.222.0.27 "GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894" status: 404 len: 111 microversion: 2.26 time: 0.079889 Oct 18 13:38:08.489896 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1743/3509] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/servers/f35c024c-f179-4833-9cd2-43888b8bf894 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:08.622547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.623375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:08.642614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.643605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.645820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.647802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.649488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.650169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.838559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.868654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.868654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '677fe6a60f0742b3820c41beccc07d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.871836 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f76d4b5-62cf-4cc1-8c70-8ea530c03773 tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 200 len: 1870 microversion: 2.32 time: 0.255867 Oct 18 13:38:08.872028 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1744/3510] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 1870 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:08.963082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:08.963590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:08.964122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:08.964832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:08.965374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:08.986230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.988778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.989266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.993787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.999996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.999996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.044342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Getting quotas for project 2ca4cc1ec1fa44159bd24c7e1d67b907. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:09.055646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Getting quotas for user 1fbc5130642349b4a985d88f4515040f and project 2ca4cc1ec1fa44159bd24c7e1d67b907. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:09.083850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:09.087108 n-d-858383-13 devstack@n-api.service[121010]: WARNING nova.utils [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1964230207 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-196423020 Oct 18 13:38:09.087936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:09.150908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:09.152455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:09.161441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.162026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.162765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.163411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.164506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.165028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.272707 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ff341428-54ae-407e-a4dd-926363c80203 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862224 Oct 18 13:38:09.281859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1767/3511] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:09.289072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3fb012c-f4d9-4ade-a80c-24fe11385740 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:09.290287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3fb012c-f4d9-4ade-a80c-24fe11385740 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:09.370823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:09.376471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f3fb012c-f4d9-4ade-a80c-24fe11385740 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:09.387120 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3fb012c-f4d9-4ade-a80c-24fe11385740 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1232 microversion: 2.1 time: 0.102363 Oct 18 13:38:09.401220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:09.402858 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1768/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:09 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1232 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:09.621733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:09.631561 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7984b42f-1b7a-4e2e-8167-d92f0209de5a tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.484593 Oct 18 13:38:09.656334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1745/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:09 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:09.902218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:09.903147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:09.913429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.914752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.922105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.922105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.922105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.922105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.954848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] HTTP exception thrown: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Request method failure captured: Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 HTTP/1.1 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqpNf6VrAp_ty4GlCi-r2AcyaURLY-t9E8dd0P-6SIMJTeNlEBSO1g5nNyzeQKFiCuRnbR7fPM4fO_xTAXvsk6H7K9SLCU0pVk4W5o3ch7ht4C5zm_k5Lnr5cdBDLjYxMz4T2YGzOZf4VXLrJJTuXfQqQnBudAGBNEzar2v7vv5MG0k Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 677fe6a60f0742b3820c41beccc07d11 Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '9719264e-f7cf-40c9-87a5-532305893524'} Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:09.960753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:09.968612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Returning 404 to user: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:09.972905 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e3cbfb8-c837-4e20-ab7e-2f3e267cdbea tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 404 len: 111 microversion: 2.32 time: 0.066140 Oct 18 13:38:09.976132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1769/3514] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:09 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:09.986472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9caa06d-84e4-4bcb-b380-ab56ccb8cede tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '.version_select at 0x7fb33124a3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:10.106594 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9caa06d-84e4-4bcb-b380-ab56ccb8cede tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430416498" status: 204 len: 0 microversion: 2.32 time: 0.126066 Oct 18 13:38:10.107923 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1746/3515] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 18 13:38:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430416498 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:38:10.412089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-430a6d0c-3636-4c60-b5cf-d2b8a3d16b86 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:10.413276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-430a6d0c-3636-4c60-b5cf-d2b8a3d16b86 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:10.575151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-430a6d0c-3636-4c60-b5cf-d2b8a3d16b86 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:10.587911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-430a6d0c-3636-4c60-b5cf-d2b8a3d16b86 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1232 microversion: 2.1 time: 0.179761 Oct 18 13:38:10.603115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1770/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:10 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1232 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:10.662617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:10.664019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:10.677593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:10.679926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:10.682462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:10.683474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:10.684167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:10.685362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:10.933478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:10.943253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5c395a2-c8a3-49f5-a35e-897750171a57 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.288093 Oct 18 13:38:10.948739 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1747/3517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:10 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:11.641144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:11.641950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:11.652781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.659940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.660546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.662400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.662400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.667903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.976150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:11.977037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:11.989110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.997913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.998840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.999901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.005483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.006311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.023099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:12.034036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10675ed1-6257-4659-9134-f46d006416ed tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1284 microversion: 2.1 time: 0.411087 Oct 18 13:38:12.044187 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1771/3518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:11 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:12.495038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:12.511065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-443fad7e-4fea-4bf9-8da8-cd5edc0315fc tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.539024 Oct 18 13:38:12.533492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1748/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:11 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:13.073009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.073669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:13.092233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.092822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.093339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.094094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.094585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.095040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.542558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.543262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:13.566089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.570612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.571166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.578233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.581176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.581902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.627144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:13.789689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:13.801951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:13.804733 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64e37d12-8db7-4b73-b4c4-061a0c116cdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1302 microversion: 2.1 time: 0.735747 Oct 18 13:38:13.811405 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1772/3520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1302 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:14.024699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:14.035756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-396029b2-d5bf-4686-87fd-e60dbbbb09ab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.501003 Oct 18 13:38:14.038282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1749/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:14.830676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:14.831856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:14.839751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.850882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.851648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.852401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.852873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.853309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.029198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:15.043856 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55dcdf72-71bc-464b-b1bd-22d86cc1c1f1 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1290 microversion: 2.1 time: 0.218017 Oct 18 13:38:15.044464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1773/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:14 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:15.067738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.069176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.078158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.078918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.079367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.080281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.080756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.081199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.687577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:15.705840 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fb73b0c-4c78-4440-9532-3f8190c7beab tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.635704 Oct 18 13:38:15.710984 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1750/3523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:16.075100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:16.075100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:16.088752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.089534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.090560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.091653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.092234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.092927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.605068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:16.629668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7961c956-d518-4100-839b-ead2987d139b tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.565052 Oct 18 13:38:16.634875 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1774/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:16 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:16.729161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:16.729637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:16.738124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.738717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.739420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.740333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.741002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.741805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.200819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:17.211641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a7d88189-b8a7-46f3-9f49-075e0316f121 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.486445 Oct 18 13:38:17.214367 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1751/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:16 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:17.666606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:17.669162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:17.691604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.692335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.692947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.694149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.694790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.695384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.116622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:18.126372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-203cec2e-0517-4b81-b5b2-b8713be7679d tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.468736 Oct 18 13:38:18.127731 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1775/3526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:17 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:18.243936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:18.247130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:18.260411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.261726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.262431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.263356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.265481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.266285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.314695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:18.333951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.334598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.336988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.356274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] Creating event network-changed:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:38:18.363750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f2d29fcb-86d5-4477-83e3-3abaaa6a6188 req-046c1613-85ec-4660-824b-4968c8bbb3ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052878 Oct 18 13:38:18.365080 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1776/3527] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:18.756855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:18.768739 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cc91c0d-8b1f-4fc0-820c-55b3e16843de tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1486 microversion: 2.1 time: 0.530743 Oct 18 13:38:18.775472 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1752/3528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:18 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1486 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:18.808243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:18.809588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:18.834873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.838633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.839389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.840375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.841646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.842455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.021987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:19.141642 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87ff0647-464b-447e-9733-553368df0e94 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "POST /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3/action" status: 202 len: 0 microversion: 2.1 time: 0.345258 Oct 18 13:38:19.149908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:19.150904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:19.152096 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1777/3529] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:18 2022] POST /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:19.164654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.165423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.168044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:19.168309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.172685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.172685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.172685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.173009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:19.193652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.194354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.196602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.200253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.200802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.201891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.690519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:19.700411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ed70aae-35c5-47cd-8da6-26755ab4995c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1494 microversion: 2.1 time: 0.546477 Oct 18 13:38:19.701399 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1778/3530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:19 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1494 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:19.832243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:19.844667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cdc606f-1a67-4c96-9918-5e3c13e4803e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.698312 Oct 18 13:38:19.848383 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1753/3531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:19 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:20.730598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:20.735366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:20.739407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:20.745868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.746448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.746863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.761050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.761735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.762653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.870340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:20.871198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:20.882587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.883537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.884353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.885602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.888543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.895024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.536144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:21.554744 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1747b0c6-f2f1-4051-b142-16915fb93f32 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1494 microversion: 2.1 time: 0.828411 Oct 18 13:38:21.556051 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1779/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:20 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1494 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:21.998911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-381037598", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:22.033880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:22.053551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b8c8c2d-f636-4037-9e16-e5fa4d8c1b4f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 1.185502 Oct 18 13:38:22.072646 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1754/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:20 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:22.089305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.090594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:22.117258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:22.122048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:22.122048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:22.122048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:22.122048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:22.125617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.128350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.130626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.134200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.134919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.138450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.158828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.159668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.160433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.161505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.162218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.163250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.179522 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] HTTP exception thrown: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Request method failure captured: Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 HTTP/1.1 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqpNf6VrAp_ty4GlCi-r2AcyaURLY-t9E8dd0P-6SIMJTeNlEBSO1g5nNyzeQKFiCuRnbR7fPM4fO_xTAXvsk6H7K9SLCU0pVk4W5o3ch7ht4C5zm_k5Lnr5cdBDLjYxMz4T2YGzOZf4VXLrJJTuXfQqQnBudAGBNEzar2v7vv5MG0k Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 677fe6a60f0742b3820c41beccc07d11 Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '9719264e-f7cf-40c9-87a5-532305893524'} Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:22.185340 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.190922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Returning 404 to user: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:22.195299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c94841b-080b-49f0-b595-30abd159dcbf tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 404 len: 111 microversion: 2.32 time: 0.117237 Oct 18 13:38:22.198077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Getting quotas for project 34c7d8a7682f4d75b980c0d60de4d6fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:22.198608 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1755/3534] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:38:22 2022] DELETE /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:22.205175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Getting quotas for user 548f86671c744430829ba6cc2d6463b6 and project 34c7d8a7682f4d75b980c0d60de4d6fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:22.219036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.222535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] [instance: 9719264e-f7cf-40c9-87a5-532305893524] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:22.225091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:22.228373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:22.243108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.243755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.244976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.255682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.259814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.260563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.299738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] HTTP exception thrown: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Request method failure captured: Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 HTTP/1.1 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqpNf6VrAp_ty4GlCi-r2AcyaURLY-t9E8dd0P-6SIMJTeNlEBSO1g5nNyzeQKFiCuRnbR7fPM4fO_xTAXvsk6H7K9SLCU0pVk4W5o3ch7ht4C5zm_k5Lnr5cdBDLjYxMz4T2YGzOZf4VXLrJJTuXfQqQnBudAGBNEzar2v7vv5MG0k Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3f57afe938f4118aed9e3b1f6b2bcdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b3f57afe938f4118aed9e3b1f6b2bcdc Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2008045825 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 677fe6a60f0742b3820c41beccc07d11 Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TaggedBootDevicesTest-2008045825-project Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '9719264e-f7cf-40c9-87a5-532305893524'} Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.304649 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. Oct 18 13:38:22.309569 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:38:22.310690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] Returning 404 to user: Instance 9719264e-f7cf-40c9-87a5-532305893524 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:22.313016 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c140517f-ac64-4235-b227-d33e2ae043ce tempest-TaggedBootDevicesTest-2008045825 tempest-TaggedBootDevicesTest-2008045825-project] 10.222.0.27 "GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524" status: 404 len: 111 microversion: 2.32 time: 0.109559 Oct 18 13:38:22.315098 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1756/3535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:22 2022] GET /compute/v2.1/servers/9719264e-f7cf-40c9-87a5-532305893524 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:22.437317 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ab21ab0-64aa-4494-8325-7d92ccbfd99f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.868444 Oct 18 13:38:22.441398 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1780/3536] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:38:22.452392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.453969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:22.580124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:22.591481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:22.592579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:22.607722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18ebd780-2fef-4f11-ad35-e0490d9660c1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 200 len: 1277 microversion: 2.47 time: 0.159938 Oct 18 13:38:22.614225 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1781/3537] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:22 2022] GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:22.623062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.624302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:22.636250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.637984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.639470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.641235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.642265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.642956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.025290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:23.038404 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b801bb53-8a41-499f-adb6-7c4cb0767542 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1494 microversion: 2.1 time: 0.421983 Oct 18 13:38:23.041400 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1782/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:22 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1494 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:23.063690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-157670629", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "abb65fda-9939-40a0-ab2f-cd9558579b11"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:23.075731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:23.076607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:23.088627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.092055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.092883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.094155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.094784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.096378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.171136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] validate_networks() for [('abb65fda-9939-40a0-ab2f-cd9558579b11', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:23.488186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:23.505063 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1466770a-5290-4b1f-b49a-a07c73f20371 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.431932 Oct 18 13:38:23.505063 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1783/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:23 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:23.525984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1931567679", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:23.633390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:23.654273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:23.654882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:23.655460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:23.656215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:23.675481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.675985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.676434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.681539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.682988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.685040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.732220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Getting quotas for project 34c7d8a7682f4d75b980c0d60de4d6fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:23.747711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Getting quotas for user 548f86671c744430829ba6cc2d6463b6 and project 34c7d8a7682f4d75b980c0d60de4d6fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:23.788271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:23.788486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:24.067717 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc4bff39-bf75-443b-bb97-a0742c6cb148 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.562551 Oct 18 13:38:24.073426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1784/3540] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:38:24.100209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:24.100209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:24.114836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.115362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.115814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.119835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.120423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.121149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.443221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:24.455746 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-948faa33-09a9-4808-9d60-1c4fbf943da5 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1500 microversion: 2.1 time: 0.379886 Oct 18 13:38:24.459160 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1785/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:24 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:24.465188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-080e33fe-c1cf-43f9-8023-d6c6a9b18063 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:24.471088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-080e33fe-c1cf-43f9-8023-d6c6a9b18063 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:24.519525 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-080e33fe-c1cf-43f9-8023-d6c6a9b18063 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "PUT /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 992 microversion: 2.47 time: 0.058927 Oct 18 13:38:24.520577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1786/3542] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Oct 18 13:38:24 2022] PUT /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 992 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:38:24.529344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:24.535214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:24.543483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.544270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.544935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.545938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.547102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.547695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.610308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:24.662014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:24.662638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:24.663233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:24.663897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:24.664517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:24.688204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.690776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.691376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.692830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.694560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.696126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.758094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Getting quotas for project 2a9860ff5bca4afc9a272f5d3781f3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:24.787652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Getting quotas for user 1704f764cb274f168e13a15f433affba and project 2a9860ff5bca4afc9a272f5d3781f3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:24.833599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:24.840816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:25.032767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59fddc3f-876b-41ed-a746-741f058fef2e tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.680372 Oct 18 13:38:25.055299 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1757/3543] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:38:25.072346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.072978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:25.079274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:25.116558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.121212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.122617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.136327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.143941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.146263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.168010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a29553d6-eb50-4080-9836-9e7259e17caa tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 204 len: 0 microversion: 2.1 time: 0.645520 Oct 18 13:38:25.171696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1787/3544] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:24 2022] DELETE /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:25.183454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.189630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:25.459344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.479620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.483640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.485195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38534079-5242-4f79-af9f-3fb0db34526a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1278 microversion: 2.47 time: 0.309209 Oct 18 13:38:25.487026 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1788/3545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:25.492311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36b65861-2630-4e2a-9009-c8bd3423854f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.493129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36b65861-2630-4e2a-9009-c8bd3423854f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:25.629863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36b65861-2630-4e2a-9009-c8bd3423854f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.638029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36b65861-2630-4e2a-9009-c8bd3423854f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1216 microversion: 2.1 time: 0.149791 Oct 18 13:38:25.641829 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1789/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:25.654898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.655859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:25.666548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.678006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.678006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.678006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.678006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.678006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.733887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.743700 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-494d874d-aacd-476d-9d56-bae618922243 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.686992 Oct 18 13:38:25.745433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1758/3547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:25.912102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.939556 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-270348e5-73f4-4d42-95f2-6b80243ab220 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.288498 Oct 18 13:38:25.940282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1790/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:26.373801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "name": "network-vif-plugged", "status": "completed", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:26.392100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.402892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.403633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.415888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] Creating event network-vif-plugged:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:38:26.454651 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fd2def0d-1214-403e-a711-19710006f482 req-8eeb6ee0-953e-480c-9f9c-5161ad5881fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083399 Oct 18 13:38:26.458104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1759/3549] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:26.517152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.517920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.536125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.538422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.539684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.542680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.543546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.544001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.677397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1cb8120b-c5ee-4231-bb27-0e1fc9ce5ac3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.678324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1cb8120b-c5ee-4231-bb27-0e1fc9ce5ac3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.864952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.869076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1cb8120b-c5ee-4231-bb27-0e1fc9ce5ac3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.876892 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1cb8120b-c5ee-4231-bb27-0e1fc9ce5ac3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1216 microversion: 2.1 time: 0.210466 Oct 18 13:38:26.878940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.880637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1760/3550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:26.886484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.891884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.892539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a89b6925-91f6-4630-b241-ea9684e8e5da tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1274 microversion: 2.47 time: 0.377366 Oct 18 13:38:26.893002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.898388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1791/3551] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1274 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:26.901720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.902459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.903068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.903964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.904612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.909776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.965315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.968270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.983022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.984530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.985244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.992915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.993770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.995090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.271317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:27.275356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:27.276458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:27.284270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f045cb54-0df1-4e3e-82a1-315dc7c11038 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.324355 Oct 18 13:38:27.286424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1792/3552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:27.295037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e197da1f-26d7-4ebc-81c3-63fe6da4db10 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.412781 Oct 18 13:38:27.295640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1761/3553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:27.908669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.910010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:27.928515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.929225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.929342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:27.929861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.930392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.931174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.931863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.932506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.937704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:27.954903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.962836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.965029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.965976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.966871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.989644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.027551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.038219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1abce10-989c-46f3-8e50-1369ae32d948 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1220 microversion: 2.1 time: 0.134947 Oct 18 13:38:28.041257 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1793/3554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.151082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.188532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.197713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.200174 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a6ad124-88de-4e7d-a14d-b42c4fe5b9a7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1330 microversion: 2.47 time: 0.280960 Oct 18 13:38:28.203631 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1762/3555] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1330 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:38:28.313853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.314520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.325549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.326210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.355203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.355748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.356215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.361085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.361602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.367511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.368155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.368807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.369772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.375074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.378671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.379668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.716668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.734462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2e73306-5980-4e7f-a1fa-db109502f7c6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1332 microversion: 2.1 time: 0.405099 Oct 18 13:38:28.739396 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1763/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1332 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:28.913335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.923648 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc6922c8-5384-4aa7-ab3d-50a27bf88cd7 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1506 microversion: 2.1 time: 0.615375 Oct 18 13:38:28.924210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1794/3557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.993099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-27389894", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "94262c69-6d41-4032-b689-b0ca83f39096"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:29.065748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:29.066392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:29.076265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.080855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.081526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.082495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.085392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.086035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.105803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] validate_networks() for [('94262c69-6d41-4032-b689-b0ca83f39096', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:29.314607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.325611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b5b6b3f-28bf-4189-841c-a5bbb9cb1bcb tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1268 microversion: 2.1 time: 0.264260 Oct 18 13:38:29.332250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1795/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:29 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1268 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:29.339801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:29.346501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:29.360192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.360928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.362679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.363600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.383567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.383567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.844413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.859385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.865291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.868838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-183e382c-14db-4506-a13c-c129efec7d5e tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1348 microversion: 2.47 time: 0.533321 Oct 18 13:38:29.871472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1796/3559] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:29 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1348 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:29.882253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:29.884450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:29.894041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.894981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.896239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.897298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.897992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.898674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.930719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:29.931504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:29.932404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:29.933058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:29.933718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:29.968525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.970348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.971861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.991166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.993014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.997965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.051387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Getting quotas for project 17da40534ba847b18b2f0cde9b822b24. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:30.066872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Getting quotas for user 658e3ac336ac4342bd204a74515fcd96 and project 17da40534ba847b18b2f0cde9b822b24. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:30.106214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Going to run 2 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:30.109507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 894ef1f6-9cf8-4695-92c3-fcc0f93ff436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:30.282210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=894ef1f6-9cf8-4695-92c3-fcc0f93ff436,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:30.611621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c15fcd6c-0148-4d55-9c2c-cb5353e006e8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.869870 Oct 18 13:38:30.616096 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1764/3560] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:30.627149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b243d6d6-4092-4f65-9394-ffbfd1808cd3", "name": "network-vif-deleted", "tag": "38e24bcf-43aa-4b9a-a707-4461165ce091"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:30.656631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.656631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.660555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.689193 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] Creating event network-vif-deleted:38e24bcf-43aa-4b9a-a707-4461165ce091 for instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 on n-h2-858383-13 Oct 18 13:38:30.702934 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-86e299da-1ec6-4fb0-81f7-fca824bb94f0 req-a36ce0d3-aac5-4920-978d-de6c602c34af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084486 Oct 18 13:38:30.705570 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1765/3561] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:30.716292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:30.721244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:30.734387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.738154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.738871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.742440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.743144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.745354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.824977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.829110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.833394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.833394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lazy-loading 'fault' on Instance uuid b243d6d6-4092-4f65-9394-ffbfd1808cd3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:30.925685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:30.939222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e7a72925-3da6-4e1a-b6ca-2b84b07b003f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 200 len: 1303 microversion: 2.1 time: 0.231218 Oct 18 13:38:30.950232 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1766/3562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:30 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 1303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:30.972603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:30.973717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.020640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.020640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.020640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.023482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.025173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.026484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.172933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.190188 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1a6c0e2-d0b0-43ea-8b6f-956be750345f tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1274 microversion: 2.1 time: 0.235656 Oct 18 13:38:31.210019 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1767/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:30 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:31.218668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.227784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.229866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Searching by: {'deleted': False, 'project_id': '17da40534ba847b18b2f0cde9b822b24'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:38:31.257366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.260311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.260972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.262238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.262959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.263768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.388658 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4aa6df5-2864-4cb0-a98e-d53cbece6016 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.177259 Oct 18 13:38:31.396879 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1768/3564] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers => generated 673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:31.403038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.408485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.435163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.436025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.436726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.437675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.438904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.440865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.508630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.539124 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77c9c435-9f10-4a79-bca6-9f71d123268a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1536 microversion: 2.1 time: 1.665346 Oct 18 13:38:31.543247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1797/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:29 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1536 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:31.576262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fb187cc-ecba-4c4f-b497-08ac4a853e27 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.577850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3fb187cc-ecba-4c4f-b497-08ac4a853e27 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.629068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.640613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.657883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.659146 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27d258f4-9726-4f4a-a6c4-8c82c9fd38f5 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1336 microversion: 2.47 time: 0.261181 Oct 18 13:38:31.674331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1769/3566] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:31.691040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8d61718-642c-4bc2-be9b-483e4164b024 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'create', calling method: .version_select at 0x7fb3314fc310>, body: {"pool": "74b8a990-fa9c-47ba-9c41-ee366d84010c"} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:31.802409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fb187cc-ecba-4c4f-b497-08ac4a853e27 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.827542 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fb187cc-ecba-4c4f-b497-08ac4a853e27 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1218 microversion: 2.1 time: 0.261378 Oct 18 13:38:31.843438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1798/3567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:31.961567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.962434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b243d6d6-4092-4f65-9394-ffbfd1808cd3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.982779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.983344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.983796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.994919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.996097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.996789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.042123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] HTTP exception thrown: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Request method failure captured: Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 HTTP/1.1 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqvWRe8U1VHYZoFtDt0gvorB_KhOs1SV4mdUPhf6HEQ2D4yQscMzRxpndWcQfkpRDu4czntAiG4r_oIqKn4GDJd7ML52yxacG3EGCjJpw16ZBtfG4eAP2epJhHpQzIWAg6I0P8U7juvgHum1TzvLU_FaNO6mCuw4N4aowFAhVoClomk Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ef289ee4f9954fc1bceaee4b381c3d3b Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ef289ee4f9954fc1bceaee4b381c3d3b Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueTestJSON-1698986589-project Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a857437becf14392bd1332824d86111c Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueTestJSON-1698986589-project Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'b243d6d6-4092-4f65-9394-ffbfd1808cd3'} Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:32.055088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Returning 404 to user: Instance b243d6d6-4092-4f65-9394-ffbfd1808cd3 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:32.060035 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1cc7b23-8b17-45d4-b019-ac59b1f6513c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3" status: 404 len: 111 microversion: 2.1 time: 0.100070 Oct 18 13:38:32.068481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1799/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers/b243d6d6-4092-4f65-9394-ffbfd1808cd3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:32.107038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.107736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:32.134383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.135556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.137720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.144551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.145117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.145774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.243575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:32.880527 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4247ec05-254e-4062-9e5d-2a455631e5c3 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 204 len: 0 microversion: 2.1 time: 0.793978 Oct 18 13:38:32.887564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1800/3569] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:32 2022] DELETE /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:32.902476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.903505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:32.911965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.912480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.912930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.913645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.914131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.914567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.303078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.313208 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04d2b0db-0e37-4942-a56a-44e516ae2ab7 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1316 microversion: 2.1 time: 0.424049 Oct 18 13:38:33.346957 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1801/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:33.364862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.365508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:33.372643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.373565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.377622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.377622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.377622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.377622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.554382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.567450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.569138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.573832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-100bed13-56aa-4407-ba80-195d4a3d94c2 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1357 microversion: 2.47 time: 0.225338 Oct 18 13:38:33.574674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1802/3571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:33.580880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ba86e32-a4e1-43cf-ad87-ec5672a3b89d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.585212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ba86e32-a4e1-43cf-ad87-ec5672a3b89d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:33.707251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ba86e32-a4e1-43cf-ad87-ec5672a3b89d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.713902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:33.740797 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ba86e32-a4e1-43cf-ad87-ec5672a3b89d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1218 microversion: 2.1 time: 0.164068 Oct 18 13:38:33.747847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1803/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:33.777321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.777321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:33.797010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.798272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.799281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.800599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.802694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.803391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:34.219886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:34.248234 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed360d21-b65e-444d-a1c5-06e47266fb7f tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1492 microversion: 2.1 time: 0.497670 Oct 18 13:38:34.251845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1804/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1492 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.275511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:34.278673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:34.293542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.294579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.295660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:34.297704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.299303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.304498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:34.500292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:34.502149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:34.502666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:34.503111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:34.503534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:34.893351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:34.920568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.920568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.920568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:34.921007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.922221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.922689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.022145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c726aea-277a-48d6-a009-2c16b280cf5c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "POST /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120/action" status: 202 len: 1079 microversion: 2.47 time: 0.768235 Oct 18 13:38:35.024222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1805/3574] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 13:38:34 2022] POST /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120/action => generated 1079 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:38:35.030721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ee7b73-1441-4489-9f35-928d2c6c2d90"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:35.039912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:35.047396 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8d61718-642c-4bc2-be9b-483e4164b024 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.371860 Oct 18 13:38:35.049531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.050278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.050896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.051770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.052380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.053005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.056350 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1770/3575] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:38:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:35.062176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:35.063036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:35.070675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.071415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.072054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.072959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.073615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.074265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.492233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.503041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-274911b3-6a7e-4bb7-94e7-ccc3fcb78e18 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1316 microversion: 2.1 time: 0.445073 Oct 18 13:38:35.515304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1771/3576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:35 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:35.515304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:35.515304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:35.516072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.516320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.517976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.518930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.519600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.520258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.541494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:35.712902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.722339 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6782621-de06-4812-be65-a5bd3f2e11b8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1214 microversion: 2.1 time: 0.217543 Oct 18 13:38:35.727650 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1772/3577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:35 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:35.732801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:35.734708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:35.741775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.742496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.744734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.744734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.744734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.745393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.891404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.900304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.902014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.903383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-811bdb27-491b-47e3-8f79-304952693861 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.174443 Oct 18 13:38:35.934151 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1773/3578] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:35 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:35.939695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.216"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:35.942605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:35.949482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.950306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.950989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.951947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:35.952599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:35.953222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.993041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:38:35.993733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquired lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:38:36.300014 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e52ab349-392c-4f4b-911e-33dc08ad8a56 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "POST /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.268057 Oct 18 13:38:36.300674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1806/3579] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:38:35 2022] POST /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 194 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:36.307315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056e37b7-bafe-438d-b2f7-e92247c4e21f", "tag": "95631b15-a586-4bbd-8f90-1f55bb6a144e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:36.318281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.319124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.319826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.325483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:36.333264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] Creating event network-changed:95631b15-a586-4bbd-8f90-1f55bb6a144e for instance 056e37b7-bafe-438d-b2f7-e92247c4e21f on n-h2-858383-13 Oct 18 13:38:36.339067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-af898070-275a-4c86-9715-1f0d954ce345 req-9805d368-1c8d-4ea3-940c-750ed5ad4088 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036643 Oct 18 13:38:36.340099 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1807/3580] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:36.345773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.347032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:36.362557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.365993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.366753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.367946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.368679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.369704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.532531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:36.553529 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b38add2-61a8-4701-804a-8ce7a6f905ca tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1450 microversion: 2.1 time: 0.211849 Oct 18 13:38:36.554785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1808/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:36 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:36.561939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.563373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:36.576461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.577581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.579439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.580968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.581685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.582712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.927873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:36.971168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84e197fb-b0b3-4dbd-89b8-f185d9ddf4fe tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1316 microversion: 2.1 time: 0.411489 Oct 18 13:38:36.974637 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1809/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:36 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:36.985419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.986591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.053479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.053479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.053479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.055224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.055758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.058323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.194625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:37.207701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe6eff2f-4a06-4714-8156-dff6cb68435f tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1278 microversion: 2.1 time: 0.231456 Oct 18 13:38:37.209808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1810/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:36 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:37.251898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:37.254758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.269095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.270156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.272146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.273804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.274554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.275857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.681511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:37.699788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:37.704409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:37.715370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70c5663b-a54b-4ffc-b83a-c4a3a8a61237 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.503804 Oct 18 13:38:37.723632 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1811/3584] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:37 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:37.733926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76ced1b-9fbd-4d2f-8201-91288e5f7894", "name": "network-vif-deleted", "tag": "4bc38e37-c557-42ec-9ba0-06654cefe66a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:37.775518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.781015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.781450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.808168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] Creating event network-vif-deleted:4bc38e37-c557-42ec-9ba0-06654cefe66a for instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 on n-h1-858383-13 Oct 18 13:38:37.825344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6505b793-5233-4506-abde-84e1d5ce52ba req-8c0c3e54-1833-401b-a198-8d84699dac0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090328 Oct 18 13:38:37.825344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1812/3585] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:37.832057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:37.832678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.847156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.847754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.860091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.860091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.860091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.860674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.944375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.944858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.945314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.953378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lazy-loading 'fault' on Instance uuid b76ced1b-9fbd-4d2f-8201-91288e5f7894 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:38.562435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a857437becf14392bd1332824d86111c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:38.577130 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b498564e-ce5c-4a4b-946c-233dfb875f3c tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 200 len: 1303 microversion: 2.1 time: 0.754251 Oct 18 13:38:38.579884 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1813/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:37 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 1303 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:38.591135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:38.594309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:38.628316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.630110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.634030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:38.635541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.639820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.640542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:39.582032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:39.591782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2041a77-c5eb-4bc3-8832-6dddb0746518 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1316 microversion: 2.1 time: 1.008905 Oct 18 13:38:39.597867 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1814/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:38 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1316 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:39.607312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:39.610216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:39.628117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:39.628826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:39.634001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:39.634001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:39.634001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:39.634001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:39.969307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:39.983559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6eb4533-b5e6-4b8c-a504-051ff4874d37 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.384212 Oct 18 13:38:39.997998 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1815/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:39 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:40.022724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:40.023575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:40.036369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.043579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.043579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.043579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.044278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.046294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.084414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:40.227231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:40.239340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:40.243651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:40.246807 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f582292-9887-484a-9858-31db936dec21 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.242570 Oct 18 13:38:40.250301 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1816/3589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:40 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:40.275851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:40.276870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] [instance: b76ced1b-9fbd-4d2f-8201-91288e5f7894] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:40.291364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.292250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.295081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.296244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.301462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.301462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.369248 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] HTTP exception thrown: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Request method failure captured: Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 HTTP/1.1 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqvWRe8U1VHYZoFtDt0gvorB_KhOs1SV4mdUPhf6HEQ2D4yQscMzRxpndWcQfkpRDu4czntAiG4r_oIqKn4GDJd7ML52yxacG3EGCjJpw16ZBtfG4eAP2epJhHpQzIWAg6I0P8U7juvgHum1TzvLU_FaNO6mCuw4N4aowFAhVoClomk Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ef289ee4f9954fc1bceaee4b381c3d3b Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef289ee4f9954fc1bceaee4b381c3d3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ef289ee4f9954fc1bceaee4b381c3d3b Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueTestJSON-1698986589 Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueTestJSON-1698986589-project Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a857437becf14392bd1332824d86111c Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueTestJSON-1698986589-project Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'b76ced1b-9fbd-4d2f-8201-91288e5f7894'} Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:40.374678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. Oct 18 13:38:40.379803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:40.381972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] Returning 404 to user: Instance b76ced1b-9fbd-4d2f-8201-91288e5f7894 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:40.383119 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90dd389f-1ff9-48b9-aae3-640d408c05b2 tempest-ServerRescueTestJSON-1698986589 tempest-ServerRescueTestJSON-1698986589-project] 10.222.0.27 "GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894" status: 404 len: 111 microversion: 2.1 time: 0.126758 Oct 18 13:38:40.383975 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1817/3590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:40 2022] GET /compute/v2.1/servers/b76ced1b-9fbd-4d2f-8201-91288e5f7894 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:40.388878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894ef1f6-9cf8-4695-92c3-fcc0f93ff436", "tag": "0219c688-cd81-4eb6-91e2-f897ecdcd396"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:40.400740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.401327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.402126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.414952 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] Creating event network-changed:0219c688-cd81-4eb6-91e2-f897ecdcd396 for instance 894ef1f6-9cf8-4695-92c3-fcc0f93ff436 on n-h2-858383-13 Oct 18 13:38:40.421007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-40d562b5-84b9-4acf-8ae9-49cd237363bd req-46f994b8-853c-4c05-ae37-f328ae768e27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 Oct 18 13:38:40.422745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1818/3591] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:40.428997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056e37b7-bafe-438d-b2f7-e92247c4e21f", "name": "network-vif-plugged", "status": "completed", "tag": "95631b15-a586-4bbd-8f90-1f55bb6a144e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:40.440613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.441416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.442200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.459607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] Creating event network-vif-plugged:95631b15-a586-4bbd-8f90-1f55bb6a144e for instance 056e37b7-bafe-438d-b2f7-e92247c4e21f on n-h2-858383-13 Oct 18 13:38:40.473037 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f9ac260f-6c28-4839-84e2-853a53b75804 req-d4973efa-32d7-4e29-85bd-6f26cae9f37a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045675 Oct 18 13:38:40.475650 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1819/3592] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:40.627318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:40.628046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.654376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.144200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:41.160806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05a18f69-8ac2-4a0b-96bb-32cf09c9f64c tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1316 microversion: 2.1 time: 0.538454 Oct 18 13:38:41.162105 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1820/3593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:40 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:41.180080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.181316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.195952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.201322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.202597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.205077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.205905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.207894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.320484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:41.443023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:38:42.489841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.521832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0953f8b-f550-4e37-8684-fc547196dcdf tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 1.351949 Oct 18 13:38:42.522670 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1821/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:41 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:42.532975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:42.536196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:42.553723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.554609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.555189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.556323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.557045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.557733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.714908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.732508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.734590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.744239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cc7b724-ebe5-4bd9-b4d6-b537f7f73d36 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.220012 Oct 18 13:38:42.750476 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1822/3595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:42 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:42.765620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:42.806558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.810655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.810655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.843719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] Creating event network-changed:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:38:42.862858 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-66eb9bd1-0857-4517-bd6e-d3a85f8e0573 req-0b1341c2-aa8a-4aa5-bc9a-2616aba10db7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105713 Oct 18 13:38:42.863539 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1823/3596] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:42.871855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:42.875735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:42.890471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.891273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.891883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.892768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.893397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.893994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.221508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Updating instance_info_cache with network_info: [{"id": "3bee9433-17e5-450f-a904-0dd6e491f41d", "address": "fa:16:3e:eb:73:ca", "network": {"id": "3133b4f7-0bf3-4805-91bd-3fea21fc44dc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1624493031-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2ca4cc1ec1fa44159bd24c7e1d67b907", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3bee9433-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:38:43.300858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:43.309909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac9f1d52-1781-4c4f-b5fe-2fe908973fdc tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1504 microversion: 2.1 time: 0.444453 Oct 18 13:38:43.310543 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1824/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:42 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:43.317470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Releasing lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:38:43.318665 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef8f51c8-9dfc-4341-a40e-9727af724ee0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 202 len: 0 microversion: 2.1 time: 7.383188 Oct 18 13:38:43.319455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1774/3598] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:35 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 0 bytes in 7385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:38:43.337274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:43.337835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.338328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43cb4dfc-1857-4926-ae77-eff85cd9ba98 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'create', calling method: .version_select at 0x7fb331238e50>, body: {"pool": "74b8a990-fa9c-47ba-9c41-ee366d84010c"} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:43.355200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.355200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.355200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.355935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.356735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.357990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.398147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:43.399289 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b36dcb7-a5d3-48f5-8a82-ca1eaa4dc0d6 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/os-instance-actions/req-59fddc3f-876b-41ed-a746-741f058fef2e" status: 200 len: 313 microversion: 2.1 time: 0.065925 Oct 18 13:38:43.399920 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1775/3599] 10.222.0.27 () {58 vars in 1419 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/os-instance-actions/req-59fddc3f-876b-41ed-a746-741f058fef2e => generated 313 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:43.415616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:43.418427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.431283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.441737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.442477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.443402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.444040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.444712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.719396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=22 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:43.743085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16f3fa9f-142a-4697-8825-90e85a631ced tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "POST /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/action" status: 202 len: 0 microversion: 2.1 time: 0.331586 Oct 18 13:38:43.747046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1776/3600] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:43 2022] POST /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:43.759269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:43.762557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.780948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.784794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.789322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.789322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.789322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.789322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.402548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.412379 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-821a9bd3-51d7-4b20-9bfe-7e28243088e1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.663666 Oct 18 13:38:44.413755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1777/3601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:44.419040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:44.421215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:44.428729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.434478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.434478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.434478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.434478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.434478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.749258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.753031 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-538e58e5-5065-436d-b67f-2aa47dce6845 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1506 microversion: 2.1 time: 0.337915 Oct 18 13:38:44.756301 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1778/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:44 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:44.774740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:44.775702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:44.786990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.787505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.787963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.790463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.791177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.791786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.922422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.935167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.938228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.940229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-398c022a-69f1-43aa-b457-373a5b4612a9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.180324 Oct 18 13:38:44.942131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1779/3603] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:44 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:44.948323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d3d2e0-f78f-4921-be9d-22c6f6d400ad", "tag": "fc81e14a-8b15-4c54-893c-88f0fceafd67"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:44.964544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.965692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.965692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.979507 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] Creating event network-changed:fc81e14a-8b15-4c54-893c-88f0fceafd67 for instance c4d3d2e0-f78f-4921-be9d-22c6f6d400ad on n-h2-858383-13 Oct 18 13:38:44.986581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-36de98ec-a73d-4ab9-aa84-b3f6375ef55f req-c01db3da-6c71-4a77-b0c7-8eca8b280d22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042899 Oct 18 13:38:44.987394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1780/3604] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:45.436763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:45.437473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:45.449531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.452516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.454467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:45.458290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.458815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.459359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.118009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.135258 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-196177bb-03af-4f62-9441-8eb2f4ad0434 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.702805 Oct 18 13:38:46.135895 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1781/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:45 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:46.154461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:46.155667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:46.167759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.168266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.168724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.169467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.169942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.170636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.695993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.710979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6257a418-7e20-49fc-9f6d-288332cc2ebf tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1506 microversion: 2.1 time: 0.573813 Oct 18 13:38:46.712172 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1782/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:46 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:46.726026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:46.727011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:46.741503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.742319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.742928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.743802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.744681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.745282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.945622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.959354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.960847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.962307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0caf7b4-0ba1-473a-9364-73269e837c69 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.248956 Oct 18 13:38:46.966779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1783/3607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:46 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:47.163277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.164169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:47.175295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.176151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.176674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.178959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.179513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.181448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.851457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:47.861080 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ca54bcf-cb25-4c77-be1e-afe5364d5e6e tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.701548 Oct 18 13:38:47.862018 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1784/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:47.889124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.889773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:47.899820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.900738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.901676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.902629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.903108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.903541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.262520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:48.288682 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39fbc39b-9ff6-4c0e-9ccd-411e0eb33254 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1506 microversion: 2.1 time: 0.424232 Oct 18 13:38:48.306387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1785/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:48.311677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:48.324176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:48.335087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.335779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.341837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.343460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.344113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.345265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.470861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:48.479877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43cb4dfc-1857-4926-ae77-eff85cd9ba98 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.149638 Oct 18 13:38:48.490448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1825/3610] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:38:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:48.499196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.114"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:48.509421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:48.509601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:48.509717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:48.509717 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40ca4f00-4288-4b82-91d1-1012c436b1f9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.196116 Oct 18 13:38:48.509717 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1786/3611] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:48 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:48.509965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.509965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.510625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.511510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.512120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.512697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.560577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:38:48.562788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquired lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:38:48.884070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:48.884779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:48.904853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.905463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.905990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.906799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.907344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.907853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.932071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:49.127022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c.", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:38:49.128486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Releasing lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:38:49.129325 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.129325 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Request method failure captured: Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action HTTP/1.1 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 46 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqw_ehZO4xZA4eXsTFB8J_NPvf8xH5gGD0ai6o5dC-1Ij85dyMFAzwy2_3fbwh1xaufJ02Lqu1tX1eP7aYJWLBLXshKAtKogk8uAn1hY0Tbr-ypW9cq0UX_HEe5pyKYr2wAv6g6kbrIFf1XMvkI3OLdG_2aoVwHvH5P7u_HsxiAjGSA Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1fbc5130642349b4a985d88f4515040f Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: {"addFloatingIp": {"address": "172.25.7.114"}} Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3135818b-32b6-4f9b-a991-953c5f1c8cf6', 'body': {'addFloatingIp': {'address': '172.25.7.114'}}} Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:38:49.132078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] Oct 18 13:38:49.137528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:49.142348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Returning 400 to user: Cannot associate floating IP 172.25.7.114 (4ac318ee-9399-41f2-a8f1-155a64ac3be3) with port 3bee9433-17e5-450f-a904-0dd6e491f41d using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74b8a990-fa9c-47ba-9c41-ee366d84010c. Oct 18 13:38:49.142348 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-6ba5b203-cad6-4bc1-b774-dd5ad1dcf84f'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:49.142348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b3ad92e-1577-442e-b9d6-d9a901b336cd tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 400 len: 381 microversion: 2.1 time: 0.642165 Oct 18 13:38:49.142348 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1826/3612] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:48 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 381 bytes in 647 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:49.142852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82bed925-cccb-4e6a-986f-e22097ada07f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '.version_select at 0x7fb330ffc430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.177121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.183701 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d90c426-3543-4a35-be60-14d5c86db98d tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.303577 Oct 18 13:38:49.198087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1787/3613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:48 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:49.313045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.316526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:49.329075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.329958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.330613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.331935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.336088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.336960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.807073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.815979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6456375d-549f-4651-8860-b948c4be8cb3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1504 microversion: 2.1 time: 0.507020 Oct 18 13:38:49.816650 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1788/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:49 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:49.821416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.822036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:49.829095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.829599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.830048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.830772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.831238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.831678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.907796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.919703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.922025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.924063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13617601-39d6-4503-9ddb-2be77e6354b1 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.106356 Oct 18 13:38:49.924707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1789/3615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:49 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:49.934526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '.version_select at 0x7fb33074d160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.938254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:49.945021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.945722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.946579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.947647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.948288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.949752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.001192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db14155a-fab6-4c43-86f5-6f617e0a9063 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.075203 Oct 18 13:38:50.029738 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1790/3616] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:38:49 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f/os-instance-actions => generated 611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:50.030359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d3d2e0-f78f-4921-be9d-22c6f6d400ad", "name": "network-vif-plugged", "status": "completed", "tag": "fc81e14a-8b15-4c54-893c-88f0fceafd67"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:50.043970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.044645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.045293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.077804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] Creating event network-vif-plugged:fc81e14a-8b15-4c54-893c-88f0fceafd67 for instance c4d3d2e0-f78f-4921-be9d-22c6f6d400ad on n-h2-858383-13 Oct 18 13:38:50.083707 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5b8cf3fd-5c59-4687-abb3-51c34eb1958b req-87539d80-589d-4b1d-acf1-109f89fa9a83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057522 Oct 18 13:38:50.086759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1791/3617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:50.127868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.128534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.160642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.161171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.164337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.165215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.168624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.169188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.225351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:50.469009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82bed925-cccb-4e6a-986f-e22097ada07f tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/4ac318ee-9399-41f2-a8f1-155a64ac3be3" status: 202 len: 0 microversion: 2.1 time: 1.329538 Oct 18 13:38:50.469600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1827/3618] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:38:49 2022] DELETE /compute/v2.1/os-floating-ips/4ac318ee-9399-41f2-a8f1-155a64ac3be3 => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:50.475512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.476134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.482144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:50.484517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.485018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.485467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.486217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.486681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.487310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.638981 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aea15aae-ec47-453b-a021-df33a7fa22dd tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 204 len: 0 microversion: 2.1 time: 0.550548 Oct 18 13:38:50.641006 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1792/3619] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:50 2022] DELETE /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:50.646675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.216"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:50.675810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:50.685182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5d74aa6-0c42-46f6-9c2d-aa4f8bfc0de8 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.214509 Oct 18 13:38:50.704429 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1828/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:50 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:50.711384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.711384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.716666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.717743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.718233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.718950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.719403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.719839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.887256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:50.891860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:50.896558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36832ce8-8536-4631-9528-559126ce98f1 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1510 microversion: 2.1 time: 0.190874 Oct 18 13:38:50.910346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1829/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:50 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:50.955771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.956281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.958944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.965004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.965515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.966190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.967668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.968363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.968776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.969284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.969634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.969748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.970493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.970954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.971683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.075091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.097757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.102745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.104015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de7641fc-dc29-4d07-afa9-d18281b5f337 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.154573 Oct 18 13:38:51.114996 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1830/3622] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:50 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:51.445283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:38:51.445715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquired lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:38:51.708887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:51.709990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.724281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.887043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.902493 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7028ebe9-63dd-4839-974d-3c41b5e0e530 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.193434 Oct 18 13:38:51.902493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1831/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:51 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:51.922671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:51.923570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.929396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.929895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.930388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.931094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.931839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.932287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.099767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.111456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2947d090-ea64-4100-8435-2cdc795d42ae tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1510 microversion: 2.1 time: 0.192949 Oct 18 13:38:52.126399 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1832/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:51 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:52.133223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894ef1f6-9cf8-4695-92c3-fcc0f93ff436", "name": "network-vif-plugged", "status": "completed", "tag": "0219c688-cd81-4eb6-91e2-f897ecdcd396"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:52.150108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.150614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.151071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.174880 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] Creating event network-vif-plugged:0219c688-cd81-4eb6-91e2-f897ecdcd396 for instance 894ef1f6-9cf8-4695-92c3-fcc0f93ff436 on n-h2-858383-13 Oct 18 13:38:52.181700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-14a3b76f-66c0-41e0-ac94-06876ffa9fa7 req-24541b96-ae97-43d9-86c7-ae449c02a5a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060701 Oct 18 13:38:52.182436 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1833/3625] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:52.198559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.200056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.208635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.209812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.210573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.211550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.212113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.212456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.300625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.310395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.311870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.313249 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4094061d-c4ac-45e2-bcde-0ffff63faeb4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.129158 Oct 18 13:38:52.314218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1834/3626] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:52.934170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.934170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.976007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.979724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.982008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.987420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.988182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.996391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:53.004455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:38:53.423158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:53.441645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc11cfd5-d74d-4bfe-8aa8-4309a3ea17e6 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1318 microversion: 2.1 time: 0.520848 Oct 18 13:38:53.443044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1835/3627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:53.465289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:53.509942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:53.511800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:53.513009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:53.540141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] Creating event network-changed:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:38:53.557895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-75b4be05-db0d-4dc7-bb8c-3b8182c25cfa req-c2c7f841-0f61-42cd-94bf-b01cc9de57f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106350 Oct 18 13:38:53.557895 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1836/3628] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:54.126193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6f7371e4-790f-40bd-a7d1-ab833d93f5f7"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:54.129960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:54.144466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.149099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.150353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.151138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.151622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.155019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.302547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Updating instance_info_cache with network_info: [{"id": "3bee9433-17e5-450f-a904-0dd6e491f41d", "address": "fa:16:3e:eb:73:ca", "network": {"id": "3133b4f7-0bf3-4805-91bd-3fea21fc44dc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1624493031-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2ca4cc1ec1fa44159bd24c7e1d67b907", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3bee9433-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:38:54.391006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Releasing lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:38:54.392549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5aef109-d88f-4b09-8f43-84750a680624 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 202 len: 0 microversion: 2.1 time: 3.750252 Oct 18 13:38:54.395603 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1793/3629] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:50 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 0 bytes in 3754 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:38:54.403722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:54.404480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:54.412908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.413519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.414243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.415153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.415954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.416625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.434657 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] HTTP exception thrown: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Request method failure captured: Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments/70ee7b73-1441-4489-9f35-928d2c6c2d90 HTTP/1.1 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 74 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqwJYfXsrMaAWUZ-LltvDx8bFlybjMscdqFdhOzazyL3qbt9IK1HEAFy5PdbGOk40RsH9D8gcn2z_0ZyTi5q90MOB-sH31gq4GHQyva-QSIpcgMVQ3I1Jg9EWwapdWlFO_Hjqk5UoGy0dwrpkni_nEQgqmZJsP0J84RYgGOBQPsIZmA Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 839ea251cbf14e1ea20d69d823d0dd12 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 839ea251cbf14e1ea20d69d823d0dd12 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesAdminNegativeTest-744806322-project-admin Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c98e22c79e144f43b84c006ecc2ad91f Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesAdminNegativeTest-744806322-project-admin Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: {"volumeAttachment": {"volumeId": "6f7371e4-790f-40bd-a7d1-ab833d93f5f7"}} Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '5d963134-c4b3-4561-8f45-302eba5e54c3', 'id': '70ee7b73-1441-4489-9f35-928d2c6c2d90', 'body': {'volumeAttachment': {'volumeId': '6f7371e4-790f-40bd-a7d1-ab833d93f5f7'}}} Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. (HTTP 404) (Request-ID: req-b1395c1f-251f-4a85-ad56-e00a913eac0d) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:38:54.463807 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Returning 400 to user: Volume 6f7371e4-790f-40bd-a7d1-ab833d93f5f7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-68fa3b5f-a556-413b-b5ae-806eef26d16f tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments/70ee7b73-1441-4489-9f35-928d2c6c2d90" status: 400 len: 107 microversion: 2.1 time: 0.908215 Oct 18 13:38:54.469554 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1837/3630] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Oct 18 13:38:53 2022] PUT /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments/70ee7b73-1441-4489-9f35-928d2c6c2d90 => generated 107 bytes in 909 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:54.483551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:54.484182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:54.508084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.520977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.522641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.528724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.530558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.531092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.634335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1704f764cb274f168e13a15f433affba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9860ff5bca4afc9a272f5d3781f3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:54.647401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b086a59b-a419-4873-a0dd-fb9aac4f9b46 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 200 len: 1468 microversion: 2.1 time: 0.248404 Oct 18 13:38:54.648356 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1794/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:54 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:54.655327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056e37b7-bafe-438d-b2f7-e92247c4e21f", "name": "network-vif-deleted", "tag": "95631b15-a586-4bbd-8f90-1f55bb6a144e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:54.673347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.674158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.674764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.694170 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] Creating event network-vif-deleted:95631b15-a586-4bbd-8f90-1f55bb6a144e for instance 056e37b7-bafe-438d-b2f7-e92247c4e21f on n-h2-858383-13 Oct 18 13:38:54.706357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:54.713783 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3cec2316-e8f8-4ad5-945d-fe5f7fa573a9 req-19d14a40-e684-474f-93a5-7617f0c67b65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063587 Oct 18 13:38:54.715503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1795/3632] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:54.717011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:54.719100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:54.723668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4db4e033-8c4f-47b1-a537-14fa4fb592a0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '.version_select at 0x7fb330c8fb80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:54.729265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80e3b80f-dfb1-4ac8-849f-8c1bb7e8cfe7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.257835 Oct 18 13:38:54.746329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1838/3633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:54 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:54.748775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:54.749737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:54.756899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.757627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.758268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.759138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.759795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.761031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.121185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:55.133866 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-654de2bb-1e20-47ce-91d1-80d1e61b6a35 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 200 len: 1506 microversion: 2.1 time: 0.389834 Oct 18 13:38:55.136480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1839/3634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:54 2022] GET /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:55.161707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.162492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.169755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.171033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.171676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.172613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.173274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.173920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.331879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lazy-loading 'services' on Instance uuid 5d963134-c4b3-4561-8f45-302eba5e54c3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:55.572605 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f5d4856-6498-4c20-a763-4965e0ffa99d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments/70ee7b73-1441-4489-9f35-928d2c6c2d90" status: 202 len: 0 microversion: 2.1 time: 0.420569 Oct 18 13:38:55.576858 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1840/3635] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:38:55 2022] DELETE /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments/70ee7b73-1441-4489-9f35-928d2c6c2d90 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:55.591592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.592385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 894ef1f6-9cf8-4695-92c3-fcc0f93ff436] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.611205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.612856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.613519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.615684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.616449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.617068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.864407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:55.878174 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac76c88e-f9ba-480b-a250-fd4c5f59fcad tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/894ef1f6-9cf8-4695-92c3-fcc0f93ff436" status: 200 len: 1507 microversion: 2.1 time: 0.303307 Oct 18 13:38:55.898596 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1841/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/894ef1f6-9cf8-4695-92c3-fcc0f93ff436 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:55.907921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.912990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.929978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.930641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.931109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.932279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.932669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.933476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.970607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11c1c828-e884-40cb-a520-7336aa0edc53 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088055 Oct 18 13:38:55.972028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1842/3637] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:55.979937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.980878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] [instance: 056e37b7-bafe-438d-b2f7-e92247c4e21f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.988959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.989735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.990450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.992695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.994183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.995145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.013770 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] HTTP exception thrown: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Request method failure captured: Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f HTTP/1.1 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqxONNzGDDw9dk6-G29WG_BTJ_x9o2ae-aEqnZ_Jbi65-MdAHrgh_qiPt-ikHdxB0caDCkyBmP-AxRS3IPU45YUcsPz_9xGEyWHpbwWk20RI9yGxF7wmC_yiymGqg4Fki8VH47oZYpY8jGrV7bdqm0ImJ_sDbrROS_vwZksv2jKWcC8 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2a9860ff5bca4afc9a272f5d3781f3e7 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsTestJSON-743278596 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a9860ff5bca4afc9a272f5d3781f3e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a9860ff5bca4afc9a272f5d3781f3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a9860ff5bca4afc9a272f5d3781f3e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a9860ff5bca4afc9a272f5d3781f3e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsTestJSON-743278596 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2a9860ff5bca4afc9a272f5d3781f3e7 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsTestJSON-743278596 Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsTestJSON-743278596-project Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1704f764cb274f168e13a15f433affba Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsTestJSON-743278596-project Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '056e37b7-bafe-438d-b2f7-e92247c4e21f'} Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:56.021196 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:56.027051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] Returning 404 to user: Instance 056e37b7-bafe-438d-b2f7-e92247c4e21f could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:56.028144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44c871a4-a069-4837-9a01-fef10dc6cfd3 tempest-InstanceActionsTestJSON-743278596 tempest-InstanceActionsTestJSON-743278596-project] 10.222.0.27 "GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f" status: 404 len: 111 microversion: 2.1 time: 0.053866 Oct 18 13:38:56.031536 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1843/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/056e37b7-bafe-438d-b2f7-e92247c4e21f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:56.038661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:56.039312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:56.056861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.057377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.060736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.061504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.063386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.063899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.607579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:56.624818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:56.626724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:56.628761 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82b33bc5-d2a5-4b6d-b9f7-65a963b2bff9 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.596259 Oct 18 13:38:56.629984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1844/3639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:56 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:56.636472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:56.639682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 894ef1f6-9cf8-4695-92c3-fcc0f93ff436] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:56.653995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.655452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.656197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.657166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.657854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.659336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.707260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 894ef1f6-9cf8-4695-92c3-fcc0f93ff436] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:57.157403 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4deefce-8423-4560-88fa-f36cce7ddabb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "DELETE /compute/v2.1/servers/894ef1f6-9cf8-4695-92c3-fcc0f93ff436" status: 204 len: 0 microversion: 2.1 time: 0.521468 Oct 18 13:38:57.157403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1845/3640] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:56 2022] DELETE /compute/v2.1/servers/894ef1f6-9cf8-4695-92c3-fcc0f93ff436 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:57.160572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:57.172124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.195610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.199886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.200382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.202485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.202983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.203430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.256246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:57.294839 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ff8e279-e4e5-4b20-90f6-d7e3af8d59bc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139890 Oct 18 13:38:57.313941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1846/3641] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:38:57 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:57.326795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:57.329908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.344923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.346748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.346748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.348856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.351952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.353517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.390672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: c4d3d2e0-f78f-4921-be9d-22c6f6d400ad] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:57.770404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4db4e033-8c4f-47b1-a537-14fa4fb592a0 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d887696a-ee89-4cab-af2d-0609e58fa313" status: 202 len: 0 microversion: 2.1 time: 3.051002 Oct 18 13:38:57.772260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1796/3642] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:38:54 2022] DELETE /compute/v2.1/os-floating-ips/d887696a-ee89-4cab-af2d-0609e58fa313 => generated 0 bytes in 3055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:57.778172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:57.779027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.791647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.798277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.798965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.801652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.802382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.805472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.814299 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbdf9378-9436-49f0-99c2-b42458a3d56a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad" status: 204 len: 0 microversion: 2.1 time: 0.497989 Oct 18 13:38:57.828944 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1847/3643] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:57 2022] DELETE /compute/v2.1/servers/c4d3d2e0-f78f-4921-be9d-22c6f6d400ad => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:57.835732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fe11f3f-3140-4541-8b72-e07afb809fdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fe11f3f-3140-4541-8b72-e07afb809fdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Request method failure captured: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action HTTP/1.1 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 34 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqw_ehZO4xZA4eXsTFB8J_NPvf8xH5gGD0ai6o5dC-1Ij85dyMFAzwy2_3fbwh1xaufJ02Lqu1tX1eP7aYJWLBLXshKAtKogk8uAn1hY0Tbr-ypW9cq0UX_HEe5pyKYr2wAv6g6kbrIFf1XMvkI3OLdG_2aoVwHvH5P7u_HsxiAjGSA Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1fbc5130642349b4a985d88f4515040f Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: {"addFloatingIp": {"address": ""}} Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3135818b-32b6-4f9b-a991-953c5f1c8cf6', 'body': {'addFloatingIp': {'address': ''}}} Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:38:57.844277 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:38:57.849297 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.852669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fe11f3f-3140-4541-8b72-e07afb809fdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:57.853755 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fe11f3f-3140-4541-8b72-e07afb809fdb tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 400 len: 142 microversion: 2.1 time: 0.023267 Oct 18 13:38:57.860061 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1848/3644] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:57 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 142 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:38:57.867294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:57.875292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.890045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.891097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.892342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.893310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.893986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.894661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.923499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:57.927083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:38:57.927750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquired lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:38:57.936815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:57.938404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:57.973052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75a80fee-8b2f-4709-89f1-ee5aef729767 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.181820 Oct 18 13:38:57.973052 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1797/3645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:57 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:58.120467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1763574583", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "94262c69-6d41-4032-b689-b0ca83f39096"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:58.242680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] validate_networks() for [('94262c69-6d41-4032-b689-b0ca83f39096', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:58.403593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Releasing lock "refresh_cache-3135818b-32b6-4f9b-a991-953c5f1c8cf6" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:38:58.404182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] HTTP exception thrown: floating IP not found Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Request method failure captured: Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action HTTP/1.1 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 41 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqw_ehZO4xZA4eXsTFB8J_NPvf8xH5gGD0ai6o5dC-1Ij85dyMFAzwy2_3fbwh1xaufJ02Lqu1tX1eP7aYJWLBLXshKAtKogk8uAn1hY0Tbr-ypW9cq0UX_HEe5pyKYr2wAv6g6kbrIFf1XMvkI3OLdG_2aoVwHvH5P7u_HsxiAjGSA Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1fbc5130642349b4a985d88f4515040f Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: exception: floating IP not found Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3135818b-32b6-4f9b-a991-953c5f1c8cf6', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 18 13:38:58.407030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Returning 404 to user: floating IP not found {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a02b608-f41d-4692-b606-cec5eb68430e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 404 len: 67 microversion: 2.1 time: 0.547178 Oct 18 13:38:58.411937 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1849/3646] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:57 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 67 bytes in 548 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:58.423705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:58.426197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:58.443014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.443531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.443981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.444703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.445175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.445609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.524142 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d048c654-8109-4c0d-b14f-3a27fa6fd180 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105324 Oct 18 13:38:58.525211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1850/3647] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:38:58 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:58.533542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0242145-fc92-42ac-9e9c-f095ac471876 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Action: 'action', calling method: .version_select at 0x7fb332dbea60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:58.640663 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-f0242145-fc92-42ac-9e9c-f095ac471876 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0242145-fc92-42ac-9e9c-f095ac471876 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Request method failure captured: Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action HTTP/1.1 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 44 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqw_ehZO4xZA4eXsTFB8J_NPvf8xH5gGD0ai6o5dC-1Ij85dyMFAzwy2_3fbwh1xaufJ02Lqu1tX1eP7aYJWLBLXshKAtKogk8uAn1hY0Tbr-ypW9cq0UX_HEe5pyKYr2wAv6g6kbrIFf1XMvkI3OLdG_2aoVwHvH5P7u_HsxiAjGSA Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1fbc5130642349b4a985d88f4515040f Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: exception: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3135818b-32b6-4f9b-a991-953c5f1c8cf6', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 18 13:38:58.643996 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 18 13:38:58.648764 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.651329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0242145-fc92-42ac-9e9c-f095ac471876 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:58.652470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0242145-fc92-42ac-9e9c-f095ac471876 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action" status: 404 len: 88 microversion: 2.1 time: 0.124685 Oct 18 13:38:58.653232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1851/3648] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:58 2022] POST /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6/action => generated 88 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:58.673854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:58.673854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:58.679990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.682441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.683135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.685408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.686884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.687531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.748936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:59.036459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:59.043067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:59.043067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:59.043067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:59.043067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:59.050214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.051069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.051589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.052403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.052934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.053438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.075151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Getting quotas for project 17da40534ba847b18b2f0cde9b822b24. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:59.081089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:59.082659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Getting quotas for user 658e3ac336ac4342bd204a74515fcd96 and project 17da40534ba847b18b2f0cde9b822b24. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:59.098166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Going to run 2 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:59.101257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:59.235712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5554d7f1-edf0-4671-83b7-c48ceecf34ff tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 204 len: 0 microversion: 2.1 time: 0.574477 Oct 18 13:38:59.236314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1852/3649] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:58 2022] DELETE /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:59.241432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=15246dad-fcbc-4cd8-b0b2-260036789476,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:59.242672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:59.243403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:59.269731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.274830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.278390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.281946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.292694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.292694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.436428 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ebc441b-fafe-4a29-bc68-2bca9a155449 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.321170 Oct 18 13:38:59.437515 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1798/3650] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1323 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 18 13:38:59.448441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:59.448441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:59.467730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.473005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.473005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.473005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.473005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.473005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.781851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.819778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.819778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.824960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7fa7e2c-2265-4fb4-8292-2a267d7a3204 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.584977 Oct 18 13:38:59.827307 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1853/3651] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:38:59 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:38:59.843762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:59.857882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.859697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.864571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Searching by: {'deleted': False, 'project_id': '17da40534ba847b18b2f0cde9b822b24'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:38:59.880760 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a742c6cf-98ef-4d62-ad46-473ae454df8a tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1542 microversion: 2.1 time: 0.437796 Oct 18 13:38:59.894083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1799/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:59 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1542 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:59.903115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:59.907248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:59.924636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.925526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.926256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.927257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.927975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.928574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.938106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.940213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.944627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:59.945619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:59.957146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:59.964187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.072067 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f7d7fe60-3ed5-4d58-92a1-e555b7768b26 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188860 Oct 18 13:39:00.074499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1800/3653] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:38:59 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:00.093264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:00.170561 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02c8a3ab-c722-4c2a-8418-2be59af4046b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.341263 Oct 18 13:39:00.171725 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1854/3654] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:38:59 2022] GET /compute/v2.1/servers => generated 1333 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:00.187695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca5465f0-52cd-4fb2-9d37-8941ea47eac4 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:00.188392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca5465f0-52cd-4fb2-9d37-8941ea47eac4 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:00.349849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca5465f0-52cd-4fb2-9d37-8941ea47eac4 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:00.362290 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca5465f0-52cd-4fb2-9d37-8941ea47eac4 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1218 microversion: 2.1 time: 0.177138 Oct 18 13:39:00.362290 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1801/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:00 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:00.854502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:00.855813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:00.869876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.870793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.871495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.874134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.876452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.877955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.907008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:00.908301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:00.925925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.925925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.927695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.931318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.933040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.934474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.135787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.153305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.153305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.153850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cf1018a-a673-482f-8131-09c47a8f8456 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.302492 Oct 18 13:39:01.159064 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1855/3656] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:00 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:01.176081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:01.178920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:01.190120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.190612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.191068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.191920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.192399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.192973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.303085 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f9b6e30-bdb9-447f-b316-66ae6e65d484 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142633 Oct 18 13:39:01.304966 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1856/3657] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:39:01 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:01.394376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-667e722d-f180-47f5-a3fe-87c1aad18eb5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:01.395417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-667e722d-f180-47f5-a3fe-87c1aad18eb5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:01.752485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.758344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-667e722d-f180-47f5-a3fe-87c1aad18eb5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.770293 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-667e722d-f180-47f5-a3fe-87c1aad18eb5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1218 microversion: 2.1 time: 0.386963 Oct 18 13:39:01.773613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1857/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:01 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1218 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:01.784532 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-225d2c27-5f0c-434d-9b02-6a11174a356e tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1542 microversion: 2.1 time: 0.880061 Oct 18 13:39:01.794797 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1802/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:00 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1542 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:01.960180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "name": "network-vif-unplugged", "status": "completed", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:01.982820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.985519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.986468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.022543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] Creating event network-vif-unplugged:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:39:02.036117 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c9c04f9c-06bd-4c29-b378-fc57f1dc6df0 req-3425a74e-a9ba-43ee-b251-875a920f8ef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077915 Oct 18 13:39:02.057094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1858/3660] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:02.195638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:02.196271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:02.214664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.216173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.216680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.221397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.223172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.225830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.320051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:02.322402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:02.344188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.374026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.378776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.379624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.383705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.386866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.529556 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b7ef85a-8ec7-40f0-a0a8-0784c0c6e93f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210456 Oct 18 13:39:02.529556 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1859/3661] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:39:02 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:02.675138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.689993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.697013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.710697 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5313e8d7-d353-42a8-9412-d74ed97687aa tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.526116 Oct 18 13:39:02.744976 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1803/3662] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:02 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:02.805060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:02.805804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:02.810947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:02.811584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:02.823914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.824419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.824865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.825962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.834879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.835387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.854715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.858728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.861589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.868365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.874025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.874025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.667017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:03.683908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-601084f3-13e6-4218-92db-6c6b242be65c tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1222 microversion: 2.1 time: 0.889029 Oct 18 13:39:03.689623 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1860/3663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:02 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1222 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:03.756577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894ef1f6-9cf8-4695-92c3-fcc0f93ff436", "name": "network-vif-deleted", "tag": "0219c688-cd81-4eb6-91e2-f897ecdcd396"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:03.786549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.791852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.793413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.831486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] Creating event network-vif-deleted:0219c688-cd81-4eb6-91e2-f897ecdcd396 for instance 894ef1f6-9cf8-4695-92c3-fcc0f93ff436 on n-h2-858383-13 Oct 18 13:39:03.844855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-08980187-b1cb-42c8-8631-9d7836ea6ac0 req-f4e21f66-5158-4e75-a8f1-9d0b84c48290 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150502 Oct 18 13:39:03.846691 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1861/3664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:03.869039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:03.872793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:03.881276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.882165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.882895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.883918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.884684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.885321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.914847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:03.924087 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-210a7a93-9819-41cb-b87c-adaf8c1738d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1542 microversion: 2.1 time: 1.117051 Oct 18 13:39:03.936157 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21650a40-3863-4892-8263-c97dfa823593 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077975 Oct 18 13:39:03.937748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1862/3665] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:39:03 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:03.945174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d3d2e0-f78f-4921-be9d-22c6f6d400ad", "name": "network-vif-deleted", "tag": "fc81e14a-8b15-4c54-893c-88f0fceafd67"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:03.950449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1804/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:02 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1542 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:03.956613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.957480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.958845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.959496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:03.960130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:03.968959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.970687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.974036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] Creating event network-vif-deleted:fc81e14a-8b15-4c54-893c-88f0fceafd67 for instance c4d3d2e0-f78f-4921-be9d-22c6f6d400ad on n-h2-858383-13 Oct 18 13:39:03.974816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.976310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.978301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.980499 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-aadc9256-c656-41f9-acd5-40095fb28031 req-e972e299-33db-4efe-8134-139eabd08d41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040657 Oct 18 13:39:03.981165 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1863/3667] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:03.981387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.237905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.245568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:04.264709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.274553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.278307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fb2156f-a970-4a5b-bbf0-dcd862249a86 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.322558 Oct 18 13:39:04.284089 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1805/3668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:03 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:04.733303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:04.733303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:04.746851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.747442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.748473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.749203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.755353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.756313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.943701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.949081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:04.952082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:04.952545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:04.962476 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48304f21-af3a-4f11-97be-64c25a29215a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1270 microversion: 2.1 time: 0.247889 Oct 18 13:39:04.963348 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1864/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:04 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:04.967534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.970710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.971241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.972194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.972681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.973123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.976437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:04.977600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:04.994023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.997058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.998708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.004336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.005243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.006002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.043465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa732c98-b499-4d85-a9a9-3aabd2b397c9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098378 Oct 18 13:39:05.056631 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1806/3670] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:39:04 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:39:05.095770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.096277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.096731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.097202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lazy-loading 'fault' on Instance uuid 3135818b-32b6-4f9b-a991-953c5f1c8cf6 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:05.179268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:05.192394 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d6615c1-a63b-4876-8219-b195504e5f84 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1322 microversion: 2.1 time: 0.225262 Oct 18 13:39:05.193293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1865/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:04 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:05.321069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:05.322465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:05.335490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.335993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.336564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.344118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.344873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.347563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.433688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-242839258", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "3eaa622f-5075-43c6-bf8c-81e792567a8b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:05.542987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:05.559670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:05.564598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:05.565876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7597d4cd-fce8-43df-8618-6553ce6559ba tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.258637 Oct 18 13:39:05.569327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1807/3672] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:05 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:05.591534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] validate_networks() for [('3eaa622f-5075-43c6-bf8c-81e792567a8b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:06.000893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3135818b-32b6-4f9b-a991-953c5f1c8cf6", "name": "network-vif-deleted", "tag": "3bee9433-17e5-450f-a904-0dd6e491f41d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:06.013223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.013984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.014633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.030324 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] Creating event network-vif-deleted:3bee9433-17e5-450f-a904-0dd6e491f41d for instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 on n-h2-858383-13 Oct 18 13:39:06.042175 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-319579e1-b1fa-496c-9c93-b85b52b4f0d9 req-4bace216-2e1e-4be1-9ff1-e20075047ef5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045667 Oct 18 13:39:06.044094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1808/3673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:06.052799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:06.053891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:06.062102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.063073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.063931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.070610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.070610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.070610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.165760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:06.173160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:06.173160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:06.173160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:06.173160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:06.182400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.183207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.184390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.186097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.187651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.189082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.213038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for project 500c1691c5bb4729ba86089d20dedf27. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:06.220672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:06.222625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Getting quotas for user 97fcf7685853432ab0173f0cfac41863 and project 500c1691c5bb4729ba86089d20dedf27. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:06.240526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:06.243646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:06.289909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.297792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f74e47c1-adfb-4fc6-8460-bbf44b37eae2 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1276 microversion: 2.1 time: 0.250839 Oct 18 13:39:06.298296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1809/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:06 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:06.303100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:06.303721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:06.320435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.320875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.321784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.322634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.323329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.323983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.359238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.360040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.360683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.361317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lazy-loading 'fault' on Instance uuid 3135818b-32b6-4f9b-a991-953c5f1c8cf6 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:06.396385 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a000772c-1693-4316-82d2-c0ab689a2a8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966438 Oct 18 13:39:06.397046 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1866/3675] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:39:06.415452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d223f8af-cdd5-4a42-819e-3dad85eec28a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:06.420969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d223f8af-cdd5-4a42-819e-3dad85eec28a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:06.498564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc5130642349b4a985d88f4515040f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.522210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d51e98c-7ff7-491d-9f3f-6b10b67cd5d2 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 200 len: 1322 microversion: 2.1 time: 0.210574 Oct 18 13:39:06.522210 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1810/3676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:06 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:06.522478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d223f8af-cdd5-4a42-819e-3dad85eec28a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.528557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d223f8af-cdd5-4a42-819e-3dad85eec28a tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1217 microversion: 2.1 time: 0.115107 Oct 18 13:39:06.528851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1867/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:06 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:06.590507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:06.591145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:06.599362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.599866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.604517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.605209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.605691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.606165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.875514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.875514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.875514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.875514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27b3d436-c634-485a-bce2-7440dbff5381 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.245658 Oct 18 13:39:06.875514 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1811/3678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:06 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:07.322581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:07.330009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:07.330965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.331472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.331930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.332640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.333108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.333546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.539789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:07.541432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] [instance: 3135818b-32b6-4f9b-a991-953c5f1c8cf6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:07.564920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.566496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.567211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.574685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.574685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.574685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.577956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.587972 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b66bfada-8cf4-4aef-976d-9c8c360579a3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.269262 Oct 18 13:39:07.596668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] HTTP exception thrown: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. Oct 18 13:39:07.598039 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1868/3679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:07 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Request method failure captured: Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 HTTP/1.1 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqw_ehZO4xZA4eXsTFB8J_NPvf8xH5gGD0ai6o5dC-1Ij85dyMFAzwy2_3fbwh1xaufJ02Lqu1tX1eP7aYJWLBLXshKAtKogk8uAn1hY0Tbr-ypW9cq0UX_HEe5pyKYr2wAv6g6kbrIFf1XMvkI3OLdG_2aoVwHvH5P7u_HsxiAjGSA Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2ca4cc1ec1fa44159bd24c7e1d67b907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2ca4cc1ec1fa44159bd24c7e1d67b907 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111 Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1fbc5130642349b4a985d88f4515040f Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3135818b-32b6-4f9b-a991-953c5f1c8cf6'} Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. Oct 18 13:39:07.599273 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] Returning 404 to user: Instance 3135818b-32b6-4f9b-a991-953c5f1c8cf6 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fca6120a-d039-4caf-952d-dcf9ef52f3e6 tempest-FloatingIPsAssociationNegativeTestJSON-438350111 tempest-FloatingIPsAssociationNegativeTestJSON-438350111-project] 10.222.0.27 "GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6" status: 404 len: 111 microversion: 2.1 time: 0.067822 Oct 18 13:39:07.603506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1812/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:07 2022] GET /compute/v2.1/servers/3135818b-32b6-4f9b-a991-953c5f1c8cf6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:07.611839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:07.614334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:07.631599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.634729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.635225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.636686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.637173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.637627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.852516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.868810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d49e283e-b994-45fa-bca0-3db55c109ebc tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1221 microversion: 2.1 time: 0.260963 Oct 18 13:39:07.869435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1869/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:07 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:07.894032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:07.894905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:07.902334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.903303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.905415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.906386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.907358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.914966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.048222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:08.069772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:08.074366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:08.080797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97f7cb4a-fca3-4cc7-8530-4cca2a6fd70c tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1366 microversion: 2.47 time: 0.191041 Oct 18 13:39:08.105405 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1813/3682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:07 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:08.625065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:08.626449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:08.634761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.635653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.636434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.637380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.638087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.638781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.898701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:08.899950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:08.915185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.916269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.918734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.918734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.918734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.919220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.025588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.036437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50f940ac-4635-4b94-aee9-94c2d95e1309 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.415762 Oct 18 13:39:09.036437 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1870/3683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:08 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:09.065949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:09.106584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:09.108013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:09.114722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:09.115725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:09.116381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.117659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:09.118357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.118531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:09.119172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.128849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2afdabae-1763-45d1-8ae0-a7ba108c1f2f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1269 microversion: 2.1 time: 0.237214 Oct 18 13:39:09.130231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1814/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:08 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1269 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:09.303273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.313166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.313624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.314868 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ecd45cb2-8ae1-400c-8394-9a587ed56bad tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1372 microversion: 2.47 time: 0.212548 Oct 18 13:39:09.321029 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1871/3685] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:09 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:10.061308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:10.062700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:10.079197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.089160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.098081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.098977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.101789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.102947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.154612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:10.155323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:10.184626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.189294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.194257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.197209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.200855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.203946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.349637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.357024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:10.359270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43ab0abd-1e1c-42dd-aae9-3736507474fa tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1275 microversion: 2.1 time: 0.210383 Oct 18 13:39:10.375297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1872/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:10 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:10.383025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:10.383974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:10.390735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.391240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.391693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.392403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.393052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.393486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.483165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.499624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.501495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.503160 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3236c3c9-a447-4966-bd78-f27da663a1f0 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1372 microversion: 2.47 time: 0.126870 Oct 18 13:39:10.504009 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1873/3687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:10 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:10.724773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.741941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1062fc3b-7613-4561-a692-560c2c4d2402 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.686022 Oct 18 13:39:10.755316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1815/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:10 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:11.388202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:11.388202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:11.398165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.398930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.399442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:11.400168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.400662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.401119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:11.534266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:11.546041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:11.550307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.551057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.552181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:11.552375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.558113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.560211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.004233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.026089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.027587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.029875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c1c7daf-8bf9-474c-a94e-a1397447cc79 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1372 microversion: 2.47 time: 0.503684 Oct 18 13:39:12.031628 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1816/3689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:11 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1372 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:12.046845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:12.047747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:12.069072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.071885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.073970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.076561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.077942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.081830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29ab9e3f-f5fe-4917-ae09-d1d1a58467f5 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.698461 Oct 18 13:39:12.089627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.089780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1874/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:11 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:12.089880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.099675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfbf010-f71e-4b57-b6da-20ab79d01f5e", "tag": "55c5e68f-7c86-42c9-a7c5-02ffba0b9211"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:12.126611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.126611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.129646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.170211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] Creating event network-changed:55c5e68f-7c86-42c9-a7c5-02ffba0b9211 for instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e on n-h1-858383-13 Oct 18 13:39:12.187428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a91e2a64-fba2-4f9e-800e-31b5e83bbf5e req-4d85d209-9632-465a-90d5-6de1c84deede service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101042 Oct 18 13:39:12.190779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1875/3691] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:12.498154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307a2529-8e64-497c-85f9-c498901f1e5e", "tag": "53120888-1943-47e8-924e-8eb1960848c2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:12.522012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.526197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.526197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.544546 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] Creating event network-changed:53120888-1943-47e8-924e-8eb1960848c2 for instance 307a2529-8e64-497c-85f9-c498901f1e5e on n-h2-858383-13 Oct 18 13:39:12.565924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a9b12a26-a710-4788-ad13-51a42518c4b1 req-e601e0da-b0e7-442f-afdb-a3a2e5f7799f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081000 Oct 18 13:39:12.568294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1876/3692] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:12.631939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.644894 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9d88db8-96e3-4551-980d-9474f36baffb tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.611958 Oct 18 13:39:12.649752 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1817/3693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:12 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:13.058373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.059137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.073773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.073773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.073773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.089035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.092978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.093724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.107237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.110130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.117936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.125832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.126465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.127233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.128482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.130082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.381308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.383321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.391375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.395417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.396655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9811f73-2473-423a-8839-ce20b117da03 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1357 microversion: 2.47 time: 0.343629 Oct 18 13:39:13.398745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1877/3694] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:13.401052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45f34b60-5a28-4b5d-ba9e-17bec5b2ecea tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.297309 Oct 18 13:39:13.401718 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1818/3695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:13.423431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.432493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.433844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Searching by: {'deleted': False, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:13.446339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.447097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.447711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.448695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.449496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.450533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.602588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:13.680165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.683004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.695662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.696422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.698705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.699595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.700363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.703818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.721929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.736667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.737179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.737639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.775148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.780540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.864921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7dac2a6-ca81-491c-9d09-340d9daf647b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.443930 Oct 18 13:39:13.864921 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1878/3696] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:13.900131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.900914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.911845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.913273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.913922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.915020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.915500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.915943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.951263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:13.961493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9092599d-6303-4778-bae6-552695463db5 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.296120 Oct 18 13:39:13.962106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:13.963108 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1819/3697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:14.314661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15246dad-fcbc-4cd8-b0b2-260036789476", "tag": "9fc89472-3d14-4195-9d7e-2361539a2bea"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:14.321840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b3dd6e5-fcd9-4718-b114-8269c64b2ec7 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "DELETE /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 204 len: 0 microversion: 2.47 time: 0.425368 Oct 18 13:39:14.324111 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1879/3698] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:39:13 2022] DELETE /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:39:14.335402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:14.336485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:14.346868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.351737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.352961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.356704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.358354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.359442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.362217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.365243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.365706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.385770 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] Creating event network-changed:9fc89472-3d14-4195-9d7e-2361539a2bea for instance 15246dad-fcbc-4cd8-b0b2-260036789476 on n-h1-858383-13 Oct 18 13:39:14.392488 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-36f74451-6bbb-4c27-953f-4037d7704304 req-6912c0e5-0c6e-4880-a445-06f6364caa69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082833 Oct 18 13:39:14.394714 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1820/3699] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:14.442910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:14.444838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:14.464864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.466126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.467954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.474894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.480143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.487453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.633808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.676581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.678602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.681112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-229486d0-2d6c-4cbc-9490-3ddd251f8dff tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1363 microversion: 2.47 time: 0.353059 Oct 18 13:39:14.694223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1880/3700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:14 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:14.989251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:14.990419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:14.997243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:14.998547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:14.999163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.004283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.004283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.004283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.078515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.086582 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f61e9de-02cf-4af1-ade7-7c68a1bb7fe6 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.652198 Oct 18 13:39:15.100423 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1821/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:14 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:15.245481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.255265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:15.260891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb9726c8-9d19-4404-9606-bbb6e88351c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.273541 Oct 18 13:39:15.262178 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1881/3702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:14 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:15.708042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:15.708820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:15.718317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.718932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.719558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.720612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.721051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.721547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.846618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.861286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.867485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.869980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-114c0674-c16b-4ac3-b9c1-0494aacbac6b tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1363 microversion: 2.47 time: 0.166560 Oct 18 13:39:15.886616 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1822/3703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:15 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:16.114412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:16.115807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:16.134226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.136976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.137889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.139553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.140295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.140954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.283840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:16.290952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:16.292130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.292873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.293677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.294759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.295447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.296900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.639554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:16.652089 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad339248-0068-4763-93b0-c9e0b1da272e tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.541452 Oct 18 13:39:16.653930 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1882/3704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:16 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:16.872839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:16.891349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-325e8b35-47fc-43e8-9a3e-affc2f5949c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.610751 Oct 18 13:39:16.893198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1823/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:16 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:16.900744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:16.901571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:16.942140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.944559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.945089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.949199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.949835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.951504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.067986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:17.070956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:17.071696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.073170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lazy-loading 'fault' on Instance uuid 591cb3d1-5f75-4fa5-843a-5d0b731ae120 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:17.182381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.195704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.207451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.212885 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05130a50-f797-4734-9459-23ce28cc9003 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1368 microversion: 2.47 time: 0.316392 Oct 18 13:39:17.217210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1883/3706] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:16 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:17.683443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:17.684907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:17.713815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.834868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-527380580", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "c25a7b9c-2cbb-4cca-b595-5a8882b48d82"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:17.959385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] validate_networks() for [('c25a7b9c-2cbb-4cca-b595-5a8882b48d82', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:18.012581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.026727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-547400fc-da89-4840-8250-b2ba9ed83771 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.350223 Oct 18 13:39:18.045115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1884/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:17 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:18.061073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.062746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:18.090194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.090924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.091933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.094139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.096914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.099882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.409734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.423161 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c7cd334-46e1-4226-9500-643e3733b778 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.392388 Oct 18 13:39:18.424313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1885/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:18.430483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.431327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:18.438776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.439487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.442614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.442614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.442614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.442614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.540362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.541090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.541282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.541737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lazy-loading 'fault' on Instance uuid 591cb3d1-5f75-4fa5-843a-5d0b731ae120 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:18.592787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.602311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.604453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.605671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3df3ff2e-9f04-4c2e-9d05-0ad07294d599 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 200 len: 1368 microversion: 2.47 time: 0.180243 Oct 18 13:39:18.606252 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1886/3709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:19.056833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.057546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.064746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.065245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.065690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.066423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.066881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.067309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.303740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:19.312412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b8d72b8-984b-4199-9322-822e3e811ec9 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.260318 Oct 18 13:39:19.312985 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1887/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:19.454670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.461173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.468119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.471659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:19.472137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:19.472304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.472555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:19.473157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:19.473580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:19.473972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.479600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.480159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.480937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.490289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.490289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.490289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.500490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.501135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.501842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.529378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:19.545075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:19.552592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for user 2ff557eb6afe4b29bbccd87ffdbe21c0 and project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:19.607822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:19.616636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:19.749520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:19.759308 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcb9b691-d414-4419-8919-33c2c6bac678 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.310869 Oct 18 13:39:19.762542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1888/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:19.786679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.788283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: 591cb3d1-5f75-4fa5-843a-5d0b731ae120] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.797666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.805658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.805658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.805658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.805658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.805658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.830721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] HTTP exception thrown: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Request method failure captured: Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 HTTP/1.1 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqxMcWJ5hLXUoklIVJltqY8XM1R_cyI9WVJeYrL75M0MUyWXPaEz2qNRNVRYiLf_UrY88MYTQoZir5DwZy7O2t-C9ktUfMwHExw8N2cJEIC0v3_rG2jcoIxLbPpU4RKiRgovfjkrN4l0nC2gMLhaDmv9YrbjM0Coacwz9oTO2QYFvlc Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 34c7d8a7682f4d75b980c0d60de4d6fe Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 34c7d8a7682f4d75b980c0d60de4d6fe Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerShowV247Test-1077694424-project Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 548f86671c744430829ba6cc2d6463b6 Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerShowV247Test-1077694424-project Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '591cb3d1-5f75-4fa5-843a-5d0b731ae120'} Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:19.837706 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Returning 404 to user: Instance 591cb3d1-5f75-4fa5-843a-5d0b731ae120 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87e5504c-99b3-4ae0-89e5-11849573fa9a tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120" status: 404 len: 111 microversion: 2.47 time: 0.071357 Oct 18 13:39:19.845145 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1889/3712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/591cb3d1-5f75-4fa5-843a-5d0b731ae120 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:39:19.850319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.850743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.883895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.884151 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17106573-6f0f-4a9d-b3fd-174538ce9b79 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336329 Oct 18 13:39:19.884590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.885081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.885740 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1824/3713] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:39:19.885859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.886293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.890548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.060764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:20.199005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1373132021", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "c25a7b9c-2cbb-4cca-b595-5a8882b48d82"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:20.296811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] validate_networks() for [('c25a7b9c-2cbb-4cca-b595-5a8882b48d82', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:20.586681 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9f451b9-f8d6-484a-a3de-8de12dc4a98f tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 204 len: 0 microversion: 2.47 time: 0.743785 Oct 18 13:39:20.588550 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1890/3714] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:39:19 2022] DELETE /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:39:20.609256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:20.613328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:20.639929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.665730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.665730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.667880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.669971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.674119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.410616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:21.427556 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16de7a55-91d5-41aa-a5fe-920c0258cc59 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.834283 Oct 18 13:39:21.428219 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1891/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:20 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:21.438627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfbf010-f71e-4b57-b6da-20ab79d01f5e", "name": "network-vif-plugged", "status": "completed", "tag": "55c5e68f-7c86-42c9-a7c5-02ffba0b9211"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:21.464259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.465091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.467608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.521810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] Creating event network-vif-plugged:55c5e68f-7c86-42c9-a7c5-02ffba0b9211 for instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e on n-h1-858383-13 Oct 18 13:39:21.540935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f6ae1999-7841-4225-ad7d-7ce0c04f5b57 req-491a234d-eabd-490c-b64c-887cd2b6a78d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108276 Oct 18 13:39:21.548328 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1892/3716] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:21.586196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:21.595571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:21.615889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.623213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.627897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.628837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.631355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.633699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.840077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:21.853928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:21.856250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:21.858915 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03f0fae8-2268-4d18-b14e-32ff67fb5143 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 200 len: 1362 microversion: 2.47 time: 0.308365 Oct 18 13:39:21.860049 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1893/3717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:21 2022] GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:21.867055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:21.867962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:21.875788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.876573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.877410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.878890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.879961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.880685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.031747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:22.032278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:22.032657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:22.033070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:22.033695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:22.055862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.056368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.056817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.057562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.058027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.058936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.127806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:22.203478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for user 2ff557eb6afe4b29bbccd87ffdbe21c0 and project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:22.257620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:22.268355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:22.530208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:22.538590 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-064bb510-f8e3-4886-a526-3a095914ca76 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.677145 Oct 18 13:39:22.543025 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1894/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:21 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:22.545467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:22.546322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:22.552429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.553136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.553763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.554773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.555395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.556226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.674377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19e60316-785c-4e12-b6f7-767ca0162aaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478511 Oct 18 13:39:22.679364 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1825/3719] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:39:22.889720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:22.890374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:22.896733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:22.906463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.908271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.908735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.909474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.909940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.910415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.006834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.018164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f345b944-9d50-42a3-9769-f202ad37e66f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.477117 Oct 18 13:39:23.018771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1895/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:22 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:23.070736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1394549796", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "451", "networks": [{"uuid": "c25a7b9c-2cbb-4cca-b595-5a8882b48d82"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:23.161170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.170924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.176674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.178637 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0d193e2-82d2-4944-87ac-db43f0b41ad6 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 200 len: 1362 microversion: 2.47 time: 0.293815 Oct 18 13:39:23.183364 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1826/3721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:22 2022] GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:23.219139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] validate_networks() for [('c25a7b9c-2cbb-4cca-b595-5a8882b48d82', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:23.528006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:23.563732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:23.565067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:23.582331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:23.582976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:23.585108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.587397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:23.588048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:23.589791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.718945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:24.269248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:24.303655 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06101d4d-41e4-431b-b62a-75c5c8811dd9 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1318 microversion: 2.1 time: 0.742596 Oct 18 13:39:24.321444 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1827/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:23 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:24.327776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307a2529-8e64-497c-85f9-c498901f1e5e", "name": "network-vif-plugged", "status": "completed", "tag": "53120888-1943-47e8-924e-8eb1960848c2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:24.372419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.375800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.375800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.434019 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] Creating event network-vif-plugged:53120888-1943-47e8-924e-8eb1960848c2 for instance 307a2529-8e64-497c-85f9-c498901f1e5e on n-h2-858383-13 Oct 18 13:39:24.459709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4e5a4022-4199-4992-ac67-b94163c79d38 req-04a9fca4-87f4-4a70-b620-772cc8102c8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141932 Oct 18 13:39:24.469146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1828/3723] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:24.483401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:24.484206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:24.540306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.542262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.542742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.546533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.547019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.548853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.887341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:24.887879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:24.888268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:24.888688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:24.889110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:24.908065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:24.909408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.909905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.910568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.911499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.912159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.912769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.917644 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-832465cf-f9b6-4159-b223-1abbbfa5c674 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.448941 Oct 18 13:39:24.924368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1829/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:24 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:24.939448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:24.940166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:24.955312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.955569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:24.956245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.956973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.957926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.958569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.962078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.962201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Getting quotas for user 2ff557eb6afe4b29bbccd87ffdbe21c0 and project 80ef7de41a5a4e3599dbefeadb7cb1fa. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:24.974547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:24.977118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:24.989973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:25.028198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.029437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.030070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.030705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lazy-loading 'fault' on Instance uuid ef1587fc-9611-4ddc-a5b0-90ce91d75472 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:25.105484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.115777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.117431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '548f86671c744430829ba6cc2d6463b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c7d8a7682f4d75b980c0d60de4d6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.118706 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa97f565-3429-44c1-a208-7a577f1952cd tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 200 len: 1367 microversion: 2.47 time: 0.191168 Oct 18 13:39:25.119432 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1830/3725] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:24 2022] GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:25.237449 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82d12490-437b-4ce7-8973-578dcea017a6 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171776 Oct 18 13:39:25.238134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1896/3726] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:39:25.249734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ffaf857-341b-4870-b2b3-8065365d22e5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:25.254093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ffaf857-341b-4870-b2b3-8065365d22e5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:25.341028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:25.370330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:25.402207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.402545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.406786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.407768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.409236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.412129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.499199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ffaf857-341b-4870-b2b3-8065365d22e5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.512992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ffaf857-341b-4870-b2b3-8065365d22e5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1221 microversion: 2.1 time: 0.265448 Oct 18 13:39:25.517706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1831/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:25 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:25.952047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:25.952684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:25.962808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.964086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.964544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.965264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.965731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.973520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.280288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.291931 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b110c434-f4fd-435e-affd-269b072e2d56 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 200 len: 1507 microversion: 2.1 time: 0.954644 Oct 18 13:39:26.293600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1897/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:25 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 1507 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:26.306157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:26.311530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] [instance: ef1587fc-9611-4ddc-a5b0-90ce91d75472] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:26.322460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.336946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.337738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.340055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.345043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.345833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.356410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:26.386278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] HTTP exception thrown: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Request method failure captured: Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 HTTP/1.1 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqxMcWJ5hLXUoklIVJltqY8XM1R_cyI9WVJeYrL75M0MUyWXPaEz2qNRNVRYiLf_UrY88MYTQoZir5DwZy7O2t-C9ktUfMwHExw8N2cJEIC0v3_rG2jcoIxLbPpU4RKiRgovfjkrN4l0nC2gMLhaDmv9YrbjM0Coacwz9oTO2QYFvlc Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 34c7d8a7682f4d75b980c0d60de4d6fe Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34c7d8a7682f4d75b980c0d60de4d6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 34c7d8a7682f4d75b980c0d60de4d6fe Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerShowV247Test-1077694424 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerShowV247Test-1077694424-project Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 548f86671c744430829ba6cc2d6463b6 Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerShowV247Test-1077694424-project Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ef1587fc-9611-4ddc-a5b0-90ce91d75472'} Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:26.388186 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] Returning 404 to user: Instance ef1587fc-9611-4ddc-a5b0-90ce91d75472 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:26.393398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bfa947b-d2d0-45d1-aba1-3c33e54ea2b4 tempest-ServerShowV247Test-1077694424 tempest-ServerShowV247Test-1077694424-project] 10.222.0.27 "GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472" status: 404 len: 111 microversion: 2.47 time: 0.096456 Oct 18 13:39:26.396629 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1898/3729] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:26 2022] GET /compute/v2.1/servers/ef1587fc-9611-4ddc-a5b0-90ce91d75472 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:39:26.407190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:26.410293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:26.424206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.424715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.425169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.428363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.431124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.431636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.514775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.531345 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5fc262c-ae26-4cc9-a43b-de953c106d62 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1317 microversion: 2.1 time: 0.578991 Oct 18 13:39:26.534296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1832/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:25 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:26.555539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15246dad-fcbc-4cd8-b0b2-260036789476", "name": "network-vif-plugged", "status": "completed", "tag": "9fc89472-3d14-4195-9d7e-2361539a2bea"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:26.596498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.596498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.596498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.628948 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] Creating event network-vif-plugged:9fc89472-3d14-4195-9d7e-2361539a2bea for instance 15246dad-fcbc-4cd8-b0b2-260036789476 on n-h1-858383-13 Oct 18 13:39:26.643378 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bcd72472-f9bd-4d21-bea8-e8aefce9e447 req-15ed3330-6b15-4cca-8c16-3c2555acb81c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104041 Oct 18 13:39:26.644786 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1833/3731] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:26.652532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40e413d7-ad67-475e-9975-2a767c2172cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:26.653674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40e413d7-ad67-475e-9975-2a767c2172cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:26.806951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.818882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef62a7b8-5db3-4aae-97fb-f69c110e6d23 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1318 microversion: 2.1 time: 0.419554 Oct 18 13:39:26.820649 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1899/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:26 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:26.962403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40e413d7-ad67-475e-9975-2a767c2172cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.970661 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40e413d7-ad67-475e-9975-2a767c2172cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1221 microversion: 2.1 time: 0.324350 Oct 18 13:39:26.973222 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1834/3733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:26 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1221 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:27.557593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:27.562603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.594091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.880325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1180916952", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6ab1dcbf-57e1-4423-b0e5-94b7286e99dd"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:27.904724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.917519 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fbd3665f-3b43-4679-8e9c-a31910e8db8d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1507 microversion: 2.1 time: 0.362671 Oct 18 13:39:27.918924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1835/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:27 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:27.933775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:27.934808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:27.944263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.944776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.945226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.945939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.946434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.946880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.987099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] validate_networks() for [('6ab1dcbf-57e1-4423-b0e5-94b7286e99dd', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:28.431571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:28.446978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a942fff-e15c-4cf8-a609-b6ef3678f5c7 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1318 microversion: 2.1 time: 0.523774 Oct 18 13:39:28.463038 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1836/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:27 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:28.470534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:28.471216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:28.482375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.529414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.534350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.542990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.543615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.544081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.971631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:28.983504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-859c0dde-7814-477d-affb-b18b015a7266 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1273 microversion: 2.1 time: 0.518363 Oct 18 13:39:28.984802 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1837/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:28 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:29.485093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:29.485886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:29.505441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.506461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.507283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:29.509729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.514703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.519241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.046748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:30.047243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:30.047726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:30.048140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:30.048664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:30.070152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.070732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.071194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.074910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.080024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.081028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.147498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:30.163086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for user f278334f3cd646a89ec99502f0bfe636 and project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:30.191040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:30.202040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:30.444064 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da03b4db-6978-4f37-8d4a-394d4e567d08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.149989 Oct 18 13:39:30.453481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1900/3737] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:39:30.464659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:30.475756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:30.509937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.514799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.518739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.521607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.522518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.524938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.584952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.608520 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8dbb30b-cbb3-4220-bb66-eaeb6e546b3b tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1506 microversion: 2.1 time: 1.121454 Oct 18 13:39:30.623322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1838/3738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:29 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1506 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:30.652196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fec5c3ae-dcc3-45b2-9850-95b9addb52cc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:30.654566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fec5c3ae-dcc3-45b2-9850-95b9addb52cc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:30.848161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.877183 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c7e925a-0c49-4dfa-a59c-e05e314d67b9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1279 microversion: 2.1 time: 0.418880 Oct 18 13:39:30.881277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1901/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:30 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1279 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:30.901597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:30.905195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:30.920598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.923019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.926259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.927146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.930020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.930976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.981022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fec5c3ae-dcc3-45b2-9850-95b9addb52cc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.996005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:31.013523 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fec5c3ae-dcc3-45b2-9850-95b9addb52cc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1218 microversion: 2.1 time: 0.384382 Oct 18 13:39:31.019210 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1839/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:30 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1218 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:31.643639 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70ff3de9-461b-40ff-ba6c-2f5c88016fff tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "DELETE /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 204 len: 0 microversion: 2.1 time: 0.757859 Oct 18 13:39:31.644991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1902/3741] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:30 2022] DELETE /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:31.653503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:31.656764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:31.677980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.678340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.678786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.686721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc25535-4722-4de8-b667-8abfdcc81463", "tag": "99b85a6b-25ce-4c9d-9d87-eece2ecade94"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:31.698679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.699189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.699698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.710299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.710802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.719183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.754123 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] Creating event network-changed:99b85a6b-25ce-4c9d-9d87-eece2ecade94 for instance cbc25535-4722-4de8-b667-8abfdcc81463 on n-h2-858383-13 Oct 18 13:39:31.768599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1ce827b4-15ca-4258-bc3c-93cfdb3bdfd7 req-f957fa2e-094a-4651-a387-54097dd53089 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.746933 Oct 18 13:39:31.778005 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1840/3742] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:31.781469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:31.909524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:31.910551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:31.924467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.930941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.933919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.934250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.934772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.935221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.094507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:32.189136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.198633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f10ba55-27db-4765-80d9-cce3abd97310 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1279 microversion: 2.1 time: 0.293677 Oct 18 13:39:32.201881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1841/3743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:31 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:32.217453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98256186-d597-4e95-8697-7d2406c512a1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:32.218117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98256186-d597-4e95-8697-7d2406c512a1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:32.344685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40aa6ed4-bf61-4f83-aac8-b4ed09d81567 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 204 len: 0 microversion: 2.1 time: 0.695214 Oct 18 13:39:32.345290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1903/3744] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:31 2022] DELETE /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:39:32.360430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "062466c1-d7ed-457d-b7fd-97234f5952e9"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:32.362542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:32.381925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98256186-d597-4e95-8697-7d2406c512a1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.399978 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98256186-d597-4e95-8697-7d2406c512a1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1218 microversion: 2.1 time: 0.191806 Oct 18 13:39:32.402473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1842/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:32 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:32.408235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.408838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.409312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.410113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.410584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.411026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.411792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:32.412591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:32.435487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.437274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.438169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.439108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.439781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.441882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.606225 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] HTTP exception thrown: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Request method failure captured: Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e/os-volume_attachments/baf931db-48b8-4a73-b5ea-9fe2b4840155 HTTP/1.1 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 74 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqwJYfXsrMaAWUZ-LltvDx8bFlybjMscdqFdhOzazyL3qbt9IK1HEAFy5PdbGOk40RsH9D8gcn2z_0ZyTi5q90MOB-sH31gq4GHQyva-QSIpcgMVQ3I1Jg9EWwapdWlFO_Hjqk5UoGy0dwrpkni_nEQgqmZJsP0J84RYgGOBQPsIZmA Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 839ea251cbf14e1ea20d69d823d0dd12 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_839ea251cbf14e1ea20d69d823d0dd12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 839ea251cbf14e1ea20d69d823d0dd12 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-744806322 Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesAdminNegativeTest-744806322-project-admin Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c98e22c79e144f43b84c006ecc2ad91f Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesAdminNegativeTest-744806322-project-admin Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: {"volumeAttachment": {"volumeId": "062466c1-d7ed-457d-b7fd-97234f5952e9"}} Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '307a2529-8e64-497c-85f9-c498901f1e5e', 'id': 'baf931db-48b8-4a73-b5ea-9fe2b4840155', 'body': {'volumeAttachment': {'volumeId': '062466c1-d7ed-457d-b7fd-97234f5952e9'}}} Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. (HTTP 404) (Request-ID: req-1a2791ed-fe65-4e8f-8e5d-a172adc94da3) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:39:32.611058 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] Returning 404 to user: Volume baf931db-48b8-4a73-b5ea-9fe2b4840155 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9df97da-48e4-4b80-ba93-b6b835e33448 tempest-VolumesAdminNegativeTest-744806322 tempest-VolumesAdminNegativeTest-744806322-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e/os-volume_attachments/baf931db-48b8-4a73-b5ea-9fe2b4840155" status: 404 len: 109 microversion: 2.1 time: 0.267349 Oct 18 13:39:32.619334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1904/3746] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Oct 18 13:39:32 2022] PUT /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e/os-volume_attachments/baf931db-48b8-4a73-b5ea-9fe2b4840155 => generated 109 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:32.908843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.921408 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17f50d18-1787-45a0-9466-5a07445c2f77 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1512 microversion: 2.1 time: 0.516377 Oct 18 13:39:32.924284 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1843/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:32 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:33.226246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:33.227431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:33.239570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.242760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.248520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.249396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.252118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.259244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.428601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:33.429453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:33.461030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.470516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.473478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.475441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.484564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.485765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.775246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:33.793540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65f3778e-6e15-490c-8fc5-c769ea2a5a46 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1214 microversion: 2.1 time: 0.370733 Oct 18 13:39:33.806086 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1844/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:33.947189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:33.947848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:33.959911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.961590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.962105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.963728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.964201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.967035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:34.477382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:34.491206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bced3aad-c61e-4654-80d2-2e4a2b0b1151 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 1.268801 Oct 18 13:39:34.493318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1905/3749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:34.701627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38771dde-43c4-4fd2-a976-7539af0c6fb6", "tag": "848f3662-3a79-4c9b-814d-ede1c279482f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:34.732892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:34.735535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:34.736003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:34.774255 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] Creating event network-changed:848f3662-3a79-4c9b-814d-ede1c279482f for instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 on n-h2-858383-13 Oct 18 13:39:34.789477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8506355d-5ba9-474b-b916-fe35abe2f79d req-23302539-8f6c-4084-bc05-957ff45c3cd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086060 Oct 18 13:39:34.790426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1906/3750] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:34.822672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:34.823474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:34.839378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:34.841229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:34.842512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:34.846913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:34.847731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:34.848297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.179544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:35.199288 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df4cab64-2636-4db3-8f3e-6134adf9398a tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1512 microversion: 2.1 time: 1.256380 Oct 18 13:39:35.200192 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1845/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1512 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:35.386048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:35.408158 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85a1d8a9-41ee-4302-8524-1d6b9338c7ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1270 microversion: 2.1 time: 0.586562 Oct 18 13:39:35.443994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1907/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:34 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1270 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:35.517396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:35.518123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:35.538146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.539078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.539724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.540622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.550889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.551736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.224408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:36.224948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:36.234032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.234560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.235004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.255390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.257749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.258477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.184518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.221526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c08d5e6-d706-46fc-9bf1-4d41e0325b54 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1512 microversion: 2.1 time: 0.993308 Oct 18 13:39:37.225425 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1908/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:36 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1512 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:37.248406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:37.250964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:37.267728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:37.269131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:37.271481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.272278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:37.273421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:37.273875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.648490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.667168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ae07bd4-106d-4799-b009-9022bd99c5c9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1276 microversion: 2.1 time: 0.434601 Oct 18 13:39:37.672390 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1909/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:37 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1276 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:37.857425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.868654 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4f4771d-ecce-4885-bb7f-304669c1b3df tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 2.355585 Oct 18 13:39:37.869692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1846/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:35 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:38.006445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15246dad-fcbc-4cd8-b0b2-260036789476", "name": "network-vif-deleted", "tag": "9fc89472-3d14-4195-9d7e-2361539a2bea"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:38.043673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.043673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.044253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.078646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] Creating event network-vif-deleted:9fc89472-3d14-4195-9d7e-2361539a2bea for instance 15246dad-fcbc-4cd8-b0b2-260036789476 on n-h1-858383-13 Oct 18 13:39:38.092129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5cdf2ddf-d859-48fa-9200-9e73fed56d5e req-cd94e928-da0d-4f02-b866-c556d568cfa2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099311 Oct 18 13:39:38.094226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1910/3756] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:38.245618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:38.246359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.265250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.429711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:38.432278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:38.462523 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc1fa093-c4cf-4573-b8d2-e261eda3ceb3 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1303 microversion: 2.1 time: 0.206998 Oct 18 13:39:38.490737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1847/3757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:38 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:38.701625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:38.705180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:38.771144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.771838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.776623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.777424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.779982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.780670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.813919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:38.814477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:38.831914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.832423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.832869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.833576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.834037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.834495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.901883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:39.006612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:39.017989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-650d06a4-4eb5-48b1-a42c-4537eca0d61a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1276 microversion: 2.1 time: 0.323371 Oct 18 13:39:39.019892 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1911/3758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:38 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1276 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:39.025995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:39.027030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:39.036058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.037466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.038557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.039518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.040483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.041098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.291506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f498525-b056-4c3b-816f-5df32cc5f06d tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "DELETE /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 204 len: 0 microversion: 2.1 time: 0.481556 Oct 18 13:39:39.292648 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1848/3759] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:38 2022] DELETE /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:39:39.301759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:39.302924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:39.313868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.314409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.314867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.319570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.320335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.320981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.600210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:39.614581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb82ae2a-2cb0-4dd0-8019-70edba5d97f9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.592118 Oct 18 13:39:39.616004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1912/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:39 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:39.630373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:39.631290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:39.650680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.652580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.653045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.656260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.659427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.660307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.768862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.769876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.770718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.771542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lazy-loading 'fault' on Instance uuid 15246dad-fcbc-4cd8-b0b2-260036789476 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:39.911650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658e3ac336ac4342bd204a74515fcd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17da40534ba847b18b2f0cde9b822b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:39.924887 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d65b9115-3f1f-41c9-ad5b-e1ad8ae112f1 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 200 len: 1308 microversion: 2.1 time: 0.307397 Oct 18 13:39:39.925792 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1913/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:39 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:40.127251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:40.174482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ebc441f-368a-4b0c-a926-da5894fa007d tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Action: 'create', calling method: .version_select at 0x7fb330392b80>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:40.196789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:40.265018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.274992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15fc2534-fe34-4049-92a9-a9d9dc365095 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1513 microversion: 2.1 time: 0.977205 Oct 18 13:39:40.276258 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1849/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:39 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1513 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:40.281339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:40.282262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:40.305513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.307494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.307992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.308765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.314282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.315167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.798031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.846082 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd807c30-a164-470a-b5a3-b3a2ce6899aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.568250 Oct 18 13:39:40.849806 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1850/3763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:40 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:40.860441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfbf010-f71e-4b57-b6da-20ab79d01f5e", "name": "network-vif-deleted", "tag": "55c5e68f-7c86-42c9-a7c5-02ffba0b9211"}, {"name": "network-changed", "server_uuid": "cff779d2-1613-4129-9878-63f7e3be3d81", "tag": "4e572084-f6cf-4451-b384-fc3e179c2a49"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:40.877531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.878939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.879867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.899871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Creating event network-vif-deleted:55c5e68f-7c86-42c9-a7c5-02ffba0b9211 for instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e on n-h1-858383-13 Oct 18 13:39:40.900641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] Creating event network-changed:4e572084-f6cf-4451-b384-fc3e179c2a49 for instance cff779d2-1613-4129-9878-63f7e3be3d81 on n-h1-858383-13 Oct 18 13:39:40.910047 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f46352d6-86f9-40ee-ba72-324d07faf930 req-fd3935c7-9261-436a-a063-bccdef8d06de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058105 Oct 18 13:39:40.911588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1851/3764] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:40.920899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:40.922079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:40.932129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.933534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.934250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.935767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.936466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.937494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.378783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:41.388976 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1318a5a4-b251-4083-aa69-bcf1d4666c88 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.475865 Oct 18 13:39:41.403011 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1852/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:40 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:41.412233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:41.413815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 15246dad-fcbc-4cd8-b0b2-260036789476] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:41.420733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.421507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.422180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.423109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.423741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.424338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.446970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] HTTP exception thrown: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Request method failure captured: Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 HTTP/1.1 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqxU-jDI319npIWrTlCtDS_D2z3Gf1cb0ru_sewSMeJBVDr5Lb9XQhaJGjFpgSGiQxWLSp2vl3iUGpzY22efRgfFm65xxuxPDj960VWnxOt0Bdn4hFnwgQcwDu1aLRPKaB3uMlRhu3aNbc4vNEsarDZOpRhJNxi1A_bI-v2CiOIX1AA Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 17da40534ba847b18b2f0cde9b822b24 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 17da40534ba847b18b2f0cde9b822b24 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateTestJSON-2048160253-project Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 658e3ac336ac4342bd204a74515fcd96 Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateTestJSON-2048160253-project Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '15246dad-fcbc-4cd8-b0b2-260036789476'} Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:41.460169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. Oct 18 13:39:41.465307 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:41.472370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Returning 404 to user: Instance 15246dad-fcbc-4cd8-b0b2-260036789476 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:41.476264 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8dbe0618-d848-44a4-9493-55b1fe55b5ea tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476" status: 404 len: 111 microversion: 2.1 time: 0.071100 Oct 18 13:39:41.477498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1853/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:41 2022] GET /compute/v2.1/servers/15246dad-fcbc-4cd8-b0b2-260036789476 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:41.487462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:41.492863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:41.504809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.506881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.508734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.509782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.511052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.512365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.989991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:42.027844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70db16fe-7e90-453d-ade4-0a1cd52edda8 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1513 microversion: 2.1 time: 0.546077 Oct 18 13:39:42.035283 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1854/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:41 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1513 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:42.060873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc25535-4722-4de8-b667-8abfdcc81463", "name": "network-vif-plugged", "status": "completed", "tag": "99b85a6b-25ce-4c9d-9d87-eece2ecade94"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:42.086606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.090297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.091286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.119643 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] Creating event network-vif-plugged:99b85a6b-25ce-4c9d-9d87-eece2ecade94 for instance cbc25535-4722-4de8-b667-8abfdcc81463 on n-h2-858383-13 Oct 18 13:39:42.130286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-358cfe92-ea08-42f9-9658-484ab3378e6e req-f106bc85-a3dd-4c2c-b6ce-833b7a219c0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082119 Oct 18 13:39:42.133708 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1855/3768] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:42.139881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:42.148160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] [instance: 1dfbf010-f71e-4b57-b6da-20ab79d01f5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:42.162000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.162828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.163460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.168614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.168614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.168614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.192619 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] HTTP exception thrown: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Request method failure captured: Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e HTTP/1.1 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqxU-jDI319npIWrTlCtDS_D2z3Gf1cb0ru_sewSMeJBVDr5Lb9XQhaJGjFpgSGiQxWLSp2vl3iUGpzY22efRgfFm65xxuxPDj960VWnxOt0Bdn4hFnwgQcwDu1aLRPKaB3uMlRhu3aNbc4vNEsarDZOpRhJNxi1A_bI-v2CiOIX1AA Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 17da40534ba847b18b2f0cde9b822b24 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17da40534ba847b18b2f0cde9b822b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 17da40534ba847b18b2f0cde9b822b24 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2048160253 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateTestJSON-2048160253-project Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 658e3ac336ac4342bd204a74515fcd96 Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateTestJSON-2048160253-project Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '1dfbf010-f71e-4b57-b6da-20ab79d01f5e'} Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:42.196652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] Returning 404 to user: Instance 1dfbf010-f71e-4b57-b6da-20ab79d01f5e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:42.201420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89abb019-4779-4816-b3e5-4addee8add01 tempest-MultipleCreateTestJSON-2048160253 tempest-MultipleCreateTestJSON-2048160253-project] 10.222.0.27 "GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e" status: 404 len: 111 microversion: 2.1 time: 0.060442 Oct 18 13:39:42.206959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1856/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:42 2022] GET /compute/v2.1/servers/1dfbf010-f71e-4b57-b6da-20ab79d01f5e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:42.212178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:42.212938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:42.221540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.225352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.225352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.225352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.225352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.225352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.391224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=20 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:43.033439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:43.044384 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36ce9d64-5e30-45f1-87ba-72127a92956a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.836187 Oct 18 13:39:43.044967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1857/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:42 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:43.064258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307a2529-8e64-497c-85f9-c498901f1e5e", "name": "network-vif-deleted", "tag": "53120888-1943-47e8-924e-8eb1960848c2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:43.084742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:43.085453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:43.086256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:43.104358 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] Creating event network-vif-deleted:53120888-1943-47e8-924e-8eb1960848c2 for instance 307a2529-8e64-497c-85f9-c498901f1e5e on n-h2-858383-13 Oct 18 13:39:43.112815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-57aeeee0-f058-42aa-987d-bae991e03ccb req-a7027f7d-636d-4844-8e86-6becd3c7962f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063310 Oct 18 13:39:43.113693 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1858/3771] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:43.123870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:43.124423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:43.133432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:43.135578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:43.136294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:43.137947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:43.138907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:43.140023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:43.979323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.002141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1671c20-ca49-42d5-a4cd-89d5ff6401e9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.886838 Oct 18 13:39:44.011373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1859/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:43 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:44.013635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:44.014509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:44.043006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.047327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.048112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.049129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.050715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.052044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.116234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.122638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.123817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.124419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lazy-loading 'fault' on Instance uuid 307a2529-8e64-497c-85f9-c498901f1e5e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:44.263413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.294527 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ec0d878-8c03-491e-ae7f-6a1c9a8bb56c tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 200 len: 1307 microversion: 2.1 time: 0.281661 Oct 18 13:39:44.294527 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1860/3773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:44 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:44.304671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:44.307042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:44.317543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.320129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.321047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.321968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.323749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.323749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.411063 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ebc441f-368a-4b0c-a926-da5894fa007d tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.483150 Oct 18 13:39:45.411685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1914/3774] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:39:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:45.462592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:45.473348 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a7e9ad00-9409-4a71-a923-5045123d0513 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 1.183743 Oct 18 13:39:45.480069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1861/3775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:44 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:45.509587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38771dde-43c4-4fd2-a976-7539af0c6fb6", "name": "network-vif-plugged", "status": "completed", "tag": "848f3662-3a79-4c9b-814d-ede1c279482f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:45.535153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.536232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.538498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.575545 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] Creating event network-vif-plugged:848f3662-3a79-4c9b-814d-ede1c279482f for instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 on n-h2-858383-13 Oct 18 13:39:45.601001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-92646ee0-e8dd-4554-bc76-be221457afd5 req-177f3896-f5db-4d2c-a326-732b8e7e96c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115265 Oct 18 13:39:45.604426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1862/3776] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:45.638316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:45.640583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:45.676374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.676374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.676374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.677197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.677675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.679247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.986011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2fdc5c2-7df8-4bcf-91c0-3683404de72e", "tag": "7c52f4cb-0d23-4662-bac9-bc5b4380f140"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:45.999288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.000286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.000801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.012712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:46.023911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] Creating event network-changed:7c52f4cb-0d23-4662-bac9-bc5b4380f140 for instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e on n-h2-858383-13 Oct 18 13:39:46.044635 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a3cdd975-f690-41e4-b085-70df198055d5 req-f86a6162-a8de-43c6-9077-9d187a7bce3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630854 Oct 18 13:39:46.050132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1915/3777] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:46.063865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:46.064817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 307a2529-8e64-497c-85f9-c498901f1e5e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:46.074362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.079685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.080617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.085582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.085582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.085582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.112041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] HTTP exception thrown: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Request method failure captured: Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e HTTP/1.1 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqv3ynmudwmFtVo89yMr05RELGjFGj4nl4ZGNJsmzBsadJz9D-wpUs-jC-yBX1S3kOOACj1L12tZUEGkshdXPAWjXXRE7YoQfvVsVGxakAZiir7RMotx6B61bWvhKFVgN19LJ4CdLo0P2lPle2AIkEf9ZlpZXPfF2N_se2biLCj5vXg Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 500c1691c5bb4729ba86089d20dedf27 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 500c1691c5bb4729ba86089d20dedf27 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesAdminNegativeTest-299651946-project Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 97fcf7685853432ab0173f0cfac41863 Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesAdminNegativeTest-299651946-project Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '307a2529-8e64-497c-85f9-c498901f1e5e'} Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:46.117941 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Returning 404 to user: Instance 307a2529-8e64-497c-85f9-c498901f1e5e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:46.130483 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-581cca89-2bf2-4c03-8a46-ac65caf96552 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e" status: 404 len: 111 microversion: 2.1 time: 0.068151 Oct 18 13:39:46.135549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1916/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:46 2022] GET /compute/v2.1/servers/307a2529-8e64-497c-85f9-c498901f1e5e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:46.145499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc306c68-3cab-4615-b319-8263314e1537 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Action: 'create', calling method: .version_select at 0x7fb3304ac9d0>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:46.489371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:46.502354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b839f95-fd91-4f2f-bdd6-e55c67a2145e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.896215 Oct 18 13:39:46.502964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1863/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:45 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:46.541641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:46.545241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:46.566682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.572747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.575599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.578098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.580700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.581464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.073623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:47.089969 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77ca25ce-4ff2-42c6-a4a7-5e5d0dd07d14 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.583059 Oct 18 13:39:47.091339 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1864/3780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:46 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:47.526635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:47.528169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:47.547905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.551622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.554851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.555778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.561454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.564694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.928981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:47.937791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f7bbd3d0-42f1-4086-b466-6d4afa341b13 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.415743 Oct 18 13:39:47.945298 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1865/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:47 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:47.975865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff779d2-1613-4129-9878-63f7e3be3d81", "name": "network-vif-plugged", "status": "completed", "tag": "4e572084-f6cf-4451-b384-fc3e179c2a49"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:48.012869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.017338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.018807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.061485 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] Creating event network-vif-plugged:4e572084-f6cf-4451-b384-fc3e179c2a49 for instance cff779d2-1613-4129-9878-63f7e3be3d81 on n-h1-858383-13 Oct 18 13:39:48.079014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-32e05a60-aee1-4463-9dbf-4821a8cb27aa req-f5228546-0bca-4c96-bc29-057c05e9bdef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132117 Oct 18 13:39:48.080536 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1866/3782] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:48.122716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:48.123718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:48.128093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:48.144652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.161364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.163189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.164132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.168437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.169204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.248730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:48.809971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:48.823899 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7fa109c8-e5fe-4e25-b5c6-a752897926f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.709522 Oct 18 13:39:48.827883 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1867/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:48 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:48.964241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:48.965207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:48.980476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.983064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.985825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.996902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.996902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.996902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.467624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:49.509148 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2d899a57-6c0a-4e40-9ad6-ad1f1e71d17f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1321 microversion: 2.1 time: 0.548684 Oct 18 13:39:49.522075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1868/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:48 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:49.854603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:49.855251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:49.899305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.899305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.899305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.905227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.907005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.910118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.551936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.581960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d1c3be7-7af3-467f-8b11-1959b87eddfe tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.730201 Oct 18 13:39:50.593304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1869/3785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:49 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:50.602583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:50.603930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:50.613823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.615336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.616297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.617461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.618267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.618872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.950033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.983135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb5ac131-2568-4ea3-8cf1-fbaa8669607d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1511 microversion: 2.1 time: 0.388029 Oct 18 13:39:50.989547 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1870/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:50 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:51.034440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:51.035078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:51.080063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.080822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.086928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.086928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.088394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.088956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.864414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:51.883234 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-66b989b1-8bea-45b2-991c-3c5a30586247 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1510 microversion: 2.1 time: 0.870157 Oct 18 13:39:51.884430 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1871/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:51 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1510 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:51.890410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:51.891464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:51.899882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.900635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.901379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.902326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.903176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.903783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.110450 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc306c68-3cab-4615-b319-8263314e1537 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.972474 Oct 18 13:39:52.115268 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1917/3788] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:39:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:52.121708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:52.126780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:52.140603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.141242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.141872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.143951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.144673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.145322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.393082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.404248 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb04b2f3-a8fb-47de-a226-eeab31cd2f4b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.517201 Oct 18 13:39:52.406625 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1872/3789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:51 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:52.421942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5760d6f4-9987-4185-9aff-be897343018e tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Action: 'create', calling method: .version_select at 0x7fb3303fd550>, body: {"pool": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:52.675186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.692035 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1be4d3d-768b-45cc-bab3-510a50b4f5e0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1512 microversion: 2.1 time: 0.575173 Oct 18 13:39:52.694133 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1918/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:52 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:53.126854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fdc5c2-7df8-4bcf-91c0-3683404de72e", "name": "network-vif-plugged", "status": "completed", "tag": "7c52f4cb-0d23-4662-bac9-bc5b4380f140"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:53.150047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.150827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.151405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.179278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] Creating event network-vif-plugged:7c52f4cb-0d23-4662-bac9-bc5b4380f140 for instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e on n-h2-858383-13 Oct 18 13:39:53.184781 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bc48e7fa-04ec-42e5-b989-4260b5e148d0 req-e125cfa3-eac2-43aa-ad18-1779511d7b72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.489045 Oct 18 13:39:53.187616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1919/3791] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:53.200927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:53.224244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.225200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:53.256998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.257594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.260136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.271687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.273112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.273803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.460574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:53.600447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.611870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.612636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.613309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.014851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5af8567-c048-48ee-a1b2-d8efbf58c442 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.825870 Oct 18 13:39:54.027474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1920/3792] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:39:53 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:54.051029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:54.054110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:54.075102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.076001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.076736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.080739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.081705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.082493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.172994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:54.572452 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e6156a6-9f1c-481b-8b9e-56e35bc1799f tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 204 len: 0 microversion: 2.1 time: 0.541760 Oct 18 13:39:54.573596 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1921/3793] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:54 2022] DELETE /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:54.582413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:54.584668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:54.603105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.605594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.607475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.608605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.613650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.614446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.901285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:54.919591 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f589319c-22da-4855-b213-2df65e827f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1318 microversion: 2.1 time: 0.344035 Oct 18 13:39:54.920320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1922/3794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:54 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:54.926622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:54.933754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:54.934850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-527380580', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:54.941089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.941719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.942270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.943230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.943761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.944247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.115490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:55.189553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:55.195320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.195973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.196487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.395935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ed8a2fd-4b41-4b88-b00c-a696af4e6419 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-527380580" status: 200 len: 1513 microversion: 2.1 time: 0.474145 Oct 18 13:39:55.397460 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1923/3795] 10.222.0.27 () {58 vars in 1261 bytes} [Tue Oct 18 13:39:54 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-527380580 => generated 1513 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:55.741026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1455528053", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:55.880937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:55.917890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5760d6f4-9987-4185-9aff-be897343018e tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.508962 Oct 18 13:39:55.918825 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1873/3796] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:39:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:55.923574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.924372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:55.970587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.974389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.980208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.982826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.987673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.988353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.459725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:56.477375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07d7000f-5a6c-4397-8eb7-32b90c4ee827 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1681 microversion: 2.1 time: 0.557411 Oct 18 13:39:56.491156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1874/3797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:55 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1681 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:56.497096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:56.502383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:56.507200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:56.515918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.518707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.519423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.527073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.527939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.528640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.657013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:56.753770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:56.765300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.766184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.767715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.823917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:56.824390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:56.825390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:56.825507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:56.825894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:56.837296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.837804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.838292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.839004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.839463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.840952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.859389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:56.860809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:56.865361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:56.878318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:56.880820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:57.040576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bee4d835-8980-4b86-8dbf-436dba75c1f2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641672 Oct 18 13:39:57.041903 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1924/3798] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:39:57.047710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b37c094-1c39-486b-8003-50af1274e153 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Action: 'create', calling method: .version_select at 0x7fb3303f9820>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:57.363566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d6dd6c5-658e-4b31-b858-194b89f05c98 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.857304 Oct 18 13:39:57.363566 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1875/3799] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:39:56 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:57.367703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:57.373350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:57.389747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:57.393160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:57.395211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:57.398716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:57.403805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:57.412249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:57.823125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:57.840438 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9cfd914-7cf8-4a7c-8a49-6192e5cbbe08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1508 microversion: 2.1 time: 0.488635 Oct 18 13:39:57.841604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1876/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:57 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:57.855256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9dfd49cf-c822-4d6f-b1a1-ce026c431041 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:57.855256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9dfd49cf-c822-4d6f-b1a1-ce026c431041 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.097662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9dfd49cf-c822-4d6f-b1a1-ce026c431041 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.117422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9dfd49cf-c822-4d6f-b1a1-ce026c431041 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1193 microversion: 2.1 time: 0.271428 Oct 18 13:39:58.134623 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1877/3801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:57 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1193 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:58.140043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.147697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.148365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.servers [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Removing options 'limit' from query {{(pid=121009) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:39:58.153284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:58.156642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.157361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.157977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.158897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.159761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.160374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.201593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.212395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.213147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.213799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.478604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df395c1b-c392-4d87-a4d2-6d0e403c6f26 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.342726 Oct 18 13:39:58.479351 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1878/3802] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:58.486612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.491341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.502508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.503304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.503941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.504919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.505597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.506713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.653758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fcf7685853432ab0173f0cfac41863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500c1691c5bb4729ba86089d20dedf27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.692023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cbaf70de-2c51-4a3c-9657-fb1535c3d2c4 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 200 len: 1613 microversion: 2.1 time: 0.195930 Oct 18 13:39:58.692023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1879/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:58.692023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.693154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.712558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.713078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.713532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.714317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.714783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.715275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.947578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.957155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-115f2449-05bb-482a-9840-2a9b1b8c6e00 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1508 microversion: 2.1 time: 0.277797 Oct 18 13:39:58.974313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1880/3804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:58.981667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.994616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.997932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:39:59.011371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.014602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.015069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.015901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.016298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.016741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.193223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:39:59.292272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff21b580-d5d4-4515-9e3c-bf50ca99079d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.318887 Oct 18 13:39:59.295978 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1881/3805] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:59.300873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d963134-c4b3-4561-8f45-302eba5e54c3", "name": "network-vif-deleted", "tag": "322a75e6-0c41-4733-a926-69592580298c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:59.314884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.315375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.315820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.338629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] Creating event network-vif-deleted:322a75e6-0c41-4733-a926-69592580298c for instance 5d963134-c4b3-4561-8f45-302eba5e54c3 on n-h1-858383-13 Oct 18 13:39:59.347941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-27be08d0-60ee-47a8-a589-fe97844e9eee req-e7d1b365-4486-423a-ac6c-ecbff53152e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050613 Oct 18 13:39:59.348869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1882/3806] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:59.357399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:59.367119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.375186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.375186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.375485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.378230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.378726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.379176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.522420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:59.524464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:59.525473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:59.526210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:59.526976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:59.826417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.841393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.847184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.847184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.847184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.847184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.847184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.857935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:59.924357 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4575d6d-b54a-4cbd-b37c-bf06b357afbb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "POST /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e/action" status: 202 len: 1110 microversion: 2.1 time: 0.574232 Oct 18 13:39:59.925014 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1883/3807] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:39:59 2022] POST /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e/action => generated 1110 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:39:59.930183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.934378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.959041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.963817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.963817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.963817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.963817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.963817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.084266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:00.095617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4159a66c-a0ee-4b3c-bf21-c3532db72e8d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1197 microversion: 2.1 time: 0.169326 Oct 18 13:40:00.096234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1884/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:59 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:00.122214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.127731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:00.128179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.servers [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Removing options 'limit' from query {{(pid=121009) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:40:00.128944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:00.157304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.157795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.158263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.159181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.159801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.160404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.203919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:00.336535 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ed36a4c-4bae-4f96-a3f7-5401363ab681 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.238870 Oct 18 13:40:00.349072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1885/3809] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:00.360872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.364236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] [instance: 5d963134-c4b3-4561-8f45-302eba5e54c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:00.383290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.384562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.385340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.386621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.387384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.388854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.446866 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] HTTP exception thrown: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Request method failure captured: Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 HTTP/1.1 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqv3ynmudwmFtVo89yMr05RELGjFGj4nl4ZGNJsmzBsadJz9D-wpUs-jC-yBX1S3kOOACj1L12tZUEGkshdXPAWjXXRE7YoQfvVsVGxakAZiir7RMotx6B61bWvhKFVgN19LJ4CdLo0P2lPle2AIkEf9ZlpZXPfF2N_se2biLCj5vXg Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 500c1691c5bb4729ba86089d20dedf27 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_500c1691c5bb4729ba86089d20dedf27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 500c1691c5bb4729ba86089d20dedf27 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-299651946 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesAdminNegativeTest-299651946-project Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 97fcf7685853432ab0173f0cfac41863 Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesAdminNegativeTest-299651946-project Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5d963134-c4b3-4561-8f45-302eba5e54c3'} Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:00.479879 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Returning 404 to user: Instance 5d963134-c4b3-4561-8f45-302eba5e54c3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e83b602f-b0cb-4d7a-bdff-714791fcc9ed tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3" status: 404 len: 111 microversion: 2.1 time: 0.131302 Oct 18 13:40:00.491757 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1886/3810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers/5d963134-c4b3-4561-8f45-302eba5e54c3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:00.492751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.493387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:00.501125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.501636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.502101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.502818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.503899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.503899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.598909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b37c094-1c39-486b-8003-50af1274e153 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.555440 Oct 18 13:40:00.600219 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1925/3811] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:39:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:00.614961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.632362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:00.633434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:00.645706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.647654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.651023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.653941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.655783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.660544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.719072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:00.820155 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26fdf44c-30a0-41e0-9c76-be364f6a22cd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.218683 Oct 18 13:40:00.821013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1926/3812] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers => generated 1011 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:00.827189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02636cec-4274-4144-ae66-411e4c9cc136 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] Calling method '.version_select at 0x7fb3304ac5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.852360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:00.872281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86d0be8a-ef2d-4584-9ffd-5c9598029f77 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.384709 Oct 18 13:40:00.872969 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1887/3813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:00.899382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a97a2d1-f79f-4681-91e2-f57ebe0e65bf tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb3302555e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.987683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02636cec-4274-4144-ae66-411e4c9cc136 tempest-VolumesAdminNegativeTest-299651946 tempest-VolumesAdminNegativeTest-299651946-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-444200607" status: 202 len: 0 microversion: 2.1 time: 0.165383 Oct 18 13:40:00.988526 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1927/3814] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-444200607 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:00.995734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.026378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:01.027413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:01.087059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.087632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.090604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.091420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.091896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.094447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.316363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:01.392815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11522d5b-e192-4269-bcd0-af958fc3ff4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.402983 Oct 18 13:40:01.394144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1928/3815] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:01.403168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.403168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:01.415438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.415958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.419266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.420035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.421675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.422174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.692641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:01.730800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0716356f-d684-4c34-8571-6ea628b51244 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1253 microversion: 2.1 time: 0.335194 Oct 18 13:40:01.733615 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1929/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:01 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1253 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:01.756573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.771865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:01.773484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.servers [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Removing options 'limit' from query {{(pid=121010) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:40:01.774915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:01.790342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.790342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.790342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.791309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.792370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.792727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.836638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d78379bb-a298-4e99-acd4-65d853b86599 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.101674 Oct 18 13:40:01.837550 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1930/3817] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 13:40:01 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:01.856308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.863660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-527380580', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.876665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.064251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:02.120377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a97a2d1-f79f-4681-91e2-f57ebe0e65bf tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/88e40a25-5b52-41f9-8727-9398d5255c5e" status: 200 len: 141 microversion: 2.1 time: 1.238058 Oct 18 13:40:02.122445 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1888/3818] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/os-floating-ips/88e40a25-5b52-41f9-8727-9398d5255c5e => generated 141 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:02.126095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f54c5c0f-7695-473a-9ab5-c103253b34bd tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-527380580" status: 200 len: 345 microversion: 2.1 time: 0.273925 Oct 18 13:40:02.130953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:02.131839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:02.134902 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1931/3819] 10.222.0.27 () {58 vars in 1240 bytes} [Tue Oct 18 13:40:01 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-527380580 => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:02.140477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5743b673-e721-47e0-988b-822dd8b5dc2c tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb330365280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:02.148557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.148557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.148557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.148557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.148557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.148990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.439513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:02.447386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ede37c8-1c81-4aea-907c-d9bf627be104 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.323317 Oct 18 13:40:02.462655 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1889/3820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:02 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:02.468559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:02.474998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.475503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.475955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.503277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Going to try to stop instance {{(pid=121009) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:40:02.712096 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2c4717d-d581-40dd-a861-ae2b653b05f1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "POST /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463/action" status: 202 len: 0 microversion: 2.1 time: 0.247789 Oct 18 13:40:02.720069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1890/3821] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:40:02 2022] POST /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:02.726562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:02.728630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:02.741592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.741592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.741592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.742081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.742676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.743210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.019098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.029629 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32cbc933-b18d-4313-a482-8fef0bb9fb9b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.310950 Oct 18 13:40:03.031358 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1891/3822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:02 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:03.046940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:03.047628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:03.055326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.056140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.056769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.057498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.058731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.059971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.150228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.159926 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc557ec8-983d-45a5-bea5-f7190aecf433 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1251 microversion: 2.1 time: 0.126861 Oct 18 13:40:03.160507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1892/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:03 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1251 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:03.476341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:03.477047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:03.484273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.485183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.485803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.486722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.487480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.488092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.709844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.718640 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65cca985-a3e4-451b-883e-07659b78699b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.248624 Oct 18 13:40:03.734595 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1893/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:03 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:04.058625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.060252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:04.087006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.088417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.089206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.090285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.090995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.097287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.386346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.394787 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8a9fad2e-91df-43ea-a071-75959be2c236 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.342131 Oct 18 13:40:04.395361 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1894/3825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:04.400294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.401123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:04.408371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.409084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.409948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.410845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.411480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.412086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.651909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.663409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9f9c569-2cd8-4134-860a-b34f114407e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.266251 Oct 18 13:40:04.679871 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1895/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:04.743260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.743890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:04.751421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.752191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.752803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.754472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.755855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.757101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.797437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5743b673-e721-47e0-988b-822dd8b5dc2c tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/88e40a25-5b52-41f9-8727-9398d5255c5e" status: 202 len: 0 microversion: 2.1 time: 2.661370 Oct 18 13:40:04.798447 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1932/3827] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:40:02 2022] DELETE /compute/v2.1/os-floating-ips/88e40a25-5b52-41f9-8727-9398d5255c5e => generated 0 bytes in 2663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:04.808893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae35ac48-5cd0-445b-a894-68b61f0e00e8 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb330309820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.941325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.950856 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc477494-c8ff-477b-bf40-be1a14733dd5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.211288 Oct 18 13:40:04.951843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1896/3828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:05.024255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7", "tag": "99f0c4df-5133-4d77-957a-d5a1db194808"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:05.034330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.035040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.035666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.047798 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] Creating event network-changed:99f0c4df-5133-4d77-957a-d5a1db194808 for instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 on n-h1-858383-13 Oct 18 13:40:05.053608 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1c2689ea-cacd-46b5-b8d3-a5924bc3d323 req-a1abc929-cc2f-47a7-af18-b355472819be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033001 Oct 18 13:40:05.054587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1897/3829] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:05.284100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae35ac48-5cd0-445b-a894-68b61f0e00e8 tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.479981 Oct 18 13:40:05.284914 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1933/3830] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:40:05.299563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b64a13bc-57ef-4efc-9362-cf856f04b81c tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb330269160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:05.423637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:05.424534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:05.437384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.437884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.438352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.439118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.439764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.440194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.645701 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b64a13bc-57ef-4efc-9362-cf856f04b81c tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.345176 Oct 18 13:40:05.647141 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1898/3831] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:40:05 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:05.685726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e22c44c-3358-49bb-8192-949a710cd94f tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb330206670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:05.747647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:05.756830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a12ddb16-7535-4a3b-8474-e0fb131ed723 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.336960 Oct 18 13:40:05.762223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1934/3832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:05 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:05.765482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:05.766394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:05.779577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.780434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.786031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.786031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.786031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.786031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.168140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.183289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c118b01-7e9d-4685-8760-073c24a67d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.422952 Oct 18 13:40:06.192475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1935/3833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:05 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:06.203932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:06.204836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:06.220296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.220885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.221344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.222082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.228260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.228705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.233788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:06.872380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.874559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:06.881358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a715313-5f42-4b5c-bb6c-72584a86dff9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.687532 Oct 18 13:40:06.882743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1936/3834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:06 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:06.900066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:06.900971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:06.908788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.909872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.910566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.911469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.912097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.912749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.177488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:07.186510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01f8c8e0-b1f9-4822-a58e-c8acbe95351a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.290886 Oct 18 13:40:07.208100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1937/3835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:06 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:07.215752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:07.224182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:07.257935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.266540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.266540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.266540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.266540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.266540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.517978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:07.532100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f239c9af-b769-4fd2-90a8-4ae5289918b0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.326420 Oct 18 13:40:07.534579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1938/3836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:07 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:07.909445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:07.911167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:07.925709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.928800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.928800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.928800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.928800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.928800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.005441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2e22c44c-3358-49bb-8192-949a710cd94f tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e9757c69-13c0-487e-9730-2f2e85693062" status: 202 len: 0 microversion: 2.1 time: 2.334187 Oct 18 13:40:08.006592 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1899/3837] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:40:05 2022] DELETE /compute/v2.1/os-floating-ips/e9757c69-13c0-487e-9730-2f2e85693062 => generated 0 bytes in 2336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:08.022949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0186e3f5-52c4-41c9-aafa-056203a4c49b tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb330206160>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:08.146573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:08.158283 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cd58c81-d879-4779-8523-920a74898770 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.252636 Oct 18 13:40:08.174548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1939/3838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:07 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:08.200559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:08.216057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:08.217417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:08.228172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.230466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.232950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.234370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.236298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.238868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.576986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:08.598335 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3bdd8cd8-b38a-43e6-ba75-2dec13724477 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.384372 Oct 18 13:40:08.606983 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1940/3839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:08 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:08.619694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:08.621972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:08.639745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.642641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.643570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.646613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.649578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.650261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.069920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:09.083179 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eebaffbe-0fe0-4cc2-980c-42cb911e58e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.479955 Oct 18 13:40:09.098783 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1941/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:08 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:09.186425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:09.187164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:09.209938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.215779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.216260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.217029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.217506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.217949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.522482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:09.543382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f78b004a-36c3-4fc7-894c-6b9859390495 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.363690 Oct 18 13:40:09.544011 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1942/3841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:09 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:09.631048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:09.634911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:09.665457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.671235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.672007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.673278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.673916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.677932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.143190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.157141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b349dd76-0db3-4228-b83b-a05536f0f9ae tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.530122 Oct 18 13:40:10.158648 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1943/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:09 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:10.166088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:10.169845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:10.174448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:10.191563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.196717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.197606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.202155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.202155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.202155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.224339 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0186e3f5-52c4-41c9-aafa-056203a4c49b tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b342ca30-c15f-4c0b-a329-65264e74b21c" status: 202 len: 0 microversion: 2.1 time: 2.205089 Oct 18 13:40:10.228347 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1900/3843] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:40:08 2022] DELETE /compute/v2.1/os-floating-ips/b342ca30-c15f-4c0b-a329-65264e74b21c => generated 0 bytes in 2210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:10.234268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-068661e8-b3bf-47b1-b6e1-31d982dc560f tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] Calling method '.version_select at 0x7fb3301c9e50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:10.491471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.500152 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b64a372-59b2-4f9e-9d1b-48e8b558233f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.340048 Oct 18 13:40:10.500740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1944/3844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:10 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:10.520381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7", "name": "network-vif-plugged", "status": "completed", "tag": "99f0c4df-5133-4d77-957a-d5a1db194808"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:10.533282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.535302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.535477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.568813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] Creating event network-vif-plugged:99f0c4df-5133-4d77-957a-d5a1db194808 for instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 on n-h1-858383-13 Oct 18 13:40:10.580145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6f6bd431-63f8-4c9a-9feb-5e73f8d8a2cc req-d18696ff-bab3-47d3-8dc3-db4d24f4244f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071585 Oct 18 13:40:10.583655 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1945/3845] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:10.597045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:10.601400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:10.617938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.618484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.622851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.623803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.624300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.624817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.860118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.869288 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a900a37-ff51-41fc-b131-62f8623f9525 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.284145 Oct 18 13:40:10.885998 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1946/3846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:10 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:11.190016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:11.194446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:11.204351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.210378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.210378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.210378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.210378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.210378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.645712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:11.662139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aac80ca8-05e7-4145-b0eb-ae00d28aa8ca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.478580 Oct 18 13:40:11.675996 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1947/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:11 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:11.689720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:11.690727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:11.699501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.700247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.700921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.702721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.703475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.704219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.986340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:12.027893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:12.048936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23c457d8-6ed3-4856-9e3e-4574b1e1ea95 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1293 microversion: 2.1 time: 0.366580 Oct 18 13:40:12.050652 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1948/3848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:11 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1293 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:12.056227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:12.057420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:12.064310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.065119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.069181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.069181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.069181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.069181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.477390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:12.499326 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-93971def-21f4-497b-92bf-dcd40eb27dee tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.447406 Oct 18 13:40:12.500529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1949/3849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:12 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:12.697186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:12.697186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:12.699461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-068661e8-b3bf-47b1-b6e1-31d982dc560f tempest-FloatingIPDetailsTestJSON-348851345 tempest-FloatingIPDetailsTestJSON-348851345-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/799dcf0c-9014-49cf-b410-d3982be20d65" status: 202 len: 0 microversion: 2.1 time: 2.467514 Oct 18 13:40:12.700498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1901/3850] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:40:10 2022] DELETE /compute/v2.1/os-floating-ips/799dcf0c-9014-49cf-b410-d3982be20d65 => generated 0 bytes in 2472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:12.701843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.702372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.717248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.717248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.717248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.717248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.056001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.072382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:13.072620 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e47f995a-5fb1-4639-ba71-bc48d0baca41 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1520 microversion: 2.1 time: 0.385205 Oct 18 13:40:13.073326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1950/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:12 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:13.073669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:13.094843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.101987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.102630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.103499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.104089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.104633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.492119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.497882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9db00bd1-dbb1-4fe7-8757-8d9b62040f1d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1475 microversion: 2.1 time: 0.429257 Oct 18 13:40:13.499074 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1902/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:13 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:13.527925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:13.528825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:13.537102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.537601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.538273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.539166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.539789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.540396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.772906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1139866978", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:13.836519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] validate_networks() for [('b66de52a-7f4d-43de-9721-de47c554f254', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:14.037275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:14.064725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1921b180-fb7f-48a2-bfe4-2a246e909bdb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.541703 Oct 18 13:40:14.067309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1903/3853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:13 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:14.089426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-561355257", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:14.164576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:15.029353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:15.030173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:15.030821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:15.031821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:15.039170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:15.048645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.049274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.051842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.052879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.053455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.054237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.075927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Getting quotas for project 90c056fcd52f4a97b89c731d06027fc5. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:15.081797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Getting quotas for user 11af7a4f65914752be86a83fa3408870 and project 90c056fcd52f4a97b89c731d06027fc5. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:15.096943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:15.099493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:15.268830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5859b05c-d216-49de-af9d-3deda3d8fea0 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.788021 Oct 18 13:40:15.275246 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1951/3854] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:40:15.291573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:15.295148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:15.305086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.306445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.307142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.310012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.310801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.311615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.351438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:15.352483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:15.353129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:15.353747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:15.354349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:15.365710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.366225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.367028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.377327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.379490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.379490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.436626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:15.446640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:15.494219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:15.497353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:15.732676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e5f5e2b-b41a-425c-b71a-5231755256b6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652598 Oct 18 13:40:15.734950 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1904/3855] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:40:15.745335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:15.755251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:15.778846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.782395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.783233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.786842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.788267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.789268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.401704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:16.406086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:16.416538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80405a30-228a-4327-a4b6-dce5082b066f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.680246 Oct 18 13:40:16.417129 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1905/3856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:15 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:16.435100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e4bd475-3912-4301-8e27-573d4eb6f3d4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:16.437874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e4bd475-3912-4301-8e27-573d4eb6f3d4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:16.557075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0e4bd475-3912-4301-8e27-573d4eb6f3d4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:16.564042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e4bd475-3912-4301-8e27-573d4eb6f3d4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1223 microversion: 2.1 time: 0.142912 Oct 18 13:40:16.580265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1906/3857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:16 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:16.590189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37507320-37b0-4fa7-ad23-a20c71141295 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:16.591168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37507320-37b0-4fa7-ad23-a20c71141295 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:16.654441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37507320-37b0-4fa7-ad23-a20c71141295 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:16.689991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:17.406610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.420825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9fad575-0bd0-4857-8261-b34d312a0e86 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1497 microversion: 2.1 time: 2.140584 Oct 18 13:40:17.424964 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1952/3858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:15 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1497 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:17.441120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:17.455885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.scheduler.client.report [None req-37507320-37b0-4fa7-ad23-a20c71141295 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Deleted allocations for instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf Oct 18 13:40:17.456382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:17.479643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.480627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.482598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.483547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.484721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.486681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.558841 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37507320-37b0-4fa7-ad23-a20c71141295 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf" status: 204 len: 0 microversion: 2.1 time: 0.976764 Oct 18 13:40:17.563982 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1907/3859] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:16 2022] DELETE /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf => generated 0 bytes in 983 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:17.570100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:17.577851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.581068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:17.589053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.590892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.591690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.592781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.593526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.594314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.628466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:17.720521 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-204466f9-94f8-457f-85f4-e206a554d698 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.154936 Oct 18 13:40:17.729165 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1908/3860] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 18 13:40:17 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:17.735032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:17.735753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:17.742408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.743541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.744425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.745791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.747094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.747751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.764778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf HTTP/1.1 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5910d5f6-afe0-4011-8d05-d8e2652c7adf'} Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:17.767187 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:40:17.772237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:17.775247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:17.776338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81f9d63f-53f3-4526-948c-2743dd885166 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf" status: 404 len: 111 microversion: 2.1 time: 0.045545 Oct 18 13:40:17.777083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1909/3861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:17 2022] GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:17.783230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:17.784236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:17.792641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.802098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.802862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.803717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.804277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.804774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.944755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.953588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a317f61d-914e-4a26-ad32-5df2d4b9ae0c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1219 microversion: 2.1 time: 0.175159 Oct 18 13:40:17.957021 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1910/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:17 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:17.966386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:17.976677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.977740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.978319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.498698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:40:18.597594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.608805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62fe04ae-436e-425e-b180-2e1dfcc5a7a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 1.172476 Oct 18 13:40:18.622136 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1953/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:17 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:18.623509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1140499231", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:18.700774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:18.743536 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-844ba4a8-65ab-4beb-98f3-c8b059f578d1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "POST /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463/action" status: 202 len: 0 microversion: 2.1 time: 0.784910 Oct 18 13:40:18.755379 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1911/3864] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:40:17 2022] POST /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:18.776926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:18.780438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:18.788501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.791035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.792550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.795005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.797547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.798776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.325045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.338149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98cb47c7-dd81-4b95-85e2-100bd23812b4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1506 microversion: 2.1 time: 0.577778 Oct 18 13:40:19.339945 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1912/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:18 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:19.355481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:19.356249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:19.370685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.373597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.382659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.390791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.390791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.390791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.528263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.538678 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02347007-1663-40bb-9d5c-aaee3619e236 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1293 microversion: 2.1 time: 0.196679 Oct 18 13:40:19.540168 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1913/3866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:19 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:19.634100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:19.634768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:19.641351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.641855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.642336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.643231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.643708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.644145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.576737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.585996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7554594-bbe0-449f-b102-29a7470ce101 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.956412 Oct 18 13:40:20.586961 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1914/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:19 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:20.592310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:20.593374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:20.605900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.606834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.608052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.610380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.611032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.611647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.754631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:20.755823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:20.756473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:20.757065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:20.757649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:20.777482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.779557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.784241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.785565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.786415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.787050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.814166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:20.842192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:20.854405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:20.885860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:20.891653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:21.083227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.095149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96b2d15d-2b1f-4ed5-b3f4-733d153db4e1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1506 microversion: 2.1 time: 0.506909 Oct 18 13:40:21.095951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1915/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:20 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:21.108585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.110509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.127926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81a21cb0-43bc-498c-990a-cba9963eaad0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516488 Oct 18 13:40:21.129287 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1954/3869] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:40:21.136379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.137469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.141554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.141554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.141554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.141554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.141976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03c5a649-12ed-41a0-9b67-854850eca0bd tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.141976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03c5a649-12ed-41a0-9b67-854850eca0bd tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.325554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03c5a649-12ed-41a0-9b67-854850eca0bd tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.337777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03c5a649-12ed-41a0-9b67-854850eca0bd tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1221 microversion: 2.1 time: 0.201178 Oct 18 13:40:21.356388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1955/3870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:21.497284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.510453 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac138f59-0601-4772-8994-475bfb34c3eb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1281 microversion: 2.1 time: 0.410447 Oct 18 13:40:21.514930 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1916/3871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1281 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:21.613618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.613618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.617615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:21.624507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.625139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.625712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.626556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.628277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.629911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.088937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.106997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de048b2f-5feb-4533-b3a9-952e1b88600b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.499177 Oct 18 13:40:22.120563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:22.121823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:22.122424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1956/3872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:22.128486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.133575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.138173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.139533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.140184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.141071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.364144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d37037ae-2bfd-4e72-abae-8c4c6529bc48 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:22.364881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d37037ae-2bfd-4e72-abae-8c4c6529bc48 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:22.478968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d37037ae-2bfd-4e72-abae-8c4c6529bc48 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.490849 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d37037ae-2bfd-4e72-abae-8c4c6529bc48 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1221 microversion: 2.1 time: 0.130413 Oct 18 13:40:22.491771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1957/3873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:22 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:22.550842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.576869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:22.580016 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f46fad8-b371-4d53-911a-3eaade2106fb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1506 microversion: 2.1 time: 0.461378 Oct 18 13:40:22.580198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:22.590332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.591086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.592463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.593596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.594323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.596044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.607140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1917/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:22 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.015042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.028529 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdb135f6-4882-4dc9-8d4a-a05d00678ad9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.493896 Oct 18 13:40:23.042460 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1958/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:22 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.134333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.135822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.144231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.145090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.145942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.146705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.147237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.147973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.508435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.515566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.516194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.526151 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7191fd57-9250-4f3b-a7e9-3bc5439fbb28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.396757 Oct 18 13:40:23.530789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1918/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.531779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.532657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.534139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.535143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.535852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.536505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.634020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.634910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.644183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.645136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.646318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.647701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.648447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.649859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.901993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.909884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e73043f-9dae-4f0c-8a63-66e9a57acfb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1273 microversion: 2.1 time: 0.398703 Oct 18 13:40:23.911077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1959/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.969299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.981991 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bc8fa2b-5e79-4f0c-b70f-1f306c43ed45 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1510 microversion: 2.1 time: 0.353236 Oct 18 13:40:23.984219 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1919/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:24.009507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.015303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.016048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.servers [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Removing options 'limit' from query {{(pid=121010) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:40:24.017031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:24.018895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.019651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.020332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.021291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.021997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.022721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.025040 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d8e7376-694d-460e-95b8-a3beda540b4e tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020086 Oct 18 13:40:24.039694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.040596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.045904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1960/3879] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:40:24.048458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.053273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.055092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.055998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.057402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.058258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.058905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.059739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.076609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.077298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.077817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.078644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.086179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.086929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.401994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.411874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c72c0871-8d10-41a2-a7f3-6424a1e21cd9 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.361395 Oct 18 13:40:24.412661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1961/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:24.554736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.556131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.566160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.566948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.567659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.568636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.569155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.570523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.928002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.940441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff3d21e6-d0f5-4220-9f59-1aa685be7803 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1510 microversion: 2.1 time: 0.903718 Oct 18 13:40:24.954744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1920/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:24.966977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:24.978131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.978866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.979531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.993370 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] Creating event network-changed:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:40:25.001115 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4ff6083e-821a-4f40-9af7-0f8d6038d791 req-76a5e386-1f22-4a81-98f4-fce7820695a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045043 Oct 18 13:40:25.002151 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1921/3882] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:25.008186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.009121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.016672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.017457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.018284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.019215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.019911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.020561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.042029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.054377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2842ef3-c86c-4978-bcd2-eb58091b49b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.503499 Oct 18 13:40:25.055941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1962/3883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:25.062097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.063220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.070104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.070887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.071575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.072531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.073064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.073961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.288437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.299487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-927e3a91-e0c6-4d47-92a1-ee2aa8740fc4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1512 microversion: 2.1 time: 0.241897 Oct 18 13:40:25.300822 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1963/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:25.338288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.352878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9570ffb7-ba62-4a9b-b08b-6df5bb2712f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1281 microversion: 2.1 time: 0.345244 Oct 18 13:40:25.354103 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1922/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1281 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:25.373251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.374126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.390282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.392154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.393266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.395603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.397158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.404254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.435240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.435995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.449558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.450413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.451066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.452004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.452695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.453516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.653690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.666901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2729de09-bb84-4067-8699-9b9bb79b520d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1511 microversion: 2.1 time: 0.316814 Oct 18 13:40:25.668500 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1964/3886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:25.694657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.701307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.702132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:25.865033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.865554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.866375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.867341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.867815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.868277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.986042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:26.074721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf95088d-2412-475c-bd15-95697c1d9a4a tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.383531 Oct 18 13:40:26.087512 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1965/3887] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:26.095810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.114781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27dde869-db01-4d02-b89c-05633a5c934e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.683306 Oct 18 13:40:26.123624 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1923/3888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:26.139410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.144256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:26.170711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.173260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.178882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.179726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.182643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.183899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.268787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:26.393157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Calling method '.version_select at 0x7fb3303a95e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.405150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.405918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.407014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.407954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.408605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.409224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.451880 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1625615-26c8-43a5-8e27-3950dfd10f24 tempest-AbsoluteLimitsTestJSON-279536199 tempest-AbsoluteLimitsTestJSON-279536199-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.358389 Oct 18 13:40:26.451880 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1966/3889] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:26.463249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.464579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:26.476138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.477548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.478447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.479394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.480682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.481929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.858745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.872944 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc659e99-1e7a-458b-a808-f0dcdf465c50 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1510 microversion: 2.1 time: 0.422344 Oct 18 13:40:26.890944 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1967/3890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:26.892810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:26.897730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.898827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:26.908205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.909013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.912234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.913276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.913955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.914571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.983146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.000066 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-029f41dc-01f0-42f3-979f-80109827bd25 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.873694 Oct 18 13:40:27.002071 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1924/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.031297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.034785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:27.051935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.057426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.060870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.061944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.062548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.064707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.305866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.316145 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ec4bcb1-28b9-41bf-b44b-b7eb01420c4f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1512 microversion: 2.1 time: 0.312690 Oct 18 13:40:27.319637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1925/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.325095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.326021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:27.333144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.338682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.338682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.338682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.338682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.338682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.414407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.424526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a48d58d-cb7e-4a72-a8c1-426e4102e7f5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.532388 Oct 18 13:40:27.425409 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1968/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.460970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.461604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:27.469329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.470043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.471618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.472576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.473226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.473665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.548885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.571517 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36bd9f94-2846-4b29-9bb2-78548aad4039 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.248736 Oct 18 13:40:27.593099 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1926/3894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.939933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.948410 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da2fd84d-9086-4508-9b61-926e5591cbb9 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1511 microversion: 2.1 time: 0.521798 Oct 18 13:40:27.949080 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1969/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.971039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.976196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.977081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:27.979277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:27.986209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.986717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.987172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.987913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.988381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.989003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.034327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.035090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.053008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.054191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.054655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.055384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.059029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.059897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.066344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:28.127628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.135570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.136418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.137386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.408952 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95ec5ea5-c8a3-4378-9122-126d8105c2b2 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.441700 Oct 18 13:40:28.409590 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1927/3896] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:28.435379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.440807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.441775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:28.617329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.618126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.619745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.621232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.622638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.624649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.762541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:28.834018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a5a8e4f-689b-46c1-a32b-d29d6ec42877 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.402494 Oct 18 13:40:28.844045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1928/3897] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:28.849251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.850259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.859445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.860005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.860462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.861286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.862951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.863628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.884399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.897305 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21cb4221-4763-4ce6-a069-d792d67aa8aa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.872736 Oct 18 13:40:28.898343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1970/3898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:28.928187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.930820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.943489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.945812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.948134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.950463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.950955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.951403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.088940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.112760 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f35c87f-c87c-4113-b3f6-361c3c58efb0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.267257 Oct 18 13:40:29.115263 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1929/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:29.125669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.140329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.140945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:29.151920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.152764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.153570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.154807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.155856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.157102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.215439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.227487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-601b61b3-9b15-4315-bc23-3464f39d61b7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.315998 Oct 18 13:40:29.230028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1971/3900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:29.239264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cee7434-e6cd-45a3-95b6-5527d9dcf5b0", "tag": "d53dc688-0c70-4124-83b1-8ad07fac5240"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:29.268944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.269826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.270869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.296997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] Creating event network-changed:d53dc688-0c70-4124-83b1-8ad07fac5240 for instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 on n-h2-858383-13 Oct 18 13:40:29.314206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2d11d329-7ff5-4bdd-baf2-93c10cc0d633 req-e03db61b-2a2c-4acd-ab3d-0c031084bc31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078668 Oct 18 13:40:29.319064 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1972/3901] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:29.321691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:29.396109 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3238c95b-dff3-4087-8c5b-d69901ebad08 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.278949 Oct 18 13:40:29.402122 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1930/3902] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:29.409978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.415345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.416106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:29.422226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.422810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.423183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.424106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.424570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.425003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.528953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:29.602719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd6b775f-ed2a-4c7d-ae70-283d983a3793 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.197047 Oct 18 13:40:29.603855 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1973/3903] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:29.617574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.623509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.624223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': '-527380580', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:29.629618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.630223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.630667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.631442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.631930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.632358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.734360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:29.808465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6b540ab-74df-4151-b733-56e4fb9835eb tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-527380580" status: 200 len: 345 microversion: 2.1 time: 0.194498 Oct 18 13:40:29.812817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1931/3904] 10.222.0.27 () {58 vars in 1156 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers?name=-527380580 => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:29.823451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.836283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.836283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:29.840006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.841423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.842750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.843935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.844797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.845571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.922513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.924001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:29.932225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.936909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.937370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.938201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.938603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.939032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.012437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:30.051373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:30.109870 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af0bdb6b-d1ce-49e0-8991-5c541e9ab7b1 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.290890 Oct 18 13:40:30.111135 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1974/3905] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:30.133411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.141143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.142121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-52738058', 'deleted': False, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:40:30.148516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.149650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.150823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.152578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.153244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.153867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.278505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:40:30.388678 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb910cb6-ed7e-487b-b02b-dba6332d77bf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-52738058" status: 200 len: 345 microversion: 2.1 time: 0.269063 Oct 18 13:40:30.401274 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1975/3906] 10.222.0.27 () {58 vars in 1226 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-52738058 => generated 345 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:30.417664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.424200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.437142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.439240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.439703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.440435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.444976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.445542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.481193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.489590 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8c6ee2d-14e0-439e-96e1-d3a7b66c97d5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.571736 Oct 18 13:40:30.494438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1932/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:30.519000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.519636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.530675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.532962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.538823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.539820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.543464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.544371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.690694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.703511 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f75c06e7-4771-4827-9559-0d9de8b92245 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.296406 Oct 18 13:40:30.704524 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1976/3908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:30.722250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.729091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.748264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.748764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.749221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.749939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.750735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.751204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.811761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:30.997221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.006460 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c26de7eb-d247-4d30-899a-3a18782a4ef1 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.509719 Oct 18 13:40:31.007662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1933/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:31.141460 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-68a1d336-9941-4dc6-b341-dd0fb2151986 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 204 len: 0 microversion: 2.1 time: 0.435307 Oct 18 13:40:31.142166 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1977/3910] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:30 2022] DELETE /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:31.151727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.153504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.163491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.165120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.165825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.167565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.168275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.170211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.374161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dfa01a41-68a9-4a13-bc93-e3e7e9b5a33a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.389755 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dfa01a41-68a9-4a13-bc93-e3e7e9b5a33a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.380689 Oct 18 13:40:31.392234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1934/3911] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:31.422360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-837a54d6-5dbe-4503-8615-7953648e5b8a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.437986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.444764 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16363ef9-0ca4-4443-a7b5-b99dde87af58 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1517 microversion: 2.1 time: 0.298477 Oct 18 13:40:31.468211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1978/3912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:31.493996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-837a54d6-5dbe-4503-8615-7953648e5b8a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.087048 Oct 18 13:40:31.494641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1935/3913] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:31.512311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6dafd93-f7d4-4a3e-939c-7c30ce593c6d tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.521774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6dafd93-f7d4-4a3e-939c-7c30ce593c6d tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013822 Oct 18 13:40:31.522404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1979/3914] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:31.526380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.527032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.535174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.535672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.535913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-196607e6-c842-4a95-bfb6-510d7b5b0227 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.536112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.537004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.537456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.538078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.544937 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-196607e6-c842-4a95-bfb6-510d7b5b0227 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013451 Oct 18 13:40:31.547086 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1980/3915] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:31.557519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09438a18-95e8-41f4-8b6b-11e01f99424a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.586628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09438a18-95e8-41f4-8b6b-11e01f99424a tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032729 Oct 18 13:40:31.587542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1981/3916] 10.222.0.27 () {58 vars in 1165 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:31.608189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffe31820-f852-4b7b-8cd9-60ca26274d32 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.612687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffe31820-f852-4b7b-8cd9-60ca26274d32 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012066 Oct 18 13:40:31.613255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1982/3917] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:31.626796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad7e564a-4fab-490a-aa88-b225c3e43b96 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.653166 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad7e564a-4fab-490a-aa88-b225c3e43b96 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.030483 Oct 18 13:40:31.659933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1983/3918] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:31.670248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8524576c-1565-4390-99f8-aa48f6415105 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.687721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8524576c-1565-4390-99f8-aa48f6415105 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021961 Oct 18 13:40:31.698390 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1984/3919] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:31.707689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a4ce100-e852-45bb-a64b-e406aa2bccb8 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.718167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.722444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a4ce100-e852-45bb-a64b-e406aa2bccb8 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022097 Oct 18 13:40:31.723234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1985/3920] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:31.737487 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2358e3f-3b2a-459b-92b0-6773ee8896ab tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.218245 Oct 18 13:40:31.738249 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1936/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:31.740288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.741672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.745365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d7e917e-faf0-4997-823c-d252076308d6 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.752934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.753701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.754477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.755371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.756012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.756647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.796946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d7e917e-faf0-4997-823c-d252076308d6 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.057229 Oct 18 13:40:31.798313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1937/3922] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:31.816805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a5ab48d-5b1f-4730-8820-3f68d056927d tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.832457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a5ab48d-5b1f-4730-8820-3f68d056927d tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021009 Oct 18 13:40:31.833715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1938/3923] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:31.848836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5814576-d287-4ee8-ba73-dced164f493b tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.883534 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5814576-d287-4ee8-ba73-dced164f493b tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041928 Oct 18 13:40:31.894238 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1939/3924] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:31.906941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62825c72-7910-4474-8eaa-c4137a41bcae tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.928008 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62825c72-7910-4474-8eaa-c4137a41bcae tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031939 Oct 18 13:40:31.928590 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1940/3925] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:31.938592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.941610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-09b79a0f-dee3-4274-96bb-240eb684ef8e tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.949754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99f0ab37-e47a-4d64-a063-f24f60daed29 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.212120 Oct 18 13:40:31.952223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1986/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.013385 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-09b79a0f-dee3-4274-96bb-240eb684ef8e tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.075747 Oct 18 13:40:32.017800 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1941/3927] 10.222.0.27 () {58 vars in 1148 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.031855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85946266-fdce-4c74-b313-6b05b79d139e tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.036510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.037162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:32.050912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.051419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.054398 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85946266-fdce-4c74-b313-6b05b79d139e tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026338 Oct 18 13:40:32.054933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.062342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.062342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.062941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1987/3928] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:32.063034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.072579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7df177aa-c2d6-4a1a-a7b7-8a5c523cd519 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.096015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7df177aa-c2d6-4a1a-a7b7-8a5c523cd519 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029856 Oct 18 13:40:32.097011 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1988/3929] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:32.112413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "name": "network-vif-plugged", "status": "completed", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:32.126852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.126852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.126852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.151352 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] Creating event network-vif-plugged:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:40:32.162924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-eef778f2-be09-4d3d-b018-a26a9fdd932b req-5afbd6f7-93ed-4818-a860-f194de014797 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055053 Oct 18 13:40:32.163595 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1989/3930] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:32.172973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e72b717-0cc1-411a-b484-67a5ad58ea06 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.212603 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e72b717-0cc1-411a-b484-67a5ad58ea06 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.047750 Oct 18 13:40:32.213569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1990/3931] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.227880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-830f8358-2ea1-4d58-91c2-1aadd4431d98 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.285911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-830f8358-2ea1-4d58-91c2-1aadd4431d98 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062723 Oct 18 13:40:32.286555 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1991/3932] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:32.290124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:32.300493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18f1397b-df13-4bbc-987b-43e9001f47cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.272354 Oct 18 13:40:32.301754 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1942/3933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.316240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-903b962d-6856-43e8-80bf-96c0e1d1c4c9 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.343650 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-903b962d-6856-43e8-80bf-96c0e1d1c4c9 tempest-FlavorsV2TestJSON-484935072 tempest-FlavorsV2TestJSON-484935072-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031190 Oct 18 13:40:32.350532 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1992/3934] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:32.469483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.470461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:32.481776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.483626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.485544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.487467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.490413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.491096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.765047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.765936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:32.773645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.776308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.778793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.779907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.781046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.781799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.785976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:32.797837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-602924e2-2d74-4bf5-9177-4a89eb25989c tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1517 microversion: 2.1 time: 0.332711 Oct 18 13:40:32.798702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1943/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1517 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.988213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.989268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:32.996656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.997920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.998643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.999588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.000299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.000958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.161668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.178309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f72c05b-9bfb-4b44-bf46-bf7b0ffebcd1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1515 microversion: 2.1 time: 0.414499 Oct 18 13:40:33.178309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1993/3936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:33.288056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.302416 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3640211-81e3-46b1-a8d5-bdde27fe487f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.327012 Oct 18 13:40:33.314542 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1944/3937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:33.326785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:33.327399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:33.334035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.334665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.335168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.341191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.341191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.341191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.639617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.651256 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-025a7005-f2d1-4cb3-8ed9-c87f415addc2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1323 microversion: 2.1 time: 0.328618 Oct 18 13:40:33.653490 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1994/3938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:33 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:33.821209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:33.822402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:33.834490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.838827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.840491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.841535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.847645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.848460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.920393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff779d2-1613-4129-9878-63f7e3be3d81", "name": "network-vif-deleted", "tag": "4e572084-f6cf-4451-b384-fc3e179c2a49"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:33.944095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.946492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.947229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.983589 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] Creating event network-vif-deleted:4e572084-f6cf-4451-b384-fc3e179c2a49 for instance cff779d2-1613-4129-9878-63f7e3be3d81 on n-h1-858383-13 Oct 18 13:40:33.995622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0acc5fd0-9eb3-40f3-b08b-7a59264943db req-4f461894-549a-4290-bee9-5760ed88c0e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077813 Oct 18 13:40:33.996984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1995/3939] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:34.069876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:34.083232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d678272d-01c9-4897-af70-4ded5594019d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1475 microversion: 2.1 time: 0.266332 Oct 18 13:40:34.085555 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1945/3940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:33 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:34.203536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:34.204329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.248152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.249664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.252124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.255558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.267890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.269068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.327829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:34.329276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.349073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.349073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.349073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.352033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.352811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.354422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.419406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:34.640043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:34.649724 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c927e895-7cc7-4cfd-9390-ff1ce32f04bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.326764 Oct 18 13:40:34.652513 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1946/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:34 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:34.689830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:34.691882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.703594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.705101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.706588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.709457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.711677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.714008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.819800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:34.834091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c8265a7e-efb6-4599-b401-74a073a73b6b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1521 microversion: 2.1 time: 0.638108 Oct 18 13:40:34.835293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1996/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:34 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1521 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:34.930573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:34.933895 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a67c256-29c7-4f86-a87f-0163da365f45 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1517 microversion: 2.1 time: 0.261223 Oct 18 13:40:34.934772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1947/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:34 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:34.957668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:34.960293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.968699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.970300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.970944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.971668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.972140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.972573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.006289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lazy-loading 'flavor' on Instance uuid a607bca9-db45-483e-a324-dd964f785966 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:35.112529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.113285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.132201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.132745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.138804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.145493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.146420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.147083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.254402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.254955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.255412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.258215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lazy-loading 'fault' on Instance uuid cff779d2-1613-4129-9878-63f7e3be3d81 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:35.342795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.363904 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39001494-6a6f-4eef-a120-15e7b32d8fd4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 200 len: 1311 microversion: 2.1 time: 0.258967 Oct 18 13:40:35.367277 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1948/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:35.458767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ac35140-b6c1-478b-8d01-9c13f327d7db tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action" status: 200 len: 32 microversion: 2.1 time: 0.505123 Oct 18 13:40:35.459822 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1997/3945] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:40:34 2022] POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:40:35.478170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.479152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.497139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.498472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.500591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.502271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.503976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.506111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.681330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.682392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.696292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.699248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.701464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.703954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.706215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.707281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.879864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.889632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1a755e8-daa5-4445-9d65-400860b92a72 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.418388 Oct 18 13:40:35.891441 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1949/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:35.911630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.912330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.923678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.924187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.924640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.925355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.925819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.926288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.326531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:36.345305 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fecf2f89-8bd2-4544-90bc-f3fb362a22a6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1521 microversion: 2.1 time: 0.451289 Oct 18 13:40:36.363410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1950/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:36.389273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.390246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cff779d2-1613-4129-9878-63f7e3be3d81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:36.401249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:36.403643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.404198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=18 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:36.405066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.405872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.407421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.408070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.408682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.428980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] HTTP exception thrown: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Request method failure captured: Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 HTTP/1.1 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyEka3PDWK1nrPS_-00H9Qz3y7tDpwgw4Ov87iI1yZVCf6fuHGd6FM_g75KuaWsmoxalFTuTdjSwqLdUfGVACDjJnxoE0oObKbCIc0gJUXlvYFHQ8TMZ0zh0jwYnkgkf-yc4l_S3cLQhhcYp6fi0x8BY1OtYOufH5bY_lYDsZqHwdQ Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2ff557eb6afe4b29bbccd87ffdbe21c0 Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'cff779d2-1613-4129-9878-63f7e3be3d81'} Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:36.431563 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. Oct 18 13:40:36.438506 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:36.440458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Returning 404 to user: Instance cff779d2-1613-4129-9878-63f7e3be3d81 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:36.441588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a24ad05-fa59-4bdf-8dad-7b68d126be46 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81" status: 404 len: 111 microversion: 2.1 time: 0.056522 Oct 18 13:40:36.442736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1951/3948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:36 2022] GET /compute/v2.1/servers/cff779d2-1613-4129-9878-63f7e3be3d81 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:36.452122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.452902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:36.461516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.462356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.463073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.464082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.466257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.466956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.512731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:36.663012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:36.670998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bba4da8-e4d5-43f3-91a6-e03542929e33 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.994897 Oct 18 13:40:36.671595 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1998/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:36.892469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cee7434-e6cd-45a3-95b6-5527d9dcf5b0", "name": "network-vif-plugged", "status": "completed", "tag": "d53dc688-0c70-4124-83b1-8ad07fac5240"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:36.909511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-09cda702-4a61-4aea-990b-d6235ecdb7c0 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 204 len: 0 microversion: 2.1 time: 0.462194 Oct 18 13:40:36.910588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1952/3950] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:36 2022] DELETE /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:40:36.919950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.920933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.921974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.923144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.926202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:36.947607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.957647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.957647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.957647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.957647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.957647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.959800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] Creating event network-vif-plugged:d53dc688-0c70-4124-83b1-8ad07fac5240 for instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 on n-h2-858383-13 Oct 18 13:40:36.983813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-781586d5-87e6-4687-9053-1c90330c417b req-57c1b85d-24ca-48de-99af-0f8db91ee89f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085966 Oct 18 13:40:36.985060 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1999/3951] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:36.998584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.999307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.006217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.006981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.007627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.008552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.009186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.010146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.158975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.167985 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ae8caec-5c6d-4d1d-b671-98c0cd34a12f tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.255651 Oct 18 13:40:37.169891 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1953/3952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:36 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:37.288294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.298792 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b269316-ad88-45db-bfef-1b6cb9eb442d tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1518 microversion: 2.1 time: 0.312161 Oct 18 13:40:37.299561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2000/3953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:36 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:37.388691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:37.389524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.400408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.401102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.401559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.407384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.409101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.409595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.698299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:37.699555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.702985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:37.715877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.716378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.723517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.723517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.723517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.723517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.751889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:37.898885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.916008 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e313559b-f981-4704-9a4d-86c24e9295da tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1521 microversion: 2.1 time: 0.531656 Oct 18 13:40:37.935961 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1954/3954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:37 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:38.075684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:38.085517 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cba3418-eb7a-4673-bba7-e53faab8ff02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.391202 Oct 18 13:40:38.099879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2001/3955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:37 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:38.194838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:38.195467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:38.201524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:38.216616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.217393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.218028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.220748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.220748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.220748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.328376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:38.329342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:38.338148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.338987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.340974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.341908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.342770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.343578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.564220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:38.572633 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0825029-7c8d-47bd-bdd8-de51b891441f tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1518 microversion: 2.1 time: 0.251613 Oct 18 13:40:38.573380 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2002/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:38 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:38.943971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:38.945338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:38.954961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.955459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.955903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.956615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.957077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.957514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.151602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.163135 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59f90d22-e186-4bfd-ba26-cfd0cef8007e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1521 microversion: 2.1 time: 0.222283 Oct 18 13:40:39.175890 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2003/3957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:38 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:39.186995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fdc5c2-7df8-4bcf-91c0-3683404de72e", "name": "network-vif-plugged", "status": "completed", "tag": "7c52f4cb-0d23-4662-bac9-bc5b4380f140"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:39.199728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.200581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.201263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.215810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] Creating event network-vif-plugged:7c52f4cb-0d23-4662-bac9-bc5b4380f140 for instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e on n-h2-858383-13 Oct 18 13:40:39.221977 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-275f0298-cb32-4c02-be26-e0039908c939 req-0845331b-1645-4289-b455-e6f12d82f832 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044461 Oct 18 13:40:39.223127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2004/3958] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:39.228115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.231007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:39.232562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:39.241031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.242002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.242763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.243797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.244523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.245485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.254230 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34d0309b-4c38-42d8-a6e9-5e87a5f5f117 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 1.060220 Oct 18 13:40:39.273349 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1955/3959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:38 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:39.599258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:39.599949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:39.612617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.615612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.617054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.619612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.622087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.622836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.686266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.692806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:39.711963 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17f7e0cf-b9cc-434e-9f1a-4d71078cc05a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1321 microversion: 2.1 time: 0.486069 Oct 18 13:40:39.717870 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2005/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:39 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:40.115606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:40.132940 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68554ea0-12aa-4c87-8be6-1a4bd371a915 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1518 microversion: 2.1 time: 0.537751 Oct 18 13:40:40.136282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1956/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:39 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1518 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:40.192282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:40.194530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:40.203304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:40.206451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.207223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.208461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.210409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.215979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.215979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.282187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:40.283771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:40.291318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.297320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.300782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.301910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.302787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.303644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.732520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:40.741819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59adb150-7580-46bc-87f3-f8184b995b8d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1521 microversion: 2.1 time: 0.554362 Oct 18 13:40:40.749580 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2006/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:40 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:40.756595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:40.758727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:40.781702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.901241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:40.918919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-00f2d3a2-47ae-4a78-a82c-1c3f9b756b25 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.633893 Oct 18 13:40:40.920375 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1957/3963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:40 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:41.020024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38771dde-43c4-4fd2-a976-7539af0c6fb6", "name": "network-vif-deleted", "tag": "848f3662-3a79-4c9b-814d-ede1c279482f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:41.053509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.057097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.057580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.090352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] Creating event network-vif-deleted:848f3662-3a79-4c9b-814d-ede1c279482f for instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 on n-h2-858383-13 Oct 18 13:40:41.107721 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0de98ab5-c9a7-4c22-a02d-b0c4ce4ba0db req-8f3a3b0e-1c67-4a8a-94db-8c01c0f9b5d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104182 Oct 18 13:40:41.111391 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1958/3964] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:41.149106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.161108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:41.161108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.169879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f82a0645-cb5c-44e9-853f-e99e6a389a03 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1503 microversion: 2.1 time: 0.412879 Oct 18 13:40:41.172986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2007/3965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:40 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:41.173589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.174315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.174768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.175491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.176140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.176578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.201744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:41.202349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.225047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.225697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.226005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.226759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.227225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.227661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.405794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.415403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-297ddf2b-b91e-4d1c-bbe6-e79dadf9aeb4 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1476 microversion: 2.1 time: 0.261397 Oct 18 13:40:41.416683 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1959/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:41 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:41.566330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.584208 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efbb2b90-8bbc-4dc2-af32-193078f5957c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1503 microversion: 2.1 time: 0.385402 Oct 18 13:40:41.584208 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2008/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:41 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:41.609453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:41.609962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.624580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.625092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.625734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.626654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.627413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.628023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.676142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:41.772920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:41.773755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.793077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.793077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.793077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.794931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.810872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.811407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.880793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:42.124224 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-807d3abb-d3a9-4dc0-bbd0-051076c1e3de tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 204 len: 0 microversion: 2.1 time: 0.518299 Oct 18 13:40:42.125430 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1960/3968] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:41 2022] DELETE /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:42.132662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.133763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.143660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.144631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.145319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.146383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.147106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.147748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.517857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.532418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d54a30c8-260f-4658-9769-b55699920cf2 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.405084 Oct 18 13:40:42.533800 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1961/3969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:42.539122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.539814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.549326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.550272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.550481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.551547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.552015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.552450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.603992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.614114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40a81f3c-672c-4b82-a84c-b83ea6387cb5 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1506 microversion: 2.1 time: 0.845892 Oct 18 13:40:42.614711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2009/3970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:41 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:42.619459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.633980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.668458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.668952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.669435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.670155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lazy-loading 'fault' on Instance uuid 38771dde-43c4-4fd2-a976-7539af0c6fb6 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:42.718477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.733328 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-501f35cd-04ba-419b-a9a0-2bc3ee1fbdca tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 200 len: 1311 microversion: 2.1 time: 0.116711 Oct 18 13:40:42.746755 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2010/3971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:42.755490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.756132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.764001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.764507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.765376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.767468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.767468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.767468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.241974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.254535 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ed96dcd1-0e10-4ae9-bfbc-8cdab08d878a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1509 microversion: 2.1 time: 0.718995 Oct 18 13:40:43.255145 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1962/3972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:43.492760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.502096 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-263c3415-0765-44e2-b1d0-1d9f244ca28b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 200 len: 1506 microversion: 2.1 time: 0.754178 Oct 18 13:40:43.502625 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2011/3973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:43.538590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:43.539917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:43.549469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.550402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.552667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.557334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:43.558548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.562882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:43.563054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.563054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.566969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.575224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.575942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.576881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.577588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.578258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.607392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:43.953827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.966668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0f1c191-fc6c-4860-837d-cce2e6938487 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.411054 Oct 18 13:40:43.967533 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2012/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:43 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:44.064302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a5b8ce0-8a6b-4171-9748-9c30a49c4ac9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 204 len: 0 microversion: 2.1 time: 0.528213 Oct 18 13:40:44.064302 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1963/3975] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:43 2022] DELETE /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:44.071125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.071902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: 38771dde-43c4-4fd2-a976-7539af0c6fb6] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:44.087833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.088256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.092832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.092832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.092832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.093675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.131718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] HTTP exception thrown: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Request method failure captured: Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 HTTP/1.1 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyEka3PDWK1nrPS_-00H9Qz3y7tDpwgw4Ov87iI1yZVCf6fuHGd6FM_g75KuaWsmoxalFTuTdjSwqLdUfGVACDjJnxoE0oObKbCIc0gJUXlvYFHQ8TMZ0zh0jwYnkgkf-yc4l_S3cLQhhcYp6fi0x8BY1OtYOufH5bY_lYDsZqHwdQ Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 2ff557eb6afe4b29bbccd87ffdbe21c0 Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '38771dde-43c4-4fd2-a976-7539af0c6fb6'} Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:44.135508 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Returning 404 to user: Instance 38771dde-43c4-4fd2-a976-7539af0c6fb6 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42967371-6ca1-4522-bf08-09ee61664462 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6" status: 404 len: 111 microversion: 2.1 time: 0.073452 Oct 18 13:40:44.144509 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1964/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:44 2022] GET /compute/v2.1/servers/38771dde-43c4-4fd2-a976-7539af0c6fb6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:44.150410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.151101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:44.158339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.158982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.160114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.160494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.161297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.161946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.193019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:44.229031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Calling method '.version_select at 0x7fb3317eae50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.346752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:40:44.348330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Neutron security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:40:44.349788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] HTTP exception thrown: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.349788 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Request method failure captured: Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/f0d697b3-5afd-466f-80ef-5d0c94b8a574 HTTP/1.1 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqzbHKFzWsbqfz5Q_9PFfqcVBuLn9wdWAA2vqqjSBN7ieX9IGY8F7GGoDAHPI_ngMdvNYYHEYiwP8IplfVuiOJm1amMpnyMhEpmSkbXuO599esNPAXSjwKJBCvFiP6VsBgmzCMD9R3UJo67mqRAhPefZw_sOVvOIgKKPoyGwS0_WBf4 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ed69f78553214ef388d5489123297357 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'f0d697b3-5afd-466f-80ef-5d0c94b8a574'} Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:40:44.357096 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] Oct 18 13:40:44.364851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:44.372044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Returning 404 to user: Security group f0d697b3-5afd-466f-80ef-5d0c94b8a574 does not exist Oct 18 13:40:44.372044 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-0944c25b-a1cf-44c0-82a3-d480538425df'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:44.373472 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa248859-6ff0-4a6b-b9ea-378fd8d69529 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f0d697b3-5afd-466f-80ef-5d0c94b8a574" status: 404 len: 194 microversion: 2.1 time: 0.389087 Oct 18 13:40:44.374253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2013/3977] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:40:43 2022] DELETE /compute/v2.1/os-security-groups/f0d697b3-5afd-466f-80ef-5d0c94b8a574 => generated 194 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:44.380537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.381206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:44.393270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.394593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.402110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.402110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.402110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.402110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.560668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:44.563450 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32884ae9-f8e1-4107-9908-4b31d1507572 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 204 len: 0 microversion: 2.1 time: 0.419064 Oct 18 13:40:44.567025 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1965/3978] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:44 2022] DELETE /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:44.569784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1344022453", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6ab1dcbf-57e1-4423-b0e5-94b7286e99dd"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:44.576041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26394d57-0c2b-447e-bb87-3b60687679fb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1467 microversion: 2.1 time: 0.200403 Oct 18 13:40:44.581690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2014/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:44 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:44.587644 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6ddac61-08f3-4ddf-8c57-2994b50736f3 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004048 Oct 18 13:40:44.592777 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2015/3980] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 18 13:40:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:40:44.603849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cee7434-e6cd-45a3-95b6-5527d9dcf5b0", "name": "network-vif-deleted", "tag": "d53dc688-0c70-4124-83b1-8ad07fac5240"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:44.658615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.659117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.661783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.680971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] validate_networks() for [('6ab1dcbf-57e1-4423-b0e5-94b7286e99dd', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:44.687800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] Creating event network-vif-deleted:d53dc688-0c70-4124-83b1-8ad07fac5240 for instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 on n-h2-858383-13 Oct 18 13:40:44.699027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4bdd3b1f-0f77-4402-a9f2-ce8187a5b7f5 req-4172ebf2-b071-4202-a4ad-b840bbf40658 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099967 Oct 18 13:40:44.701603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2016/3981] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:44.713061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.715242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:44.728726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.735048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.738423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.738423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.738423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.738423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.022339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:45.038504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6a4e9e9-2f8c-4463-baec-e37b49f7eaaf tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1516 microversion: 2.1 time: 0.332528 Oct 18 13:40:45.040313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2017/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:44 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:45.051353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc680bda-b15b-4370-b047-a9fdc668c3bc tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Calling method '.version_select at 0x7fb3315edd30>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:45.475016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:45.475648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:45.476291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:45.476909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:45.477485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:45.498966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.514300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.514300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.514300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.514300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.514300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.522797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:45.528816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for user f278334f3cd646a89ec99502f0bfe636 and project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:45.544699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:45.548275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:45.730926 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa227e7b-0c16-4da8-a776-19883e0a73fb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163148 Oct 18 13:40:45.731713 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1966/3983] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:40:45.744905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:45.746975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:45.771765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.772464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.775482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.776259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.778565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.780290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.027184 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc680bda-b15b-4370-b047-a9fdc668c3bc tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.984217 Oct 18 13:40:46.028483 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2018/3984] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:40:45 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:46.036803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.037657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:46.058919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.060693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.062956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.063927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.065872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.067191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.175144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.183470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec758620-63f7-4859-8bef-5a7739622171 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.450318 Oct 18 13:40:46.199285 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1967/3985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:45 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:46.204597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8adf1626-c48f-456f-a811-59592c4848d4 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.205432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8adf1626-c48f-456f-a811-59592c4848d4 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:46.206932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.220262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5016b221-18f4-480d-8dba-2eb9d875c7dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1306 microversion: 2.1 time: 0.189360 Oct 18 13:40:46.220854 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2019/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:46.260721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Calling method '.version_select at 0x7fb331688e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.325052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8adf1626-c48f-456f-a811-59592c4848d4 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8adf1626-c48f-456f-a811-59592c4848d4 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1218 microversion: 2.1 time: 0.134460 Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1968/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.349350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.350034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.353386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.363188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.363776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Request method failure captured: Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-security-groups/cd2251f8-dd55-4aa0-abe8-551edbe2d4fb HTTP/1.1 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqzbHKFzWsbqfz5Q_9PFfqcVBuLn9wdWAA2vqqjSBN7ieX9IGY8F7GGoDAHPI_ngMdvNYYHEYiwP8IplfVuiOJm1amMpnyMhEpmSkbXuO599esNPAXSjwKJBCvFiP6VsBgmzCMD9R3UJo67mqRAhPefZw_sOVvOIgKKPoyGwS0_WBf4 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ed69f78553214ef388d5489123297357 Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: exception: Insufficient rights for removing default security group. Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'cd2251f8-dd55-4aa0-abe8-551edbe2d4fb'} Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.584384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-93b416ba-f584-4396-9844-e06eec5b5d5a'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1b37c2a-6e57-4d07-8f47-3df8f2c00ac8 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cd2251f8-dd55-4aa0-abe8-551edbe2d4fb" status: 400 len: 182 microversion: 2.1 time: 0.361734 Oct 18 13:40:46.589037 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2020/3988] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:40:46 2022] DELETE /compute/v2.1/os-security-groups/cd2251f8-dd55-4aa0-abe8-551edbe2d4fb => generated 182 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:40:46.604182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Calling method '.version_select at 0x7fb330bdf310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.608317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.617328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b358c6c2-e97c-49c9-b7bf-e5135ca90284 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1516 microversion: 2.1 time: 0.280445 Oct 18 13:40:46.634569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1969/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG neutronclient.v2_0.client [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist", "detail": ""}} {{(pid=121010) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Neutron security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 not found {{(pid=121010) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] HTTP exception thrown: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Request method failure captured: Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-security-groups/1614a6f4-bde0-4d33-9f39-e98d6f5b3239 HTTP/1.1 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqzbHKFzWsbqfz5Q_9PFfqcVBuLn9wdWAA2vqqjSBN7ieX9IGY8F7GGoDAHPI_ngMdvNYYHEYiwP8IplfVuiOJm1amMpnyMhEpmSkbXuO599esNPAXSjwKJBCvFiP6VsBgmzCMD9R3UJo67mqRAhPefZw_sOVvOIgKKPoyGwS0_WBf4 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: ed69f78553214ef388d5489123297357 Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: exception: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '1614a6f4-bde0-4d33-9f39-e98d6f5b3239'} Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.698923 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Returning 404 to user: Security group 1614a6f4-bde0-4d33-9f39-e98d6f5b3239 does not exist Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: Neutron server returns request_ids: ['req-18a43736-3152-4c1f-9a01-c8f4c26dba2e'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:46.704213 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5c6aa9a-9511-4d41-811c-915492e30299 tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/1614a6f4-bde0-4d33-9f39-e98d6f5b3239" status: 404 len: 194 microversion: 2.1 time: 0.101946 Oct 18 13:40:46.708585 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2021/3990] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/os-security-groups/1614a6f4-bde0-4d33-9f39-e98d6f5b3239 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:46.711057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Action: 'update', calling method: .version_select at 0x7fb330873ca0>, body: {"security_group": {"name": "tempest-sg-1820905173", "description": "tempest-description-2082414310"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:46.842620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG neutronclient.v2_0.client [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist", "detail": ""}} {{(pid=121009) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:40:46.844157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.security_group_api [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Neutron security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 not found {{(pid=121009) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:40:46.844868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] HTTP exception thrown: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.844868 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Request method failure captured: Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/os-security-groups/d26ef868-48d3-4af4-8d10-6b8e8d88a705 HTTP/1.1 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 102 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqzbHKFzWsbqfz5Q_9PFfqcVBuLn9wdWAA2vqqjSBN7ieX9IGY8F7GGoDAHPI_ngMdvNYYHEYiwP8IplfVuiOJm1amMpnyMhEpmSkbXuO599esNPAXSjwKJBCvFiP6VsBgmzCMD9R3UJo67mqRAhPefZw_sOVvOIgKKPoyGwS0_WBf4 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f306cab2d79640c4be438bbf95cf421f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: f306cab2d79640c4be438bbf95cf421f Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ed69f78553214ef388d5489123297357 Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1893052753-project Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: {"security_group": {"name": "tempest-sg-1820905173", "description": "tempest-description-2082414310"}} Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: exception: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd26ef868-48d3-4af4-8d10-6b8e8d88a705', 'body': {'security_group': {'name': 'tempest-sg-1820905173', 'description': 'tempest-description-2082414310'}}} Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:40:46.847794 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] Oct 18 13:40:46.852843 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:40:46.857882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] Returning 404 to user: Security group d26ef868-48d3-4af4-8d10-6b8e8d88a705 does not exist Oct 18 13:40:46.857882 n-d-858383-13 devstack@n-api.service[121009]: Neutron server returns request_ids: ['req-8d186cc4-42b0-47e3-86ac-9ff54a9f8346'] {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:46.865039 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c423e18-7b81-499b-aa40-72405d340ede tempest-SecurityGroupsNegativeTestJSON-1893052753 tempest-SecurityGroupsNegativeTestJSON-1893052753-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/d26ef868-48d3-4af4-8d10-6b8e8d88a705" status: 404 len: 194 microversion: 2.1 time: 0.153329 Oct 18 13:40:46.865039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1970/3991] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Oct 18 13:40:46 2022] PUT /compute/v2.1/os-security-groups/d26ef868-48d3-4af4-8d10-6b8e8d88a705 => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:47.206230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:47.206869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:47.218751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.219266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.219744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.220444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.221022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.221324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.272745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:47.273437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:47.302590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.305603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.307528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.308332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.311451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.311931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.382678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.383682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.384155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.384710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:47.498002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:47.512038 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e5e0684-76f9-483a-a0b9-c687982906f4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 200 len: 1311 microversion: 2.1 time: 0.265038 Oct 18 13:40:47.527174 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1971/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:47 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:47.544076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:47.544710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:47.556324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.567173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.567173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.567173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.567173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.567173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.763784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:47.781965 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-650cf8c4-0698-41c0-bb86-cc68b673c263 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1214 microversion: 2.1 time: 0.252284 Oct 18 13:40:47.786284 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1972/3993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:47 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:47.800713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:47.801375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:47.816690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.817921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.818559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.824646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.825459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.826309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.938903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:47.950467 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea988223-4012-4c40-b4bf-dda61f7d611a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.745505 Oct 18 13:40:47.955661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2022/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:47 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:48.541407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:48.543619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:48.556443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.558039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.573565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.573565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.573565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.573565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.633156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 HTTP/1.1 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3cee7434-e6cd-45a3-95b6-5527d9dcf5b0'} Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:48.639951 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:40:48.645945 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:48.649313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:48.650638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5922174-7fc1-48e9-a1ae-758b196863ee tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 404 len: 111 microversion: 2.1 time: 0.114819 Oct 18 13:40:48.652973 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2023/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:48 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:48.682919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa3f41c0-a083-499d-8555-809951c022dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: .version_select at 0x7fb3318073a0>, body: {"keypair": {"name": "tempest-key-1515845812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKBENIkAc7jeU4stPppJntKAw4GrEUeZrLeyi5wY8xA9iB7mr9C6dcn8FTevYQAFOUq2wJLMI0AlfTWM97Cws8PlLILgh0y50XnhHb17BMscQyu+KPdUxWaCDkTZY3eWA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:48.714649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-aa3f41c0-a083-499d-8555-809951c022dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:48.721123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-aa3f41c0-a083-499d-8555-809951c022dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:48.909482 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa3f41c0-a083-499d-8555-809951c022dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.238084 Oct 18 13:40:48.910827 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2024/3996] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:40:48 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:48.918580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:48.920410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:48.941063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.942424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.943375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.947755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.950936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.951588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.012269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.024742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-371ef91d-7ea5-4f68-8769-f60de939edb5 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1516 microversion: 2.1 time: 1.235697 Oct 18 13:40:49.025656 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1973/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:47 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1516 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:49.048537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5402fdce-41e6-4d0c-8371-a1e606c615fa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '.version_select at 0x7fb3312a59d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:49.053831 n-d-858383-13 devstack@n-api.service[121009]: WARNING oslo_db.sqlalchemy.utils [None req-5402fdce-41e6-4d0c-8371-a1e606c615fa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:40:49.059848 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5402fdce-41e6-4d0c-8371-a1e606c615fa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015862 Oct 18 13:40:49.060426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1974/3998] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:40:49 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:49.071189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.074881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:49.087955 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7738596c-3b9f-4f6a-b473-86503add7c0d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1270 microversion: 2.1 time: 0.175668 Oct 18 13:40:49.092603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:49.101400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:49.106227 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2025/3999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:48 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:49.124747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.127486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.128504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.144753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.145592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.146298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.339966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1709186165", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-key-1515845812", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:49.421737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:49.704248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.719597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d410aef8-4e47-407d-acae-a35756772008 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.646564 Oct 18 13:40:49.734708 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1975/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:49 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:49.744678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2fdc5c2-7df8-4bcf-91c0-3683404de72e", "name": "network-vif-deleted", "tag": "7c52f4cb-0d23-4662-bac9-bc5b4380f140"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:49.778914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.778914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.778914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.809745 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] Creating event network-vif-deleted:7c52f4cb-0d23-4662-bac9-bc5b4380f140 for instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e on n-h2-858383-13 Oct 18 13:40:49.819716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a31ec264-8813-4e6f-9802-12f65ea72750 req-f2fcaa6a-8ea7-4aa2-a040-89265051895e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083330 Oct 18 13:40:49.827251 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1976/4001] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:49.941930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc25535-4722-4de8-b667-8abfdcc81463", "name": "network-vif-deleted", "tag": "99b85a6b-25ce-4c9d-9d87-eece2ecade94"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:49.963679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.973614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.974110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.008070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] Creating event network-vif-deleted:99b85a6b-25ce-4c9d-9d87-eece2ecade94 for instance cbc25535-4722-4de8-b667-8abfdcc81463 on n-h2-858383-13 Oct 18 13:40:50.030471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a39b84a0-217f-41e7-898a-ec0c5e49d5f9 req-e94d688a-5e43-4747-b078-6ba87a9fc407 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089676 Oct 18 13:40:50.033779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1977/4002] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:50.061681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:50.062479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:50.094146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.096467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.099683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.103244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.107733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.108716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.314173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:50.322456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdc480f2-8094-4b86-b2ba-1269990c957b tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1474 microversion: 2.1 time: 0.276791 Oct 18 13:40:50.331219 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1978/4003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:50 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:50.351076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:50.355105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:50.358627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.359338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.359948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.360819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.361441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.362034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.389337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:50.503769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:50.511494 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d04d4a89-633a-4270-acae-0905e53f6c3d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1276 microversion: 2.1 time: 0.164125 Oct 18 13:40:50.512084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1979/4004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:50 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:50.748532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:50.749151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:50.765493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.765493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.765493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.765493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.765493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.766650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.209083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:51.209555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:51.209999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:51.210673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:51.211101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:51.219724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.225956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.226696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.227151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.227902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.228375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.229346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.231474 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9654072a-d4f7-4240-91cc-ed2efe8e05e4 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.487051 Oct 18 13:40:51.261163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1980/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:50 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:51.266179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:51.278187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:51.293783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:51.301464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:51.355541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:51.356549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:51.361475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:51.369282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.370166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.371274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.373201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.374990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.378419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.475858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.476355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.477026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.477490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lazy-loading 'fault' on Instance uuid cbc25535-4722-4de8-b667-8abfdcc81463 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:51.545837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-400ce181-cc98-4d95-8abd-211295159d79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211726 Oct 18 13:40:51.551559 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2026/4006] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:40:51.570854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:51.573216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:51.593322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.595087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.595760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.596728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.598987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.599703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.719348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff557eb6afe4b29bbccd87ffdbe21c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.730747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10c1f3b8-ab46-49ba-be39-9dae698bd427 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 200 len: 1310 microversion: 2.1 time: 0.380871 Oct 18 13:40:51.738008 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1981/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:51 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 1310 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:51.753884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b238dfea-900c-4487-bdcb-d969e24739a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:51.758585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b238dfea-900c-4487-bdcb-d969e24739a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:51.938673 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:40:51.939013 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 13:40:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 (ip 10.222.0.27) !!! Oct 18 13:40:52.020078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b238dfea-900c-4487-bdcb-d969e24739a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.029853 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b238dfea-900c-4487-bdcb-d969e24739a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1229 microversion: 2.1 time: 0.290288 Oct 18 13:40:52.030573 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1982/4008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:51 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1229 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:52.147423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.167612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d4f2757-305f-4bc2-9e0b-32160314c483 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.611465 Oct 18 13:40:52.183359 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2027/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:51 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:52.259720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:52.260881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:52.271893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.272602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.273148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.287163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.287163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.287163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.580151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65b6eae4-c76b-49a8-b19e-eac393c3e67c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Action: 'create', calling method: .version_select at 0x7fb3306f75e0>, body: {"keypair": {"name": "tempest-keypair-346283189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfEjpfa2B5iwFrOgJ20Op7DAX/j0hbXUEFsM+I6pXy5yCj5t8murM0klpzl/+N2EoBL+2hOg5WSIcyMEg54L069zQmQpsSYKRQ4NOZIafYinitgnY5NBUzsON115fg/JA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:52.628807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-65b6eae4-c76b-49a8-b19e-eac393c3e67c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for project 8c8666b164a743dea89a8f81a277d186. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:52.639933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-65b6eae4-c76b-49a8-b19e-eac393c3e67c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for user b7c0f8d3344b45e0a73747d85a9f9e0b and project 8c8666b164a743dea89a8f81a277d186. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:52.752631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.763304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2db402ce-aa41-426f-b70e-69d6072f5e3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.507397 Oct 18 13:40:52.765707 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2028/4010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:52 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:52.770152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65b6eae4-c76b-49a8-b19e-eac393c3e67c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.738477 Oct 18 13:40:52.771025 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1983/4011] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:40:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:52.775435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:52.776399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] [instance: cbc25535-4722-4de8-b667-8abfdcc81463] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:52.785450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.790266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.790266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.790266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.792632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.793360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.835489 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] HTTP exception thrown: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Request method failure captured: Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 HTTP/1.1 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyEka3PDWK1nrPS_-00H9Qz3y7tDpwgw4Ov87iI1yZVCf6fuHGd6FM_g75KuaWsmoxalFTuTdjSwqLdUfGVACDjJnxoE0oObKbCIc0gJUXlvYFHQ8TMZ0zh0jwYnkgkf-yc4l_S3cLQhhcYp6fi0x8BY1OtYOufH5bY_lYDsZqHwdQ Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80ef7de41a5a4e3599dbefeadb7cb1fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 80ef7de41a5a4e3599dbefeadb7cb1fa Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1443814396 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2ff557eb6afe4b29bbccd87ffdbe21c0 Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListServerFiltersTestJSON-1443814396-project Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'cbc25535-4722-4de8-b667-8abfdcc81463'} Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:52.837587 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] Returning 404 to user: Instance cbc25535-4722-4de8-b667-8abfdcc81463 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40b94075-3854-437e-af93-a952ec28e441 tempest-ListServerFiltersTestJSON-1443814396 tempest-ListServerFiltersTestJSON-1443814396-project] 10.222.0.27 "GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463" status: 404 len: 111 microversion: 2.1 time: 0.074766 Oct 18 13:40:52.850688 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2029/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:52 2022] GET /compute/v2.1/servers/cbc25535-4722-4de8-b667-8abfdcc81463 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:53.055008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:53.055756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:53.071760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.077600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.082492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.083677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.084626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.086980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.196777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:53.197400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:53.218584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.219102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.221787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.222639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.223127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.223570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.267614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:53.284079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6f6b086-c638-4071-ab52-a0cce8fcb3c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1233 microversion: 2.1 time: 0.232958 Oct 18 13:40:53.300816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1984/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:53 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1233 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:53.627706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:53.637512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c45430c9-80f0-48ea-a13b-bbac3071d621 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.444448 Oct 18 13:40:53.642284 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2030/4014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:53 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:53.796424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:53.797681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:53.810122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.813485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.829472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.829472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.829472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.829472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.308467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:54.309351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:54.319611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.320130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.320629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.321367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.326977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.327765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.419404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:54.436496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa89d0be-5f8e-4b40-adc5-a8037af04b3b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.645585 Oct 18 13:40:54.441593 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1985/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:53 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:54.673768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:54.674444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:54.692685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.695723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.697539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.700279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.700801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.703212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.789699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:54.799908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80c43bb6-55b5-43e7-8e5b-f43d5eb8427c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1281 microversion: 2.1 time: 0.496197 Oct 18 13:40:54.805212 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2031/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:54 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1281 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:54.938592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a775a65-ea2b-480b-8db4-1ebd29670943", "tag": "59be9f50-e295-4ec6-aa92-dfbc4072fe98"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:54.950015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.952722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.953564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.997803 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] Creating event network-changed:59be9f50-e295-4ec6-aa92-dfbc4072fe98 for instance 3a775a65-ea2b-480b-8db4-1ebd29670943 on n-h1-858383-13 Oct 18 13:40:55.009855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-210a05b3-af77-4247-80ea-6ff27762371a req-a9583aba-fcf1-4e2f-b349-b70fc78a2458 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078193 Oct 18 13:40:55.013449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2032/4017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 13:40:55.290403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.306422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ecb8d03c-7f4e-4d29-8fb1-7f9ca7215165 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.642707 Oct 18 13:40:55.307972 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1986/4018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:54 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:55.468884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.469486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:55.524308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.526988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.527469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.528214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.528690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.531888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.839396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.840688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:55.843413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:55.857213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.858701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.859282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.861699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.862369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.870823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.440774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.456443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.468799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f4cc5c9-74bc-44d6-a9f8-4465efa9d992 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1287 microversion: 2.1 time: 0.635677 Oct 18 13:40:56.469426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1987/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:55 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1287 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:56.475240 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-07962446-9ebb-4def-85ef-bf3dce6ac97e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 1.012052 Oct 18 13:40:56.476439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2033/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:55 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:56.493540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:56.494517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.521640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.003096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.044519 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d63a7db-b3e6-4c2e-be72-d3f2bdb5a0fa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.573741 Oct 18 13:40:57.047109 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1988/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:56 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:57.494405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:57.498843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:57.502010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:57.503242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:57.516572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.518181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.518886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.519416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.519707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.520380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.521984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.522631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.524326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.525102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.525627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.526149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.637369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.646709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-462b5257-02ae-45d3-bea8-1dccb11a3eab tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1287 microversion: 2.1 time: 0.157504 Oct 18 13:40:57.647962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2034/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:57 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:58.078247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:58.078880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:58.091052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.091597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.092232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:58.093154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.093888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.094520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:58.161904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:58.173898 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d90fef9-bb90-474e-a6e3-a368eb20d52d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.676330 Oct 18 13:40:58.175280 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1989/4023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:57 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:58.472360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:58.483262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db6328fb-b154-419e-81d4-34e30e431a24 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.410142 Oct 18 13:40:58.484623 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2035/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:58 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:58.670615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:58.671233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:58.678351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.683335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.684090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:58.685043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.685703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.686415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:59.203865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:59.205484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:59.218845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:59.220707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:59.224472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:59.226745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:59.227975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:59.229851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:59.299313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:59.313298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a21e7962-0d08-4839-896e-49ad14465572 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.646190 Oct 18 13:40:59.313727 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1990/4025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:58 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:59.506704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:59.507600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:59.517654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:59.520352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:59.521279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:59.522644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:59.523147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:59.523604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:00.258624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:00.275279 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7df4e189-7d1f-4978-b8a9-b7dbd8a085d7 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 1.074201 Oct 18 13:41:00.281693 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2036/4026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:59 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:00.341376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:00.342560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:00.353952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:00.374029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:00.374907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:00.374907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:00.375891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:00.376375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:00.378842 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6111eee5-aa51-417b-adb6-37c147e01d7d tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.872989 Oct 18 13:41:00.380111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:00.381524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1991/4027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:59 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:01.058763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.069696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37ec8f9c-aec8-4bb6-9892-d52a8b9a545a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.732543 Oct 18 13:41:01.087128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2037/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:00 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:01.215988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-226524775", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e1482607-a7e2-4618-9793-659434d9a08c"}], "security_groups": [{"name": "tempest-securitygroup--105284463"}], "key_name": "tempest-keypair-346283189", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:01.308729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.309738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:01.316547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:01.324222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:01.333638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.336915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.337522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.338314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.338832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.339271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.493898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] validate_networks() for [('e1482607-a7e2-4618-9793-659434d9a08c', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:01.558086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.567669 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b32b6da-c7ab-4ea6-8abb-97569b298b80 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.263639 Oct 18 13:41:01.568592 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2038/4029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:01.586261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1308f5a5-f296-4bc1-86de-10690d38c637", "tag": "f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:01.598738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.599241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.600439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.612810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] Creating event network-changed:f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85 for instance 1308f5a5-f296-4bc1-86de-10690d38c637 on n-h2-858383-13 Oct 18 13:41:01.618482 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-82bca342-98bd-4bae-8cc7-d0f4b26518cb req-35240ae8-af6f-4149-aab5-7fecc7489a64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039181 Oct 18 13:41:01.619099 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2039/4030] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:01.631610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.631610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:01.633958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.634783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.635474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.636388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.637043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.637481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.910602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.923779 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9274e063-eef1-41aa-8a8b-9d2c2d748b28 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.298254 Oct 18 13:41:01.924810 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2040/4031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:02.093250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.094215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.109646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.110354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.110936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.113212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.115942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.117029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.396690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.408090 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c052de52-fb42-4c0d-bac4-cd5af3511653 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.318923 Oct 18 13:41:02.408681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2041/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:02.418074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a775a65-ea2b-480b-8db4-1ebd29670943", "name": "network-vif-plugged", "status": "completed", "tag": "59be9f50-e295-4ec6-aa92-dfbc4072fe98"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:02.431723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:02.441845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.442690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.446641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.475938 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] Creating event network-vif-plugged:59be9f50-e295-4ec6-aa92-dfbc4072fe98 for instance 3a775a65-ea2b-480b-8db4-1ebd29670943 on n-h1-858383-13 Oct 18 13:41:02.481265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f86140cb-95a2-4e20-a4c7-ea4a4e0afb6a req-4bfe32ed-aec0-4796-8c2d-70d1c8cd5f32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071153 Oct 18 13:41:02.482505 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2042/4033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:02.501993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for project 8c8666b164a743dea89a8f81a277d186. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:02.510927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for user b7c0f8d3344b45e0a73747d85a9f9e0b and project 8c8666b164a743dea89a8f81a277d186. Resources: dict_keys(['metadata_items']) {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:02.521679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:02.522126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:02.522616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:02.523056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:02.523475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:02.533177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.533715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.534197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.534953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.535416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.535849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.555465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for project 8c8666b164a743dea89a8f81a277d186. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:02.560936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Getting quotas for user b7c0f8d3344b45e0a73747d85a9f9e0b and project 8c8666b164a743dea89a8f81a277d186. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:02.585274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:02.588526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:02.594001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.596088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.613036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.613679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.614242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.615038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.619552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.619552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.759077 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19db7b77-dc40-482c-b1e6-889aede9a307 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.549906 Oct 18 13:41:02.772048 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1992/4034] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:02.791261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-897b4edc-04a7-4246-b574-f90c098d544c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.792023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-897b4edc-04a7-4246-b574-f90c098d544c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.862343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.889606 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5439e457-e963-42db-b3a9-0337d3812a2a tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.299476 Oct 18 13:41:02.915110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2043/4035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:02.949356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.950193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.958654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-897b4edc-04a7-4246-b574-f90c098d544c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.960546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.963320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.963825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.964551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.967921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-897b4edc-04a7-4246-b574-f90c098d544c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1268 microversion: 2.1 time: 0.182514 Oct 18 13:41:02.968759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.970966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.971404 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1993/4036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:03.209242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:03.218309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f464bc4-2016-4f2d-835f-1854b26039a7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.274378 Oct 18 13:41:03.218905 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2044/4037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:03.433126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:03.433759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:03.450033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.450033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.451461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.453815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.455809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.459393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.676483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:03.685593 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e6c4e4e-7422-4e1c-b324-54083885d2b9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.257066 Oct 18 13:41:03.686655 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1994/4038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:03 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:03.920636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:03.921269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:03.938309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.939566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.940562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.941591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.942258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.942914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.993806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1781c989-b773-4b68-894f-5db9601a01e2 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:03.994677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1781c989-b773-4b68-894f-5db9601a01e2 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:04.132275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1781c989-b773-4b68-894f-5db9601a01e2 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.140063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1781c989-b773-4b68-894f-5db9601a01e2 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1268 microversion: 2.1 time: 0.151202 Oct 18 13:41:04.140898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1995/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:03 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:04.246922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:04.247467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:04.263985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:04.264507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:04.264962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:04.265666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:04.266164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:04.266608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:04.667769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.670129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:04.680279 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-887a05b9-83d0-4f86-8b40-fefbf6f4a314 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1523 microversion: 2.1 time: 0.764492 Oct 18 13:41:04.681290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2045/4040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:03 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1523 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:04.692855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.692855 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64b657c2-fc6f-4750-93c3-16096a817450 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1318 microversion: 2.1 time: 0.449662 Oct 18 13:41:04.692855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1996/4041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:04 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:04.721763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:04.729790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:04.740642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:04.742382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:04.743027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:04.743915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:04.744544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:04.747537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.166737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:05.167626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:05.185970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.194187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.194187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.202592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.203154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.203616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.418621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.441537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae2ecab7-c086-42e0-8cac-05a62d25f171 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1320 microversion: 2.1 time: 0.280443 Oct 18 13:41:05.446608 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2046/4042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:05 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:05.519010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.530984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ac80069-af91-4d6d-baf4-87f6c45e2b9e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.824082 Oct 18 13:41:05.532379 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1997/4043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:04 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:05.706030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:05.706792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:05.717093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.717968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.718713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.719711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.719886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:05.720506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:05.722536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.723018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.728452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.733349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.733349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.733349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.733349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.733349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.018291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:06.027420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-017a2f92-f115-4c6e-9001-945cc9f1c40e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1503 microversion: 2.1 time: 0.326604 Oct 18 13:41:06.031653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2047/4044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:05 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:06.055537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aca2fb6c-7bad-4dbc-9ba9-3065a5b40f2c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'create', calling method: .version_select at 0x7fb330e42e50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-546585683", "description": "tempest-description-896612886"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:06.562294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:06.574778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e36d3c84-096b-423f-9239-136b1dbdd37a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1508 microversion: 2.1 time: 0.856344 Oct 18 13:41:06.581628 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1998/4045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:05 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1508 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:06.587998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:06.590038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:06.598325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.599467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.602446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.603626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.604354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.606031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.791072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:06.805413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6cf81d4-430c-4d7c-9edd-cefef5776d4c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1338 microversion: 2.1 time: 0.223850 Oct 18 13:41:06.806449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 1999/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:06 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:06.814284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:06.824967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:06.858489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.860309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.861598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.864007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.865997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.866751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.915944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:07.122570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aca2fb6c-7bad-4dbc-9ba9-3065a5b40f2c tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.070782 Oct 18 13:41:07.131334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2048/4047] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Oct 18 13:41:06 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:07.136355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:07.137221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:07.149543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.150043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.150512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.151274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.151744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.152181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.210385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:07.221568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c0b2c72e-0d03-45dd-bcee-7d24e6aef0ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.410990 Oct 18 13:41:07.222369 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2000/4048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:06 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:07.249733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-546585683"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:07.250316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:07.272143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.273784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.275697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.279838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.280471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.281007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.554868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.network.security_group_api [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Adding security group 744625e8-84e3-4151-9520-a94c8e6f5b66 to port bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 Oct 18 13:41:07.568860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:07.581426 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f0c39e4-1f06-45fa-bbb9-3207d63d94d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1508 microversion: 2.1 time: 0.445159 Oct 18 13:41:07.582088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2049/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:07 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1508 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:07.608650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:07.611203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:07.628032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.628892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.629576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.630614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.631320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.636039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.853840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ecb63fb-ba3f-4410-8d7e-fab62efaa436 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "PUT /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1080 microversion: 2.1 time: 0.249480 Oct 18 13:41:07.855642 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2050/4050] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:41:07 2022] PUT /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1080 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:07.863198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:07.863828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:07.880839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.883951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.884410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:07.885263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:07.885666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:07.888543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.153745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:08.165013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb542aff-7059-42c5-bf36-1929a8656cc8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1326 microversion: 2.1 time: 0.308264 Oct 18 13:41:08.182676 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2051/4051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:07 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1326 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:08.198165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:08.199248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:08.217357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.218312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.219027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.220034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.220735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.221403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.566646 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-038dca48-2e09-411b-8a43-3cb622e84fcb tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action" status: 202 len: 0 microversion: 2.1 time: 1.329817 Oct 18 13:41:08.567255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2001/4052] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:07 2022] POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:08.572484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:08.574154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:08.586432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.587365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.588152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.589761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.590503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.591120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.873885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:08.891415 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfebfb89-0489-4caf-bfc7-bd25d6cb088d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.322790 Oct 18 13:41:08.902530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2002/4053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:08 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:08.920101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-546585683"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:08.920101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:08.931337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.933355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.936470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.937516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.938385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.939414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.087933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:09.099664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e4db689-c782-44b5-aa84-324edecd4f19 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1506 microversion: 2.1 time: 0.915596 Oct 18 13:41:09.100568 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2052/4054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:08 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1506 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:09.117062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:09.130524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.131363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.131980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.145946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] Creating event network-changed:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:41:09.155325 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-db1c6bc2-371d-4daf-b21b-367725c9cc32 req-aead3bbc-4d60-4c03-9eaf-186358292138 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053094 Oct 18 13:41:09.156858 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2053/4055] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:09.162477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:09.163467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:09.170431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.171307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.171990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.172980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.173625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.174345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.329902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.network.security_group_api [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Removing security group 744625e8-84e3-4151-9520-a94c8e6f5b66 from port bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 Oct 18 13:41:09.685175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:09.702417 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-adb7ee62-1961-435a-81d4-61765b08af20 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1506 microversion: 2.1 time: 0.543983 Oct 18 13:41:09.728785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2054/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:09 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:09.739812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:09.743438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:09.768039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.768818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.769442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.770393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.771023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.771625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.265670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:10.281002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e2fbd65-9cf0-48a8-be27-1b7b345eee5d tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.548330 Oct 18 13:41:10.281940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2055/4057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:09 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:10.291954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:10.304866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:10.314450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.315214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.315888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.317117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.318028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.318718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.422559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:10.423254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:10.425002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:10.425699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:10.426379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:10.578413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-600b340e-f9d0-4b38-a81d-a44285a8ea66 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action" status: 202 len: 0 microversion: 2.1 time: 1.673831 Oct 18 13:41:10.579646 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2003/4058] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:08 2022] POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action => generated 0 bytes in 1677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:10.586422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:10.587407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:10.597745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.599287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.602612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.605088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.607194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.608790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.705690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:10.717866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.718882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.722203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.722974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.724942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.725706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.779509 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c92ccab-cffc-4776-95d8-9619519ad122 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "POST /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943/action" status: 202 len: 1112 microversion: 2.1 time: 0.495928 Oct 18 13:41:10.794709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2056/4059] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:10 2022] POST /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943/action => generated 1112 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:41:10.800857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb40d905-c2e0-48b0-bcfd-21ce0c9aec2e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'create', calling method: .version_select at 0x7fb330c32f70>, body: {"pool": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:10.968187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:10.988086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd87140f-35f4-427c-b4bf-b549cf3d0fe8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.405693 Oct 18 13:41:10.989641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2004/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:10 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:10.996210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:10.997241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:11.010597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.011412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.012243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.016379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.017587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.021399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.766004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:11.786872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f4f554a-5c50-42f9-8a30-d1270e6b7c53 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.795524 Oct 18 13:41:11.787843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2005/4061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:10 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:11.801947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:11.806476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:11.813021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.813784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.814762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.815704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.816332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.816941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.093891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:12.105230 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c2e0835-7258-4e83-9e44-cf30b83800de tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.314806 Oct 18 13:41:12.106135 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2006/4062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:11 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:12.115744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:12.152652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.153934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.154306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.185099 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] Creating event network-changed:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:41:12.199095 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-65ada251-f022-434a-8281-a55489b5b846 req-621a9c27-dbd5-478a-93f3-b94258ebb6ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089605 Oct 18 13:41:12.203626 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2007/4063] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:12.219607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308f5a5-f296-4bc1-86de-10690d38c637", "name": "network-vif-plugged", "status": "completed", "tag": "f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:12.249116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.249616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.252484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.289574 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] Creating event network-vif-plugged:f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85 for instance 1308f5a5-f296-4bc1-86de-10690d38c637 on n-h2-858383-13 Oct 18 13:41:12.296253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bd353b9f-5e9e-4836-9979-51aaaa2ac761 req-dbface8e-ace8-4a8c-9150-81a92f4d8cc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090242 Oct 18 13:41:12.297243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2008/4064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:12.303290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:12.304006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:12.323872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.324401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.324874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.325631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.327105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.327571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.752048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:12.892482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:12.915471 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6868598-3c7b-42d2-8533-cda8d05a8e14 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.614763 Oct 18 13:41:12.917484 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2009/4065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:12 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:12.924414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:12.925362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:12.936388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:12.946670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.947340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.947844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.954832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.955370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.956588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.394973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:13.411160 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2ec6808-047d-4a2c-9483-aac9627a59b0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.492354 Oct 18 13:41:13.411758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2010/4066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:12 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:13.432820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:13.433720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:13.440490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.441351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.441964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.442950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.443587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.444184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.924868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:13.952925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6029c70-109b-4a51-ab6d-0431926e6162 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.525259 Oct 18 13:41:13.960506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2011/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:13 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:13.967377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:13.968000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:13.990856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.991357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.991800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.992585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.996422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.998264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.136146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=28 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:14.314356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:14.330825 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15f75964-424e-4317-8c20-bb5a9ad1cced tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1329 microversion: 2.1 time: 0.367817 Oct 18 13:41:14.334319 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2012/4068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:13 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1329 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:14.336928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad82e6b-d6a0-4994-852d-d55b0a448a56", "tag": "e0247fc8-6e0f-440e-9e0b-2b9321c11fec"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:14.356061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:14.356559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:14.356999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.377683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] Creating event network-changed:e0247fc8-6e0f-440e-9e0b-2b9321c11fec for instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 on n-h2-858383-13 Oct 18 13:41:14.384283 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0f89fd15-01ed-435f-84d0-4a72b8dee6c2 req-be6edfce-53b6-468d-9488-cf19624013c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051079 Oct 18 13:41:14.386271 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2013/4069] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:14.441593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:14.442733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:14.451853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:14.452826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:14.453584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.454839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:14.455414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:14.456717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.764898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:14.777495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9553c5de-66d2-4d10-b023-1e33c7e51054 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.341237 Oct 18 13:41:14.792063 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2014/4070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:14 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:14.997389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:14.999815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:15.017331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.024089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.029003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:15.030174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.031524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.033311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:15.896765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:15.913472 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-420fa3fd-a365-47c5-813b-a879ed97c696 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.934992 Oct 18 13:41:15.919544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2015/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:14 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:15.926786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:15.928510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:15.948037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.948940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.949731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:15.950721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.951377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.952241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:16.323662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:16.332413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a47f5219-3aa8-4b5f-b596-c32251852090 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1510 microversion: 2.1 time: 0.411419 Oct 18 13:41:16.346467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2016/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:15 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:16.358988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:16.362872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:16.384351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:16.385312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:16.385975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:16.386944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:16.387611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:16.388246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:16.672156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:16.686086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3485cb7b-f327-47d3-8e0c-7085fdc97947 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.338149 Oct 18 13:41:16.690853 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2017/4073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:16 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:16.703634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:16.704620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:16.719683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:16.720545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:16.721149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:16.724928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:16.725730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:16.726950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.154010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:17.168227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-101ea6b7-3795-4b18-b41c-e4c2f0a0fc40 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1510 microversion: 2.1 time: 0.474012 Oct 18 13:41:17.170121 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2018/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:16 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:17.288326 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb40d905-c2e0-48b0-bcfd-21ce0c9aec2e tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.491802 Oct 18 13:41:17.289269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2057/4075] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Oct 18 13:41:10 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:17.307628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:17.307628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:17.311930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.319265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.320485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.324588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.329337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.330083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.493751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: .version_select at 0x7fb330810d30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1011641305", "policies": ["affinity"]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:17.535894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:17.546642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:17.681012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:17.697608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99075a24-c795-4a6b-bf02-18926bed2b28 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.406922 Oct 18 13:41:17.698486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2058/4076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:17 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:17.707976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:17.708759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:17.715931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:17.723463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:17.724269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.724775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.731520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.737170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.738559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.739031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.748515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff2f2caf-0e1a-42e3-bc6c-1378fbd9d7a8 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.577073 Oct 18 13:41:17.750232 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2019/4077] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:41:17 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:17.761371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.9"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:17.764233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:17.791105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.792325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.792852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.794873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:17.795413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:17.797486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:17.801718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:17.842680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:41:17.843782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquired lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:41:18.204332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97e189c6-f872-4e80-93b9-18206e75f89a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 204 len: 0 microversion: 2.1 time: 0.504240 Oct 18 13:41:18.208482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2059/4078] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:17 2022] DELETE /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:18.216645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:18.217538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:18.237337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:18.237854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:18.241197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:18.243233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:18.244065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:18.246474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:18.615805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:18.618383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:18.630311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38b77f5c-af4d-4a98-b9c4-e9b00e917a02 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.420289 Oct 18 13:41:18.631319 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2060/4079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:18 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:18.635816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: .version_select at 0x7fb331190310>, body: {"server_group": {"name": "tempest-server-group-862769942", "policies": ["affinity"]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:18.677651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:18.695163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:18.830901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:18.839975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:18.878542 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbeec32d-9fbe-4e4f-a267-6c628357f163 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.246148 Oct 18 13:41:18.880901 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2061/4080] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 18 13:41:18 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:18.888216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:18.889061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:18.896625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:18.899827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:18.900452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:18.901436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:18.902260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:18.903091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:19.165755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:19.176043 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b528e033-c9f2-44b7-911a-f22ae8f4b17e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1516 microversion: 2.1 time: 0.293884 Oct 18 13:41:19.191302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2062/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:18 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1516 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:19.205213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:19.206828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:19.227528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:19.228624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:19.229630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:19.230427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:19.235221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:19.235784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.075084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:20.089378 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bce73893-b76d-4782-b6e9-ed6b1d5b53ad tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.895784 Oct 18 13:41:20.090500 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2063/4082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:19 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:20.101569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: .version_select at 0x7fb331014b80>, body: {"server_group": {"name": "tempest-server-group-862769942", "policies": ["affinity"]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:20.134625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:20.141690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:20.350018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:20.357010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:20.392511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:20.395298 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-490e70eb-741d-4e9a-a56e-beea798c6282 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.303056 Oct 18 13:41:20.402196 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2064/4083] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 18 13:41:20 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:20.418314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:20.418314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:20.423712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.424918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.425499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.426437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.427312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.427949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.613313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:20.623027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e194bf1-5a12-499b-888b-4322dd209022 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.219671 Oct 18 13:41:20.627692 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2065/4084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:20 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:20.638715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:20.645729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:20.658412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.659186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.660161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.661491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.662586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.667304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.895019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:20.911958 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c0632f3-f4c3-4272-a113-f7b4c22019af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1516 microversion: 2.1 time: 0.278018 Oct 18 13:41:20.912740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2066/4085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:20 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:20.920761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e30a691-5b3a-46ff-9c71-897fcaf5a537 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:21.003876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e30a691-5b3a-46ff-9c71-897fcaf5a537 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/898e5b7b-202d-4d36-b96f-54818ec33ee7" status: 204 len: 0 microversion: 2.1 time: 0.089869 Oct 18 13:41:21.004464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2067/4086] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:20 2022] DELETE /compute/v2.1/os-server-groups/898e5b7b-202d-4d36-b96f-54818ec33ee7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:21.123377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f931b2c1-f92f-418e-b22c-09a8fe87a1d6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Action: 'create', calling method: .version_select at 0x7fb3312a6c10>, body: {"keypair": {"name": "tempest-keypair-350143490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHs3PAQPcYlNp//9j5arIXvOqKJ/JszuzCgQIJ26iVfgdWdbvFH8mFnCuds2VjFNNGRALmTm20YTel0gjQu0Vn+HFQzM1QXQi8C7HD3yVWWeKv5z3F0BZYYGOYe1ifA/4w=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:21.156220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f931b2c1-f92f-418e-b22c-09a8fe87a1d6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for project e41731743d534457a92c6244b7671d7b. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:21.175096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f931b2c1-f92f-418e-b22c-09a8fe87a1d6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for user 41b888dbd64a4fc48ee745a7b38014c7 and project e41731743d534457a92c6244b7671d7b. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:21.312780 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f931b2c1-f92f-418e-b22c-09a8fe87a1d6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.307053 Oct 18 13:41:21.314034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2068/4087] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:41:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:21.319013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5340880-51c6-494d-b550-3bf4888d8912 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:21.376206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5340880-51c6-494d-b550-3bf4888d8912 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.061002 Oct 18 13:41:21.380068 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2069/4088] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:41:21 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:21.388817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:21.393219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:21.406359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:21.410596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:21.411301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:21.412311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:21.416132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:21.416132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:21.767987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:21.781771 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efe5788e-d2b8-4e2c-9561-55d6cc8bdde8 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.400474 Oct 18 13:41:21.791829 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2070/4089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:21 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:21.805985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a034cd1-6d14-43d0-985f-ad73ced8d52e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:21.944763 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a034cd1-6d14-43d0-985f-ad73ced8d52e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b1af30ea-1b79-400b-b51a-2f412679d018" status: 204 len: 0 microversion: 2.1 time: 0.156543 Oct 18 13:41:21.945844 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2071/4090] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:21 2022] DELETE /compute/v2.1/os-server-groups/b1af30ea-1b79-400b-b51a-2f412679d018 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:21.960559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:21.961469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:21.985642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:21.988703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:21.990421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:21.992272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:21.994933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:21.994933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:22.231713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:22.243183 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-409fd37e-89d1-4d23-b278-0f695c6a7dfa tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.294993 Oct 18 13:41:22.245236 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2072/4091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:21 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:22.250733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:22.252249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:22.271013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:22.272438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:22.273104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:22.274386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:22.275077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:22.276770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:22.373332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:22.386855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ce115649-d36a-4c4b-ae62-57112cf693d4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 200 len: 1474 microversion: 2.1 time: 0.138539 Oct 18 13:41:22.401211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2073/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:22 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:22.416898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2e6fefa-b9b8-4917-a65b-1cbe1323ca36 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:22.441764 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2e6fefa-b9b8-4917-a65b-1cbe1323ca36 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034569 Oct 18 13:41:22.442617 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2074/4093] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:41:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:22.447028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1308f5a5-f296-4bc1-86de-10690d38c637", "name": "network-vif-deleted", "tag": "f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:22.458571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:22.459134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:22.459611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:22.491443 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] Creating event network-vif-deleted:f4bb1188-7c83-4ffc-aa4b-fdfa8dd13b85 for instance 1308f5a5-f296-4bc1-86de-10690d38c637 on n-h2-858383-13 Oct 18 13:41:22.504927 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-656d96f5-1be3-40a2-8298-d6d464ff081e req-44c9db9e-44f8-45ca-ab96-093a909ab051 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060761 Oct 18 13:41:22.505887 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2075/4094] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:22.515326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: .version_select at 0x7fb3310144c0>, body: {"server_group": {"name": "tempest-server-group-44151178", "policies": ["affinity"]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:22.524443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:41:22.532589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:22.552931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:22.561374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:22.738787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:22.744642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:22.762668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f793cabb-b72b-4240-b48f-71af2009ca1d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.255314 Oct 18 13:41:22.764030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2076/4095] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 18 13:41:22 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:22.779244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95c7d96e-98cc-4cbb-92f1-16328145fe96 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:22.912962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95c7d96e-98cc-4cbb-92f1-16328145fe96 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3da40390-7715-47e5-b7f7-44aab12864a7" status: 204 len: 0 microversion: 2.1 time: 0.142432 Oct 18 13:41:22.919610 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2077/4096] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:22 2022] DELETE /compute/v2.1/os-server-groups/3da40390-7715-47e5-b7f7-44aab12864a7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:22.925634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:22.932167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:22.957510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:22.958333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:22.959270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:22.960884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:22.961566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:22.962238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:23.261585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:23.274289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f4987b6-d6db-43c4-979f-5c76dab63496 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.351164 Oct 18 13:41:23.274289 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2078/4097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:22 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:23.284650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d9022a72-d3d3-4b1d-8727-946c59feb1f3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:23.306253 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d9022a72-d3d3-4b1d-8727-946c59feb1f3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027391 Oct 18 13:41:23.308829 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2079/4098] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:41:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:23.314445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad82e6b-d6a0-4994-852d-d55b0a448a56", "name": "network-vif-plugged", "status": "completed", "tag": "e0247fc8-6e0f-440e-9e0b-2b9321c11fec"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:23.344274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:23.344767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:23.345251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:23.374987 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] Creating event network-vif-plugged:e0247fc8-6e0f-440e-9e0b-2b9321c11fec for instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 on n-h2-858383-13 Oct 18 13:41:23.380694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-119168d3-22e5-4cd5-a907-3410cbc1d69e req-cfb4eefa-356e-44c9-a153-a2bb684875a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070468 Oct 18 13:41:23.381804 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2080/4099] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:23.387699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:23.388568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:23.395877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:23.396599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:23.397215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:23.398101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:23.398707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:23.399283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:23.887535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:23.905016 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-617aaeec-c8a8-465a-a7dd-d3132f52c651 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.520416 Oct 18 13:41:23.907302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2081/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:23 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:23.919786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: .version_select at 0x7fb3312895e0>, body: {"server_group": {"name": "tempest-server-group-1150729062", "policies": ["anti-affinity"]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:23.958978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:23.972281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:23.988851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:24.093684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:24.103239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:24.125176 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ca29ebb-8d97-431a-a3da-7d3d815ffbf3 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.214776 Oct 18 13:41:24.126214 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2082/4101] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 18 13:41:23 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:24.132073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:24.132968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:24.141490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:24.142345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:24.142987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:24.148312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:24.151349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:24.152096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:24.175982 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 HTTP/1.1 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '1308f5a5-f296-4bc1-86de-10690d38c637'} Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:24.177915 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f235db1a-ffea-4898-b8a6-2d9a6d00a117 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 404 len: 111 microversion: 2.1 time: 0.052237 Oct 18 13:41:24.185591 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2083/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:24 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:24.190315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-899cdeea-e40a-4592-b6ef-73938c123d24 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:24.284957 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-899cdeea-e40a-4592-b6ef-73938c123d24 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/aeff0c03-2908-495b-b07e-a30b6c133cc6" status: 204 len: 0 microversion: 2.1 time: 0.102992 Oct 18 13:41:24.286548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2084/4103] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:24 2022] DELETE /compute/v2.1/os-server-groups/aeff0c03-2908-495b-b07e-a30b6c133cc6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:24.292007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8209ebdf-d2d6-4de4-a6d8-7a5f01bd6b2e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '.version_select at 0x7fb33121e4c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:24.402594 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8209ebdf-d2d6-4de4-a6d8-7a5f01bd6b2e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1515845812" status: 202 len: 0 microversion: 2.1 time: 0.114802 Oct 18 13:41:24.403616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2085/4104] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:41:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1515845812 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:24.409943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0be252c-2827-4c02-848e-ba389056ff07 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:24.426952 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0be252c-2827-4c02-848e-ba389056ff07 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022242 Oct 18 13:41:24.430011 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2086/4105] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:41:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:24.434288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:24.434912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:24.453636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:24.454167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:24.454618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:24.455332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:24.455794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:24.456264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:24.782482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Updating instance_info_cache with network_info: [{"id": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43", "address": "fa:16:3e:bd:7f:52", "network": {"id": "b66de52a-7f4d-43de-9721-de47c554f254", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-133461255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "90c056fcd52f4a97b89c731d06027fc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbf4e63bd-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:41:24.843629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:24.856332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70e34aff-b8f2-4f77-8da6-2575f5ca8a44 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1393 microversion: 2.1 time: 0.427505 Oct 18 13:41:24.857868 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2087/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:24 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1393 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:24.863453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-989354355", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "7d017cdd-348c-48f4-b96a-4f14fcaa1c2d"}]}, "os:scheduler_hints": {"group": "87289a1b-c590-42e8-8f54-e6e0b07c3455"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:24.929437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Releasing lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:41:24.930352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36e83e9c-1881-45f1-b06d-9996d3ef3118 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action" status: 202 len: 0 microversion: 2.1 time: 7.179992 Oct 18 13:41:24.935013 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2020/4107] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:17 2022] POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action => generated 0 bytes in 7185 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:41:24.941400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:24.945512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] validate_networks() for [('7d017cdd-348c-48f4-b96a-4f14fcaa1c2d', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:24.956857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:24.959277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:24.959804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:24.974293 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] Creating event network-changed:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:41:24.979569 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5ae94da5-1984-47a3-b4e5-a5bb6e2e0624 req-c2309bff-377a-4eb7-9f2e-69a0d3cd234c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042708 Oct 18 13:41:24.980333 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2021/4108] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:24.986684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1125787222", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:25.084560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:25.890155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:25.891273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:25.891273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:25.891623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:25.892137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:25.906602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:25.907375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:25.907963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:25.909191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:25.909810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:25.910479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:25.946328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:25.953150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:25.970040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:25.972547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:26.082257 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21009f44-e681-40ec-abcc-65bdc9e12169 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100499 Oct 18 13:41:26.083574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2022/4109] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:26.089832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.119853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:26.316669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:26.325274 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6e9cb7d-816b-47e5-b259-3d9d28fa3b30 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.240313 Oct 18 13:41:26.326181 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2023/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:26 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:26.334921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.9"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:26.513305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:26.521102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:26.521102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:26.521102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:26.521102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:26.547023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.547903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.548544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:26.549522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.550358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.551003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:26.577574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:26.589492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:26.643443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:26.660909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:26.842686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:26.850573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:26.903909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:26.919685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.920611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.930226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:26.931239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:26.932427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:26.935727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.006321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:27.023330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Getting quotas for user 6c07f47c7ef045aab1daa8cb6df9566b and project 634f588c94434a2d95b1da508cb56f85. Resources: {'server_group_members'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:27.122693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd457e5c-89e5-4d44-8112-86d6b18f3007 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263204 Oct 18 13:41:27.124502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2088/4111] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:27.135241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:27.138875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:27.153725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.157703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.159069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.160018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.160938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.168291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.446769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:27.457458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c151884f-c3a9-4659-9c0a-fb2c325e5b7c tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1574 microversion: 2.1 time: 0.329628 Oct 18 13:41:27.459480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2089/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:27 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1574 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:27.472427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:27.473301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:27.491966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.492212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.493361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.494161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.494631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.495067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.509085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:41:27.509497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquired lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:41:27.595826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:27.606381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e0e635a-e48c-457e-9342-92784bc53cdb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1213 microversion: 2.1 time: 0.144831 Oct 18 13:41:27.608370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2090/4113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:27 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:27.613253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94c3afec-b5da-49c1-b227-1ca6187c0c5f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:27.614193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94c3afec-b5da-49c1-b227-1ca6187c0c5f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:27.713970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94c3afec-b5da-49c1-b227-1ca6187c0c5f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:27.725128 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94c3afec-b5da-49c1-b227-1ca6187c0c5f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1212 microversion: 2.1 time: 0.112844 Oct 18 13:41:27.725766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2091/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:27 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1212 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:27.736664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:27.739194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:27.751731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.752232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.752679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.753448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:27.754094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:27.754515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:27.991109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:28.006226 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-625eaa10-341f-43ab-a22f-9210e28320c1 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.279213 Oct 18 13:41:28.016190 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2092/4115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:27 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:28.016190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-491974541", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f0e31ae3-2d22-4a93-952e-bd066d3fcfdb"}], "security_groups": [{"name": "tempest-securitygroup--2025926972"}], "key_name": "tempest-keypair-350143490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:28.160781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] validate_networks() for [('f0e31ae3-2d22-4a93-952e-bd066d3fcfdb', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:28.769732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for project e41731743d534457a92c6244b7671d7b. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:28.778608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for user 41b888dbd64a4fc48ee745a7b38014c7 and project e41731743d534457a92c6244b7671d7b. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:28.800591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:28.801430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:28.802137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:28.802946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:28.804106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:28.816434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:28.817072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:28.817731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:28.819092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:28.819783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:28.820669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:28.839049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:28.847173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for project e41731743d534457a92c6244b7671d7b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:28.853362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Getting quotas for user 41b888dbd64a4fc48ee745a7b38014c7 and project e41731743d534457a92c6244b7671d7b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:28.867139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:28.869536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:29.022782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-360aefa4-fd4a-41fd-b8bd-5f5e7b87c8a2 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.013569 Oct 18 13:41:29.035166 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2093/4116] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:29.043954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:29.047627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:29.072277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.073728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.074404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.075296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.079133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.081438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.267140 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90a42110-9705-4806-b63f-d2006cced1fb tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230341 Oct 18 13:41:29.267886 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2094/4117] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:41:29 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:29.279981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:29.279981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:29.291283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.292975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.293571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.308690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.310778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.312936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.513586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:29.539799 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbdf245e-a493-406d-8181-ba942acfcc87 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1279 microversion: 2.1 time: 0.265586 Oct 18 13:41:29.540460 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2095/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:29 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:29.553675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:29.555818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:29.568045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.568555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.569009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.569767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.571085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.571539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.577378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:29.668492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Building network info cache for instance {{(pid=121009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:41:29.699033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:29.708309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bfcb914-fd4a-4996-9a99-4d477c831604 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1264 microversion: 2.1 time: 0.165950 Oct 18 13:41:29.708907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2096/4119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:29 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:29.740385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffcea273-c243-42a9-aa0e-920ba08088ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:29.741025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ffcea273-c243-42a9-aa0e-920ba08088ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:29.854771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ffcea273-c243-42a9-aa0e-920ba08088ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:29.865102 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffcea273-c243-42a9-aa0e-920ba08088ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1276 microversion: 2.1 time: 0.135208 Oct 18 13:41:29.885136 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2097/4120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:29 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:29.897604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:29.898298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:29.924122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.925610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.926368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:29.930169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:29.937193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:29.941149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:30.852865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:30.861073 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-402617f1-80fc-47ed-8d1f-4c5e19fa59ce tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.974744 Oct 18 13:41:30.861732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2098/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:29 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:30.866181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:30.882024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:30.882756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:30.883305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:30.896678 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] Creating event network-changed:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:41:30.902743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a779889b-efcc-4f37-8f3c-bb4141cae1a3 req-39c588b6-b1b6-4ecf-b0bd-8a141623f5fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039814 Oct 18 13:41:30.903737 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2099/4122] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:30.909656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:30.910686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:30.918769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:30.919267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:30.919998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:30.920801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:30.921246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:30.922619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.127191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Updating instance_info_cache with network_info: [{"id": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43", "address": "fa:16:3e:bd:7f:52", "network": {"id": "b66de52a-7f4d-43de-9721-de47c554f254", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-133461255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "90c056fcd52f4a97b89c731d06027fc5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbf4e63bd-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:41:31.213309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Releasing lock "refresh_cache-a607bca9-db45-483e-a324-dd964f785966" {{(pid=121009) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:41:31.214634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2fad2144-ebf1-4c55-a199-efe9e26779d3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action" status: 202 len: 0 microversion: 2.1 time: 4.887720 Oct 18 13:41:31.219472 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2024/4123] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:26 2022] POST /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966/action => generated 0 bytes in 4893 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:41:31.227414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:31.229640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:31.244957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.248732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.249716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.253079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.254021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.254673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.428145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:31.444291 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17357719-46bb-4adb-b27e-8dc4e3c5b734 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1270 microversion: 2.1 time: 0.217829 Oct 18 13:41:31.454934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:31.459459 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2025/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:31 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:31.479797 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50ad39b0-f559-49a7-a6cb-f93bc39b6468 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1267 microversion: 2.1 time: 0.573831 Oct 18 13:41:31.498284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:31.498284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:31.498481 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2100/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:30 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1267 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:31.504923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.505853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.506655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.509778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.519376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.519376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.519713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-45381ff2-4b17-4ec7-9445-28a74a97df60 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '.version_select at 0x7fb3315ed820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:31.665886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:31.678429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d23e766-5703-4700-b74a-05e2fa5ef25e tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1328 microversion: 2.1 time: 0.193517 Oct 18 13:41:31.679724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2026/4126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:31 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1328 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:31.888761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:31.890743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:31.900863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.901750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.902465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.904300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.905582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.906474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:32.783508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:32.796755 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5332397-14ea-4386-ac40-23ec0f9ae466 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.914434 Oct 18 13:41:32.797683 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2027/4127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:31 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:32.803616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:32.804492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:32.811015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:32.811749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:32.812515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:32.813427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:32.814111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:32.814773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:32.934270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:32.942961 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0106f235-092d-4fd5-8974-44f58ebeeaff tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1270 microversion: 2.1 time: 0.143162 Oct 18 13:41:32.944155 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2028/4128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:32 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:32.950842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:32.951643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:32.961220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:32.961935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:32.962407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:32.964222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:32.964700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:32.965138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.328626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:33.336680 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ceb7a4d6-ad55-43f8-9e4b-1708972b1bd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.390674 Oct 18 13:41:33.350473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2029/4129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:32 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:33.357728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:33.358613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:33.365390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.366122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.366718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.367589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.370949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.370949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.488223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:33.515362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d76bc613-ddcf-4e68-b5ef-8d5bf6c3e3b9 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1334 microversion: 2.1 time: 0.161784 Oct 18 13:41:33.518094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2030/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:33 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:33.833713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:33.835405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:33.847294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.848170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.849037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.849966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.850665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.851363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.177056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:34.191311 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f076e40-0691-4432-9155-7fa18bacda65 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.366840 Oct 18 13:41:34.214794 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2031/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:33 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:34.220166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:34.221754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:34.227764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.228735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.229369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.230802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.231449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.232132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.569498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:34.583129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-618397ee-f15f-4101-aac9-11dbecfc094f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.366807 Oct 18 13:41:34.583804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2032/4132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:34 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:34.601791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:34.605741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:34.622392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.622903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.623348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.624066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.624527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.624959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.985518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:34.993686 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ebe5489-820b-4703-8aaf-f407cb2b765f tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1574 microversion: 2.1 time: 0.407650 Oct 18 13:41:35.006626 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2033/4133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:34 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1574 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:35.018756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:35.019600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:35.026542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.027375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.028398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.028849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.029616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.030286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.034877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-45381ff2-4b17-4ec7-9445-28a74a97df60 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e7637a8c-f9ec-44c3-b49f-abcb57d0bf6e" status: 202 len: 0 microversion: 2.1 time: 3.539339 Oct 18 13:41:35.040072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2101/4134] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:41:31 2022] DELETE /compute/v2.1/os-floating-ips/e7637a8c-f9ec-44c3-b49f-abcb57d0bf6e => generated 0 bytes in 3541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:35.045752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad82e6b-d6a0-4994-852d-d55b0a448a56", "tag": "e0247fc8-6e0f-440e-9e0b-2b9321c11fec"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:35.070155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.072300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.077502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.092495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] Creating event network-changed:e0247fc8-6e0f-440e-9e0b-2b9321c11fec for instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 on n-h2-858383-13 Oct 18 13:41:35.098309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-46864682-54f5-4774-ac49-d9a9bb2e8e88 req-27347669-b9d6-4af2-87d5-ac1a74b94ba2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060480 Oct 18 13:41:35.099377 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2102/4135] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:35.109370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d26017-97a5-4608-be79-49ce94b11fff", "tag": "710917bf-d91c-4ca3-bce9-c35afba0ce5e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:35.129266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.129266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.129266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.141463 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] Creating event network-changed:710917bf-d91c-4ca3-bce9-c35afba0ce5e for instance 40d26017-97a5-4608-be79-49ce94b11fff on n-h2-858383-13 Oct 18 13:41:35.148222 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-902109ae-0bb0-4563-a93d-ff401348c099 req-e04d95b8-24e7-4662-8d35-35a9ac396df1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046481 Oct 18 13:41:35.149466 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2103/4136] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:35.156008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:35.157123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:35.167186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.168073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.168726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.169715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.170326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.170999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.279749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:35.287984 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2ce1415-b718-4575-8356-3c814b98ddc6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1334 microversion: 2.1 time: 0.136382 Oct 18 13:41:35.305484 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2104/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:35 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:35.311103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15a5c3b1-2a70-44fe-98a7-d0ad1841c0e6 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '.version_select at 0x7fb330c261f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:35.478477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:35.489973 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3951c866-adab-4dce-b66d-e04ef3fa1741 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.482140 Oct 18 13:41:35.491371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2034/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:35 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:35.496874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:35.497926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:35.511421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.512029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.512545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.513453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.514940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.515578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.848357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:35.862993 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-369c9a6c-e353-4a55-aec5-e53082958638 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.370255 Oct 18 13:41:35.863596 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2035/4139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:35 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:35.872872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:35.873350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:35.881688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.882216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.882674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.883377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.883837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.884271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.926312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:35.963076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:36.120303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:36.130164 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f2c7918-5fdb-4ec8-a452-2e42d56e6704 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.265432 Oct 18 13:41:36.141198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2036/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:35 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:36.312898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:36.313576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:36.324016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.324629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.325839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.328700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.329915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.331785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.351262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:36.467514 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15a5c3b1-2a70-44fe-98a7-d0ad1841c0e6 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/744625e8-84e3-4151-9520-a94c8e6f5b66" status: 202 len: 0 microversion: 2.1 time: 1.160344 Oct 18 13:41:36.469294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2105/4141] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 13:41:35 2022] DELETE /compute/v2.1/os-security-groups/744625e8-84e3-4151-9520-a94c8e6f5b66 => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:36.476957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:36.477545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:36.504337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.505325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.505922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.506860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.507499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.508104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.537487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:36.751616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:36.762461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1bad79cf-d63c-4614-a9fd-43623845d8b3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.453778 Oct 18 13:41:36.765453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2037/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:36 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:36.772324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:36.773214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:36.779951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.780451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.780998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.781710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.782235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.782662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.916850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c8b4702-49c9-473c-950a-b16812223cb5 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 204 len: 0 microversion: 2.1 time: 0.443390 Oct 18 13:41:36.917844 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2106/4143] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:36 2022] DELETE /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:41:36.924211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:36.924932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:36.933977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.933977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.933977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.933977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.933977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.934465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.365064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:37.375218 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c1caaa0-215a-4e6e-b436-2284343ff99a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.455578 Oct 18 13:41:37.395716 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2107/4144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:36 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:37.401165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:37.402044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:37.410092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.411130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.411812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.412759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.413399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.414012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.452179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:37.464747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a65716ef-0e3c-42f4-9358-47885c0ac114 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.697937 Oct 18 13:41:37.466772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2038/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:36 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:37.472673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:37.473473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:37.487901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.489721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.490503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.491787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.493034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.493627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.856982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:37.869684 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0973da0e-671e-47a3-897b-19d7f32ebc8e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.400346 Oct 18 13:41:37.871078 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2039/4146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:37 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:37.876866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d2c3dc-32b1-49d0-9265-f5a8642b88ff", "tag": "112dfe31-6f59-468c-bc12-0c9692045678"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:37.892346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.893194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.893857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.909813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] Creating event network-changed:112dfe31-6f59-468c-bc12-0c9692045678 for instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff on n-h2-858383-13 Oct 18 13:41:37.917758 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-395290b1-973d-4bd2-bad1-43ca78e8b1de req-deb739ac-88a3-46d2-9132-053410168991 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 Oct 18 13:41:37.920046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2040/4147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:37.924380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:37.925366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:37.933221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:37.935167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.935895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.937871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.938985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.939876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.940490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.231770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:38.251839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28d9a604-dd3c-4f42-a616-1d0731f76d49 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.331882 Oct 18 13:41:38.256850 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2041/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:37 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:38.334455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:38.348720 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58966c87-1c12-4c5a-9dc4-61c2693bc8cd tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1509 microversion: 2.1 time: 0.951464 Oct 18 13:41:38.349442 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2108/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:37 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1509 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:38.402704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:38.403537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:38.411920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.412622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.413084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.414513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.414986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.415423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.493856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:38.495005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:38.504450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.505007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.505487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.506536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.506995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.508428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.685026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:38.694037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02523cea-e77d-499b-a10d-0f1e9c012133 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.297017 Oct 18 13:41:38.706899 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2042/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:38 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:38.830995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:38.875044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:38.889201 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d2c672c-079c-4c34-a3b3-603f1de76a78 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.400060 Oct 18 13:41:38.890248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2109/4151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:38 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:38.907043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:38.908729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:38.920755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.921356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.922141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.923288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.923965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.924965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.278937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:39.279998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:39.287898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.288608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.289296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.290354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.291211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.293330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.323929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:39.354683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5811754-34cb-449e-a49a-61925b5a66ee tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.460958 Oct 18 13:41:39.372339 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2043/4152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:38 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:39.384850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:39.385796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:39.394327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.395045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.395643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.404399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.404399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.404399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.777084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:39.805382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:39.815994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fd8fcd8-e095-428e-af03-343007b4e803 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.544597 Oct 18 13:41:39.823422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-574a1612-70ca-411b-bc9a-c7c50c65988d tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1509 microversion: 2.1 time: 0.449583 Oct 18 13:41:39.824039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2044/4153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:39 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:39.845668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:39.846402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:39.846533 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2110/4154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:39 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:39.863583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.864116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.864836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.865567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.866031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.866550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.912998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:39.913700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:39.915759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=64 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:39.924955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.925524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.925979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.926762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.927288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.927723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.497536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:40.510115 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2ceafd2-fa77-4327-bd96-5e3185425024 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.600764 Oct 18 13:41:40.510705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2111/4155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:39 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:40.529778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d542c8-51dd-4d1a-87ce-b33b6e39a7aa", "tag": "62b14289-02a4-47de-adf8-6c048149b9fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:40.542638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.543341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.543924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.558685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] Creating event network-changed:62b14289-02a4-47de-adf8-6c048149b9fa for instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa on n-h2-858383-13 Oct 18 13:41:40.565421 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7612e8ed-1dae-4445-a52b-1cf003c4e666 req-d7f726a6-c91c-43b5-a775-d23932dfc2f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037877 Oct 18 13:41:40.566836 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2112/4156] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:40.571212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:40.573666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:40.574712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:40.583110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.583766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.584277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5907d17b-1737-420c-a174-dc0940f89e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.744855 Oct 18 13:41:40.584592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.585030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2045/4157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:39 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:40.589052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.589887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.590577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.848684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:40.849892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:40.857052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.857791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.858416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.859278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.859886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.860469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.015478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.052309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76b3c7ae-76c5-4eb5-a339-6f82e6cd7e4a tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.484039 Oct 18 13:41:41.053575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2113/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:40 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:41.062828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:41.063678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:41.072803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.073634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.074374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.077494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.078146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.078804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.220963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.240454 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7243e38e-ef5c-492f-916f-8d73385c941b tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1467 microversion: 2.1 time: 0.184245 Oct 18 13:41:41.242426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2114/4159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:41 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1467 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:41.250583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a607bca9-db45-483e-a324-dd964f785966", "name": "network-vif-deleted", "tag": "bf4e63bd-7fc9-4968-8d91-ac8d45a0be43"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:41.258575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.267017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.267966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.268626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.269273 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c69b5e98-3376-4b55-9d91-20a8c104c311 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.424403 Oct 18 13:41:41.270848 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2046/4160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:40 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:41.284738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] Creating event network-vif-deleted:bf4e63bd-7fc9-4968-8d91-ac8d45a0be43 for instance a607bca9-db45-483e-a324-dd964f785966 on n-h1-858383-13 Oct 18 13:41:41.291921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-53e2ac3d-13da-46c2-bf61-939c05ede525 req-d88cda32-8d90-4c6d-ae09-dfb77ce7d628 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046377 Oct 18 13:41:41.293077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2115/4161] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:41.532593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:41.533238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:41.541224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.541941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.542418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.543679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.544288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.544865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.610882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:41.611942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:41.618418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.619224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.619778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.620881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.621458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.622900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.792099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.800094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-504b2e56-e914-4ee0-9900-703110bb54b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.194682 Oct 18 13:41:41.800667 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2116/4162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:41 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:41.846491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.854392 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-516153d5-830c-47e0-b2f5-76fdd0ffb4af tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.325828 Oct 18 13:41:41.855818 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2047/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:41 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:42.076375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:42.077005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:42.083214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.083712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.084162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.084869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.085490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.085933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.101575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:42.268501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:42.271594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:42.289489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.290342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.291128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.292196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.293178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.293178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.330492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.330990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.331436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.331897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lazy-loading 'fault' on Instance uuid a607bca9-db45-483e-a324-dd964f785966 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:41:42.376908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:42.386502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7928f8e4-382e-41ca-8a05-604f46b1acd3 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1313 microversion: 2.1 time: 0.124720 Oct 18 13:41:42.387028 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2048/4164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:42.391700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:42.392328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:42.398625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.399235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.399694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.400569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.400964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.401904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.561800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:42.575838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-162fe152-a2cb-4131-be30-4192c3e72a42 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.187651 Oct 18 13:41:42.577189 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2049/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:42.617346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:42.629356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26dfa17f-79ac-4bfc-8620-83a11990cd63 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.557350 Oct 18 13:41:42.643302 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2117/4166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:42.831790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:42.835257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:42.855940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.856708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.857697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.859113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.859866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.861024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.882767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:42.883770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:42.899678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.900701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.901154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:42.905478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:42.907031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:42.909642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.150955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.165100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d293838-5b97-483a-9f60-7a0714ec6819 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.289563 Oct 18 13:41:43.166495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2118/4167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:43.230640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.246704 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d02285a8-918c-47c1-b242-45ac945849f7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1517 microversion: 2.1 time: 0.425054 Oct 18 13:41:43.263722 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2050/4168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:43.299251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d26017-97a5-4608-be79-49ce94b11fff", "name": "network-vif-plugged", "status": "completed", "tag": "710917bf-d91c-4ca3-bce9-c35afba0ce5e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:43.312209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.312939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.313454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.331251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] Creating event network-vif-plugged:710917bf-d91c-4ca3-bce9-c35afba0ce5e for instance 40d26017-97a5-4608-be79-49ce94b11fff on n-h2-858383-13 Oct 18 13:41:43.337782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ffff31e5-f1af-4445-bfe1-37b56368ccc4 req-99da2a6d-97f1-471d-849d-bed0ef13d3a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045296 Oct 18 13:41:43.339496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2119/4169] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:43.415498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:43.416358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:43.424801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.425742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.426375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.427279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.427920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.428546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.486804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.487570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.488524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.489183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lazy-loading 'fault' on Instance uuid a607bca9-db45-483e-a324-dd964f785966 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:41:43.568019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af7a4f65914752be86a83fa3408870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c056fcd52f4a97b89c731d06027fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.576547 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-755e612d-ae6b-4011-aa13-a6d1e552d0ed tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 200 len: 1313 microversion: 2.1 time: 0.170285 Oct 18 13:41:43.586850 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2051/4170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:43 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:43.604984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:43.605888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:43.631606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.634639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.636842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.637898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.639560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.640167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.655029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:43.657231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:43.662536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.663032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.663638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.664351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.664808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.665239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.826924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.846754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8c966eb-8b96-48ad-a78f-96effbc829a6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.249503 Oct 18 13:41:43.847358 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2120/4171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:43 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:43.864554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.874992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c40f46f-1837-4f5b-8460-278eaf0de455 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.223681 Oct 18 13:41:43.890583 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2052/4172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:43 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:44.199994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.200734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.207259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.207756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.208207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.208914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.209379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.209810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.276928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.277800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.285538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.286177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.286634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.289738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.289738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.289738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.404214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:44.418561 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1231a81b-059f-4b98-acc5-599d429a0b63 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1309 microversion: 2.1 time: 0.223102 Oct 18 13:41:44.421955 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2121/4173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:44.611490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.612745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] [instance: a607bca9-db45-483e-a324-dd964f785966] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.620523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.621276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.621778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.622498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.622960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.625736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.645835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] HTTP exception thrown: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Request method failure captured: Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 HTTP/1.1 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqy9tGURbMOJesX7cBQWlHpA1le33FLRWsxjTnVq6NB-dOg8rF1AtvAVcXbVg27uOknFalpCfwUswj4CM5e8lh_PtEk-tMf7jypYAUWBI9giP3CT3cIQeR-dSA3iEmWLjJMa-Dt5wRo6lR20o0hYfmiSgl4oRuGTZeGYZ1R8pVd506w Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 90c056fcd52f4a97b89c731d06027fc5 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-771460691 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90c056fcd52f4a97b89c731d06027fc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90c056fcd52f4a97b89c731d06027fc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90c056fcd52f4a97b89c731d06027fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90c056fcd52f4a97b89c731d06027fc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-771460691 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 90c056fcd52f4a97b89c731d06027fc5 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-771460691 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueTestJSONUnderV235-771460691-project Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 11af7a4f65914752be86a83fa3408870 Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-771460691-project Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a607bca9-db45-483e-a324-dd964f785966'} Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:44.647629 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] Returning 404 to user: Instance a607bca9-db45-483e-a324-dd964f785966 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:44.650846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75dede63-4642-4d46-ac4f-fb2eb8637203 tempest-ServerRescueTestJSONUnderV235-771460691 tempest-ServerRescueTestJSONUnderV235-771460691-project] 10.222.0.27 "GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966" status: 404 len: 111 microversion: 2.1 time: 0.041708 Oct 18 13:41:44.653529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2122/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/a607bca9-db45-483e-a324-dd964f785966 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:44.680583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:44.687246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:44.694747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fca8b791-10c8-46d7-a7e2-712f6091b431 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.422653 Oct 18 13:41:44.713260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2053/4175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:44.868866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.869498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.879846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.881161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.881954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.882879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.883930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.884509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.911069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.913150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.931614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.933384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.947677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.949319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.950455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.957329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.268425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:45.277316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9299cb67-138b-4499-b79a-4082f8ac3536 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.412254 Oct 18 13:41:45.282439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2123/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:45.332417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:45.348011 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fddb5665-2d71-414d-a600-8bd949562a71 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.448166 Oct 18 13:41:45.355025 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2054/4177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:45.373052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d2c3dc-32b1-49d0-9265-f5a8642b88ff", "name": "network-vif-plugged", "status": "completed", "tag": "112dfe31-6f59-468c-bc12-0c9692045678"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:45.382747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.383229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.383665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.403405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] Creating event network-vif-plugged:112dfe31-6f59-468c-bc12-0c9692045678 for instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff on n-h2-858383-13 Oct 18 13:41:45.408615 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a544c3d8-f644-45c4-b8f6-24623ed6bba1 req-c29fc794-7c8d-4317-9896-12abcc3f0782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039761 Oct 18 13:41:45.409774 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2124/4178] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:45.447628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:45.448259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.455538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.456052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.456497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.457512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.457644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.458326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.723516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:45.723720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:45.724356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.736345 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0d479ca-39d2-4bb1-a9ce-d39840ed86aa tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1491 microversion: 2.1 time: 0.292932 Oct 18 13:41:45.737851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.738561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.739168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.740069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.740706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.742964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.757927 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2055/4179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:45 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1491 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:45.925030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1125787222", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:45.993588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:46.176155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:46.199679 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-74805e0b-2daa-4956-a40f-fd4d019b4973 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.480569 Oct 18 13:41:46.200325 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2125/4180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:45 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:46.308061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:46.310224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:46.322912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.326174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.327939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.329527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.330649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.331704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.592319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:46.611900 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53309cda-1da1-4c9c-a4be-f5052ba2a6b6 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.300360 Oct 18 13:41:46.611900 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2126/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:46 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:46.614479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:46.615398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:46.631078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.631593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.632055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.632946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.633416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.634267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.748017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:46.748777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:46.749367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:46.750136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:46.750583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:46.767672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.768263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.768967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.774268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.774896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.775359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:46.814334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:46.824192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:46.845242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:46.870978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:46.924035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:46.937685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a9882af6-d26b-44f2-b743-666a9814ef9e tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1312 microversion: 2.1 time: 0.330231 Oct 18 13:41:46.939863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2127/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:46 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:47.002141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7156bed7-e0bf-4d73-bbe5-9ee646cdab24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085899 Oct 18 13:41:47.003273 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2056/4183] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:47.017179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa4e9d58-da1d-4206-b8bd-e6a5f7198ee5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:47.017774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa4e9d58-da1d-4206-b8bd-e6a5f7198ee5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:47.094359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa4e9d58-da1d-4206-b8bd-e6a5f7198ee5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:47.109846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa4e9d58-da1d-4206-b8bd-e6a5f7198ee5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1209 microversion: 2.1 time: 0.097875 Oct 18 13:41:47.110816 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2128/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:47 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:47.223562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:47.225833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:47.241935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.242474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.242925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.243674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.244138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.244576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.466076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:47.477374 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0b349b1-fcdc-4d05-b25b-226a41bad4f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.257596 Oct 18 13:41:47.479057 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2057/4185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:47 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:47.502192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a775a65-ea2b-480b-8db4-1ebd29670943", "name": "network-vif-unplugged", "status": "completed", "tag": "59be9f50-e295-4ec6-aa92-dfbc4072fe98"}, {"server_uuid": "93d542c8-51dd-4d1a-87ce-b33b6e39a7aa", "name": "network-vif-plugged", "status": "completed", "tag": "62b14289-02a4-47de-adf8-6c048149b9fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:47.516993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.517482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.518119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.553470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Creating event network-vif-unplugged:59be9f50-e295-4ec6-aa92-dfbc4072fe98 for instance 3a775a65-ea2b-480b-8db4-1ebd29670943 on n-h1-858383-13 Oct 18 13:41:47.554303 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] Creating event network-vif-plugged:62b14289-02a4-47de-adf8-6c048149b9fa for instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa on n-h2-858383-13 Oct 18 13:41:47.589007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-614da7d7-cf61-4554-beba-c0db1f530ee7 req-7e944f26-9516-4375-be5c-e6eecc0461f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.113492 Oct 18 13:41:47.590739 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2129/4186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:47.633284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:47.635151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:47.648164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.650775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.661630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.663328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.664484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.665147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.964694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:47.965824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:47.973895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.975566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.975566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.976287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.976965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.977620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.184162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:48.192859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85e6546d-f9f1-4734-b210-57860771c543 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1496 microversion: 2.1 time: 0.232457 Oct 18 13:41:48.193805 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2130/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:47 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1496 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:48.224980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:48.225830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:48.234325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.235048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.235644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.236644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.237253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.237882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.326560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:48.335355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a995d38-7449-40e6-b63e-af88baf194c9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1213 microversion: 2.1 time: 0.114791 Oct 18 13:41:48.351746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2131/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:48 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:48.368336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:48.375897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:48.391976 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f7702b9e-273a-4238-b55b-77f59528feae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.762918 Oct 18 13:41:48.395973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.server_groups [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Querying cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) for 1 instances {{(pid=121010) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:41:48.396691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.397359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.397944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.405464 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2058/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:47 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:48.429696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b818995-32b8-4b50-ae34-b74484600d91 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455" status: 200 len: 222 microversion: 2.1 time: 0.076403 Oct 18 13:41:48.430921 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2132/4190] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:41:48 2022] GET /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455 => generated 222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:48.458216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:48.458834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:48.474759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.477540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.478179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.479004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.479543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.481514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.505272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:48.509107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:48.519608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:48.524579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.525409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.531482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.531482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.531482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.531482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.824588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:48.835912 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6efce265-bf62-4015-9828-4e70860754e9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.337483 Oct 18 13:41:48.836704 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2133/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:48 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:48.924500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-111dd02d-3785-4720-9dc9-50e81abec38f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 204 len: 0 microversion: 2.1 time: 0.484703 Oct 18 13:41:48.924500 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2059/4192] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:48 2022] DELETE /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:48.933520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:48.934746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:48.939391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:48.943917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.944722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.945393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:48.946345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:48.947050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:48.947688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.293088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:49.304495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-528876ab-0873-4f5e-abfe-0bcf44693494 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1502 microversion: 2.1 time: 0.375359 Oct 18 13:41:49.306997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2134/4193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:48 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1502 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:49.362988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:49.363704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:49.381243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.383151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.383865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.384845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.385832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.387610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.426100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:49.426808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:49.435435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.435959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.437631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.439612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.440977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.441437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.537238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:49.547204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3584507f-41a0-442b-a572-2e46c2c5091a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1261 microversion: 2.1 time: 0.188439 Oct 18 13:41:49.547971 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2060/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:49 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:49.712485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:49.725758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a23135bd-acdb-45b3-84ab-959e0426d8ab tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1402 microversion: 2.1 time: 0.303841 Oct 18 13:41:49.726721 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2135/4195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:49 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1402 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:49.862973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:49.863635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:49.874547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.875372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.875833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.876554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.877025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.877496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.237181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:50.247432 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdeb301e-8976-447c-9ea0-cd50a6d10ad0 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.389222 Oct 18 13:41:50.248394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2061/4196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:49 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:50.282378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a775a65-ea2b-480b-8db4-1ebd29670943", "name": "network-vif-plugged", "status": "completed", "tag": "59be9f50-e295-4ec6-aa92-dfbc4072fe98"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:50.302587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.303576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.304175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.325009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] Creating event network-vif-plugged:59be9f50-e295-4ec6-aa92-dfbc4072fe98 for instance 3a775a65-ea2b-480b-8db4-1ebd29670943 on n-h1-858383-13 Oct 18 13:41:50.326600 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2bdcc8d0-84c0-4205-bc84-73b5dea5e3ce req-7f37b4e6-85e3-41db-ad82-51dfd7596a07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049346 Oct 18 13:41:50.328996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:50.330146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:50.332270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2136/4197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:50.338419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.339259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.340210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.341167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.341842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.342506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.576218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:50.578279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:50.592107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.593645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.594815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.595905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.596799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.598301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.745303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:50.749554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:50.761480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae49fd57-976c-4b91-9304-f3d03ecf2fd7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1267 microversion: 2.1 time: 0.193199 Oct 18 13:41:50.762393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2137/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:50 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:50.773584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:50.776074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:50.782671 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71fc3222-302e-4e71-a7ba-42abe878b8af tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1502 microversion: 2.1 time: 0.457580 Oct 18 13:41:50.783274 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2062/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:50 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1502 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:50.785247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.785858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.786491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.787498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.788827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.790080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.153814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:51.162915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:51.177649 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79ce4781-944b-48db-9fbf-f50ca551ef13 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1589 microversion: 2.1 time: 0.413019 Oct 18 13:41:51.190652 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2138/4200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:50 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1589 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:51.204989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:51.205729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:51.214430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.216340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.216340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.217258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.217927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.218827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.281088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:51.282585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:51.292465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.296637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.296637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.296637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.296637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.296637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.387194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e06d407b-a920-4ae0-ae5e-f3a9c4a6bf17 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186870 Oct 18 13:41:51.387918 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2063/4201] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:41:51 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:51.658513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:51.677781 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-303f0d72-ec2f-4880-92f9-5deed75a747b tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1523 microversion: 2.1 time: 0.400728 Oct 18 13:41:51.686251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2139/4202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:51 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:51.788046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:51.788759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:51.795717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.796626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.797297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.798141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.799440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.800102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.808814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:51.809950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:51.817319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.817818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.818302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.819009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.819729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.820179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:52.145201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:52.156003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb936d3e-7af7-474a-8ab0-be1c5b1234bb tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1502 microversion: 2.1 time: 0.353654 Oct 18 13:41:52.156598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2140/4203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:51 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:52.169254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d2c3dc-32b1-49d0-9265-f5a8642b88ff", "name": "network-vif-deleted", "tag": "112dfe31-6f59-468c-bc12-0c9692045678"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:52.188102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:52.188637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:52.189249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:52.207948 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] Creating event network-vif-deleted:112dfe31-6f59-468c-bc12-0c9692045678 for instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff on n-h2-858383-13 Oct 18 13:41:52.218344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-733e168c-3d1a-46ce-b36e-3da77a45282f req-cff8d1c6-f22b-4135-9681-c5d94a2d9e9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059551 Oct 18 13:41:52.220514 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2141/4204] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:52.368832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:52.380779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9378126-50c5-41ce-986c-7da44f5a4be0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.597774 Oct 18 13:41:52.382016 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2064/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:51 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:52.702151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:52.702875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:52.725960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:52.727404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:52.728032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:52.731336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:52.731834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:52.732284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:52.931772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:52.940543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da83efd3-0879-4dc3-8306-f7429e8a12bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1508 microversion: 2.1 time: 0.242799 Oct 18 13:41:52.941149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2142/4206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:52 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:52.963845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:52.965090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:52.971311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:52.971807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:52.972253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:52.972955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:52.973419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:52.973850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.185390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:53.186141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:53.193389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.201471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.202208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.205707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.206330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.207109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.297147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.297664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.298145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.303179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lazy-loading 'fault' on Instance uuid 95d2c3dc-32b1-49d0-9265-f5a8642b88ff {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:41:53.412534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07f47c7ef045aab1daa8cb6df9566b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634f588c94434a2d95b1da508cb56f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:53.422975 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b36e25b4-8c51-417c-8aea-03ea998d5b10 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 200 len: 1302 microversion: 2.1 time: 0.243213 Oct 18 13:41:53.427740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2143/4207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:53 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:53.435147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:53.435935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:53.463917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.467510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.468155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.471944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.477579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.478822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.636784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:53.688060 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ddbf2aa5-05d4-4df4-bd71-ca6b80526936 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 200 len: 1508 microversion: 2.1 time: 0.728716 Oct 18 13:41:53.706965 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2065/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:52 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 1508 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:53.725483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:53.726272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:53.735310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.736081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.737350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.738289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.739105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.739716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.751194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:53.770816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:53.783495 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b9e1b0c-cd6f-481c-9602-af24f155fe31 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.350731 Oct 18 13:41:53.787335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2144/4209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:53 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:54.191074 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6398ff17-e887-4f3b-9c41-5f8e7c8b9add tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 204 len: 0 microversion: 2.1 time: 0.474712 Oct 18 13:41:54.198865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2066/4210] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:53 2022] DELETE /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:54.204048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:54.205185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:54.215659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.218612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.220586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.222549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.222679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d542c8-51dd-4d1a-87ce-b33b6e39a7aa", "tag": "62b14289-02a4-47de-adf8-6c048149b9fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:54.226514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.226989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.250869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.252139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.252818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.277633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] Creating event network-changed:62b14289-02a4-47de-adf8-6c048149b9fa for instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa on n-h2-858383-13 Oct 18 13:41:54.286888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c07eb330-d6aa-4a34-8c64-913c9224eea4 req-041707b7-df7c-4269-a3d1-c09e6190dbd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076244 Oct 18 13:41:54.288072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2067/4211] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:54.353432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2031678098", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6ab1dcbf-57e1-4423-b0e5-94b7286e99dd"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:54.480269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] validate_networks() for [('6ab1dcbf-57e1-4423-b0e5-94b7286e99dd', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:54.725526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:54.744334 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40f47ce3-8979-47ab-a2e8-29216f29a5d0 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1589 microversion: 2.1 time: 0.541937 Oct 18 13:41:54.746497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2145/4212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:54 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1589 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:54.753191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:54.770942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:54.792384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.792901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.793359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.794107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.794583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.795022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.842662 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff HTTP/1.1 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '95d2c3dc-32b1-49d0-9265-f5a8642b88ff'} Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:54.844396 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:54.847819 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b2cf326-9bb0-4192-9677-3e4abe2efa79 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 404 len: 111 microversion: 2.1 time: 0.098212 Oct 18 13:41:54.862439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2146/4213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:54 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:54.869524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:54.869868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:54.893337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.893795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.894256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.894969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.904416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.906039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.264596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:55.272220 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0bd9ed8-31e4-438b-8771-eae6a08ffb02 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.408630 Oct 18 13:41:55.276237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2147/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:54 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:55.295232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.338859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.server_groups [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Querying cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) for 1 instances {{(pid=121010) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:41:55.341201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.343638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.344599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.374283 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcc53d97-6565-47e1-beba-fec998ea2afd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.091897 Oct 18 13:41:55.374283 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2148/4215] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:41:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:55.387343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.424334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.server_groups [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Querying cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) for 1 instances {{(pid=121010) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:41:55.426661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.428137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.429759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.449176 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad70951c-262a-4cf2-b681-c16abe533f52 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455" status: 200 len: 184 microversion: 2.1 time: 0.067053 Oct 18 13:41:55.450319 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2149/4216] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:41:55 2022] GET /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455 => generated 184 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:55.466513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.467566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:55.475614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.476280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.477089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.482826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.483578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.484196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.504347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff HTTP/1.1 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '95d2c3dc-32b1-49d0-9265-f5a8642b88ff'} Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:55.505614 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.510280 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.511062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:55.511062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:55.511062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:55.511062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:55.511062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:55.514623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.515698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ff90a79-69dd-429b-9a54-2c3936822276 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 404 len: 111 microversion: 2.1 time: 0.054360 Oct 18 13:41:55.516945 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2150/4217] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.527927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.528684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.529917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.533287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.534359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.534953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.541783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] [instance: 95d2c3dc-32b1-49d0-9265-f5a8642b88ff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:55.542088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.562598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.563108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.563564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.564293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.564759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.567425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.600672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:55.603858 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff HTTP/1.1 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '95d2c3dc-32b1-49d0-9265-f5a8642b88ff'} Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.610444 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance 95d2c3dc-32b1-49d0-9265-f5a8642b88ff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cff0bf6a-defa-46c2-9770-1e5b90622a0b tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff" status: 404 len: 111 microversion: 2.1 time: 0.091809 Oct 18 13:41:55.621548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2151/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:55 2022] GET /compute/v2.1/servers/95d2c3dc-32b1-49d0-9265-f5a8642b88ff => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.626703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Getting quotas for user f278334f3cd646a89ec99502f0bfe636 and project fc7d921cf98c41e092f10fda507c0624. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:55.643772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c77d1995-51e1-42d9-8238-eeac1861414f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.669526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c77d1995-51e1-42d9-8238-eeac1861414f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c77d1995-51e1-42d9-8238-eeac1861414f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-server-groups/aeff0c03-2908-495b-b07e-a30b6c133cc6 HTTP/1.1 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'aeff0c03-2908-495b-b07e-a30b6c133cc6'} Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.677205 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. Oct 18 13:41:55.681678 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.683129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c77d1995-51e1-42d9-8238-eeac1861414f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance group aeff0c03-2908-495b-b07e-a30b6c133cc6 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.684407 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c77d1995-51e1-42d9-8238-eeac1861414f tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/aeff0c03-2908-495b-b07e-a30b6c133cc6" status: 404 len: 117 microversion: 2.1 time: 0.061893 Oct 18 13:41:55.684976 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2152/4219] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/os-server-groups/aeff0c03-2908-495b-b07e-a30b6c133cc6 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.687950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:55.695703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:55.698921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b7dd41-7a56-4f40-88d0-3946248a943d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.713919 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-44b7dd41-7a56-4f40-88d0-3946248a943d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b7dd41-7a56-4f40-88d0-3946248a943d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-server-groups/3da40390-7715-47e5-b7f7-44aab12864a7 HTTP/1.1 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3da40390-7715-47e5-b7f7-44aab12864a7'} Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.718559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. Oct 18 13:41:55.722380 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.724517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44b7dd41-7a56-4f40-88d0-3946248a943d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance group 3da40390-7715-47e5-b7f7-44aab12864a7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.726345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44b7dd41-7a56-4f40-88d0-3946248a943d tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3da40390-7715-47e5-b7f7-44aab12864a7" status: 404 len: 117 microversion: 2.1 time: 0.034400 Oct 18 13:41:55.729144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2153/4220] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/os-server-groups/3da40390-7715-47e5-b7f7-44aab12864a7 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.745438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a77f52f2-0e1e-4b90-bba6-2f20ad595eea tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.756152 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a77f52f2-0e1e-4b90-bba6-2f20ad595eea tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a77f52f2-0e1e-4b90-bba6-2f20ad595eea tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-server-groups/b1af30ea-1b79-400b-b51a-2f412679d018 HTTP/1.1 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'b1af30ea-1b79-400b-b51a-2f412679d018'} Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.759850 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.763625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a77f52f2-0e1e-4b90-bba6-2f20ad595eea tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance group b1af30ea-1b79-400b-b51a-2f412679d018 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.764901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a77f52f2-0e1e-4b90-bba6-2f20ad595eea tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b1af30ea-1b79-400b-b51a-2f412679d018" status: 404 len: 117 microversion: 2.1 time: 0.031163 Oct 18 13:41:55.765612 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2154/4221] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/os-server-groups/b1af30ea-1b79-400b-b51a-2f412679d018 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.774530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-390d3894-aca9-4567-b9d4-d146550824dd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.782535 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-390d3894-aca9-4567-b9d4-d146550824dd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] HTTP exception thrown: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-390d3894-aca9-4567-b9d4-d146550824dd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Request method failure captured: Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-server-groups/898e5b7b-202d-4d36-b96f-54818ec33ee7 HTTP/1.1 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqz88vEmxsNZ28DzNaxjwCq5VJhwXJcMDSmEFB21LVYpo4F1OlmxcdVDhOQuCzfxh9B9F5wQxgAMZBkLuI4PexbFYuq3AhJNZ4D7yzXeuTgKwhAusook7pmOoOYZoe_JVO8dyBaYvgC7MIYQPuiOXCuu5B3_GnVuiGhjZ-FkCnGkHy8 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/634f588c94434a2d95b1da508cb56f85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_634f588c94434a2d95b1da508cb56f85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 634f588c94434a2d95b1da508cb56f85 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroupTestJSON-969001225 Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6c07f47c7ef045aab1daa8cb6df9566b Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroupTestJSON-969001225-project Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '898e5b7b-202d-4d36-b96f-54818ec33ee7'} Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.784405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. Oct 18 13:41:55.787949 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:41:55.791095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-390d3894-aca9-4567-b9d4-d146550824dd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Returning 404 to user: Instance group 898e5b7b-202d-4d36-b96f-54818ec33ee7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:55.792126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-390d3894-aca9-4567-b9d4-d146550824dd tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/898e5b7b-202d-4d36-b96f-54818ec33ee7" status: 404 len: 117 microversion: 2.1 time: 0.022174 Oct 18 13:41:55.793188 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2155/4222] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/os-server-groups/898e5b7b-202d-4d36-b96f-54818ec33ee7 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.803144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6d1c574-709c-40f8-9c28-60b43b86e556 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.865356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c8cc149-bd2f-4984-997b-9b506c8dcf47 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518137 Oct 18 13:41:55.866441 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2068/4223] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:55.889994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a94c1b49-5011-4977-aaed-6d147bb03b6a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.893630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a94c1b49-5011-4977-aaed-6d147bb03b6a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:55.897787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:55.918263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6d1c574-709c-40f8-9c28-60b43b86e556 tempest-ServerGroupTestJSON-969001225 tempest-ServerGroupTestJSON-969001225-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455" status: 204 len: 0 microversion: 2.1 time: 0.120745 Oct 18 13:41:55.919419 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2156/4224] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:41:55 2022] DELETE /compute/v2.1/os-server-groups/87289a1b-c590-42e8-8f54-e6e0b07c3455 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:56.086909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a94c1b49-5011-4977-aaed-6d147bb03b6a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:56.099102 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a94c1b49-5011-4977-aaed-6d147bb03b6a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1218 microversion: 2.1 time: 0.218713 Oct 18 13:41:56.099700 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2069/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:55 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:56.306411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:56.310455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:56.318147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338e7ce9-c523-472a-af71-816c69c91584", "tag": "6a1da0f3-7e4b-48f0-8489-a934acee08e9"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:56.322296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:56.322808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:56.323259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:56.326598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:56.327148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:56.327713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:56.333896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:56.334701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:56.335488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:56.353529 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] Creating event network-changed:6a1da0f3-7e4b-48f0-8489-a934acee08e9 for instance 338e7ce9-c523-472a-af71-816c69c91584 on n-h1-858383-13 Oct 18 13:41:56.359607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f61b8657-6212-4236-bde2-d537df807b3d req-50e12711-cc92-4b27-99cf-3a608037eefd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046000 Oct 18 13:41:56.360982 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2070/4226] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:57.107487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:57.130217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e0c24d3-dd90-41ef-bcd1-d0ea743d2f26 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:57.130961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1e0c24d3-dd90-41ef-bcd1-d0ea743d2f26 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:57.270293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1e0c24d3-dd90-41ef-bcd1-d0ea743d2f26 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:57.281581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e0c24d3-dd90-41ef-bcd1-d0ea743d2f26 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1218 microversion: 2.1 time: 0.160047 Oct 18 13:41:57.283413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2071/4227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:57 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:57.327560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:57.338688 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37b93092-336e-48ab-a836-7cfb8c620152 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 1.037671 Oct 18 13:41:57.340093 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2157/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:56 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:58.312952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:58.314590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:58.324249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.325790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.326418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.327155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.327627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.328118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.334188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:58.366435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:58.370125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:58.375064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.375695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.376217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.377588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.378170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.379237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.498424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:58.517504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48498a76-c09b-409b-ab05-226389ea2f1e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1222 microversion: 2.1 time: 0.212671 Oct 18 13:41:58.518789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2072/4229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:58 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1222 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:58.525634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a775a65-ea2b-480b-8db4-1ebd29670943", "name": "network-vif-deleted", "tag": "59be9f50-e295-4ec6-aa92-dfbc4072fe98"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:58.536877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.537689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.538358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.556260 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] Creating event network-vif-deleted:59be9f50-e295-4ec6-aa92-dfbc4072fe98 for instance 3a775a65-ea2b-480b-8db4-1ebd29670943 on n-h1-858383-13 Oct 18 13:41:58.563940 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a5f90ce3-0a4c-451d-a294-d4dab6330e92 req-8de8035a-6fa4-4c37-a0a4-4561e7975957 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042813 Oct 18 13:41:58.565415 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2073/4230] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:58.739498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:58.754778 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcaa9bce-1e27-4ba0-b197-52636b68a750 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.391534 Oct 18 13:41:58.754778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2158/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:58 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:59.546985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.547807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.570872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.571835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.572496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.573307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.573859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.574397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.679218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:59.693870 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46010514-3f49-42af-8cee-a2b86f7af5b7 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1270 microversion: 2.1 time: 0.154583 Oct 18 13:41:59.696751 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2074/4232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:59.777167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.778529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.785949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.786758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.787533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.788722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.789390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.790066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:00.253395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:00.275850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2dcc61a-b960-4586-ae7e-0e2af3fe0c1e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.502953 Oct 18 13:42:00.276953 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2159/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:00.721157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:00.722561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:00.743850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:00.744521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:00.745091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:00.746330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:00.746901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:00.747449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:00.930957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:00.965009 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc464201-2525-42a9-baf0-c1fb41b45559 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1276 microversion: 2.1 time: 0.247591 Oct 18 13:42:00.965957 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2075/4234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:00 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:01.301015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:01.301652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:01.309958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:01.310513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:01.310958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:01.311662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:01.312505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:01.312951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:01.482249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:01.490662 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e6c8fd5-f835-4549-b0a8-f7a07f4cac8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.193225 Oct 18 13:42:01.500815 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2160/4235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:01 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:01.995482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:01.996213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:02.009275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.016384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.017010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.018048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.018690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.019282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.166578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:02.182145 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cd47b02-751f-42ec-8b33-2b111925a8f6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1276 microversion: 2.1 time: 0.190162 Oct 18 13:42:02.201886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2076/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:01 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:02.399223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338e7ce9-c523-472a-af71-816c69c91584", "name": "network-vif-plugged", "status": "completed", "tag": "6a1da0f3-7e4b-48f0-8489-a934acee08e9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:02.419881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.421006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.421601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.442628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] Creating event network-vif-plugged:6a1da0f3-7e4b-48f0-8489-a934acee08e9 for instance 338e7ce9-c523-472a-af71-816c69c91584 on n-h1-858383-13 Oct 18 13:42:02.452221 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f0f72d13-53dc-46eb-b999-5d554d0721e1 req-cbaeda1e-a178-4834-8722-31550c7b35dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055729 Oct 18 13:42:02.460505 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2161/4237] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:02.515319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:02.515930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:02.533695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.534247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.534707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.535436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.535903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.536351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.021048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:03.042451 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dfb03e3f-0db5-452c-985d-c7ea28f448fc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.530689 Oct 18 13:42:03.043791 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2077/4238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:02 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:03.238049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:03.238973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:03.265034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.265290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.266525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.268098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.273950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.273950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.502745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:03.511783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:03.521549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Searching by: {'deleted': False, 'project_id': '8c8666b164a743dea89a8f81a277d186'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:42:03.521549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.522379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.522778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.523529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.524222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.525625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.597103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:42:03.652757 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fc22ee4-995d-4431-98cd-927e6c76b438 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.154229 Oct 18 13:42:03.654075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2078/4239] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:42:03 2022] GET /compute/v2.1/servers => generated 333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:03.670428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:03.675715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:03.676616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Searching by: {'deleted': False, 'project_id': '8c8666b164a743dea89a8f81a277d186'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:42:03.682339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.682949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.683488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.688752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.689915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.694569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:03.710185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:03.752914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c323c18c-58dc-490d-814e-9e6b44bb0892 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.545943 Oct 18 13:42:03.765573 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2162/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:03 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:03.792359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:42:03.888775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:03.943498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:03.943987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:03.949418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:04.065056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:04.065751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:04.075669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:04.076213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:04.076678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:04.077418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:04.078384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:04.078814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:04.315896 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68f3872b-a831-4258-bea9-5d0ccbe9aa26 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.652222 Oct 18 13:42:04.317497 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2079/4241] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:42:03 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:04.346706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33dc40d9-f7b9-437d-8e5f-083e3aad754e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:04.358305 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-33dc40d9-f7b9-437d-8e5f-083e3aad754e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015407 Oct 18 13:42:04.366146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2080/4242] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:42:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:04.402562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:04.412790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f37c002c-8b0d-4d54-ba5e-6d3907e225bc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1309 microversion: 2.1 time: 0.351802 Oct 18 13:42:04.415956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2163/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:04 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:04.780449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:04.781082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:04.795506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:04.796015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:04.796467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:04.797184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:04.800553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:04.801194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.191996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:05.200358 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4b46810e-ade4-4418-92d3-2e48eb6b3ec9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.423716 Oct 18 13:42:05.200948 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2081/4244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:04 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:05.337974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.343199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:05.346932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.347682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.348272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.349282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.349750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.350506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.384199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:05.387460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:05.414457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a26b487-1109-4999-8704-4577cfef02a8", "tag": "45e6fb45-435a-4c3d-a273-46f3bbfd7145"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:05.437579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.438092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.441978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.493025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] Creating event network-changed:45e6fb45-435a-4c3d-a273-46f3bbfd7145 for instance 8a26b487-1109-4999-8704-4577cfef02a8 on n-h1-858383-13 Oct 18 13:42:05.498437 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-533ca94a-292f-4fce-9714-09ff000d3bc1 req-b4ec0535-bc93-4a4d-bf26-306a22db5f58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087421 Oct 18 13:42:05.499512 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2082/4245] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:05.520790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.521569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:05.537210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.537552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.538013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.547404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.547404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.547608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.785136 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb1e616b-96a6-4f99-93a1-4b57c5961aef tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 204 len: 0 microversion: 2.1 time: 0.450797 Oct 18 13:42:05.789483 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2164/4246] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:05 2022] DELETE /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:05.796408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.797238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:05.803473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.804058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.804596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.805367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.806007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.806679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.949645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:05.964085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-def82cc9-92aa-44e0-802a-26c31ea34de9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1490 microversion: 2.1 time: 0.462875 Oct 18 13:42:05.967119 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2083/4247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:05 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1490 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:05.998982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.999696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:06.020301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.020827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.021286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.022007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.022810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.023405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.032745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:06.044266 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6025e3a6-50c8-4ea9-852d-7bb378d4ab22 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1699 microversion: 2.1 time: 0.252444 Oct 18 13:42:06.045040 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2165/4248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:05 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1699 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:06.228410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:06.229331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:06.239332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.240072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.240677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.241621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.242284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.242717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.382693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:06.400417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d211127f-1bcc-4065-9d55-59ea30c9358b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1491 microversion: 2.1 time: 0.404912 Oct 18 13:42:06.402161 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2084/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:05 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1491 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:06.423060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:06.423784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:06.439920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.440557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.441100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.441852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.442364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.443017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.572042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:06.583736 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab4f5ed4-0015-4176-86df-57c56eda6a08 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.362597 Oct 18 13:42:06.585863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2166/4250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:06 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:06.789876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:06.798476 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-504e5845-f8a1-4be5-9756-660e8242981b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1490 microversion: 2.1 time: 0.379292 Oct 18 13:42:06.799204 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2085/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:06 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1490 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:06.821066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:06.822173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:06.828202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.828700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.829151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.830241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.830368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.830990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.859416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:07.073891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:07.074790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:07.086287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.088117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.090018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.091295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.091935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.092587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.179048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9f9cfaf-a213-4d56-bb8f-816a03c8a2ca tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 204 len: 0 microversion: 2.1 time: 0.361293 Oct 18 13:42:07.183057 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2167/4252] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:06 2022] DELETE /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:07.195560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:07.200414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:07.214909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.215910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.217058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.218145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.218998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.219675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.339546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:07.355175 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-073068dc-2371-44f0-8343-6e381bf951d6 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1699 microversion: 2.1 time: 0.285535 Oct 18 13:42:07.368804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2086/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:07 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1699 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:07.553634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:07.574073 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6ac10dc-ba9e-485b-9aab-9470b715b9ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1496 microversion: 2.1 time: 0.387891 Oct 18 13:42:07.577647 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2168/4254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:07 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1496 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:07.613994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:07.615682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:07.622785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.628585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.629255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.631791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.634419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.634887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.938893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:07.949468 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77a18f75-a6ae-4fe5-960f-7ea9aa149369 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.339024 Oct 18 13:42:07.949468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2087/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:07 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:08.382415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:08.382562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:08.393013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.400218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.400687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.401439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.401914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.402383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.599423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:08.600308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:08.623740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.624394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.626689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.630537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.632168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.632867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.700783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:08.709864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9c864b0-d30a-48a7-9729-8c3bce6a437e tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1699 microversion: 2.1 time: 0.331683 Oct 18 13:42:08.714933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2169/4256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:08 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1699 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:08.954977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:08.971992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:08.972624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:08.980882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.981383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.981822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.982734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-360c4967-e3fc-4b3a-b4e4-c4aa2f4f3633 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1496 microversion: 2.1 time: 0.387912 Oct 18 13:42:08.983350 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2088/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:08 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1496 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:08.993303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.994126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.995189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.226173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:09.236280 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0145ee3c-22e1-45fd-a893-bb22c65f69bd tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.268196 Oct 18 13:42:09.251743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2170/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:08 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:09.573520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad82e6b-d6a0-4994-852d-d55b0a448a56", "name": "network-vif-deleted", "tag": "e0247fc8-6e0f-440e-9e0b-2b9321c11fec"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:09.602840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.603530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.608999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.641704 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] Creating event network-vif-deleted:e0247fc8-6e0f-440e-9e0b-2b9321c11fec for instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 on n-h2-858383-13 Oct 18 13:42:09.660557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9eb79241-0315-4a55-991a-167c4af28d1e req-67a838ee-4331-40b4-96ac-789838345b65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091413 Oct 18 13:42:09.668269 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2089/4259] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:09.739626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:09.740891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:09.752578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.755079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.755889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.759498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.762711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.764970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.889501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:09.901494 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28bd1166-67e9-4bf3-889e-8ebcc1ca3c88 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1353 microversion: 2.1 time: 0.165636 Oct 18 13:42:09.905403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2171/4260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:09 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:10.010917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.012082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:10.024843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.025507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.025967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.029407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.030427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.031050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.263460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.264409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:10.270571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:10.275629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.280985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.282149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.283057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.283540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.283983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.585837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:10.597361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.338748 Oct 18 13:42:10.602133 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2172/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:10.809208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:10.812998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:10.830702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1496 microversion: 2.1 time: 0.819884 Oct 18 13:42:10.831352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2090/4262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1496 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:10.832571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.833777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001539 Oct 18 13:42:10.834724 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2173/4263] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:42:10.843318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.856356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002159 Oct 18 13:42:10.856356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2174/4264] 10.222.0.27 () {54 vars in 1035 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 18 13:42:10.862936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.864066 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cafc7c29-30c6-4690-83f1-e95fb7e8a868 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001702 Oct 18 13:42:10.864790 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2091/4265] 10.222.0.27 () {54 vars in 1041 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:10.876546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.877760 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f7e146-fb41-412a-be35-201390eba840 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001600 Oct 18 13:42:10.878287 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2175/4266] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:42:10.930095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:10.930768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:10.938707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.944525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.947585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.948600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:10.950879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:10.951500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.004046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338e7ce9-c523-472a-af71-816c69c91584", "name": "network-vif-deleted", "tag": "6a1da0f3-7e4b-48f0-8489-a934acee08e9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:11.018191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.018617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.029640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.039121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.040187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.040885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.041551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lazy-loading 'fault' on Instance uuid 8ad82e6b-d6a0-4994-852d-d55b0a448a56 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:11.050692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] Creating event network-vif-deleted:6a1da0f3-7e4b-48f0-8489-a934acee08e9 for instance 338e7ce9-c523-472a-af71-816c69c91584 on n-h1-858383-13 Oct 18 13:42:11.063027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3b63cdb1-877c-4146-866b-287060cd9162 req-6154d537-700f-46ec-a45a-bf0bfedd2b01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062860 Oct 18 13:42:11.064216 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2176/4267] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:11.173057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c0f8d3344b45e0a73747d85a9f9e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8666b164a743dea89a8f81a277d186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:11.183086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d189c3d-c8e3-46f8-bfdc-c4a9ca4f1392 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 200 len: 1358 microversion: 2.1 time: 0.256809 Oct 18 13:42:11.198560 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2092/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:10 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:11.625628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:11.626656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:11.633084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.633876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.634567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.635493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.636172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.636840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.820046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:11.828560 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23752f36-79c3-4948-addb-68080c0b8252 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.207429 Oct 18 13:42:11.829130 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2177/4269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:11 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:11.860847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:11.862156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:11.870005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.871059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.871680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.872584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.873224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.873834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.016421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.016932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.021100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.023680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid 338e7ce9-c523-472a-af71-816c69c91584 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:12.159856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:12.176069 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac7402a6-e63b-4be8-a7ef-59822605a3be tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 200 len: 1299 microversion: 2.1 time: 0.319845 Oct 18 13:42:12.177251 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2093/4270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:11 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 1299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:12.210229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.211554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] [instance: 8ad82e6b-d6a0-4994-852d-d55b0a448a56] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:12.227818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.236124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.240630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.244220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.245724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.246835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.300223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] HTTP exception thrown: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Request method failure captured: Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 HTTP/1.1 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqzjkk29vJz-4Jhc1YMdlfZB17SrcJ5Hagqc4g1no2u8BYMWbuuUIQ358EO_Z3rj7i-qPXybCzZTOklNIuTPs_bpyjvrn-pcByP0aHnN24NH50e5JKA2yYf2Hin5UbjO3eDn2FOGM3Wv1KFRBjJ9s5-hKme2Nqgtrv1YeVv1PA4ns0I Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 8c8666b164a743dea89a8f81a277d186 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-1341711816 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8666b164a743dea89a8f81a277d186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c8666b164a743dea89a8f81a277d186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c8666b164a743dea89a8f81a277d186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c8666b164a743dea89a8f81a277d186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-1341711816 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 8c8666b164a743dea89a8f81a277d186 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-1341711816 Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-1341711816-project Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b7c0f8d3344b45e0a73747d85a9f9e0b Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-1341711816-project Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8ad82e6b-d6a0-4994-852d-d55b0a448a56'} Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:12.310107 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. Oct 18 13:42:12.313933 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.315667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Returning 404 to user: Instance 8ad82e6b-d6a0-4994-852d-d55b0a448a56 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:12.316638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9096ba7-57d8-4fa2-8163-1714cf384529 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56" status: 404 len: 111 microversion: 2.1 time: 0.111711 Oct 18 13:42:12.317350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2178/4271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:12 2022] GET /compute/v2.1/servers/8ad82e6b-d6a0-4994-852d-d55b0a448a56 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:12.325796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41982a40-6dc3-4669-9f48-4c27efd87b34 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] Calling method '.version_select at 0x7fb330c9b8b0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.431459 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41982a40-6dc3-4669-9f48-4c27efd87b34 tempest-ServersTestJSON-1341711816 tempest-ServersTestJSON-1341711816-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-346283189" status: 202 len: 0 microversion: 2.1 time: 0.109065 Oct 18 13:42:12.432331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2094/4272] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-346283189 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:12.862935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.862935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:12.868733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.869251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.869778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.879648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.879648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.879648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.206977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:13.208371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:13.235837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.237995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.238693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.241641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.244944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.246453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.312498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 HTTP/1.1 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '338e7ce9-c523-472a-af71-816c69c91584'} Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:13.327094 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2b27df07-3dba-4865-abd3-490b1e96f81e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 404 len: 111 microversion: 2.1 time: 0.126537 Oct 18 13:42:13.339998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2095/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:13 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:42:13.344179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:13.344694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:13.359083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.361314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.371425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.372645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.373306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.374605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.407505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:13.667512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:13.682624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa9cca2c-790c-4261-a0ce-3ec8224c607a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.829373 Oct 18 13:42:13.683374 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2179/4274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:12 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:13.706108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:13.786992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4e65456-fc9a-44e4-a202-92b7076e1013 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 204 len: 0 microversion: 2.1 time: 0.445716 Oct 18 13:42:13.787706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2096/4275] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:13 2022] DELETE /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:13.798889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:13.800768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:13.810307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.811060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.811695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.812559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.813173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.813755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.224746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:14.240121 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d785d7b-9ec2-4afa-930e-4b0610924505 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1497 microversion: 2.1 time: 0.445231 Oct 18 13:42:14.241019 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2180/4276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:13 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1497 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:14.439168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a26b487-1109-4999-8704-4577cfef02a8", "name": "network-vif-plugged", "status": "completed", "tag": "45e6fb45-435a-4c3d-a273-46f3bbfd7145"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:14.445438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:14.482770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:14.483241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:14.486297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.503349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] Creating event network-vif-plugged:45e6fb45-435a-4c3d-a273-46f3bbfd7145 for instance 8a26b487-1109-4999-8704-4577cfef02a8 on n-h1-858383-13 Oct 18 13:42:14.512630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8763e7f7-65a5-4632-9dd9-5f9caaf6da2f req-c42e9d19-65c1-450d-9d58-ba999a831fa6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078369 Oct 18 13:42:14.513796 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2097/4277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:14.710473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:14.710473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:14.720047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:14.720621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:14.721077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.721928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:14.722425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:14.722857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.994484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:15.007877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eff68fe2-ce52-4fd5-9e65-d6ed76e34e3a tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1318 microversion: 2.1 time: 0.301104 Oct 18 13:42:15.008559 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2181/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:14 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:15.270007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:15.271759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:15.286683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.288577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.291608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.292575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.295262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.296513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.353367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:15.431613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96c973dc-61fa-41ec-8ec3-e258f1028871 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Action: 'create', calling method: .version_select at 0x7fb330cac160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-215207529"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:15.874849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:15.888506 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9c7e9c4-3879-422f-abd3-3849d5c08545 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1497 microversion: 2.1 time: 0.623718 Oct 18 13:42:15.902321 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2182/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:15 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1497 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:16.039536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:16.041126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:16.048338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.049179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.049863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:16.050886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.052766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.053435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:16.469622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96c973dc-61fa-41ec-8ec3-e258f1028871 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.436777 Oct 18 13:42:16.470301 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2098/4280] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Oct 18 13:42:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 13:42:16.483515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5c1bb39-4f8a-45a0-a554-9bbd371cebba tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb33526e820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:16.552208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5c1bb39-4f8a-45a0-a554-9bbd371cebba tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.072471 Oct 18 13:42:16.556081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2099/4281] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:16 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:16.795677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:16.807036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c94011e-df77-4390-bbd5-e7afd1705db9 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1509 microversion: 2.1 time: 0.771563 Oct 18 13:42:16.810268 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2183/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:16 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1509 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:16.842659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:16.843416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:16.853336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.853845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.854328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:16.855085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.871082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.871559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:16.917157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:16.917814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:16.926297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.929026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.929785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:16.932982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:16.935569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:16.936189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.160639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:17.174276 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cfc2aa70-36fa-4c88-b4de-95043d9b980e tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1509 microversion: 2.1 time: 0.335536 Oct 18 13:42:17.178611 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2100/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:16 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:17.206345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:17.210175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:17.224100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.227715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.230005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.231175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.232675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.234585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.260657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:17.269033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e81ce63c-d307-41c7-a4a4-fa9d92059f24 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1455 microversion: 2.1 time: 0.357204 Oct 18 13:42:17.274773 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2184/4284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:16 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1455 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:17.387463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d26017-97a5-4608-be79-49ce94b11fff", "name": "network-vif-deleted", "tag": "710917bf-d91c-4ca3-bce9-c35afba0ce5e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:17.411449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.413285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.414675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.438150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] Creating event network-vif-deleted:710917bf-d91c-4ca3-bce9-c35afba0ce5e for instance 40d26017-97a5-4608-be79-49ce94b11fff on n-h2-858383-13 Oct 18 13:42:17.470370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-146a7007-dde9-453b-91b0-73b3afb6e260 req-c3e5db57-451d-4136-b474-9d8006c1a87f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077937 Oct 18 13:42:17.496867 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2185/4285] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:17.569301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee4ca4e3-c593-4e23-a122-d8cdaa26c575 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353d0af0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:17.648513 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee4ca4e3-c593-4e23-a122-d8cdaa26c575 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.082557 Oct 18 13:42:17.651992 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2186/4286] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:17 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:17.831511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16cd44f3-aaae-42a7-9cf6-f2cc9ac0f4a2 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "PUT /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1081 microversion: 2.1 time: 0.633368 Oct 18 13:42:17.839111 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2101/4287] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:42:17 2022] PUT /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1081 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:17.851551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:17.852626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:17.861426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.870244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.870244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.870244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.870244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.870244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.296410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:18.300070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:18.303954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:18.312441 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-559172ec-9a9d-414a-9c8b-f6f99c05d209 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1507 microversion: 2.1 time: 0.465176 Oct 18 13:42:18.313275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2187/4288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:17 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:18.339741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:18.340368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:18.349433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.350238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.356192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.356687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.356836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.357439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.358383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.359172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.359809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.362822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.363400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.368733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.446876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.467245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.468757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.473706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid 40d26017-97a5-4608-be79-49ce94b11fff {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:18.583827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:18.596504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32cafef8-4cf8-4d0f-8803-13c368890176 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 200 len: 1299 microversion: 2.1 time: 0.307137 Oct 18 13:42:18.598333 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2102/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:18 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:18.668062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-041a3081-d499-4e69-99ec-42287a544b65 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330a33310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:18.819149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-041a3081-d499-4e69-99ec-42287a544b65 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 345 microversion: 2.1 time: 0.155209 Oct 18 13:42:18.819149 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2103/4290] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:18 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:18.831625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d71c582f-3328-4626-9816-b00bf30e0830 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Action: 'create', calling method: .version_select at 0x7fb33521fd30>, body: {"snapshot": {"volume_id": "88947c45-2166-40a3-95f0-5784e91b2fc1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1109088037"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:18.962649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:18.975602 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1268d82e-fb63-4b8d-8f28-416fd9ae63b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1507 microversion: 2.1 time: 0.637846 Oct 18 13:42:18.984849 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2188/4291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:18 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:19.010831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:19.011528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:19.032170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.032690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.039281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.039281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.039281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.039281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.267207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2675655a-c936-400d-9bb9-0d8c064c018f tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "PUT /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1083 microversion: 2.1 time: 0.266884 Oct 18 13:42:19.269867 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2189/4292] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:42:18 2022] PUT /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1083 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:19.289059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.290002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:19.314769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.316132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.317045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.317929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.318766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.319405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.588692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:19.606372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5d95daf-8965-40d9-ad8f-710f85d7c573 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1509 microversion: 2.1 time: 0.321256 Oct 18 13:42:19.609403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2190/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:19.626114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.626847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:19.636865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.643176 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d71c582f-3328-4626-9816-b00bf30e0830 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.815869 Oct 18 13:42:19.644061 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2104/4294] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 18 13:42:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:19.651334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.652118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:19.653608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.655794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.660672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.662032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.665651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.667978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.668480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.670348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.672457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:19.675137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:19.677958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:19.712122 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff HTTP/1.1 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '40d26017-97a5-4608-be79-49ce94b11fff'} Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:19.713884 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04bd82cf-6ec9-41fb-8f84-b3e9f27ee670 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 404 len: 111 microversion: 2.1 time: 0.093716 Oct 18 13:42:19.719217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2191/4295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:42:19.749330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c3e2b4c-748a-4b93-9534-2996a8bac5dc tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353f1e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.859903 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c3e2b4c-748a-4b93-9534-2996a8bac5dc tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.142851 Oct 18 13:42:19.860954 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2192/4296] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:19.873202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac83cc68-78e3-45a0-a205-4605ea86a3d2 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353c49d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.931308 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac83cc68-78e3-45a0-a205-4605ea86a3d2 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.062433 Oct 18 13:42:19.932269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2193/4297] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:19.943531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed318848-8f7b-49e4-9d07-d6866f5da5c4 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353d0280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:19.998627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed318848-8f7b-49e4-9d07-d6866f5da5c4 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.058974 Oct 18 13:42:19.999285 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2194/4298] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:20.005758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1758914639", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:20.112595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:42:20.279754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:20.294626 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d5e8d8e-b967-4f7b-ba72-d60ddf6acd11 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1509 microversion: 2.1 time: 0.647801 Oct 18 13:42:20.295298 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2105/4299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:19 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1509 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:20.317519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:20.318358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:20.325103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:20.328852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:20.328852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:20.328852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:20.328852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:20.328852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:20.361084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:20.761340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ee15c6c-edd6-4d15-a21b-a26e94a00e35 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 204 len: 0 microversion: 2.1 time: 0.447473 Oct 18 13:42:20.761946 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2106/4300] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:20 2022] DELETE /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:20.781381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:20.782462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:20.793197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:20.793197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:20.793197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:20.793197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:20.793632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:20.794393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:20.838270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:21.021513 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.compute.api [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Instance is already in deleting state, ignoring this request Oct 18 13:42:21.022315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59a7e968-c9c8-4291-ab03-0a35f7b30084 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 204 len: 0 microversion: 2.1 time: 0.246788 Oct 18 13:42:21.023062 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2107/4301] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:20 2022] DELETE /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:21.027921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e32028f-a316-41e6-9e18-7d9a3aeab5b7 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330c8ff70>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.070637 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e32028f-a316-41e6-9e18-7d9a3aeab5b7 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.046279 Oct 18 13:42:21.071816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2108/4302] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:21 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:21.090843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.091487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:21.104711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.105217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.105673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.106428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.106896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.107339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.157876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:21.382457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:21.383751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:21.386308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:21.387501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:21.388103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:21.413366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:21.421814 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69666dbd-9edc-4b59-9247-f03492dcd4eb tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1515 microversion: 2.1 time: 0.342460 Oct 18 13:42:21.422998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2109/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:21 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1515 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:21.427962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.429414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.430762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.431690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.432443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.433037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.468714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:21.475768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:21.494629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:21.498818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:21.704510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fab4ab29-728d-4054-86e2-143694e13626 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703599 Oct 18 13:42:21.705657 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2195/4304] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:42:21.718573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd3ac7ef-fee8-4887-ba29-9e9ebfde721e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.719538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd3ac7ef-fee8-4887-ba29-9e9ebfde721e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:21.987472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd3ac7ef-fee8-4887-ba29-9e9ebfde721e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:22.002463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd3ac7ef-fee8-4887-ba29-9e9ebfde721e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1209 microversion: 2.1 time: 0.288368 Oct 18 13:42:22.002909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2110/4305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:21 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1209 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:22.086778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-284ff3c1-9f5e-46ee-b0e1-e34490945469 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353c4a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:22.141666 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-284ff3c1-9f5e-46ee-b0e1-e34490945469 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.061150 Oct 18 13:42:22.142493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2196/4306] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:22 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:22.445510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:22.446041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:22.453342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:22.455171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:22.458102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:22.458371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:22.459228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:22.459902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:22.460559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:22.751512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:22.761063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69ab0f38-b505-4cc4-a384-b0b58f894581 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1515 microversion: 2.1 time: 0.319798 Oct 18 13:42:22.762334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2111/4307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:22 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:23.027513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f830f08-d16d-4409-87eb-0832d6a28dc9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:23.029030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f830f08-d16d-4409-87eb-0832d6a28dc9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:23.108028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f830f08-d16d-4409-87eb-0832d6a28dc9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:23.123100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f830f08-d16d-4409-87eb-0832d6a28dc9 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1209 microversion: 2.1 time: 0.100175 Oct 18 13:42:23.139759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2197/4308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:23 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:23.155574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-330cfcb5-b85e-4d99-88ab-f6648d6bc0d8 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330b0eee0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:23.220369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a26b487-1109-4999-8704-4577cfef02a8", "name": "network-vif-deleted", "tag": "45e6fb45-435a-4c3d-a273-46f3bbfd7145"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:23.235326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:23.235841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:23.236286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:23.247354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-330cfcb5-b85e-4d99-88ab-f6648d6bc0d8 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 288 microversion: 2.1 time: 0.096136 Oct 18 13:42:23.248188 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2112/4309] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:23 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:23.268186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4918125c-97b3-4e2a-b94e-3ae76f05460b tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330c479d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:23.275871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] Creating event network-vif-deleted:45e6fb45-435a-4c3d-a273-46f3bbfd7145 for instance 8a26b487-1109-4999-8704-4577cfef02a8 on n-h1-858383-13 Oct 18 13:42:23.282121 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8cb6ed4e-3568-4c90-a357-872a74d351b0 req-10597786-accd-4a0d-81e5-b38111306de0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066087 Oct 18 13:42:23.284001 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2198/4310] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:23.549799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4918125c-97b3-4e2a-b94e-3ae76f05460b tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 202 len: 0 microversion: 2.1 time: 0.288594 Oct 18 13:42:23.553583 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2113/4311] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:42:23 2022] DELETE /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:23.562915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c17886b4-e167-4e4f-b6d9-a4963e0aa46a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353c4a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:23.618442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c17886b4-e167-4e4f-b6d9-a4963e0aa46a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.060193 Oct 18 13:42:23.620766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2199/4312] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:23 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:23.787376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:23.788267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:23.804583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:23.807452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:23.808403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:23.809426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:23.811278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:23.813182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:23.898092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:23.899984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:23.900439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:23.901735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lazy-loading 'fault' on Instance uuid 8a26b487-1109-4999-8704-4577cfef02a8 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:23.972930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f278334f3cd646a89ec99502f0bfe636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7d921cf98c41e092f10fda507c0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:23.983772 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-664383a0-32c0-4400-aaef-5e37f5217f49 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 200 len: 1308 microversion: 2.1 time: 0.201433 Oct 18 13:42:23.984368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2114/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:23 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:24.152469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:24.153887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:24.163129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:24.163913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:24.164632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:24.166137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:24.166838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:24.167517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:24.292702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:24.302792 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c8e6a493-522a-4293-9750-1e746330a9f1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1261 microversion: 2.1 time: 0.155912 Oct 18 13:42:24.303607 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2200/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:24 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:24.637098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-702e2c3d-48ed-4e71-9ff1-e8d06d508e1f tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330b340d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:24.704842 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-702e2c3d-48ed-4e71-9ff1-e8d06d508e1f tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.075076 Oct 18 13:42:24.705491 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2115/4315] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:24 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:25.008999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.010378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 8a26b487-1109-4999-8704-4577cfef02a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.022316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.025050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.027117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.028752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.030251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.031264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.096421 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] HTTP exception thrown: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Request method failure captured: Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 HTTP/1.1 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyOfS2HIo8IzBlhJ6TMJXIONSbExEyrPDeGai0vlj-faFS9KyVa0DCmFjmJsZwzNcq7zE5wjL7MMdueip6tA44dL-hNJt56T58wkZXnoo60yl8__33FtGBvbYXVsVIS8nnRryPgCJ9GP1_FoNsMS7KMuxBFch1TyV0Gjadn14DySak Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f278334f3cd646a89ec99502f0bfe636 Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8a26b487-1109-4999-8704-4577cfef02a8'} Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.099302 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.103939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Returning 404 to user: Instance 8a26b487-1109-4999-8704-4577cfef02a8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:25.107000 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-38ec9462-b82e-4628-b10d-c9a8d413af7c tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8" status: 404 len: 111 microversion: 2.1 time: 0.098922 Oct 18 13:42:25.109773 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2201/4316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:25 2022] GET /compute/v2.1/servers/8a26b487-1109-4999-8704-4577cfef02a8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:25.116600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.120318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.139941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.145724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.146637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.162543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.162543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.162543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.207850 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] HTTP exception thrown: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Request method failure captured: Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 HTTP/1.1 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyOfS2HIo8IzBlhJ6TMJXIONSbExEyrPDeGai0vlj-faFS9KyVa0DCmFjmJsZwzNcq7zE5wjL7MMdueip6tA44dL-hNJt56T58wkZXnoo60yl8__33FtGBvbYXVsVIS8nnRryPgCJ9GP1_FoNsMS7KMuxBFch1TyV0Gjadn14DySak Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: f278334f3cd646a89ec99502f0bfe636 Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3a775a65-ea2b-480b-8db4-1ebd29670943'} Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:25.209853 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.214186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.216391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Returning 404 to user: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:25.218808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c1e35eb-2041-4620-aa3f-caa1cad424bc tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 404 len: 111 microversion: 2.1 time: 0.105736 Oct 18 13:42:25.220484 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2116/4317] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:25 2022] DELETE /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:25.230399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.231570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: 3a775a65-ea2b-480b-8db4-1ebd29670943] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.243287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.243847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.244313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.245041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.247636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.252089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.273404 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] HTTP exception thrown: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Request method failure captured: Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 HTTP/1.1 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyOfS2HIo8IzBlhJ6TMJXIONSbExEyrPDeGai0vlj-faFS9KyVa0DCmFjmJsZwzNcq7zE5wjL7MMdueip6tA44dL-hNJt56T58wkZXnoo60yl8__33FtGBvbYXVsVIS8nnRryPgCJ9GP1_FoNsMS7KMuxBFch1TyV0Gjadn14DySak Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: f278334f3cd646a89ec99502f0bfe636 Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3a775a65-ea2b-480b-8db4-1ebd29670943'} Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.284491 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Returning 404 to user: Instance 3a775a65-ea2b-480b-8db4-1ebd29670943 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbf9ed83-fa0a-4d21-b572-7c3e3fbd9e39 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943" status: 404 len: 111 microversion: 2.1 time: 0.061676 Oct 18 13:42:25.288088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2202/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:25 2022] GET /compute/v2.1/servers/3a775a65-ea2b-480b-8db4-1ebd29670943 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:42:25.312703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.313214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.327283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.327918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.332088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.342866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.343333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.344077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.344541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.344975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.347778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.349649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.350468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.355093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.356690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.358872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.376955 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] HTTP exception thrown: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Request method failure captured: Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e HTTP/1.1 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyOfS2HIo8IzBlhJ6TMJXIONSbExEyrPDeGai0vlj-faFS9KyVa0DCmFjmJsZwzNcq7zE5wjL7MMdueip6tA44dL-hNJt56T58wkZXnoo60yl8__33FtGBvbYXVsVIS8nnRryPgCJ9GP1_FoNsMS7KMuxBFch1TyV0Gjadn14DySak Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: f278334f3cd646a89ec99502f0bfe636 Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd2fdc5c2-7df8-4bcf-91c0-3683404de72e'} Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:25.382398 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Returning 404 to user: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:25.385815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f494af3a-2a01-4eea-aec9-0738269fa6b8 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 404 len: 111 microversion: 2.1 time: 0.088420 Oct 18 13:42:25.386868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2117/4319] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:25 2022] DELETE /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:25.398280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.402919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] [instance: d2fdc5c2-7df8-4bcf-91c0-3683404de72e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:25.431420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.432146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.441164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.447199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:25.447889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:25.451905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:25.481320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] HTTP exception thrown: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Request method failure captured: Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e HTTP/1.1 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyOfS2HIo8IzBlhJ6TMJXIONSbExEyrPDeGai0vlj-faFS9KyVa0DCmFjmJsZwzNcq7zE5wjL7MMdueip6tA44dL-hNJt56T58wkZXnoo60yl8__33FtGBvbYXVsVIS8nnRryPgCJ9GP1_FoNsMS7KMuxBFch1TyV0Gjadn14DySak Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc7d921cf98c41e092f10fda507c0624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fc7d921cf98c41e092f10fda507c0624 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1568784541 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: f278334f3cd646a89ec99502f0bfe636 Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerDiskConfigTestJSON-1568784541-project Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd2fdc5c2-7df8-4bcf-91c0-3683404de72e'} Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:25.493421 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. Oct 18 13:42:25.498711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:25.500554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] Returning 404 to user: Instance d2fdc5c2-7df8-4bcf-91c0-3683404de72e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:25.501756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3697b90a-416f-410e-8818-d8528b8725d6 tempest-ServerDiskConfigTestJSON-1568784541 tempest-ServerDiskConfigTestJSON-1568784541-project] 10.222.0.27 "GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e" status: 404 len: 111 microversion: 2.1 time: 0.111264 Oct 18 13:42:25.502879 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2118/4320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:25 2022] GET /compute/v2.1/servers/d2fdc5c2-7df8-4bcf-91c0-3683404de72e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:25.508126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:25.522604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50623f6a-3e03-4cd6-bee6-ac199a956369 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1279 microversion: 2.1 time: 0.193404 Oct 18 13:42:25.522604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2203/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:25 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:25.718867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6dcd4bc-cdd3-437a-8615-a56069dd26ee tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330873790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:25.796808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6dcd4bc-cdd3-437a-8615-a56069dd26ee tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 200 len: 287 microversion: 2.1 time: 0.081639 Oct 18 13:42:25.802347 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2119/4322] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:25 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:26.544318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:26.544943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:26.561448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:26.561965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:26.562619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:26.563541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:26.567285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:26.568189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:26.810885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7519b721-4bf0-4d9b-affc-8faf73d57dd3 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb33521fd30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:26.860711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7519b721-4bf0-4d9b-affc-8faf73d57dd3 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] HTTP exception thrown: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7519b721-4bf0-4d9b-affc-8faf73d57dd3 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Request method failure captured: Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 HTTP/1.1 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq026O_H3frc9EGpv4pxxt__toh8NT9kEfzFyzP9pEGHNG4CG3d5L_5OHkzUVnSOSGRc1hdzfLksVwKiY8V_izYRfuMbWsYE9SFTCV23-bvZve3MsWSBzs4qyE5zYH_NrbYEzgKd3rxjyr7PUzDZkCoME1gkW_6LKBR7Bzf-0hGARDw Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d11c68a0dd7e4f5b8010efd50a906a42 Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: exception: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '95dde651-4205-4eea-972f-6f2764b53b61'} Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. (HTTP 404) (Request-ID: req-08d040ff-4a88-4d77-85d2-3ac22c467356) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:42:26.873737 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7519b721-4bf0-4d9b-affc-8faf73d57dd3 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Returning 404 to user: Snapshot 95dde651-4205-4eea-972f-6f2764b53b61 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7519b721-4bf0-4d9b-affc-8faf73d57dd3 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61" status: 404 len: 111 microversion: 2.1 time: 0.069021 Oct 18 13:42:26.877769 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2120/4323] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:42:26 2022] GET /compute/v2.1/os-snapshots/95dde651-4205-4eea-972f-6f2764b53b61 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:42:26.885597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb8c3ec4-f795-4dfe-815a-a51c817f8690 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb331432790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:26.992571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:27.004884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d299039e-2e14-43a0-8012-7e044c4b1216 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.464346 Oct 18 13:42:27.018417 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2204/4324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:26 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:27.185575 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb8c3ec4-f795-4dfe-815a-a51c817f8690 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 202 len: 0 microversion: 2.1 time: 0.304683 Oct 18 13:42:27.187584 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2121/4325] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:42:26 2022] DELETE /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:42:27.197596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53f07998-0855-4e70-9d66-9250daa54fa0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb33538f310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:27.376409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53f07998-0855-4e70-9d66-9250daa54fa0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.184199 Oct 18 13:42:27.377466 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2205/4326] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:27 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:28.034852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:28.036560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:28.047947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:28.048644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:28.072406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:28.072406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:28.072406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:28.072406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:28.370176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:28.400177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-043a1def-4e82-4342-9204-4129732b60b1 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3353f15e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:28.418354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49b4472b-fc21-418d-805d-ce109afe550b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.387733 Oct 18 13:42:28.428357 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2122/4327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:28 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:28.510829 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-043a1def-4e82-4342-9204-4129732b60b1 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.120503 Oct 18 13:42:28.511667 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2206/4328] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:28 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:29.477273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:29.478499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:29.494475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.501415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.502081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.502970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.503661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.504198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.525650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3085e5d9-64e9-4053-83f0-25f76c0c5748 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3352ee5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:29.594228 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3085e5d9-64e9-4053-83f0-25f76c0c5748 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.073299 Oct 18 13:42:29.595899 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2207/4329] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:29 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:29.627242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:29.632926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:29.643127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Searching by: {'deleted': False, 'project_id': 'e41731743d534457a92c6244b7671d7b'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:42:29.654426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.655354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.655960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.656866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.657487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.658117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.691970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:42:29.793693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d68b736-c408-401a-9734-e16fe41bc386 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.170712 Oct 18 13:42:29.806812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2208/4330] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:42:29 2022] GET /compute/v2.1/servers => generated 339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:29.817106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:29.830360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:29.833002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Searching by: {'deleted': False, 'project_id': 'e41731743d534457a92c6244b7671d7b'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:42:29.846806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.848574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.849262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.854523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:29.855602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:29.856211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:29.915557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:42:30.021959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:30.036395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:30.037297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:30.038118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:30.041678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:30.055052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-73fc73b6-2ad7-4f31-967c-9c57b645afb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.595969 Oct 18 13:42:30.061616 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2123/4331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:29 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:30.614410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd62caaa-4f31-45ce-b4c4-8ca951e68112 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330ba6280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:30.711506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd62caaa-4f31-45ce-b4c4-8ca951e68112 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 200 len: 344 microversion: 2.1 time: 0.106481 Oct 18 13:42:30.712413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2124/4332] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:30 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:30.902965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a652a141-e890-4a37-9318-94c0fcdb9d43", "tag": "6f88319d-89c8-4711-b0e8-f30580282e6d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:30.931337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:30.933491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:30.934668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:30.949552 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] Creating event network-changed:6f88319d-89c8-4711-b0e8-f30580282e6d for instance a652a141-e890-4a37-9318-94c0fcdb9d43 on n-h2-858383-13 Oct 18 13:42:30.959764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d801159a-affe-429a-bf86-37dbefbb729c req-6e2c30d3-caba-49f6-a520-643e857148b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056001 Oct 18 13:42:30.959764 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2125/4333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:31.015929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3baa12f2-f035-4ecb-a989-bd453692cf3f tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.207083 Oct 18 13:42:31.016856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2209/4334] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:42:29 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:31.044885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42d5505e-1fd9-4bfb-a6e6-553ef88321c5 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:31.054122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42d5505e-1fd9-4bfb-a6e6-553ef88321c5 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013347 Oct 18 13:42:31.067647 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2126/4335] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:42:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:31.085866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:31.086879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:31.104279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:31.104780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:31.105233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:31.105948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:31.106438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:31.107039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:31.492007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:31.493354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:31.521900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:31.524175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:31.532150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:31.538756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:31.539542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:31.540200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:31.588807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:31.833394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:31.846815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a87b7e60-a0b0-4bcd-a643-e5ca04541683 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.766987 Oct 18 13:42:31.847422 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2210/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:31 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:31.859961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e34eaa09-bd4c-4dc3-a9fa-bed37af44bb0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb331659670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:31.901748 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e34eaa09-bd4c-4dc3-a9fa-bed37af44bb0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] HTTP exception thrown: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e34eaa09-bd4c-4dc3-a9fa-bed37af44bb0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Request method failure captured: Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 HTTP/1.1 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq026O_H3frc9EGpv4pxxt__toh8NT9kEfzFyzP9pEGHNG4CG3d5L_5OHkzUVnSOSGRc1hdzfLksVwKiY8V_izYRfuMbWsYE9SFTCV23-bvZve3MsWSBzs4qyE5zYH_NrbYEzgKd3rxjyr7PUzDZkCoME1gkW_6LKBR7Bzf-0hGARDw Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d11c68a0dd7e4f5b8010efd50a906a42 Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '88947c45-2166-40a3-95f0-5784e91b2fc1'} Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. (HTTP 404) (Request-ID: req-377b0ea1-ba48-4b63-af0a-2b60994e1de4) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:42:31.909008 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e34eaa09-bd4c-4dc3-a9fa-bed37af44bb0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Returning 404 to user: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e34eaa09-bd4c-4dc3-a9fa-bed37af44bb0 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 404 len: 109 microversion: 2.1 time: 0.063861 Oct 18 13:42:31.919805 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2211/4337] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:31 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:31.934687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f694889-0375-4bcd-a475-8474ddb01a38 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb3352fec10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:31.997044 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9f694889-0375-4bcd-a475-8474ddb01a38 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] HTTP exception thrown: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f694889-0375-4bcd-a475-8474ddb01a38 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Request method failure captured: Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 HTTP/1.1 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq026O_H3frc9EGpv4pxxt__toh8NT9kEfzFyzP9pEGHNG4CG3d5L_5OHkzUVnSOSGRc1hdzfLksVwKiY8V_izYRfuMbWsYE9SFTCV23-bvZve3MsWSBzs4qyE5zYH_NrbYEzgKd3rxjyr7PUzDZkCoME1gkW_6LKBR7Bzf-0hGARDw Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d11c68a0dd7e4f5b8010efd50a906a42 Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '88947c45-2166-40a3-95f0-5784e91b2fc1'} Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. (HTTP 404) (Request-ID: req-21ec7e07-52b6-4cc6-a2d4-1feb6894be3e) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:42:31.999821 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.003217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.007651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:32.008251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f694889-0375-4bcd-a475-8474ddb01a38 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Returning 404 to user: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:32.008251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f694889-0375-4bcd-a475-8474ddb01a38 tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 404 len: 109 microversion: 2.1 time: 0.079181 Oct 18 13:42:32.008922 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2212/4338] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:42:31 2022] DELETE /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:32.013733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2358e7f9-f751-48ef-aeed-95f71979b52a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Calling method '.version_select at 0x7fb330c32940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:32.070702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b018766-1428-429f-b7f0-9d8a6a2a1d25 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 204 len: 0 microversion: 2.1 time: 0.582346 Oct 18 13:42:32.071522 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2127/4339] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:31 2022] DELETE /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:32.073450 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2358e7f9-f751-48ef-aeed-95f71979b52a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] HTTP exception thrown: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2358e7f9-f751-48ef-aeed-95f71979b52a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Request method failure captured: Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 HTTP/1.1 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq026O_H3frc9EGpv4pxxt__toh8NT9kEfzFyzP9pEGHNG4CG3d5L_5OHkzUVnSOSGRc1hdzfLksVwKiY8V_izYRfuMbWsYE9SFTCV23-bvZve3MsWSBzs4qyE5zYH_NrbYEzgKd3rxjyr7PUzDZkCoME1gkW_6LKBR7Bzf-0hGARDw Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d04a029c3b6b4aaeb1070405cd1e7ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d04a029c3b6b4aaeb1070405cd1e7ee0 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-917590918 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d11c68a0dd7e4f5b8010efd50a906a42 Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-917590918-project Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '88947c45-2166-40a3-95f0-5784e91b2fc1'} Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. (HTTP 404) (Request-ID: req-16b1ad36-67d1-4634-bb3f-82120ebccb56) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:42:32.084333 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2358e7f9-f751-48ef-aeed-95f71979b52a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] Returning 404 to user: Volume 88947c45-2166-40a3-95f0-5784e91b2fc1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:32.089129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2358e7f9-f751-48ef-aeed-95f71979b52a tempest-VolumesSnapshotsTestJSON-917590918 tempest-VolumesSnapshotsTestJSON-917590918-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1" status: 404 len: 109 microversion: 2.1 time: 0.069072 Oct 18 13:42:32.092313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:32.092405 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2213/4340] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:32 2022] GET /compute/v2.1/os-volumes/88947c45-2166-40a3-95f0-5784e91b2fc1 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:32.092496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:32.096655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.097343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.098084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.099147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.099759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.100328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.630685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:32.651085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5778bc5f-3947-4975-8564-32788fe6dcae tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1713 microversion: 2.1 time: 0.575448 Oct 18 13:42:32.662081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2128/4341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:32 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1713 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:32.895362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:32.896089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:32.922436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.922436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.922436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.927319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.928138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.938847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.961550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:33.689472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:33.689472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:33.707064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:33.707869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:33.708542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:33.709474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:33.710122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:33.710769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:33.780067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:33.798146 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ecc27da8-86ce-472f-88eb-0d496c974646 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.927420 Oct 18 13:42:33.799690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2214/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:32 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:34.167014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:34.177296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9376141e-8e81-4b53-87c0-189893bf7f9c tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1713 microversion: 2.1 time: 0.500247 Oct 18 13:42:34.193772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2129/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:33 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1713 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:34.830691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:34.832108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:34.846013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:34.847013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:34.847698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:34.848880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:34.851106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:34.852953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:35.205886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:35.207797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:35.251857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:35.254554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:35.256296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:35.259389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:35.261120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:35.262365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:35.811421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:35.830274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:35.877055 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68fc5da7-5501-471c-935a-3b316a77ea61 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1713 microversion: 2.1 time: 0.676297 Oct 18 13:42:35.882007 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2130/4344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:35 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1713 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:35.882784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-901c5e38-18ad-4aea-b0ad-ed040a589fc7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 1.055133 Oct 18 13:42:35.899547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2215/4345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:34 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:36.916329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:36.917800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:36.919061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:36.920731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:36.949102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:36.954025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:36.955582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:36.956211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:36.956987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:36.958554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:36.959420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:36.961748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:36.963718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:36.964470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:36.965128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:36.969743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:37.251356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:37.254994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:37.280098 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05b2c1a1-4edc-47b9-bb0e-6c5caf805e76 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.371922 Oct 18 13:42:37.290123 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2131/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:36 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:37.290686 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c70a5256-d76f-4784-bb54-3fb54bacae43 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1645 microversion: 2.1 time: 0.376902 Oct 18 13:42:37.290686 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2216/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:36 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1645 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:37.704332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d542c8-51dd-4d1a-87ce-b33b6e39a7aa", "name": "network-vif-deleted", "tag": "62b14289-02a4-47de-adf8-6c048149b9fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:37.737377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:37.740981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:37.741509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:37.768759 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] Creating event network-vif-deleted:62b14289-02a4-47de-adf8-6c048149b9fa for instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa on n-h2-858383-13 Oct 18 13:42:37.786851 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-79c7316d-9e70-4664-bee0-addd23772df0 req-0b33319d-d915-4f1d-b5b6-3fc3ca2c62c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086568 Oct 18 13:42:37.788698 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2132/4348] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:38.318201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:38.318201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:38.323244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:38.331970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:38.333776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:38.335816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:38.337855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:38.340636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:39.079802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:39.095102 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de151d1b-c801-4c97-90c3-ab67d4fd789e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.786881 Oct 18 13:42:39.095738 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2217/4349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:38 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:39.116513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:39.117716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:39.128615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:39.129555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:39.130127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:39.131028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:39.131735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:39.132378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:39.188249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9284c5a9-a697-4c26-953d-b74129eb8ed7 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Action: 'create', calling method: .version_select at 0x7fb330b34040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-989280398", "metadata": {"Type": "work"}}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:39.275292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:39.278867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:39.279349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:39.282822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lazy-loading 'fault' on Instance uuid 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:39.476470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b888dbd64a4fc48ee745a7b38014c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41731743d534457a92c6244b7671d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:39.489151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-656e8f6c-c2da-4f02-9de7-4438d26f5dba tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 200 len: 1366 microversion: 2.1 time: 0.390146 Oct 18 13:42:39.491467 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2218/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:39 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:40.126984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:40.128835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:40.134773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:40.135641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:40.152782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:40.153444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:40.154195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:40.155228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:40.155903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:40.156509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:40.350677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9284c5a9-a697-4c26-953d-b74129eb8ed7 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.044317 Oct 18 13:42:40.351398 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2133/4351] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:42:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2046 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 13:42:40.364297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b7cc330-5c5f-4ece-b4df-ee6aaada5ca2 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb330b34430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:40.502683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b7cc330-5c5f-4ece-b4df-ee6aaada5ca2 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.139920 Oct 18 13:42:40.511421 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2134/4352] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:40 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:40.720926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:40.740351 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-acc08847-b212-4ad3-89ed-81150d26ede3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.608152 Oct 18 13:42:40.743393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2219/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:40 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:40.781687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:40.782468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] [instance: 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:40.804832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:40.805359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:40.805824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:40.806593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:40.814976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:40.814976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:40.866206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] HTTP exception thrown: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Request method failure captured: Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa HTTP/1.1 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq0AoHFIdbxECcQ669PpjCcVLpVLsVo2cmEeagiWaFyhC-0wrqe7CxI814bjRBq9DARuoGtClTDXfdkyu8bskg27iSYDdk_MODFvtpxMmDLRBzufC8Wb09JwggZceHWZeM4eimXInTgmiF2xbgARlfNFECC7NmdeJA5UcXBCEUDtSBc Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e41731743d534457a92c6244b7671d7b Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestManualDisk-1117324156 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e41731743d534457a92c6244b7671d7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e41731743d534457a92c6244b7671d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e41731743d534457a92c6244b7671d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e41731743d534457a92c6244b7671d7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestManualDisk-1117324156 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e41731743d534457a92c6244b7671d7b Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestManualDisk-1117324156 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestManualDisk-1117324156-project Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 41b888dbd64a4fc48ee745a7b38014c7 Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestManualDisk-1117324156-project Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '93d542c8-51dd-4d1a-87ce-b33b6e39a7aa'} Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:40.869053 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. Oct 18 13:42:40.874330 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:40.876694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Returning 404 to user: Instance 93d542c8-51dd-4d1a-87ce-b33b6e39a7aa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:40.878477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49082f3f-1af6-47f2-9d95-53fd613723d3 tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa" status: 404 len: 111 microversion: 2.1 time: 0.118043 Oct 18 13:42:40.897253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1280591210", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:40.902311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2220/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:40 2022] GET /compute/v2.1/servers/93d542c8-51dd-4d1a-87ce-b33b6e39a7aa => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:40.916459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0984399-7e08-476e-9fe7-e704ec01571d tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] Calling method '.version_select at 0x7fb3304a1040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:41.001387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:41.001828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:41.002363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:41.005058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:41.006633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:41.038170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:41.038877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:41.039352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:41.040172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:41.040642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:41.041077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:41.081817 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0984399-7e08-476e-9fe7-e704ec01571d tempest-ServersTestManualDisk-1117324156 tempest-ServersTestManualDisk-1117324156-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350143490" status: 202 len: 0 microversion: 2.1 time: 0.175411 Oct 18 13:42:41.082458 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2221/4355] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350143490 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:41.092533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Getting quotas for project ca6bb7ad775b425fa91bbb81597c2fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:41.110079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Getting quotas for user 6524b3e0315b48f59a53d7ca47575675 and project ca6bb7ad775b425fa91bbb81597c2fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:41.139228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:41.142916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:41.348351 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a05c2be-c7ba-4eb9-892d-c2e7e6021d1f tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.835686 Oct 18 13:42:41.359745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2135/4356] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:42:41.365167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:41.365989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:41.518473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aca091f2-8609-4099-852c-0c6aefe481f0 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb33526e820>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:41.604972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aca091f2-8609-4099-852c-0c6aefe481f0 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.090981 Oct 18 13:42:41.605706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2136/4357] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:41 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:41.618088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:41.629123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:41.631481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:41.633297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4cfcaa0c-b152-4ebf-bfd1-51c9275977ee tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1278 microversion: 2.54 time: 0.275246 Oct 18 13:42:41.634778 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2222/4358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:41 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:41.770606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:41.771229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:41.788744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:41.790281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:41.793713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:41.793713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:41.793713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:41.793713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:42.619948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9f4570f-9425-4f3f-97b4-82eb4991b974 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb335290040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:42.649393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:42.682811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd6da2d2-84e4-46c7-abcf-edb92228529a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.911921 Oct 18 13:42:42.694291 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2137/4359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:41 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:42.710561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:42.710561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:42.745335 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9f4570f-9425-4f3f-97b4-82eb4991b974 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 353 microversion: 2.1 time: 0.129379 Oct 18 13:42:42.746451 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2223/4360] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:42 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:42.761925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f36dcac9-4b35-4002-98a8-9582c1680284 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb33136c040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:42.825354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:42.868137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:42.879777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:42.880332 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fd99157-c289-4931-b11d-80c828d6f872 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1278 microversion: 2.54 time: 0.194960 Oct 18 13:42:42.883926 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2138/4361] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:42 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:42.898493 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f36dcac9-4b35-4002-98a8-9582c1680284 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 353 microversion: 2.1 time: 0.142604 Oct 18 13:42:42.900740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2224/4362] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:42 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:42.915645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76e37e08-165c-4ea9-8b35-cbdce11df39c tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb33050e670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:43.162812 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76e37e08-165c-4ea9-8b35-cbdce11df39c tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 202 len: 0 microversion: 2.1 time: 0.251429 Oct 18 13:42:43.163874 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2139/4363] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:42:42 2022] DELETE /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:43.173712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbd8a6e1-f8b1-4859-87c8-378ed4f1e2d5 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb3304a1550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:43.308980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbd8a6e1-f8b1-4859-87c8-378ed4f1e2d5 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.140664 Oct 18 13:42:43.309560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2225/4364] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:43 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:43.710860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:43.712713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:43.731281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:43.738019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:43.741839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:43.745313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:43.749431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:43.751221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:43.754648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:44.118852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1295068194", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9f5b77b7-3a75-447d-8e36-983dbb5a76f3"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:44.215695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:44.227149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0262abc3-d752-4cf1-be5c-dcdd138baa5c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.523008 Oct 18 13:42:44.232323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2226/4365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:43 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:44.247167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a652a141-e890-4a37-9318-94c0fcdb9d43", "name": "network-vif-plugged", "status": "completed", "tag": "6f88319d-89c8-4711-b0e8-f30580282e6d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:44.249573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] validate_networks() for [('9f5b77b7-3a75-447d-8e36-983dbb5a76f3', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:42:44.290334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:44.291733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:44.291733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:44.318917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] Creating event network-vif-plugged:6f88319d-89c8-4711-b0e8-f30580282e6d for instance a652a141-e890-4a37-9318-94c0fcdb9d43 on n-h2-858383-13 Oct 18 13:42:44.331247 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3553766f-929c-4ccd-baef-e1c8cfae45c9 req-43c2f1e9-01c1-402b-9f76-d1e324b85e16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096114 Oct 18 13:42:44.331881 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2227/4366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:44.346707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:44.349494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:44.376759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:44.377599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:44.379222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:44.381533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:44.382245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:44.384452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:44.604997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:44.619478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:44.625395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:44.626393 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d9df788-e49b-4e84-9012-3f1ed085bcd0 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1330 microversion: 2.54 time: 0.291701 Oct 18 13:42:44.629276 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2228/4367] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:44 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1330 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:44.650629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4beb32c3-aaf4-46a7-9c87-6a2c4a9db212 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb3352fe0d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:44.746846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4beb32c3-aaf4-46a7-9c87-6a2c4a9db212 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.115791 Oct 18 13:42:44.747497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2229/4368] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:44 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:45.259140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:45.263378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:45.270230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.274706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.275344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.276247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.277766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.280581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.769326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:45.777665 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0a34526-eb38-49bd-9c40-df4580528d8f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1309 microversion: 2.1 time: 0.524543 Oct 18 13:42:45.782360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2230/4369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:45 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:45.789356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:45.790378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:45.814149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.815518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.816136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.818539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.820040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.821156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.833586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:45.834810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:45.835298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:45.836027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:45.836453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:45.882397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.882397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.882397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.888473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.889581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.890582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.972277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Getting quotas for project 4b1125779ec1410a9c732e26473be4d3. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:45.978366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:45.994039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Getting quotas for user 74035c297a274fbdbc0b51d2e33b6fba and project 4b1125779ec1410a9c732e26473be4d3. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:45.997882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:45.999793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:46.004022 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa0631a3-dbb2-402d-beeb-d3219725ee67 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1336 microversion: 2.54 time: 0.219495 Oct 18 13:42:46.006675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2231/4370] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:45 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1336 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:46.012272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-009fab35-0edc-4339-972f-6e2f8555970c tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb33535eaf0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.084856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:46.087179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:46.145898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-009fab35-0edc-4339-972f-6e2f8555970c tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.137970 Oct 18 13:42:46.146711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2232/4371] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:46 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:46.298738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-729f2b76-ce22-4456-a952-3d359716c2fb tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.701182 Oct 18 13:42:46.302706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2140/4372] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:42:46.321163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c239dcc-fd14-4f30-852e-cab3ef1ecd7e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.325334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c239dcc-fd14-4f30-852e-cab3ef1ecd7e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:46.467248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c239dcc-fd14-4f30-852e-cab3ef1ecd7e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:46.499067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c239dcc-fd14-4f30-852e-cab3ef1ecd7e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1214 microversion: 2.1 time: 0.191300 Oct 18 13:42:46.505261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2233/4373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:46 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:46.812276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.815988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:46.825329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.826826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.828141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.829278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.829961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.830629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.039326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.040825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:47.048415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.049251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.049913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.050988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.051646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.052264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.200920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.214291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.217052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.220318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4349c49-17bb-46e0-8893-a2aefc5ec834 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1336 microversion: 2.54 time: 0.185565 Oct 18 13:42:47.221049 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2234/4374] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:47.229381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c742fab0-579a-42c2-a09a-5235954b3a5f tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb3352f2a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.267802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.278369 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f769156-a0e5-45ea-8cdf-dd63f6fa9512 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1490 microversion: 2.1 time: 0.473925 Oct 18 13:42:47.279280 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2141/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:46 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1490 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:47.306813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:47.310560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:47.317238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.318142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.318664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.319569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.320460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.320968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.388816 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c742fab0-579a-42c2-a09a-5235954b3a5f tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 200 len: 352 microversion: 2.1 time: 0.163846 Oct 18 13:42:47.389599 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2235/4376] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:47.422302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:47.530692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99a88311-7458-4276-8984-57169675fd81 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.532162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99a88311-7458-4276-8984-57169675fd81 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:47.553227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47044f41-3d4b-4c4c-879c-bc6932c2f272 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "PUT /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1085 microversion: 2.1 time: 0.251420 Oct 18 13:42:47.558921 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2142/4377] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:42:47 2022] PUT /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1085 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:47.579774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.580401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:47.592357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.593142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.593894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.594832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.595610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.611640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.691768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99a88311-7458-4276-8984-57169675fd81 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.702363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99a88311-7458-4276-8984-57169675fd81 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1214 microversion: 2.1 time: 0.177525 Oct 18 13:42:47.703569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2236/4378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:48.248392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:48.250868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:48.263209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:48.264134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:48.264827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:48.266679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:48.270652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:48.271341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b8221ef-a025-44d3-8bbc-8bc3f192084a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1357 microversion: 2.54 time: 0.328469 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2237/4379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:48 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88e89a1a-11bc-4248-9044-2b14d37e53d9 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Calling method '.version_select at 0x7fb3352fe280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-88e89a1a-11bc-4248-9044-2b14d37e53d9 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] HTTP exception thrown: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88e89a1a-11bc-4248-9044-2b14d37e53d9 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Request method failure captured: Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 HTTP/1.1 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1OqOOEMU7e3ldc3DfEqNkw4DHBbNmZcFfsWYj021bdUehk2xmTRj-4OjHxhB5BDxgM965rNIRoJZuGr_VvKcFs7Havh753tYLQ9h-IBad5C8tA7kZGGGYSJBj2UrLRWOrJHsTid_U7-gGLrvXPYDrd53epZWm6HGsm-iLitChtLVg Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ae249afdcf6d4cf18d42abb8c1baaa5a Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesGetTestJSON-116570522 Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae249afdcf6d4cf18d42abb8c1baaa5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae249afdcf6d4cf18d42abb8c1baaa5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae249afdcf6d4cf18d42abb8c1baaa5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae249afdcf6d4cf18d42abb8c1baaa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:48.672198 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesGetTestJSON-116570522 Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ae249afdcf6d4cf18d42abb8c1baaa5a Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesGetTestJSON-116570522 Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesGetTestJSON-116570522-project Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2f9b535d9e7d4a32947d3201fd04ad22 Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesGetTestJSON-116570522-project Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3c786387-417a-4a5f-929c-2dc7b04ca636'} Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. (HTTP 404) (Request-ID: req-13c19085-0815-4694-9ec6-7a120e455ae3) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:42:48.679581 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88e89a1a-11bc-4248-9044-2b14d37e53d9 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] Returning 404 to user: Volume 3c786387-417a-4a5f-929c-2dc7b04ca636 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88e89a1a-11bc-4248-9044-2b14d37e53d9 tempest-VolumesGetTestJSON-116570522 tempest-VolumesGetTestJSON-116570522-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636" status: 404 len: 109 microversion: 2.1 time: 0.045776 Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2238/4380] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:48 2022] GET /compute/v2.1/os-volumes/3c786387-417a-4a5f-929c-2dc7b04ca636 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b5505e5-54c9-4721-8102-8665bf6a2fac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Action: 'create', calling method: .version_select at 0x7fb3352903a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-357253396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORdu+SxFjeBEOg9uaVtKWZM3WIXRF7W9Cpz4eYb0XXWwXN0IhAphCTCWL3t7ZM8I96B8aitvJNcir7JwuiOPL1ml4659Gyop4iodEBgc5ps8rLUF6fD4Q0Jj1de/1SpsQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:48.687963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5b5505e5-54c9-4721-8102-8665bf6a2fac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Getting quotas for project ca6bb7ad775b425fa91bbb81597c2fb0. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:48.697312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5b5505e5-54c9-4721-8102-8665bf6a2fac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Getting quotas for user 6524b3e0315b48f59a53d7ca47575675 and project ca6bb7ad775b425fa91bbb81597c2fb0. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:48.856361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b5505e5-54c9-4721-8102-8665bf6a2fac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.232566 Oct 18 13:42:48.862333 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2239/4381] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:42:48 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:42:48.875946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:48.878445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:48.906970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:48.909901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:48.909901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:48.911522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:48.912213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:48.912860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:48.950338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:48.965422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-544ba5d6-5ef4-4bf6-9e1c-9efa20640397 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1511 microversion: 2.1 time: 1.390810 Oct 18 13:42:48.972422 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2143/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1511 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:48.991442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-357253396", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:48.997438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.005713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.006621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.008019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.009188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.010393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.011763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.121423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:49.130759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2662e1a8-8534-4598-bcbd-402395406dc3 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1210 microversion: 2.1 time: 0.271459 Oct 18 13:42:49.146698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2240/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:48 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:49.158991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:49.161818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.180680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.181177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.183331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.184353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.185007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.185664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.268145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:49.270261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:49.275904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:49.275904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:49.275904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:49.725272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.764180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.764703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.771276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.772072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.772567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.775396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.818201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b5d4fe6-0ecd-4453-abb1-fd7afc9ec2ac tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "POST /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3/action" status: 202 len: 1139 microversion: 2.54 time: 0.841328 Oct 18 13:42:49.818201 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2144/4384] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Oct 18 13:42:48 2022] POST /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3/action => generated 1139 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:42:49.845376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:49.846277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.854772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.855548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.856643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.857378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.858009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.858480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.083139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.098531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.105442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.118267 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa984119-faef-49c0-aa6e-e93ea6e9735c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1511 microversion: 2.1 time: 0.970239 Oct 18 13:42:50.120100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.120620 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2241/4385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:49 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1511 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:50.140244 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6152985c-d650-4e73-b675-d4e5ea2f8907 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.301477 Oct 18 13:42:50.140781 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2145/4386] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:49 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:50.146189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:50.147528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:50.156625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.160830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.161342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.162119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.166227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.174294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:50.175011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.175143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:50.202931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.202931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.203282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.204089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.204570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.205002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.231467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:50.393063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:50.434911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.459418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdfa6f2d-2c79-4045-a147-a4821acf16a5 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1284 microversion: 2.1 time: 0.297269 Oct 18 13:42:50.465898 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2146/4387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:50 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:50.593698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc678a81-4c88-4d61-a557-45870f62c875 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 204 len: 0 microversion: 2.1 time: 0.448979 Oct 18 13:42:50.597877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2242/4388] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:50 2022] DELETE /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:50.605749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:50.606470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:50.619676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.620770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.620895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.621888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.622403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.622990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.952119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.958490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1925737632", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6ca5d613-8f2c-4bb5-9cb7-a6d06694fe55"}, {"uuid": "2d0ec7fd-88a4-49bf-a779-9d25c85412c2"}, {"uuid": "6ca5d613-8f2c-4bb5-9cb7-a6d06694fe55"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:50.970359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e14123d-2a3a-46aa-b7e6-08ee2ac6d17c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1517 microversion: 2.1 time: 0.369666 Oct 18 13:42:50.972414 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2147/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:50 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:51.080143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] validate_networks() for [('6ca5d613-8f2c-4bb5-9cb7-a6d06694fe55', None, None, None, None, None), ('2d0ec7fd-88a4-49bf-a779-9d25c85412c2', None, None, None, None, None), ('6ca5d613-8f2c-4bb5-9cb7-a6d06694fe55', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:42:51.169960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:51.171331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:51.179157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.184288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.184288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.184288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.184288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.184288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.296406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:51.312043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:51.314659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:51.316455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1e01fc5-ce6d-45ed-bb25-26261ebe8d0a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.152433 Oct 18 13:42:51.335626 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2148/4390] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:51 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:51.487408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:51.488390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:51.499630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.500544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.501144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.503718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.504749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.507904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.698834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:51.711664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e304205-7b03-4438-ae14-738c0750650b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1272 microversion: 2.1 time: 0.226269 Oct 18 13:42:51.712989 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2149/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:51 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:51.997594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:51.998641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:52.017702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:52.020351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.022249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.023932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.026997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.038263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.038263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.474031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:52.474031 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-236782f7-87e0-4a44-b01f-5feea3eab3e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1517 microversion: 2.1 time: 0.445293 Oct 18 13:42:52.474031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2150/4392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:51 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1517 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:52.484018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:52.484944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:52.501689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.502517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.503726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.504695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.506140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.506775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.623723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:52.662097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:52.683364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:52.686508 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb8f8d47-e00f-4564-94fd-7c1fe88bb1a9 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.213413 Oct 18 13:42:52.690037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2151/4393] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:52 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:52.748747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:52.749505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:52.765392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.767189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.767654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.772201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.773094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.773865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.002142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:53.021063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ccb239e-35f9-48c1-9e57-ad421c2262a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1272 microversion: 2.1 time: 0.281384 Oct 18 13:42:53.022787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2152/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:52 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:53.469757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:53.470931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:53.481540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.482711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.483205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.483907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.484360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.484782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.177615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:54.193949 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8de2b6d-1c23-462f-9834-d5786342094f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1517 microversion: 2.1 time: 0.729782 Oct 18 13:42:54.208843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2153/4395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:53 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1517 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:54.234165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.235975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:54.260703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.262960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.263965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.266002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.268506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.269235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.436185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:54.484707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:54.489791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:54.489791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b8054b6-238b-4914-b2a9-a16aa9cd73c5 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.279029 Oct 18 13:42:54.490458 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2154/4396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:54.505517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.506470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:54.516028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.516766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.519528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.519528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.519528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.519528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.634646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:54.635155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:54.639124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:54.642960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:54.648451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:54.679348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.679348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.681799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.682621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.683105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.683554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.751526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Getting quotas for project 097aa0eadf644bcebb1726180c126259. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:54.771695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Getting quotas for user 725680d81f6f43679703425651a3e207 and project 097aa0eadf644bcebb1726180c126259. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:54.797572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:54.807487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:54.980403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:54.998748 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-defe9e6e-0438-43c6-b545-8ad0ba1c2200 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.506861 Oct 18 13:42:55.000578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2155/4397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:55.003563 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6b05af7-7fd3-4ec6-bf86-98fbc60e1869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.049942 Oct 18 13:42:55.005733 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2243/4398] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:42:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:42:55.017999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b7fb780-fd71-4d21-bb5f-76d011c1ba3a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.018756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b7fb780-fd71-4d21-bb5f-76d011c1ba3a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:55.030762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a652a141-e890-4a37-9318-94c0fcdb9d43", "name": "network-vif-deleted", "tag": "6f88319d-89c8-4711-b0e8-f30580282e6d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:55.054082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.057219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.057688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.088375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] Creating event network-vif-deleted:6f88319d-89c8-4711-b0e8-f30580282e6d for instance a652a141-e890-4a37-9318-94c0fcdb9d43 on n-h2-858383-13 Oct 18 13:42:55.100262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8925df30-ef74-4901-845d-ec9075dbcce4 req-aff89a78-badd-4c34-a0f2-bb99b883d228 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096762 Oct 18 13:42:55.108017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2156/4399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:55.188785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b7fb780-fd71-4d21-bb5f-76d011c1ba3a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:55.204164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b7fb780-fd71-4d21-bb5f-76d011c1ba3a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1213 microversion: 2.1 time: 0.190215 Oct 18 13:42:55.213810 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2244/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:55.235177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.235952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:55.251640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.252198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.254108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.254920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.255393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.257955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.331825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:55.394606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.398247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.398732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.399529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid a652a141-e890-4a37-9318-94c0fcdb9d43 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:55.519760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.520657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:55.529662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.530567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.531330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.532362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:55.533329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:55.534039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.652380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:55.667577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-393e6450-649d-484f-b003-65a8c102c504 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 200 len: 1320 microversion: 2.1 time: 0.436311 Oct 18 13:42:55.673156 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2157/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:56.025017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:56.026007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:56.029084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:56.057689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:56.059649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.066189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.068385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:56.071499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.077660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.078617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:56.403090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:56.419262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:56.423981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:56.427371 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51be9cbe-ec40-4b50-b50b-b9a239639620 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.911548 Oct 18 13:42:56.431454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2245/4402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:56.472904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-049c671f-f357-4a2f-b372-8c13bda8aaf0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:56.474532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-049c671f-f357-4a2f-b372-8c13bda8aaf0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:56.659624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-049c671f-f357-4a2f-b372-8c13bda8aaf0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:56.685053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-049c671f-f357-4a2f-b372-8c13bda8aaf0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1213 microversion: 2.1 time: 0.234215 Oct 18 13:42:56.687972 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2246/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:56 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1213 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:56.712708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:56.713517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:56.758008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.759356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.760715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:56.762944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.767404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.769452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 HTTP/1.1 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a652a141-e890-4a37-9318-94c0fcdb9d43'} Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:56.823212 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:56.827878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25cfe022-e9d9-419d-97b9-1fddbb5cd4e2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 404 len: 111 microversion: 2.1 time: 0.119649 Oct 18 13:42:56.841009 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2247/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:56 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:56.850234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:56.866002 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b802092-8857-472c-a68b-438dc323875e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.845706 Oct 18 13:42:56.868335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2158/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:56 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:57.074626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-30701550", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "46ca13cd-fa10-4e35-9195-f154af43e2dc"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:57.166499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] validate_networks() for [('46ca13cd-fa10-4e35-9195-f154af43e2dc', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:42:57.457038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:57.457756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:57.488063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:57.490757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:57.491210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:57.496939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:57.497912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:57.499385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:57.725662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:57.748571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:57.751278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:57.761021 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a328a98c-5646-4c87-a8ff-24298fa06028 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.298690 Oct 18 13:42:57.761959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2159/4406] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:57 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:42:57.786450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:57.786450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:57.799541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:57.800439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:57.801406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:57.802528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:57.805563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:57.806751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.074369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:58.081493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0d84366-e14a-455b-9e86-cbf93c919936 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1265 microversion: 2.1 time: 0.314739 Oct 18 13:42:58.082122 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2160/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:57 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:58.100226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e6c0d31-3a35-4546-9c84-23d372d22f79 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb330873670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:58.265490 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e6c0d31-3a35-4546-9c84-23d372d22f79 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/88818e07-e2f7-44ad-b22f-aba403662e11" status: 200 len: 350 microversion: 2.1 time: 0.171726 Oct 18 13:42:58.265490 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2161/4408] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:58 2022] GET /compute/v2.1/os-volumes/88818e07-e2f7-44ad-b22f-aba403662e11 => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:58.265490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:58.265490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:58.281543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.282110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.282543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.283397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.283724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.284290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.701522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:58.701998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:58.702450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:58.702864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:58.703289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:58.725331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.726408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.736552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.737720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.738263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.738728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.741282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:58.756272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c821fb95-73a0-4c9b-b444-c484c1e0917c tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.499616 Oct 18 13:42:58.756868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2162/4409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:58 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:58.761485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4864eb8e-8719-420b-9e62-b6b5b75a03a5", "tag": "759fb319-9570-473b-bf49-8574171d009b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:58.776322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:58.783262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Getting quotas for user 62ff0a5713b44b7aac67e73e037e8a6b and project 3c6a1e83216c4a3882adbeab292b822f. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:58.783702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.784203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.784650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.803437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:58.809197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:58.831021 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] Creating event network-changed:759fb319-9570-473b-bf49-8574171d009b for instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 on n-h2-858383-13 Oct 18 13:42:58.838972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-31b9f7cc-d76a-4845-bd8f-e0bee74c1371 req-a446a305-65b3-4c2a-8631-fe2df2e5e420 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080246 Oct 18 13:42:58.840207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2163/4410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:58.867752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:58.869228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:58.891101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.891974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.894173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.896793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.899034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.900153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.031075 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6f29726-e137-43c4-b7f1-06d9aaad7b5a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960602 Oct 18 13:42:59.033609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2248/4411] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:42:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:42:59.068499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8fe258a6-7bee-4fdb-8622-f6dd2fd2b26c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:59.071289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8fe258a6-7bee-4fdb-8622-f6dd2fd2b26c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:59.119454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.139569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.142486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.151903 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ec0a41f-c13a-406e-aa23-fcdbe8187c7a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.307350 Oct 18 13:42:59.153809 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2164/4412] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:42:58 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:42:59.170476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:59.171559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:59.184361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.185680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.187614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.188473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.190559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.191220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.254219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fe258a6-7bee-4fdb-8622-f6dd2fd2b26c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.263581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8fe258a6-7bee-4fdb-8622-f6dd2fd2b26c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1207 microversion: 2.1 time: 0.210092 Oct 18 13:42:59.264552 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2249/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:59 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1207 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:59.353208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.369703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-899f16d9-9381-406b-b6f4-7c7dc104e71c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1273 microversion: 2.1 time: 0.214514 Oct 18 13:42:59.372066 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2165/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:59 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:59.783278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:59.783917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:59.803489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.804639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.805111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.806300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.806779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.807224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.184182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:00.185746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:00.200894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.201793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.204122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.205253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.207132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.207787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.222530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.234708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-466ee8e9-1757-435b-8ade-36621d2c4e1e tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.455431 Oct 18 13:43:00.237653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2250/4415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:59 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:00.287605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c3b9253-f513-41af-b227-6bce5ad1ef42 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:00.289087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c3b9253-f513-41af-b227-6bce5ad1ef42 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:00.376808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.388946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.392208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.395546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bb65843-f2c4-4dd4-97b4-0e2c768d5f07 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.218109 Oct 18 13:43:00.399837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2166/4416] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:00 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:00.410018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:00.410998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:00.426361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.426361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.426361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.426361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.426761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.427183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.590984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c3b9253-f513-41af-b227-6bce5ad1ef42 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.606867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c3b9253-f513-41af-b227-6bce5ad1ef42 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1207 microversion: 2.1 time: 0.319564 Oct 18 13:43:00.634952 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2251/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:00 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1207 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:00.764006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:00.772101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11cf8aee-ba26-42de-ac78-d827f4ade2a2 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1271 microversion: 2.1 time: 0.371105 Oct 18 13:43:00.773675 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2167/4418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:00 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:01.262554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:01.263194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:01.266037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:01.275336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.275855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.276320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.278622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.278622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.292909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.424977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:01.425960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:01.435749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.439008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.439604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.440437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.442203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.442763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.617990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:01.640479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:01.648383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:01.650027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34f55e59-eced-4da7-a97f-9eaa9f71dd59 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.229131 Oct 18 13:43:01.665095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2168/4419] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:01 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:01.681391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f2d08f6-6fe4-4a30-a802-7abe2d75624b tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb3352d6b80>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:01.726956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:01.761636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd05d8c0-bf4f-4957-9b0a-c7fd06974b6b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.502691 Oct 18 13:43:01.763880 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2252/4420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:01 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:01.771019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:01.772183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:01.796560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.797299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.799863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.801797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.805287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.806408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.812954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f2d08f6-6fe4-4a30-a802-7abe2d75624b tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/19a12206-e2f6-4b9f-b9d1-59fbbaa9971c" status: 200 len: 351 microversion: 2.1 time: 0.140419 Oct 18 13:43:01.814408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2169/4421] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:43:01 2022] GET /compute/v2.1/os-volumes/19a12206-e2f6-4b9f-b9d1-59fbbaa9971c => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:01.820321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:01.821145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:01.874773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.875227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.876052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.886874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:01.888146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:01.888748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:01.989571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:02.010591 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0f136474-1e43-4402-b967-55c5489ed0c6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1259 microversion: 2.1 time: 0.243286 Oct 18 13:43:02.013449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2253/4422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:01 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:02.156756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:02.169689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ca65f05-ec41-469e-9c22-2d01a090223b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1313 microversion: 2.1 time: 0.352607 Oct 18 13:43:02.182858 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2170/4423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:01 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:02.684021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:02.684791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:02.699588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:02.702494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:02.703144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:02.704084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:02.707624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:02.708306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:02.787342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:02.789365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:02.798293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:02.799136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:02.800708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:02.801837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:02.802542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:02.803748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:03.305171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:03.317344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:03.330753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:03.332021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a03835ad-4766-40d2-ad8e-a92c32cab80a tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.653544 Oct 18 13:43:03.332614 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2254/4424] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:02 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:03.351416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:03.352052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:03.359866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:03.360614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:03.361244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:03.377221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:03.377668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:03.378152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:03.904444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:03.912759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec987d30-61c3-4fc3-a855-b981cf3939a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.579055 Oct 18 13:43:03.917966 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2255/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:03 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:03.931508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:03.931508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:03.940482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:03.941087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:03.941554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:03.948285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:03.949359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:03.950112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:04.230472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:04.243715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67c5823a-567f-4a58-8371-cdc502ba052d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1334 microversion: 2.1 time: 0.323380 Oct 18 13:43:04.244315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2256/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:03 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1334 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:04.365567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:04.367337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:04.370481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:04.384653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.385093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8de1c05-a6e8-4893-9049-d8d2e8bfea1b tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 1.603581 Oct 18 13:43:04.386777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.387472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:04.391492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.392878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.394942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:04.398652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2171/4427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:02 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:04.545603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:04.572562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:04.576268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:04.577524 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57ea9de7-e0af-43bb-a216-709348c54b9e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.219044 Oct 18 13:43:04.578866 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2257/4428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:04 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:04.940924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:04.941512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:04.949080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.949603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.950015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:04.950988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.951670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.952192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.271356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:05.272547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:05.279272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.280000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.280446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.281379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.282089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.282525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.498372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.512813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d066fae-01d0-45c2-9af5-c30583aa3eb2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.571747 Oct 18 13:43:05.513753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2172/4429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:04 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:05.523450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:05.533439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:05.542638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.546788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.547428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.548344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.548962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.549621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.563873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.573308 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad6f85ba-be35-4b0f-b4c3-7bd0f33b40fe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1334 microversion: 2.1 time: 0.305713 Oct 18 13:43:05.594240 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2258/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:05 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1334 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:05.611583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:05.613167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:05.637691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.639155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.639941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.641074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.642205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.643339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.822828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.835694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.837282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.841545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4466ec8f-a097-4740-a68a-e9299a3e7924 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.240655 Oct 18 13:43:05.842366 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2259/4431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:05 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:05.852843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864eb8e-8719-420b-9e62-b6b5b75a03a5", "name": "network-vif-plugged", "status": "completed", "tag": "759fb319-9570-473b-bf49-8574171d009b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:05.873326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.873825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.874294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.902253 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] Creating event network-vif-plugged:759fb319-9570-473b-bf49-8574171d009b for instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 on n-h2-858383-13 Oct 18 13:43:05.908697 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-18779af7-5fd9-4e6c-a0b2-5a62c6daa8c0 req-4f2a6d3f-d445-4599-a4ff-bac3c6051feb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065306 Oct 18 13:43:05.911856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2260/4432] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:05.921424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62ef72f-763d-49f5-a433-9c40cbe8a14a", "tag": "76f3a884-1663-4497-9aae-211d13cd16ea"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:05.937416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:05.938163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:05.938370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.953991 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] Creating event network-changed:76f3a884-1663-4497-9aae-211d13cd16ea for instance e62ef72f-763d-49f5-a433-9c40cbe8a14a on n-h2-858383-13 Oct 18 13:43:05.959496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-35b3c486-25c2-48b8-8ec4-c3b992c36229 req-a0969675-a63e-4dec-9d49-0ff9881c3a26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048076 Oct 18 13:43:05.961530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2261/4433] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:05.973044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1347da7d-9b74-4f64-854d-ae228b2bcc7b tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb3352ee5e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.052118 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1347da7d-9b74-4f64-854d-ae228b2bcc7b tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca609e41-2081-49bd-a9df-45361b4c2697" status: 200 len: 349 microversion: 2.1 time: 0.088249 Oct 18 13:43:06.053344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2262/4434] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:43:05 2022] GET /compute/v2.1/os-volumes/ca609e41-2081-49bd-a9df-45361b4c2697 => generated 349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:06.067220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46cd0cd9-25cb-4318-b0cd-1856baae737c tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb3352cb670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.089760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:06.116133 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c283c6da-997e-46b5-869f-810f9c077379 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.600831 Oct 18 13:43:06.118354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2173/4435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:05 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:06.190581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46cd0cd9-25cb-4318-b0cd-1856baae737c tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.128180 Oct 18 13:43:06.200484 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2263/4436] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:06.206471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ede1cab9-3c9c-40ba-ab1f-be8102d9f27d tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb33526ee50>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.324662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ede1cab9-3c9c-40ba-ab1f-be8102d9f27d tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.121238 Oct 18 13:43:06.340105 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2174/4437] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:06.344936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63af8606-23ff-4dd6-b10d-4001b581466d tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb3352ee430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.453004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63af8606-23ff-4dd6-b10d-4001b581466d tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.106713 Oct 18 13:43:06.453004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2264/4438] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:06.458593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e9b192e-02bf-4a24-a2a8-ea9ee1f23531 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb33050ec10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.540111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.541111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:06.556420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2e9b192e-02bf-4a24-a2a8-ea9ee1f23531 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102008 Oct 18 13:43:06.558740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.559763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2175/4439] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:06.560931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.561619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.563573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.564263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.565632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.574942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f5ba3ab-51f0-4027-b6a5-ff6af2c05804 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb33071c790>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.705064 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f5ba3ab-51f0-4027-b6a5-ff6af2c05804 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.135894 Oct 18 13:43:06.706019 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2176/4440] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:06.738121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.739159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:06.747499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.748126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.748801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.750740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.751644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.752917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.916635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:06.947812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf580b13-91f9-4bc0-b92e-3959b8bc995f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.415637 Oct 18 13:43:06.952683 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2265/4441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:06.963227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba2859d5-a761-4352-b5c7-9f31efc1c0f1 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb331107160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.093676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba2859d5-a761-4352-b5c7-9f31efc1c0f1 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.135940 Oct 18 13:43:07.094982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2266/4442] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:07.101507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.102382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:07.112784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.114299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.115317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:07.116302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.117093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.118009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:07.255239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:07.270403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:07.273593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:07.274910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b8f1945-4f7f-4392-a464-c6733d6f5892 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.178724 Oct 18 13:43:07.275581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2267/4443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:07 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:07.277393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:07.286405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-916ecf5f-1c1c-4cf4-9aa5-3eca5f2e4dae tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb331238040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.290630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e8fd00a-e5d3-4b85-8ec6-4b55b320d331 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.562139 Oct 18 13:43:07.291371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2177/4444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:07.296706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.297458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:07.306303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.307162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.316471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:07.316471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.316471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.316471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:07.400866 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-916ecf5f-1c1c-4cf4-9aa5-3eca5f2e4dae tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.124227 Oct 18 13:43:07.401489 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2268/4445] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 18 13:43:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:07.415650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53dcc21f-de53-4a18-9d4f-169f30137736 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] Calling method '.version_select at 0x7fb33136c9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.548273 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53dcc21f-de53-4a18-9d4f-169f30137736 tempest-VolumesTestJSON-1638931554 tempest-VolumesTestJSON-1638931554-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.136692 Oct 18 13:43:07.548845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2269/4446] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:43:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:07.825763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:07.835495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59b0be2a-ea4c-4115-907f-f81ccdd6d8b8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1314 microversion: 2.1 time: 0.542690 Oct 18 13:43:07.836053 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2178/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:07 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:07.977685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:07.978501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:07.992690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.993201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.994285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:07.995038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:07.995508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:07.996517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.316960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:08.317748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:08.323415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.329754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.330592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.332220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.334352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.340081 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d0ddaf8-7545-4695-a90e-c04d667e186b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.368759 Oct 18 13:43:08.340689 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2270/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:07 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:08.347623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.349311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.362502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:08.367373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:08.373800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:08.386744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.389902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.391267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.392787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.395874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.396540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.554530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.572973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.577617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.579263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2e3f45a-0947-4d10-94c8-461d3e224f6e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.221527 Oct 18 13:43:08.581581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2271/4449] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:08 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:08.635901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.651992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4753cbcf-ed43-43ad-96da-f4e020303869 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.340269 Oct 18 13:43:08.653960 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2179/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:08 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:08.868230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:08.868990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:08.888705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:08.908464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.908464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.912527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.921934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.923177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.926539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.950889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:08.997783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "tag": "05bd7b9e-85f9-4fc2-8c78-55c7a83611fa"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:09.018205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.019063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.019844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:09.052690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] Creating event network-changed:05bd7b9e-85f9-4fc2-8c78-55c7a83611fa for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:09.064602 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9da1e8ca-743a-40f4-9af5-5a998a63a536 req-ce8707d6-fbca-4738-a0dc-336566db5221 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071227 Oct 18 13:43:09.075264 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2180/4451] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:09.282072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:09.291728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-631e0bd9-fbb2-4c37-a7a5-bfe767079413 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1498 microversion: 2.1 time: 0.433020 Oct 18 13:43:09.292318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2272/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:08 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:09.370944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:09.372002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:09.412073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.415405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.422836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:09.422836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.422836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.422836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:09.615795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:09.616973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:09.637493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.639396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.640019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:09.643946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.645492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.648782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.598875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=30 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:10.653023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:10.666948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:10.673159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:10.675807 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e676d100-20f9-459e-9530-fa609f210a1e tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 1.064797 Oct 18 13:43:10.676440 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2273/4453] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:09 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:10.686493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:10.690017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:10.705630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.706479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.710857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.711628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.712114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.712560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.976927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:10.993247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f660dfc8-6c03-417f-9aed-885037be61ce tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 1.629308 Oct 18 13:43:11.010003 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2181/4454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:09 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:11.708645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:11.709281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:11.720519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:11.721023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:11.721468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:11.726935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:11.727433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:11.727885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:11.980435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:12.020223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:12.025206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:12.031680 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-809f6af0-1f55-4da6-a4dd-2a04061d86d1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.327365 Oct 18 13:43:12.033433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2182/4455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:11 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:12.060701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:12.063644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:12.083692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:12.085736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:12.086395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:12.088562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:12.090005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:12.091883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:12.092733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:12.123503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e4f6fe3-6d1a-47ff-b1ef-5a1ab7146691 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 1.432147 Oct 18 13:43:12.134285 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2274/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:10 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:12.521800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:12.535458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74645943-af47-40d2-863f-a5e0f695191a tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.498384 Oct 18 13:43:12.536065 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2183/4457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:12 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:12.593947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "tag": "a4811554-fe6a-47d7-830e-5928c2110f61"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:12.613013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:12.613350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:12.613799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:12.676062 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] Creating event network-changed:a4811554-fe6a-47d7-830e-5928c2110f61 for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:12.687892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-59b99543-2c16-48f4-899a-023c5cc9063e req-27ebeb53-84a9-47e1-9891-7b25d38d0b8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099130 Oct 18 13:43:12.709356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2275/4458] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:13.061737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:13.065906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:13.076825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.077548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.078218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.079161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.079838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.080460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.150922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:13.152367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:13.174931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.177484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.178200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.179204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.179886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.180547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.352480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.368054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.369846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.372225 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd48ab1b-a428-4a95-ac18-95927608e506 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.315196 Oct 18 13:43:13.373272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2184/4459] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:13 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:13.565459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:13.566234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:13.576321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.578645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.579360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.581041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:13.583125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:13.584295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:13.593709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.606668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af805693-38e5-4ff8-b05e-1ae61711903c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.461548 Oct 18 13:43:13.614356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2276/4460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:13 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:13.961720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.984766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b50420d6-c4ad-4ba6-9dae-4b47711b5e70 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.423694 Oct 18 13:43:13.987688 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2185/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:13 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:14.402483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:14.403099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:14.421903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.422444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.422892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.423618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.424103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.424548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.587053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:14.601695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:14.614659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:14.615531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f17435dd-e88a-4959-a7d7-4fbc6c59b414 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.218464 Oct 18 13:43:14.616115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2277/4462] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:14 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:14.630901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:14.635457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:14.645184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.645873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.646526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.647857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.648481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.649075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.744028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "tag": "e770c673-5b75-45dc-ae45-6fcc87f3999d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:14.774976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.776137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.776853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.819701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] Creating event network-changed:e770c673-5b75-45dc-ae45-6fcc87f3999d for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:14.834086 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e2a06f1c-844c-4c37-8380-7e5dcf02fff6 req-6a3b1d08-002e-406b-bab9-f7713dd587f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093523 Oct 18 13:43:14.837618 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2278/4463] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:14.998474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.013324 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5631212f-ada9-4475-a577-9525bed56154 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.386315 Oct 18 13:43:15.013666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:15.014511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:15.015053 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2186/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:14 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:15.028836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.034974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.034974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.034974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.034974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.037285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.326295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.340597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-857901b9-21b6-4b46-a893-e7fa79b3991e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.331389 Oct 18 13:43:15.341496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2279/4465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:15 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:15.659854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:15.659854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:15.688929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.692193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.695998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.698294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.702316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.702835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.875961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62ef72f-763d-49f5-a433-9c40cbe8a14a", "name": "network-vif-plugged", "status": "completed", "tag": "76f3a884-1663-4497-9aae-211d13cd16ea"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:15.898531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.899983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.901357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.927566 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] Creating event network-vif-plugged:76f3a884-1663-4497-9aae-211d13cd16ea for instance e62ef72f-763d-49f5-a433-9c40cbe8a14a on n-h2-858383-13 Oct 18 13:43:15.939507 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-04964826-75d2-43cf-a613-15f1d3087454 req-2256ef2b-c4b2-42bf-97d2-9eca48b917ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069903 Oct 18 13:43:15.939697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.941643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2280/4466] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:15.977498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.988218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.999418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0a67e44-4c20-4503-a18c-756b2d53db80 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1408 microversion: 2.54 time: 0.345035 Oct 18 13:43:16.000076 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2187/4467] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:15 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:16.043467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:16.044484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:16.055016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.055858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.058894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.058894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.058894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.058894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.369310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:16.370443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:16.380206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.381025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.381654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.382743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.383764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.384961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.654813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:16.669973 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bfa8ab2-6e31-451e-8f3d-dd7ab82af566 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.304656 Oct 18 13:43:16.676198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2188/4468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:16 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:16.687867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:16.697094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5661796c-b24b-4220-9351-44a1cf176f46 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.659316 Oct 18 13:43:16.704467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:16.704467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:16.705475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2281/4469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:16 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:16.715147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.715789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.716337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.717222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.717805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.718365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.793191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:17.188208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-051700e7-4f4d-45df-88c0-26e6d13e7d05 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 204 len: 0 microversion: 2.1 time: 0.510385 Oct 18 13:43:17.190406 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2189/4470] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:16 2022] DELETE /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:43:17.196117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.196866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:17.212095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.212622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.213235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.213950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.214447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.216818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.408135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-455371099", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "2f023431-4c13-49c0-9ef3-7e855468061e"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:17.529646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] validate_networks() for [('2f023431-4c13-49c0-9ef3-7e855468061e', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:43:17.932768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:17.945295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:17.952416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:17.962544 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7042f78-fafb-42ac-a7a5-71c02a9b5dfb tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1426 microversion: 2.54 time: 0.770730 Oct 18 13:43:17.963472 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2190/4471] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:17 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1426 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:17.968380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.972539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:17.985263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.986137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.986790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.987723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.988385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.992788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.348587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:43:18.349631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:43:18.350871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:43:18.352330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:43:18.352330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:43:18.363189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.363999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.364659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.365772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.366901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.367306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.367434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.385122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1f12361-4006-435b-a4f4-fbe94a0fdaf8 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1504 microversion: 2.1 time: 0.420328 Oct 18 13:43:18.386367 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2191/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:17 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:18.391083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:18.391975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:18.398123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.398866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.399716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.400794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.401468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.402120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.406937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Getting quotas for project f43e41bfbb72427198a878de059fe0f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:43:18.412642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Getting quotas for user 89acf827045f47d98b97a8a4c2a3e19d and project f43e41bfbb72427198a878de059fe0f6. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:43:18.429601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:43:18.432614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:43:18.583665 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2dc9eff0-817c-45a2-8364-8a6cab977eea tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.701477 Oct 18 13:43:18.592708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2282/4473] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 13:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 13:43:18.600449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:18.603928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:18.630840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.633325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.641962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.644682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.645189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.645633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.757497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.766630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d7b71086-bb16-4568-b178-ab1f81717fcc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1307 microversion: 2.1 time: 0.379075 Oct 18 13:43:18.767447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2192/4474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:18 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:18.787740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:18.791840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:18.877281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.896016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.902629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.904350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-753597b5-0829-4d5c-ae4f-cd0d0bf807ed tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1258 microversion: 2.21 time: 0.136175 Oct 18 13:43:18.913913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2193/4475] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:18 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:18.995424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:18.996172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:19.007546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.008065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.008548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.011657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.012171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.012630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.153863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:19.168168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:19.173908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:19.175996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a408f020-7158-4b8c-b0ce-be94a4912769 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1414 microversion: 2.54 time: 0.185099 Oct 18 13:43:19.176966 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2194/4476] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:18 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:19.237527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:19.249636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0f5396e-3f22-4e1c-9455-8a205e182a34 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.655491 Oct 18 13:43:19.250696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2283/4477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:18 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:19.422915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:19.423568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:19.432558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.433081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.433530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.434290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.434842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.435284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.790084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:19.790593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:19.808763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.809272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.809718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.810659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.811293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.811884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.929976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:19.934671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:19.939979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e45c113f-6ba7-4ef8-a75b-574e7f931169 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1504 microversion: 2.1 time: 0.534574 Oct 18 13:43:19.941116 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2195/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:19 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:19.950196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:19.951152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.039772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.050542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.052008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.053161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95255f3a-0f07-439a-9faa-af2dcacc795d tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1258 microversion: 2.21 time: 0.110039 Oct 18 13:43:20.060431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2196/4479] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:19 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1258 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:20.217831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:20.220367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.229063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.229995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.231318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.232758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.233491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.234914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.287426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.295941 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d19ed62-51af-4b86-9896-b93ba454d1ac tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1488 microversion: 2.1 time: 0.510677 Oct 18 13:43:20.296531 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2284/4480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:19 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1488 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:20.318743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:20.318743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.326324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.326831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.327285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.328024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.328532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.329016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.351402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.362029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.364331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.365786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ebee7541-7945-45d8-ba16-d27b6bc8c6cf tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1399 microversion: 2.54 time: 0.159205 Oct 18 13:43:20.368645 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2197/4481] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:20 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1399 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:20.373676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-974053636"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:20.376620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.384549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.385234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.385767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.386649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.387230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.387733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.588242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e3740dd-745e-48c3-a7e2-8e6cafafb1a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "PUT /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1074 microversion: 2.1 time: 0.220332 Oct 18 13:43:20.588894 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2198/4482] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:43:20 2022] PUT /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1074 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:20.594717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4cb7f67-4892-4d54-8daa-296cc7ea7dc1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '.version_select at 0x7fb3305d2ca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:20.608265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:20.718740 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4cb7f67-4892-4d54-8daa-296cc7ea7dc1 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-357253396" status: 204 len: 0 microversion: 2.54 time: 0.125835 Oct 18 13:43:20.718740 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2199/4483] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-357253396 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:43:20.727312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:20.728234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.742486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.747300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.749322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.749808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.753613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90dc094e-a317-49cc-9166-1c41201afc80 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.455964 Oct 18 13:43:20.754478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.754959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.755415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.757685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2285/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:20 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:20.806984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:20.810164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:20.826592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.839868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.841736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.843663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:20.844394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:20.845881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.900629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:21.200368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.212414 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6161663d-d1ef-4e2d-b365-e881034c0fd1 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1500 microversion: 2.1 time: 0.492417 Oct 18 13:43:21.213779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2200/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:20 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1500 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:21.224505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864eb8e-8719-420b-9e62-b6b5b75a03a5", "name": "network-vif-deleted", "tag": "759fb319-9570-473b-bf49-8574171d009b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:21.245484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.246945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.249306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.274403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] Creating event network-vif-deleted:759fb319-9570-473b-bf49-8574171d009b for instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 on n-h2-858383-13 Oct 18 13:43:21.286276 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3b52fe1a-a199-48ba-bf74-3d948f0a292a req-eaf48629-1807-4652-a251-8d5bf2154bc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070477 Oct 18 13:43:21.286832 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2201/4486] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:21.293422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.294469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.304075 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6467e554-f6e9-41bd-a0b0-8a7574308213 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 204 len: 0 microversion: 2.54 time: 0.543226 Oct 18 13:43:21.304937 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2286/4487] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:43:20 2022] DELETE /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:43:21.319362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.319446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.319446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.320197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.322712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.324022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.326172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.326877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.334269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.336346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.337045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.338025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.338775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.339471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.435387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.435893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.440477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.441000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lazy-loading 'fault' on Instance uuid 4864eb8e-8719-420b-9e62-b6b5b75a03a5 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:21.530805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.544423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.552706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.554675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8411450-73fe-4136-8705-b08275fa9d26 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1310 microversion: 2.21 time: 0.247195 Oct 18 13:43:21.572752 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2287/4488] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1310 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:21.577884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.579165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.592283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.593152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.593831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.594901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.595567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.596315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.606444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.615817 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90cb533a-883f-401e-8fe5-37200ff504a6 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1304 microversion: 2.1 time: 0.327548 Oct 18 13:43:21.617070 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2202/4489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:21.627392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.637566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.657183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.657690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.659845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.660772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.662912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.663759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.865779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.866942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.877169 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0bf54d2-7b3a-4fe3-9ef5-292127373740 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1500 microversion: 2.1 time: 0.303005 Oct 18 13:43:21.877393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.878279 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2288/4490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1500 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:21.889672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.889821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.889821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.889975 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fb95564-1a70-41c2-ad3c-7970c163d384 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1405 microversion: 2.54 time: 0.260268 Oct 18 13:43:21.889975 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2203/4491] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:21.904916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:21.918899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.921247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.921784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.922269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.922572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.922991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.923365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.923507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.927993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.984518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Going to try to stop instance {{(pid=121009) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:43:22.285152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd045292-ca86-4d70-9433-b094640da15b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "POST /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a/action" status: 202 len: 0 microversion: 2.1 time: 0.387377 Oct 18 13:43:22.291594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2204/4492] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:43:21 2022] POST /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:43:22.297042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.304191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:22.308553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.309862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6002c82-9e6f-42b8-9bba-b71d9b783411 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.430273 Oct 18 13:43:22.310364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2289/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:22.324364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.325350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.325956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.345931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.348175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.352135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.582441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:22.583074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.590389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.591125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.592685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.593596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.595088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.611194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.640528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:22.718035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.727434 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ca86571-d788-452b-a136-b99f36b0e6b4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.432158 Oct 18 13:43:22.743138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2205/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:22 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:22.749480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:22.750457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.758410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.759150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.759766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.760632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.761310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.761914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.767761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.780627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.783697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.784871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae2a9811-0542-4554-ab3d-e4be1f5cc89e tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1318 microversion: 2.21 time: 0.208477 Oct 18 13:43:22.787910 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2290/4495] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:22 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:22.823768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.824642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.825287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.825895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lazy-loading 'fault' on Instance uuid 4864eb8e-8719-420b-9e62-b6b5b75a03a5 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:22.892726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74035c297a274fbdbc0b51d2e33b6fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1125779ec1410a9c732e26473be4d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:22.906140 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31fb141d-f0e6-4285-a48e-6d3e1e340870 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 200 len: 1304 microversion: 2.1 time: 0.159398 Oct 18 13:43:22.921328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:22.921985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.925368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2206/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:22 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.966503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.108238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.118252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.120048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.121746 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08e20fd3-d9e9-4ac8-85e1-a6ec4f73f81b tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1405 microversion: 2.54 time: 0.209714 Oct 18 13:43:23.122868 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2291/4497] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:22 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:23.335660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:23.337061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:23.349068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.350864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.352184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.354837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.355560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.356338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.621993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.629642 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c3353a4-e557-42f0-92b7-87ee49fb9675 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.300387 Oct 18 13:43:23.630242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2207/4498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:23 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:23.754324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:23.755182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:23.761998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.763888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.764440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.765561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.766307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.767747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.819157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:23.820204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:23.829908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.830431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.830873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.837650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.838174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:23.838618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.978374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.992788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-522bf440-d365-4684-b216-61bdb62c453d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.237385 Oct 18 13:43:23.992788 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2292/4499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:23 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:23.992788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:23.992788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] [instance: 4864eb8e-8719-420b-9e62-b6b5b75a03a5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:23.999113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:23.999630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.000086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.000810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.001282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.001722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.031466 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] HTTP exception thrown: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Request method failure captured: Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 HTTP/1.1 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1McsUnfv3RzEolRdiaI3GN_XU835cgoJkEi-qXFP4ZZjnZjIuCcKSVMTBfYkTIlNtCOdPPzm3ycL_B5PxqDjvjm2uY7BLOVmAVfD2o4EytxqascUjr_4Kh-txKSPDnPVAqGXgIyCAjQknrLu8PF0KrmYBxWja2lon4fzvEe8cAm28 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4b1125779ec1410a9c732e26473be4d3 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesActionsTest-871757799 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b1125779ec1410a9c732e26473be4d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b1125779ec1410a9c732e26473be4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b1125779ec1410a9c732e26473be4d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b1125779ec1410a9c732e26473be4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesActionsTest-871757799 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4b1125779ec1410a9c732e26473be4d3 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesActionsTest-871757799 Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesActionsTest-871757799-project Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 74035c297a274fbdbc0b51d2e33b6fba Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesActionsTest-871757799-project Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4864eb8e-8719-420b-9e62-b6b5b75a03a5'} Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:24.033500 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. Oct 18 13:43:24.038535 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:24.039726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] Returning 404 to user: Instance 4864eb8e-8719-420b-9e62-b6b5b75a03a5 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:24.041111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b5a9fb1-26c4-44f0-9cb3-05d36a36b661 tempest-VolumesActionsTest-871757799 tempest-VolumesActionsTest-871757799-project] 10.222.0.27 "GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5" status: 404 len: 111 microversion: 2.1 time: 0.052886 Oct 18 13:43:24.042255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2293/4500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:23 2022] GET /compute/v2.1/servers/4864eb8e-8719-420b-9e62-b6b5b75a03a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:24.149924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:24.150786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:24.161981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.167663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.167663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.170130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.170840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.172734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.253294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.253833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.254513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.255032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lazy-loading 'fault' on Instance uuid 95694354-77be-4375-9330-64cb62b287a3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:24.307146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.314109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.318177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.320375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6524b3e0315b48f59a53d7ca47575675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.321943 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab6c2f45-a36d-4840-aab1-0d04b6f780c2 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 200 len: 1410 microversion: 2.54 time: 0.177103 Oct 18 13:43:24.323369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2294/4501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:24 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 1410 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:24.327495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.329374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:24.330800 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dba06f2c-630c-464d-9cc2-0d923b5b7f7c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1316 microversion: 2.21 time: 0.516018 Oct 18 13:43:24.331705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2208/4502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:23 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:24.653641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:24.654340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:24.660539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.661024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.661858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.662595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.663080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.663692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.014393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:25.014393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:25.027397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.029803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.030508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.033961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.035597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.036119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.043201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.055833 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-935d8a79-dd43-4ab9-8845-ffad1dcf4b13 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.405815 Oct 18 13:43:25.060417 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2295/4503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:24 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:25.248650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.269130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fac84605-689e-4d15-9a9e-adc458e5aa58 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.261476 Oct 18 13:43:25.273441 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2209/4504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:25 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:25.361051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:25.361780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] [instance: 95694354-77be-4375-9330-64cb62b287a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:25.377626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.378165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.378619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.378735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:25.379340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.379453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:25.379809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.380253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.386893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.387972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.388596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.389699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:25.390469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:25.398625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.399269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] HTTP exception thrown: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Request method failure captured: Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 HTTP/1.1 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1PGMWL-MW_YODxnZqVSrVheBia7FgBOWG5ET2CAK4jfEkRfHQ6cNTlnNAwyQsVRgJSCcxkfP21kHazbpqrzsI66-xvmUMCTAlGclytWJIEOkzF2-t_oYnNcgFmalljfC-vd013hrrxfl9XR_c7bCBWDXLLKxQQTSZXL1FkTMKLEf8 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.54 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ca6bb7ad775b425fa91bbb81597c2fb0 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerShowV254Test-1110842530 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ca6bb7ad775b425fa91bbb81597c2fb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ca6bb7ad775b425fa91bbb81597c2fb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ca6bb7ad775b425fa91bbb81597c2fb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ca6bb7ad775b425fa91bbb81597c2fb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerShowV254Test-1110842530 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ca6bb7ad775b425fa91bbb81597c2fb0 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerShowV254Test-1110842530 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerShowV254Test-1110842530-project Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6524b3e0315b48f59a53d7ca47575675 Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerShowV254Test-1110842530-project Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '95694354-77be-4375-9330-64cb62b287a3'} Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:25.399726 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] Returning 404 to user: Instance 95694354-77be-4375-9330-64cb62b287a3 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d664c395-3f15-4c1c-bbdd-9d1ab5c47f00 tempest-ServerShowV254Test-1110842530 tempest-ServerShowV254Test-1110842530-project] 10.222.0.27 "GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3" status: 404 len: 111 microversion: 2.54 time: 0.044037 Oct 18 13:43:25.404100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2296/4505] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:25 2022] GET /compute/v2.1/servers/95694354-77be-4375-9330-64cb62b287a3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:25.652550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.662344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.664607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.665866 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-41a465af-5b24-4b45-949b-17560aa616d8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.293251 Oct 18 13:43:25.666563 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2210/4506] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:25 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:26.081227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:26.082897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:26.094602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:26.098333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.101160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.102030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.105357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.107303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.108032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.299195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:26.300196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:26.314222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.315163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.316435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.317600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.318790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.319777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.765700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:26.780667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63583b8e-700c-4aaa-93fb-d07ebc4e868e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.482143 Oct 18 13:43:26.781367 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2211/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:26 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:26.794786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:26.804812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:26.811822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.812328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.812780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.813590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.817770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.823241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:27.021407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:27.032873 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0dcf14e3-91f0-4486-86a7-074916ac3109 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.953248 Oct 18 13:43:27.034768 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2297/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:26 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:27.059274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:27.073294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:27.088067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:27.091873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:27.098628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e42fb369-d6d7-4eab-ad1f-2a72be8d587c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.312324 Oct 18 13:43:27.099250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2212/4509] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:26 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:27.477599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148ce968-4632-49ce-947a-30fe6c957085", "tag": "eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:27.497165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:27.497657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:27.500719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:27.525545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] Creating event network-changed:eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d for instance 148ce968-4632-49ce-947a-30fe6c957085 on n-h2-858383-13 Oct 18 13:43:27.537527 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bf9df05e-8bdb-4c52-abd4-3c486b9411b4 req-43e63f6c-48f3-4802-97bf-710eb138be14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067217 Oct 18 13:43:27.540008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2298/4510] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:27.806203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:27.806870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:27.820766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:27.823369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:27.824791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:27.825733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:27.830785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:27.831500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.064894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.066148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:28.095131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.095662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.096123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.096854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.106245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.110571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.311422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.322276 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef69a79e-d3dd-4c25-b631-30f88f3e71dc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.520235 Oct 18 13:43:28.325426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2213/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:27 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:28.335366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.337735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:28.359466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.360890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.361569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.363059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.369725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.369725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.387571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:28.421197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:28.656316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.665713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.674601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.674601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c69f0df-9a8e-44e6-a9b9-4b7ed1431391 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.341743 Oct 18 13:43:28.674601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2214/4512] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:28.701592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.710741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3107f020-475c-4f81-967b-4e8a532a87af tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.655395 Oct 18 13:43:28.711644 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2299/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:29.004947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-plugged", "status": "completed", "tag": "e770c673-5b75-45dc-ae45-6fcc87f3999d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:29.035098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.035651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.040971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.076295 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] Creating event network-vif-plugged:e770c673-5b75-45dc-ae45-6fcc87f3999d for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:29.087970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-eb7a95df-4d90-461c-a731-2af6625574cc req-e9ce242d-4f31-4843-9ecc-570ab2a43625 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087173 Oct 18 13:43:29.093518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2215/4514] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:29.348807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:29.349431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:29.357425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.364790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.370825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.370825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.370825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.370825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.697568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:29.699257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:29.715506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.716830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.717300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.720674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.721933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.724462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.048283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:30.067519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.084216 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a1a0e27-be26-44b2-a996-f1a699d64e4f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.739208 Oct 18 13:43:30.102401 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2300/4515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:29 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:30.109786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.117983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:30.137159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.140134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.140792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.145068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.145811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.149793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.197283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.218779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.222836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.224548 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b73525a-fd96-4376-af3c-27a08536ce1b tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.532774 Oct 18 13:43:30.227067 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2216/4516] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:29 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:31.118119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:31.118781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:31.137354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.137891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.138539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.139406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.140090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.140761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.238849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:31.263949 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94e8ea21-04e9-4fc5-a3ab-b804932132aa tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 1.175679 Oct 18 13:43:31.275403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2301/4517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:30 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:31.300735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-plugged", "status": "completed", "tag": "a4811554-fe6a-47d7-830e-5928c2110f61"}, {"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-plugged", "status": "completed", "tag": "05bd7b9e-85f9-4fc2-8c78-55c7a83611fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:31.330364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.331103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.331800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.347146 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Creating event network-vif-plugged:a4811554-fe6a-47d7-830e-5928c2110f61 for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:31.347940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] Creating event network-vif-plugged:05bd7b9e-85f9-4fc2-8c78-55c7a83611fa for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:31.356043 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8161a382-ca0b-4429-8ab9-e7a3cc8c200a req-ffd2b29f-eaa9-46dd-95de-8e4e0c3099c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075286 Oct 18 13:43:31.357335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2302/4518] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:31.365043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:31.366153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:31.376299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.377057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.378046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.379957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.380852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.381555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.583367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:31.593409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-631d090d-4d4a-4950-8e5c-3d23362f39ae tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.480361 Oct 18 13:43:31.598943 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2217/4519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:31 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:31.783999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:31.799512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:31.801046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:31.807621 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8bd01c8f-2a90-4472-a23d-29048c7fffb8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.448760 Oct 18 13:43:31.810717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2303/4520] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:31 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:32.293638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:32.294538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:32.313390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.316107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.318631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.321602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.326404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.328414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.625160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:32.625793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:32.649605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.663810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.665574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.667668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.668609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.670751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.788604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:32.803017 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0bcf53d8-42b5-40e7-9e62-6b785776898d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1355 microversion: 2.1 time: 0.515167 Oct 18 13:43:32.825146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2218/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:32 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1355 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:32.839246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:32.839940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:32.856308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.856819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.857267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.859652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:32.860388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:32.860838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:33.071618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:33.080911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21fcc9a4-0357-4d3f-80f1-b994e56f020f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.459964 Oct 18 13:43:33.087127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2304/4522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:32 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:33.415349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:33.430702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:33.434687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:33.438315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0aaf6c21-1b84-4d5d-abfb-0e4d5032cea8 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.606147 Oct 18 13:43:33.446974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2219/4523] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:32 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:33.834881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:33.837284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:33.854341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:33.855293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:33.856984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:33.858076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:33.858969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:33.859635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.113051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:34.113686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:34.129112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.130678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.131800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.135294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.140076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.142134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.254527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:34.273552 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d3fd1f6-d590-40d1-9caa-a20896cef545 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1806 microversion: 2.1 time: 0.439713 Oct 18 13:43:34.276693 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2305/4524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:33 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1806 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:34.305574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:34.306451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:34.315240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.316106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.316854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.318157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.318922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.319535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.442663 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ca084f6-9857-4418-90fd-a35d320b6e11 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807/ips" status: 200 len: 219 microversion: 2.1 time: 0.140104 Oct 18 13:43:34.465756 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2306/4525] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:43:34 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807/ips => generated 219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:34.485214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:34.486581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:34.516426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.517258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.518360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.519270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.524389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.525264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.597941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:34.675219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:34.684220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-efa3c2bb-c709-4f05-ae68-d17c0dfdb2bb tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.575818 Oct 18 13:43:34.691273 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2220/4526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:34 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:34.708963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:34.710634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:34.733803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.734726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.737632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.747154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.747849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.748319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.806335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:35.036155 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fc83124-d52b-4686-9d03-2d0aaac760bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 204 len: 0 microversion: 2.1 time: 0.567652 Oct 18 13:43:35.036788 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2307/4527] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:34 2022] DELETE /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:43:35.065524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:35.068304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:35.096750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.097475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.098079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.098935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.101527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.101527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.246307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:35.259082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:35.268606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:35.275069 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c284932-c9ed-42be-89c5-f21abb89ef73 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.582334 Oct 18 13:43:35.297823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2221/4528] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:34 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:35.397128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:35.408773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcb9605b-b8a6-46eb-84a7-d753420d038b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1812 microversion: 2.1 time: 0.348395 Oct 18 13:43:35.409966 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2308/4529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:35 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1812 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:35.715830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:35.716362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:35.727032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.727032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.727032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.727294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.727840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.728370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.750779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148ce968-4632-49ce-947a-30fe6c957085", "name": "network-vif-plugged", "status": "completed", "tag": "eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:35.768807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.769528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.770188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.786082 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] Creating event network-vif-plugged:eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d for instance 148ce968-4632-49ce-947a-30fe6c957085 on n-h2-858383-13 Oct 18 13:43:35.794161 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-32890665-253f-4116-a54c-3a333b5e155c req-48f0f5d9-dce1-4bae-8e1b-b9deca227784 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048662 Oct 18 13:43:35.798286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2309/4530] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:36.312867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:36.312867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:36.323767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.325008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.325702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.326881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.327576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.328481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.722810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:36.746709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02291da9-15a3-4cbc-b65c-e498ce71cb2d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 1.034655 Oct 18 13:43:36.747567 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2222/4531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:35 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:36.754139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:36.755021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:36.774925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.775560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.776110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.777207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.777730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.778821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:37.186257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:37.199666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:37.201431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:37.202927 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bab85b77-98bb-48e1-a1ef-5ff9a361cf30 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1358 microversion: 2.21 time: 0.901433 Oct 18 13:43:37.203813 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2310/4532] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:36 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1358 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:37.441120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:37.457938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3638c452-40aa-4360-8b9b-893871efc114 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1812 microversion: 2.1 time: 0.707928 Oct 18 13:43:37.462506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2223/4533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:36 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1812 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:37.774192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:37.774889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:37.791283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:37.793197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:37.794421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:37.797845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:37.798596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:37.799212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.230462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:38.231275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:38.246787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.247610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.248244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.249149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.251767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.252435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.328702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:38.343082 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2feca992-3104-4376-b35a-3f8d203242a4 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.574638 Oct 18 13:43:38.346159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2311/4534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:37 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:38.497236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:38.499162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:38.524635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.532772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.533343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.534577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.535264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.538825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.842191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:38.851874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5ce629b-2b82-42a6-a1e7-3de860a90157 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1791 microversion: 2.1 time: 0.364253 Oct 18 13:43:38.858261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2312/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:38 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1791 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:38.867602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:38.874648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-deleted", "tag": "a4811554-fe6a-47d7-830e-5928c2110f61"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:38.884352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:38.885792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:38.887473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ad6fb65-096c-4237-8c46-32675db2a149 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1551 microversion: 2.21 time: 0.661221 Oct 18 13:43:38.891066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.895826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.896528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.902956 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2224/4536] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:38 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1551 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:38.920477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:38.920979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:38.925788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] Creating event network-vif-deleted:a4811554-fe6a-47d7-830e-5928c2110f61 for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:38.932947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.933452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.933893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.934681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:38.935143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:38.935572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:38.940924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-eb8f27d1-b4d6-4aff-abde-e74324438cc8 req-336590a2-540a-45c9-b80a-0329e76a264f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079686 Oct 18 13:43:38.942586 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2313/4537] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:38.989108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:39.370725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ed2a63c-eb1f-4b03-aa00-2c635e3be934 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "DELETE /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 204 len: 0 microversion: 2.21 time: 0.453881 Oct 18 13:43:39.371911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2225/4538] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:43:38 2022] DELETE /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:43:39.393598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:39.394824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:39.400074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:39.402839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:39.421180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:39.423168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:39.426899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:39.427751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:39.430543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:39.431363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:39.438722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:39.438840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:39.438840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:39.439181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:39.439708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:39.440222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:40.182715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:40.201835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e794639-120d-498a-b0b8-fd1c448527d6 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.826511 Oct 18 13:43:40.223746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2314/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:39 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:40.230886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:40.231914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:40.241166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:40.241898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:40.243293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:40.244648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:40.245365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:40.245956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:40.353397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:40.364758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:40.374998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:40.377530 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3bbf2bb-bd65-4c12-8dee-e2d60378f0c1 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1557 microversion: 2.21 time: 0.997341 Oct 18 13:43:40.378936 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2226/4540] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:39 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1557 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:40.465603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:40.474684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a691669-dae4-475b-95c1-5544f0ce6b7f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1632 microversion: 2.1 time: 0.249436 Oct 18 13:43:40.479353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2315/4541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:40 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1632 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:40.828639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-unplugged", "status": "completed", "tag": "e770c673-5b75-45dc-ae45-6fcc87f3999d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:40.851007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:40.852134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:40.853835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:40.875495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] Creating event network-vif-unplugged:e770c673-5b75-45dc-ae45-6fcc87f3999d for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:40.884318 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ca34a6da-116b-4120-bbfe-cffc66a780d2 req-6b669e57-4d0c-4d7a-9937-7d9b3e521a47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062408 Oct 18 13:43:40.888992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2227/4542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:40.984929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-deleted", "tag": "05bd7b9e-85f9-4fc2-8c78-55c7a83611fa"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:41.007909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:41.008545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:41.009091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:41.039499 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] Creating event network-vif-deleted:05bd7b9e-85f9-4fc2-8c78-55c7a83611fa for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:41.059990 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7c2d7ab7-3994-40fc-9ee0-a8378089d1c7 req-f887ce0b-c93b-4bbb-a40c-65a6fef8011e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080050 Oct 18 13:43:41.066619 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2316/4543] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:41.228005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:41.228870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:41.243515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:41.243928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:41.244377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:41.245082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:41.246049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:41.246049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:41.411364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:41.414881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:41.431779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:41.432302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:41.432755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:41.433484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:41.433952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:41.434421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:42.107293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:42.126394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:42.133675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:42.137636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85aed060-d930-49ab-9d96-88da0c136054 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1557 microversion: 2.21 time: 0.732689 Oct 18 13:43:42.140476 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2317/4544] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:41 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1557 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:42.151294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:42.152077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:42.162528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:42.163200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:42.164713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:42.167807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:42.168577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:42.169184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:42.316744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:42.356287 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8faa5f6-e22b-4d10-a3bc-f3676ca917a8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 1.130970 Oct 18 13:43:42.357636 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2228/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:41 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:42.649668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:42.660109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20af1196-d99b-4089-8996-604a4b45b5e7 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1496 microversion: 2.1 time: 0.514687 Oct 18 13:43:42.671232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2318/4546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:42 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1496 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:43.121174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90d5eeb-8691-4863-9f87-f69556c59807", "name": "network-vif-deleted", "tag": "e770c673-5b75-45dc-ae45-6fcc87f3999d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:43.149916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1084143915", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:43.166778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.174165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.181611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:43.255836 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] Creating event network-vif-deleted:e770c673-5b75-45dc-ae45-6fcc87f3999d for instance d90d5eeb-8691-4863-9f87-f69556c59807 on n-h1-858383-13 Oct 18 13:43:43.266813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-af6fc5e3-3542-43e6-a146-cff65cb4a8c4 req-f72ce759-635e-478b-a0e9-fa9f7b15818a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151296 Oct 18 13:43:43.269338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2319/4547] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:43.297145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] validate_networks() for [('f427c4fd-906e-450c-aa93-bc4186f30328', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:43:43.303381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:43.311096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:43.331885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.332380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.332823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:43.339000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.339000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.339000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:43.558226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:43.571618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:43.578681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:43.580012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d91daf63-be58-43b5-b57b-9bdaa13bb1aa tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1515 microversion: 2.21 time: 0.291560 Oct 18 13:43:43.581009 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2320/4548] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:43 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:43:43.590271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:43.592751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:43.603434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.608333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.609166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:43.610153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.612047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.614218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:43.917221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:43.932341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-604b6ee3-dbbb-4437-9677-946b83ff840c tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.348022 Oct 18 13:43:43.936487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2321/4549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:43 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:43.941616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148ce968-4632-49ce-947a-30fe6c957085", "name": "network-vif-deleted", "tag": "eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:43.991870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:43.992380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:43.992825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.046601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] Creating event network-vif-deleted:eeb200b1-b8d5-4335-9dde-8df6b7ae9c5d for instance 148ce968-4632-49ce-947a-30fe6c957085 on n-h2-858383-13 Oct 18 13:43:44.069576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ff2e74cc-7c61-412e-993a-b4a56d13429c req-ca8341c4-1b37-4565-89c2-bed2692886b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131635 Oct 18 13:43:44.071044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2322/4550] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:44.090127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:44.095595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:44.109275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.111018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.113565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.115280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.117081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.118828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.196291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.197778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.198542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.199167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lazy-loading 'fault' on Instance uuid d90d5eeb-8691-4863-9f87-f69556c59807 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:44.283422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:44.297472 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0124570-1377-4b7a-9862-6530246c2443 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 200 len: 1303 microversion: 2.1 time: 0.222864 Oct 18 13:43:44.298812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2323/4551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:44 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:44.553151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:43:44.554680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:43:44.555414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:43:44.556427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:43:44.557642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:43:44.602906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.603481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.605379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.605379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.605379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.605835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.611206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:44.613050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:44.616567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:44.630477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Getting quotas for project 0afceb9a2a5b41cb8a7e59f036f57422. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:43:44.633978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.634515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.634978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.635707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.636180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.636627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.639028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Getting quotas for user d50c668c2b2f43798ab247029a8386e5 and project 0afceb9a2a5b41cb8a7e59f036f57422. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:43:44.654982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:43:44.665122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:43:44.695806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.696312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.696762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.697403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lazy-loading 'fault' on Instance uuid 148ce968-4632-49ce-947a-30fe6c957085 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:44.777505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:44.778683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:44.780641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89acf827045f47d98b97a8a4c2a3e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e41bfbb72427198a878de059fe0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:44.782160 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9df1c5b3-0522-4d85-895c-39b0cca009a2 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 200 len: 1348 microversion: 2.21 time: 0.175272 Oct 18 13:43:44.783443 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2324/4552] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:44 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 1348 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:43:44.841504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20543822-4854-4070-aee5-e9a0dbe192e2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932142 Oct 18 13:43:44.842872 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2229/4553] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:43:44.854574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd39cb94-628c-473e-911d-83fab918c220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:44.855455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd39cb94-628c-473e-911d-83fab918c220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:44.956944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:44.957862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:44.991312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:44.993793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:44.994295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:44.997715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.000764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.001863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.003817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd39cb94-628c-473e-911d-83fab918c220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:45.013271 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd39cb94-628c-473e-911d-83fab918c220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1217 microversion: 2.1 time: 0.163506 Oct 18 13:43:45.027008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2325/4554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:44 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:45.309433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:45.320210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42b2e6b9-7640-4536-82a2-e8b3666cab79 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.367105 Oct 18 13:43:45.322335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2230/4555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:44 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:45.342879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:45.343737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:45.359319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.359835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.360855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.363596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.364311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.364910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.382611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 HTTP/1.1 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'd90d5eeb-8691-4863-9f87-f69556c59807'} Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:45.384932 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:43:45.388676 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.391246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:45.393096 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa4011b0-4918-468a-b9ea-2474245ab0ef tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 404 len: 111 microversion: 2.1 time: 0.060474 Oct 18 13:43:45.393958 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2326/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:45 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:45.816053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:45.821037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:45.830568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.831279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.832796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.833691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.836037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.836850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.873381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] HTTP exception thrown: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Request method failure captured: Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 HTTP/1.1 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq10dr8mqGZ77M9i4HBjz1iKGPKlwFrhXQXzdDDKijDZhyEQlNnRtkpUqKwnDHD323QpGSWAdJtv3KFxn_R2Sl7Ek5jV0_Jg6xF8b6NkuO9aHx-f-vSgDcKSMTVuJzgTg2X4fn6r4YtXkqK9005MadARkIBILFpGtcExRXr4TmMmjZY Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89acf827045f47d98b97a8a4c2a3e19d Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '148ce968-4632-49ce-947a-30fe6c957085'} Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.875948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Returning 404 to user: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f224a70f-1652-49fb-bde8-80d92b9ce05c tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 404 len: 111 microversion: 2.21 time: 0.073045 Oct 18 13:43:45.887265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2231/4557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:45 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:45.893119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '.version_select at 0x7fb3304ac4c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:45.893935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:45.906003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.907077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.909675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:45.911399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:45.914165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:45.914775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.040495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3e7a73f-ef07-4935-a18b-8a5bbab5e3f1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:46.041309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3e7a73f-ef07-4935-a18b-8a5bbab5e3f1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:46.112664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3c055e5-fa5f-47c6-bb92-150d907abfb5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.227136 Oct 18 13:43:46.116248 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2327/4558] 10.222.0.27 () {60 vars in 1337 bytes} [Tue Oct 18 13:43:45 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085/os-instance-actions => generated 611 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:43:46.133166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:46.134391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:46.151934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.153462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.154116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.157364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.158137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.160290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.205975 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] HTTP exception thrown: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Request method failure captured: Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 HTTP/1.1 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq10dr8mqGZ77M9i4HBjz1iKGPKlwFrhXQXzdDDKijDZhyEQlNnRtkpUqKwnDHD323QpGSWAdJtv3KFxn_R2Sl7Ek5jV0_Jg6xF8b6NkuO9aHx-f-vSgDcKSMTVuJzgTg2X4fn6r4YtXkqK9005MadARkIBILFpGtcExRXr4TmMmjZY Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89acf827045f47d98b97a8a4c2a3e19d Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '148ce968-4632-49ce-947a-30fe6c957085'} Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:46.226317 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.230859 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.233097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Returning 404 to user: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:46.241815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a42274e7-7559-4572-a5f2-e17c829375be tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "DELETE /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 404 len: 111 microversion: 2.21 time: 0.112731 Oct 18 13:43:46.248463 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2328/4559] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:43:46 2022] DELETE /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:43:46.256633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:46.260140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d3e7a73f-ef07-4935-a18b-8a5bbab5e3f1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:46.260507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] [instance: 148ce968-4632-49ce-947a-30fe6c957085] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:46.271002 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3e7a73f-ef07-4935-a18b-8a5bbab5e3f1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1217 microversion: 2.1 time: 0.234803 Oct 18 13:43:46.276495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2232/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:46 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:46.281130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.285251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.288915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.289904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.290816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.291422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.332079 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] HTTP exception thrown: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Request method failure captured: Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 HTTP/1.1 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq10dr8mqGZ77M9i4HBjz1iKGPKlwFrhXQXzdDDKijDZhyEQlNnRtkpUqKwnDHD323QpGSWAdJtv3KFxn_R2Sl7Ek5jV0_Jg6xF8b6NkuO9aHx-f-vSgDcKSMTVuJzgTg2X4fn6r4YtXkqK9005MadARkIBILFpGtcExRXr4TmMmjZY Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f43e41bfbb72427198a878de059fe0f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f43e41bfbb72427198a878de059fe0f6 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-974730562 Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89acf827045f47d98b97a8a4c2a3e19d Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsV221TestJSON-974730562-project Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '148ce968-4632-49ce-947a-30fe6c957085'} Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.346582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] Returning 404 to user: Instance 148ce968-4632-49ce-947a-30fe6c957085 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:46.351329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f0fb9e1-2240-4bbd-8c7d-0137643c06e5 tempest-InstanceActionsV221TestJSON-974730562 tempest-InstanceActionsV221TestJSON-974730562-project] 10.222.0.27 "GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085" status: 404 len: 111 microversion: 2.21 time: 0.096565 Oct 18 13:43:46.359565 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2329/4561] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:43:46 2022] GET /compute/v2.1/servers/148ce968-4632-49ce-947a-30fe6c957085 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:43:46.362358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:46.367267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:46.407129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.408575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.411111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:46.413424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:46.415345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:46.416755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:47.035125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:47.049354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9674a8c-5ccb-4d8b-b8a3-71e5213c5c8e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.702464 Oct 18 13:43:47.050285 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2233/4562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:46 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:47.297743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:47.298426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:47.315216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:47.316052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:47.319132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:47.322969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:47.324750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:47.325813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:47.363745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:47.792139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:47.807577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2591025-21d0-417d-9944-5572606e0871 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1213 microversion: 2.1 time: 0.513489 Oct 18 13:43:47.811309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2330/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1213 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:48.078291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:48.078291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:48.099284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:48.111585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:48.112516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:48.113301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:48.113782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:48.121287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:48.628871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:48.642778 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a1f5ed5-0c85-4a16-bd0b-e9f0c5c2293f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1510 microversion: 2.1 time: 0.568338 Oct 18 13:43:48.643868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2234/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:48 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1510 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:48.837518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:48.839457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:48.853968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:48.864351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:48.870788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:48.873680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:48.874457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:48.878445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:49.003045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:49.024381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-417aa265-8d2e-4478-b1c7-97b4b38ce4de tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1287 microversion: 2.1 time: 0.185620 Oct 18 13:43:49.026676 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2331/4565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:48 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:49.685147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:49.685147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:49.689916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:49.705620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:49.706212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:49.706610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:49.707322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:49.707813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:49.708206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.057979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:50.059306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:50.072791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.073402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.076859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.077715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.079782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.080299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.273476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:50.316063 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f89f68b4-6b48-4fef-be1a-c171876ecdd2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1487 microversion: 2.1 time: 0.601880 Oct 18 13:43:50.316743 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2235/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:49 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1487 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:50.343586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-835440235"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:50.366317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:50.400647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.401165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.408473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.409331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.413087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.415506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.786804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf649f4f-4e9c-4b39-a927-3d66eeb26cc8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "PUT /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1060 microversion: 2.1 time: 0.447450 Oct 18 13:43:50.788509 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2236/4567] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:43:50 2022] PUT /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1060 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:50.808688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:50.809602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:50.830642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.831234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.831759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.832813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:50.833565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:50.834274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:50.996395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:51.032482 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06923d2e-6076-4818-b376-f7780bc13a21 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.978501 Oct 18 13:43:51.037203 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2332/4568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:50 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:51.225469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:51.237870 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-044740db-0c4d-4dfc-afa2-222538e62ecc tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1487 microversion: 2.1 time: 0.433422 Oct 18 13:43:51.238490 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2237/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:50 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1487 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:51.266476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:51.267423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:51.275941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:51.277782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:51.278282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:51.291806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:51.291806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:51.291806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.035598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:52.077545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.078034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.079226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.118794 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] Creating event network-changed:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:43:52.128846 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3200db70-6420-4aa5-a41f-aa3a9f4defd0 req-d40703c0-5e25-4344-9d45-a7e6c6ca59f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096776 Oct 18 13:43:52.129924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2238/4570] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:52.149264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:52.150015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:52.171535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.172050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.174337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.175504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.182997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.182997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.371947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:52.386288 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c44cf042-21dd-485d-bc49-555dcdad0c2f tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1487 microversion: 2.1 time: 1.124148 Oct 18 13:43:52.387601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2333/4571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:51 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1487 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:52.413262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:52.414153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:52.433955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.435456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.436488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.438854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.439680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.440681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.500775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:52.509194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0670672e-57bb-4322-8407-ec17b18d6a85 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.377013 Oct 18 13:43:52.509779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2239/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:52 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:52.539345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:52.930992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59421a63-7eb9-448d-b5bd-69f728d3f8a5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 204 len: 0 microversion: 2.1 time: 0.523505 Oct 18 13:43:52.934013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2334/4573] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:52 2022] DELETE /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:43:52.942004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:52.943137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:52.963085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.963221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.963574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:52.964288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:52.964749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:52.965186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:53.535432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:53.536157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:53.549316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:53.556496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:53.556986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:53.557798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:53.559514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:53.559971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:53.978100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:53.998015 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5391b2cb-9f90-4283-b058-ac3fadfc34db tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1493 microversion: 2.1 time: 1.060386 Oct 18 13:43:54.000539 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2240/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:52 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1493 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:54.042799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:54.052676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8f8b0ac-21eb-4b79-826d-0b18c77562f6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.522627 Oct 18 13:43:54.068843 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2335/4575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:53 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:55.024905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:55.025671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:55.035061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:55.050380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:55.081242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:55.081963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:55.092018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:55.120892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:55.123959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:55.124702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:55.128540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:55.129308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:55.130679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:56.169788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:56.190521 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d4a063d-e482-4f6e-b6a4-1e822cf81f2b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1493 microversion: 2.1 time: 1.171251 Oct 18 13:43:56.191777 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2241/4576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:55 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1493 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:56.479477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:56.503999 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84c5d591-65bd-4c19-b0c2-e18f89e7517f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 1.426641 Oct 18 13:43:56.505206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2336/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:55 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:57.222546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:57.223444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:57.227046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:57.248587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:57.252938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:57.253776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:57.257807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:57.260362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:57.261269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:57.531406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:57.534449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:57.543768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:57.557058 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ad08b80-82b7-4ccf-bcd9-835c10971720 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1451 microversion: 2.1 time: 0.338648 Oct 18 13:43:57.560369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:57.560913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:57.561383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:57.561559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2242/4578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:57 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1451 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:57.571537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:57.572222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:57.574115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62ef72f-763d-49f5-a433-9c40cbe8a14a", "name": "network-vif-deleted", "tag": "76f3a884-1663-4497-9aae-211d13cd16ea"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:57.575390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:57.594617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:57.595423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:57.608354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:57.650192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] Creating event network-vif-deleted:76f3a884-1663-4497-9aae-211d13cd16ea for instance e62ef72f-763d-49f5-a433-9c40cbe8a14a on n-h2-858383-13 Oct 18 13:43:57.656845 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-510e1dd0-d819-4152-a948-e1d00ac98bea req-0c7db0df-59ea-49ee-b3ae-78e9e6d61770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093860 Oct 18 13:43:57.658488 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2243/4579] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:58.288218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:58.300592 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3053e119-4335-48f2-a3f7-40e5416a472f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.773793 Oct 18 13:43:58.304446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2337/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:57 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:58.348111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1112636311", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f680e9e5-fc07-4d89-b321-a54f1383e1d7"}, {"uuid": "32505caa-ed46-4c8d-8b7a-7f44728e3362"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:58.485377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] validate_networks() for [('f680e9e5-fc07-4d89-b321-a54f1383e1d7', None, None, None, None, None), ('32505caa-ed46-4c8d-8b7a-7f44728e3362', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:43:58.582579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:58.584412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:58.588014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:58.593234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:58.594012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:58.594698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:58.595781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:58.596476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:58.597118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:58.634831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:58.635597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:58.636263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:58.636934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid e62ef72f-763d-49f5-a433-9c40cbe8a14a {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:58.765707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:58.781837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a18cf2a-09f1-4cc5-bc57-63a36cb8d569 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 200 len: 1309 microversion: 2.1 time: 0.203140 Oct 18 13:43:58.783022 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2338/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:58 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:43:59.328105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:59.328758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:59.340506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:59.346771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:59.349894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:59.351131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:59.354167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:59.354830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.139698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:00.164523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f3f7d38-ecc1-495a-a3da-9ff4aa7d829b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.839701 Oct 18 13:44:00.165206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2339/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:59 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:00.195223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.196801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.213582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.214523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.215220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.216757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.218412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.219529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.269164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a HTTP/1.1 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e62ef72f-763d-49f5-a433-9c40cbe8a14a'} Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.271528 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.276767 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.281761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.284323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2994821-4c4a-4648-ac68-e95ce696c20b tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 404 len: 111 microversion: 2.1 time: 0.097757 Oct 18 13:44:00.296722 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2340/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:00 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.306832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.310310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.322368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.324999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.328893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.329875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.330602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.342372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.364359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a HTTP/1.1 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e62ef72f-763d-49f5-a433-9c40cbe8a14a'} Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.366891 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.371351 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.373793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.375373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-483cb261-4142-48f2-b3d3-94ffc99abc84 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 404 len: 111 microversion: 2.1 time: 0.077333 Oct 18 13:44:00.379933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2341/4584] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:00 2022] DELETE /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.386553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.392691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: e62ef72f-763d-49f5-a433-9c40cbe8a14a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.395724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.396948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.397638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.399694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.400421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.401008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.423171 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a HTTP/1.1 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e62ef72f-763d-49f5-a433-9c40cbe8a14a'} Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.425411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. Oct 18 13:44:00.430714 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.432894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance e62ef72f-763d-49f5-a433-9c40cbe8a14a could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.434229 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5da07df6-5801-43db-9db7-9c36db49ab35 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a" status: 404 len: 111 microversion: 2.1 time: 0.051945 Oct 18 13:44:00.434957 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2342/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:00 2022] GET /compute/v2.1/servers/e62ef72f-763d-49f5-a433-9c40cbe8a14a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.445397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.447043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.456396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.457344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.458099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.459881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.460502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.461089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.482859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 HTTP/1.1 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a652a141-e890-4a37-9318-94c0fcdb9d43'} Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.653029 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2ecb9cc-172e-4c24-a052-8765bf0074e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 404 len: 111 microversion: 2.1 time: 0.047737 Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2343/4586] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:00 2022] DELETE /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: a652a141-e890-4a37-9318-94c0fcdb9d43] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.672407 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 HTTP/1.1 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a652a141-e890-4a37-9318-94c0fcdb9d43'} Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.674217 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance a652a141-e890-4a37-9318-94c0fcdb9d43 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8001bd79-f11a-4a11-afbe-7fbdc141e145 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43" status: 404 len: 111 microversion: 2.1 time: 0.124984 Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2344/4587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:00 2022] GET /compute/v2.1/servers/a652a141-e890-4a37-9318-94c0fcdb9d43 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.685446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.690309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 HTTP/1.1 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '338e7ce9-c523-472a-af71-816c69c91584'} Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.692657 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6649e1cc-5eff-40b5-8da7-8fd52da470e0 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 404 len: 111 microversion: 2.1 time: 0.066823 Oct 18 13:44:00.699246 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2345/4588] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:00 2022] DELETE /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.710650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.710778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 338e7ce9-c523-472a-af71-816c69c91584] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.723617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.729294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.731978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.733439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.735695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.736169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.783375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 HTTP/1.1 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '338e7ce9-c523-472a-af71-816c69c91584'} Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.788335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 338e7ce9-c523-472a-af71-816c69c91584 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-796b3c8e-488d-44c4-a228-e198fa1266c7 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584" status: 404 len: 111 microversion: 2.1 time: 0.091094 Oct 18 13:44:00.808759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2346/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:00 2022] GET /compute/v2.1/servers/338e7ce9-c523-472a-af71-816c69c91584 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:44:00.818118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.819755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.832049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.853788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff HTTP/1.1 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '40d26017-97a5-4608-be79-49ce94b11fff'} Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.860762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d778fdf-ecc0-414f-bb96-95983a511aef tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 404 len: 111 microversion: 2.1 time: 0.045381 Oct 18 13:44:00.864628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2347/4590] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:00 2022] DELETE /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.872144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.873263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 40d26017-97a5-4608-be79-49ce94b11fff] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:00.902227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.934347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.934347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.934347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:00.934347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:00.934347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:00.973805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff HTTP/1.1 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '40d26017-97a5-4608-be79-49ce94b11fff'} Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.976576 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 40d26017-97a5-4608-be79-49ce94b11fff could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:00.981572 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-68e39dea-87fa-4107-9361-507726fef650 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff" status: 404 len: 111 microversion: 2.1 time: 0.112150 Oct 18 13:44:00.984435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2348/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:00 2022] GET /compute/v2.1/servers/40d26017-97a5-4608-be79-49ce94b11fff => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:00.998643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:00.999243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:01.016048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.020168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.020629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.024824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.027159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.027638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.073725 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 HTTP/1.1 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '1308f5a5-f296-4bc1-86de-10690d38c637'} Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:01.076289 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.080779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.084694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:01.086144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb138fde-6145-46e1-9064-f478729bbd4e tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 404 len: 111 microversion: 2.1 time: 0.099842 Oct 18 13:44:01.087209 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2349/4592] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:00 2022] DELETE /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:01.098246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:01.099055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 1308f5a5-f296-4bc1-86de-10690d38c637] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:01.107016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.107805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.108543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.110015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.110703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.111288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.153550 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 HTTP/1.1 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '1308f5a5-f296-4bc1-86de-10690d38c637'} Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.159449 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 1308f5a5-f296-4bc1-86de-10690d38c637 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18a49c9e-4c31-4b41-bdd3-375efb3dd348 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637" status: 404 len: 111 microversion: 2.1 time: 0.071423 Oct 18 13:44:01.168635 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2350/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:01 2022] GET /compute/v2.1/servers/1308f5a5-f296-4bc1-86de-10690d38c637 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:01.195419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:01.195953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:01.225833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.226555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.227017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.228642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.229134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.232430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.280950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 HTTP/1.1 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3cee7434-e6cd-45a3-95b6-5527d9dcf5b0'} Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:01.284462 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:01.288838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2fd5e2a-09b3-4e50-adce-d9fef20d3760 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 404 len: 111 microversion: 2.1 time: 0.119022 Oct 18 13:44:01.293619 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2351/4594] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:01 2022] DELETE /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:01.315465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:01.316406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.343681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.705518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:01.705958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:01.706464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:01.706862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:01.707322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:01.738546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.739346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.740555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.741485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:01.742209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:01.742989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:01.770857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Getting quotas for project 097aa0eadf644bcebb1726180c126259. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:01.777596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Getting quotas for user 725680d81f6f43679703425651a3e207 and project 097aa0eadf644bcebb1726180c126259. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:01.797280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:01.800544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:02.014861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7bb7f457-2c79-4f59-8c8c-61eab29f3165 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.699411 Oct 18 13:44:02.022752 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2244/4595] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:44:02.042610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:02.053159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:02.070742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.071234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.086870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.088862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.089347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.089799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.124190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 HTTP/1.1 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3cee7434-e6cd-45a3-95b6-5527d9dcf5b0'} Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.125885 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:02.131061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e246766-5890-421a-ae63-7af5814a7ef2 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0" status: 404 len: 111 microversion: 2.1 time: 0.102487 Oct 18 13:44:02.142425 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2245/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:02 2022] GET /compute/v2.1/servers/3cee7434-e6cd-45a3-95b6-5527d9dcf5b0 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:02.148516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49db1080-61a6-4c3e-975e-1694fd76b991 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:02.149149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49db1080-61a6-4c3e-975e-1694fd76b991 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:02.310109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-49db1080-61a6-4c3e-975e-1694fd76b991 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:02.316232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49db1080-61a6-4c3e-975e-1694fd76b991 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1213 microversion: 2.1 time: 0.172603 Oct 18 13:44:02.358465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2246/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:02 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:02.379648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:02.380069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:02.403790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.410176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.410859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.414332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.417138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.420210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.506670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf HTTP/1.1 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5910d5f6-afe0-4011-8d05-d8e2652c7adf'} Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:02.509461 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.517591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:02.535566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32297dc3-a213-4deb-96fb-66fe527ff4ba tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf" status: 404 len: 111 microversion: 2.1 time: 0.150187 Oct 18 13:44:02.535566 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2247/4598] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:02 2022] DELETE /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:02.549643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:02.550302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 5910d5f6-afe0-4011-8d05-d8e2652c7adf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:02.582982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.587124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.587760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.588729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.591265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.591845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.617870 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf HTTP/1.1 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5910d5f6-afe0-4011-8d05-d8e2652c7adf'} Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.630948 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. Oct 18 13:44:02.644222 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:02.650680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 5910d5f6-afe0-4011-8d05-d8e2652c7adf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:02.662687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a183b51-f5bb-43db-a93c-b16dc3dd97a3 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf" status: 404 len: 111 microversion: 2.1 time: 0.112852 Oct 18 13:44:02.666843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2248/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:02 2022] GET /compute/v2.1/servers/5910d5f6-afe0-4011-8d05-d8e2652c7adf => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:02.678544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "name": "network-vif-plugged", "status": "completed", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:02.715478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.716174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.722183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.768144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] Creating event network-vif-plugged:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:44:02.777781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2a0e8738-da2f-4135-a136-1232f8abcc57 req-810fe220-ca8f-4bb6-81b3-34d2b8253f39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109136 Oct 18 13:44:02.778800 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2249/4600] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:02.784331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:02.788934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:02.791473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:02.792453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:02.799581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9efaa51-aa11-428f-abdc-c095f43ce725 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 1.504456 Oct 18 13:44:02.809292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.810009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.816818 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2352/4601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:01 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:02.831295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.838028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:02.838028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:02.838028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:02.885298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:03.320047 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8c26f06-ad67-47d8-81a7-2846d0c92d80 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 204 len: 0 microversion: 2.1 time: 0.539487 Oct 18 13:44:03.321173 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2250/4602] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:02 2022] DELETE /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:44:03.334524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:03.334524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:03.345581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:03.350084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7474796-8088-4c6c-994d-814733c63eb0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:03.351588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c7474796-8088-4c6c-994d-814733c63eb0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:03.352180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:03.352634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:03.356785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:03.357314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:03.357776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:03.592361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7474796-8088-4c6c-994d-814733c63eb0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:03.618168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7474796-8088-4c6c-994d-814733c63eb0 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1213 microversion: 2.1 time: 0.271770 Oct 18 13:44:03.623910 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2251/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:03 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1213 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:03.847690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:03.848321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:03.866536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:03.867053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:03.867506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:03.868233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:03.868694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:03.869125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:03.955638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:04.204801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:04.214700 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5eb7d7f6-ec11-49d8-9df8-47bfe77655f4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.374089 Oct 18 13:44:04.217147 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2252/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:03 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:04.654839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:04.654839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:04.659349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:04.659853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:04.660295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:04.669084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:04.687615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:04.713464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:04.717686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:04.718752 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e64df246-5a91-4f3b-9489-9386f08af63d tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1481 microversion: 2.1 time: 1.389493 Oct 18 13:44:04.723874 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2353/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:03 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1481 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:04.857024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:04.872473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e87935d3-bafe-4673-b5ef-44852f91190b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1209 microversion: 2.1 time: 0.226794 Oct 18 13:44:04.873312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2253/4606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:04 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:05.247280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:05.247909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:05.269246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.269985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.270471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.287775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.288401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.288871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.750296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:05.750993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:05.771688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.772814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.776069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.777463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.779537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.781517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.853993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:05.869401 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8ebed3a-df83-41f4-b988-94049f6ba01f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1317 microversion: 2.1 time: 0.628221 Oct 18 13:44:05.876108 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2354/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:05 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:05.906483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:05.908172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:05.929860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.931856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.934033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.935113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.936036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.937554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:06.238959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:06.258372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-142dd4af-5568-47d2-be16-a072bc4aaf71 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1273 microversion: 2.1 time: 0.358014 Oct 18 13:44:06.261291 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2355/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:05 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:06.416043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:06.433330 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0da2f85f-84de-4a52-8c84-ed6742f9fe32 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1481 microversion: 2.1 time: 0.688767 Oct 18 13:44:06.433330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2254/4609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:05 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1481 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:06.838371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7", "name": "network-vif-deleted", "tag": "99f0c4df-5133-4d77-957a-d5a1db194808"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:06.851731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:06.852587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:06.853346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:06.870317 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] Creating event network-vif-deleted:99f0c4df-5133-4d77-957a-d5a1db194808 for instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 on n-h1-858383-13 Oct 18 13:44:06.877287 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-71fec912-ab5f-4e13-84e5-f88a7b6d144d req-9ecff246-2e52-433a-ad13-e4450ebfd434 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044662 Oct 18 13:44:06.878335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2356/4610] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:06.908821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:06.909502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:06.928104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:06.932215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:06.938863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:06.941497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:06.943292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:06.943955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.152318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:07.160196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1c4be1c-d0b5-40bc-a1fb-6d279f9f0ddf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.263228 Oct 18 13:44:07.182433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2255/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:06 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:07.292501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:07.293881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:07.309863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.311805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.315019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.315714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.316235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.322113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.446240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2082943251", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:07.535671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] validate_networks() for [('f427c4fd-906e-450c-aa93-bc4186f30328', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:07.570665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:07.583086 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d49917f-6822-4181-b36f-80d7d85d5e92 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1271 microversion: 2.1 time: 0.295038 Oct 18 13:44:07.584709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2357/4612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:07 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:07.592477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:07.596064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:07.615114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.615114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.617113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.621373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.622894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.623727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.702398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.702719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.703264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.703926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lazy-loading 'fault' on Instance uuid 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:44:07.833324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62ff0a5713b44b7aac67e73e037e8a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6a1e83216c4a3882adbeab292b822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:07.878150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b9cb610-4b3c-4b16-a623-8417eb463cf8 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 200 len: 1283 microversion: 2.1 time: 0.291209 Oct 18 13:44:07.899477 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2358/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:07 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 1283 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:08.306830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:08.307282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:08.307726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:08.308144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:08.309298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:08.337398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.339635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.340262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.346939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.346939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.346939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.366765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Getting quotas for project 0afceb9a2a5b41cb8a7e59f036f57422. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:08.373737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Getting quotas for user d50c668c2b2f43798ab247029a8386e5 and project 0afceb9a2a5b41cb8a7e59f036f57422. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:08.390824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:08.398819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:08.609688 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fcf85c2a-a91e-4198-b2ca-41f34160d1e8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168621 Oct 18 13:44:08.613978 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2256/4614] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:44:08.628404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7836a73f-ee86-43ea-a7b3-e5b418e9406f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:08.634599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7836a73f-ee86-43ea-a7b3-e5b418e9406f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:08.668753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:08.673634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:08.686104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.689287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.691782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.692651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.693333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.693760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.808841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7836a73f-ee86-43ea-a7b3-e5b418e9406f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:08.819030 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7836a73f-ee86-43ea-a7b3-e5b418e9406f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1217 microversion: 2.1 time: 0.197933 Oct 18 13:44:08.819949 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2359/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:08 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:08.904782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:08.905502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] [instance: 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:08.943908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.944675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.945312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.949487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:08.951632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:08.952995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.984710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:09.009459 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a813df3-35b7-41ef-ad3c-cae379fd143f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1271 microversion: 2.1 time: 0.371185 Oct 18 13:44:09.010508 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] HTTP exception thrown: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Request method failure captured: Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 HTTP/1.1 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTqyphU7NZm1Gc33MYkdMfQBAZ3GkxWb03szwHz5H0Qb-ka1qqJVbMaQqJWCJfqwk9nC_LWp7XecsfnQyEDUgNXHc6ZoCwjDuoUEY9DXy03U5oBUez0lRifQxipjLsDmMwM6amLjmL4kSq2bxSRkfpXnEsV_n9a-pgpB6AEwI1XAKKzE Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c6a1e83216c4a3882adbeab292b822f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestJSON-473003667 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3c6a1e83216c4a3882adbeab292b822f Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestJSON-473003667 Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestJSON-473003667-project Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 62ff0a5713b44b7aac67e73e037e8a6b Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestJSON-473003667-project Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7'} Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:09.018601 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:09.024195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] Returning 404 to user: Instance 4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:09.026837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2257/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:08 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1271 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:09.031292 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32c1a3fb-b911-454a-bb47-ca459d8a07e5 tempest-ServersTestJSON-473003667 tempest-ServersTestJSON-473003667-project] 10.222.0.27 "GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7" status: 404 len: 111 microversion: 2.1 time: 0.130389 Oct 18 13:44:09.032577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2360/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:08 2022] GET /compute/v2.1/servers/4eaf5a25-3e00-4f2b-a7dd-08a0f76e45e7 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:44:09.869797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30171ed4-c86e-44df-8395-1e3fd6c48738 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:09.871103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-30171ed4-c86e-44df-8395-1e3fd6c48738 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:10.039131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:10.039756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:10.057813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:10.058338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:10.058999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:10.059881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:10.060505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:10.061100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:10.078813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-30171ed4-c86e-44df-8395-1e3fd6c48738 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:10.087986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30171ed4-c86e-44df-8395-1e3fd6c48738 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1217 microversion: 2.1 time: 0.236522 Oct 18 13:44:10.096680 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2258/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:09 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:10.660306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:10.673123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0f2e964-407e-490d-b159-1db6e98886ec tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1313 microversion: 2.1 time: 0.638232 Oct 18 13:44:10.673698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2361/4619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:10 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:11.121309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:11.122229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:11.133733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.134434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.138682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.139638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.143376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.143376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.701941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:11.702612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:11.731507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.734841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.735315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.736069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.742491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.742963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.916332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:11.926088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9703bc07-ead4-4be2-9739-7ab8a109ed20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1269 microversion: 2.1 time: 0.807985 Oct 18 13:44:11.938279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2259/4620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:11 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1269 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:12.620067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:12.629362 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04c4550c-f2dd-49c1-8106-b3f61808e737 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1313 microversion: 2.1 time: 0.936223 Oct 18 13:44:12.640271 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2362/4621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:11 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1313 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:12.966290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:12.970484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:13.028486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.031633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.041513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:13.047442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.050808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.051336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:13.217812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:13.240189 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a0beb3d-5acf-4542-808b-8e333c7a5dc1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1275 microversion: 2.1 time: 0.291701 Oct 18 13:44:13.267489 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2260/4622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:12 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:13.667410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:13.668666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:13.684409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.684938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.685447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:13.686225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.686691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.697726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:14.273707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:14.274970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:14.293956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:14.294713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:14.295326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:14.296275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:14.296912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:14.297510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:14.458864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:14.492079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e7a6c764-63e4-4aab-83d8-aefbebc68146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1275 microversion: 2.1 time: 0.222940 Oct 18 13:44:14.507415 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2261/4623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:14 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:15.537320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:15.539179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:15.555824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:15.558677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:15.559899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:15.561572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:15.563519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:15.568984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:15.728585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:15.733092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:15.739246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee258c94-1b71-4bda-af73-daedcd26b1dc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1275 microversion: 2.1 time: 0.207332 Oct 18 13:44:15.741091 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2262/4624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:15 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:15.758540 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a20b0f69-5cbb-4b87-9743-c8d18d06e9ad tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 2.095804 Oct 18 13:44:15.761824 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2363/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:13 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:16.765498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:16.767328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:16.776522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:16.777809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:16.778339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:16.779791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:16.780464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:16.781886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:16.789837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:16.790781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:16.808891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:16.819585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:16.819872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:16.820814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:16.821576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:16.822199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.061563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:17.071123 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51cf0646-80e8-4b3b-a1b8-cf4d0bd2cbc5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.311042 Oct 18 13:44:17.076613 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2263/4626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:16 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:17.831323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:17.845494 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b6f345a-6306-4475-809f-e8644eb0c49f tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 1.061692 Oct 18 13:44:17.846099 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2364/4627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:16 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:18.105968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:18.107176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:18.115443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.116206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.116859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.118079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.118711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.119451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.356540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:18.619246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "tag": "be135403-f542-4a7d-930a-0556150fed75"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:18.651452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.651452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.651452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.665178 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] Creating event network-changed:be135403-f542-4a7d-930a-0556150fed75 for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:18.672828 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c5267e53-62e7-43a4-b078-41f068019c9c req-13adbb23-8204-413f-b88b-213f51665c50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067868 Oct 18 13:44:18.675065 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2365/4628] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:18.788015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:18.798633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e69f9e4-ab36-49a6-acbb-ca68b5efe4c4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.701877 Oct 18 13:44:18.800551 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2264/4629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:18 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:18.867119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:18.872378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:18.873040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:18.879787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.880880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.881453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.882226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.882734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.883171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:19.826432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:19.827694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:19.828127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:19.830048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:19.841403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:19.842111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:19.844286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:19.845247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:19.847070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f2da901-1481-4a25-88fb-b59811311610 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.981670 Oct 18 13:44:19.847804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:19.848472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:19.854446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2366/4630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:18 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:20.088232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:20.376568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:20.389287 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fafd2acf-cfa8-447d-b9cf-abffb608fc36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.568881 Oct 18 13:44:20.390706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2265/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:19 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:20.754078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31dc009b-a8cf-4222-a045-c71b6bed556d", "tag": "670e5463-ec84-429e-be01-285018863cb9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:20.791848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:20.795181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:20.795730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:20.836895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] Creating event network-changed:670e5463-ec84-429e-be01-285018863cb9 for instance 31dc009b-a8cf-4222-a045-c71b6bed556d on n-h2-858383-13 Oct 18 13:44:20.853198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-111e7b4e-79ee-4165-9b75-482b77d18441 req-26c9ba50-9bed-4ddc-9b85-fda91362be74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102950 Oct 18 13:44:20.855167 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2367/4632] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:20.879730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:20.880529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:20.902149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:20.904593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:20.907168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:20.912172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:20.912807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:20.913362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:21.408722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:21.415467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:21.416521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:21.430270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ae4e9d71-197e-47aa-b0a9-70836b345e6e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.555020 Oct 18 13:44:21.434383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:21.434979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:21.435618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:21.437744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:21.437954 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2266/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:20 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:21.438630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:21.439351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.238569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:22.246964 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fa650be-2d55-415e-bc33-9d507b414e3d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.837586 Oct 18 13:44:22.255210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2368/4634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:21 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:22.459123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:22.459888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:22.472235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:22.472235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:22.472235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.473039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:22.475057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:22.476746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.841132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:22.855106 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da152d8b-8120-4ca6-8062-b502d445f39d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.405933 Oct 18 13:44:22.855701 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2267/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:22 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:22.928987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "tag": "3faa6c94-5c74-4c7c-8a6b-551e23b6f24c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:22.941441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:22.941934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:22.942436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.975180 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] Creating event network-changed:3faa6c94-5c74-4c7c-8a6b-551e23b6f24c for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:22.981239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9422e029-58ff-42f6-9d93-6ebd656e939e req-3e12e55b-4556-47a6-8054-7411e8328622 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062411 Oct 18 13:44:22.982449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2369/4636] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:23.279791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:23.279791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:23.294026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.296100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.296749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.298774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.299775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.301747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.758251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:23.778204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a9040b26-9fd1-4037-9c1f-c92d28beb2c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.505431 Oct 18 13:44:23.779643 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2268/4637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:23 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:23.882680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:23.883401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:23.901476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.902000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.908702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.908702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.908702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.908702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:24.809041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:24.810462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:24.823469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:24.823876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:24.824383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:24.825095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:24.825553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:24.825986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:25.051264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:25.060386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5593f1a8-ff47-4ad5-901b-007faed595a6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.256521 Oct 18 13:44:25.061286 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2269/4638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:24 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:25.097647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:25.108117 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d24c44c9-25a9-4354-8e2d-bcdb31408efe tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 1.231530 Oct 18 13:44:25.109704 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2370/4639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:23 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:26.089880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.091219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:26.109087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.111337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.112082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:26.113097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.113831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.115472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:26.124952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1de8601d-5b61-4900-ad3c-6e067b3ae143 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Calling method '.version_select at 0x7fb32be86940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.207650 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1de8601d-5b61-4900-ad3c-6e067b3ae143 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac/defaults" status: 200 len: 371 microversion: 2.1 time: 0.232610 Oct 18 13:44:26.208640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2270/4640] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:44:25 2022] GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac/defaults => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:26.220271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.221163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:26.227798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.228445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.229050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:26.229850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.230570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.231214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:26.601672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:26.621123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7168e8b2-aeca-43e4-a7c7-b7d4108c2669 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.531799 Oct 18 13:44:26.636979 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2371/4641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:26.645201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd00d375-af8b-4bb8-9f19-888b68b41661 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Calling method '.version_select at 0x7fb32bc0e310>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.793292 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd00d375-af8b-4bb8-9f19-888b68b41661 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac" status: 200 len: 371 microversion: 2.1 time: 0.159669 Oct 18 13:44:26.794343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2372/4642] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:26.857462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:26.860884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:26.868460 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a611b661-5d0a-4ae9-a95d-ad950053f22b tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.651921 Oct 18 13:44:26.869107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1194781215", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "24660c29-616d-4ccb-a7e6-8bfdc9520c42"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:26.884294 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2271/4643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:26.891535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e64c63e-c115-4da1-ba89-ac8ef8e59685 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Calling method '.version_select at 0x7fb3301da3a0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.966765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e64c63e-c115-4da1-ba89-ac8ef8e59685 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac/defaults" status: 200 len: 371 microversion: 2.1 time: 0.080489 Oct 18 13:44:26.967128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] validate_networks() for [('24660c29-616d-4ccb-a7e6-8bfdc9520c42', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:26.967956 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2272/4644] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac/defaults => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:26.989576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fac95961-bc1f-4704-8654-6f49bed7b72c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Calling method '.version_select at 0x7fb3304bdc10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:27.074935 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fac95961-bc1f-4704-8654-6f49bed7b72c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac" status: 200 len: 371 microversion: 2.1 time: 0.091765 Oct 18 13:44:27.076360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2273/4645] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:27.089922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1e2ce3a-3110-4f37-80bf-e7b86c41ace7 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Calling method '.version_select at 0x7fb32beb29d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:27.194972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1e2ce3a-3110-4f37-80bf-e7b86c41ace7 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac?user_id=13ec7fa980b34262948e752194ce1a85" status: 200 len: 371 microversion: 2.1 time: 0.110083 Oct 18 13:44:27.196834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2274/4646] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Oct 18 13:44:27 2022] GET /compute/v2.1/os-quota-sets/2fa90f115c8848e7a135083d5bd4acac?user_id=13ec7fa980b34262948e752194ce1a85 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:27.654096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:27.656148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:27.672166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:27.673122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:27.673941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:27.705394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:27.709150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:27.711799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.224325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:28.234755 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c429f091-875e-4a4b-8ef0-8da99425f38c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.589004 Oct 18 13:44:28.235337 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2275/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:27 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:28.248424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:28.249039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:28.264464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.265198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.266271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.269092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.269811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.273525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.378599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:28.379076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:28.379488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:28.380478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:28.381175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:28.395155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.401583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.402149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.402965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.403448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.403877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.456633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Getting quotas for project 51f272b5abc047c49f5eb0bed78f9ed2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:28.478469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Getting quotas for user fb29c723cbc249a781905fdbde1b3ad9 and project 51f272b5abc047c49f5eb0bed78f9ed2. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:28.508412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:28.511743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:28.748341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d54d7255-203b-4f64-9672-fab2dcd778aa tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952629 Oct 18 13:44:28.750997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2373/4648] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:44:28.766040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31dc009b-a8cf-4222-a045-c71b6bed556d", "name": "network-vif-plugged", "status": "completed", "tag": "670e5463-ec84-429e-be01-285018863cb9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:28.811939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.812652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.813243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.839137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] Creating event network-vif-plugged:670e5463-ec84-429e-be01-285018863cb9 for instance 31dc009b-a8cf-4222-a045-c71b6bed556d on n-h2-858383-13 Oct 18 13:44:28.852097 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d6f9c9d2-cfaf-4757-abca-6eec0562468a req-d6ba1ab9-f6f0-4aff-8af8-44e3d5e68497 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099785 Oct 18 13:44:28.853023 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2374/4649] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:28.870657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-241f797f-cfb2-4e68-a902-141b79c1421e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:28.871460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-241f797f-cfb2-4e68-a902-141b79c1421e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:29.024338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-241f797f-cfb2-4e68-a902-141b79c1421e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:29.038804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-241f797f-cfb2-4e68-a902-141b79c1421e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1225 microversion: 2.1 time: 0.181474 Oct 18 13:44:29.049796 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2375/4650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:28 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:29.259110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:29.260012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:29.263397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:29.278553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:29.279315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:29.279946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:29.280865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:29.281709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:29.282174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:29.314984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:29.333970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d6d9e71-6a27-4ce0-9605-95ea608c4a0d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 1.096878 Oct 18 13:44:29.337556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2276/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:28 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:29.664173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:29.683552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:29.692994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-957c4978-6035-4f2f-9b79-519d6b680db2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1317 microversion: 2.1 time: 0.433805 Oct 18 13:44:29.708457 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2376/4652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:29 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:30.076289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c255a71-1eb5-4a96-9960-1afda2a03e3a tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:30.077142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c255a71-1eb5-4a96-9960-1afda2a03e3a tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:30.244940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c255a71-1eb5-4a96-9960-1afda2a03e3a tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:30.256645 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c255a71-1eb5-4a96-9960-1afda2a03e3a tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1225 microversion: 2.1 time: 0.183934 Oct 18 13:44:30.261902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2277/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:30 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1225 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:30.366491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:30.367179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:30.382190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.389032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.391468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.393533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.394676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.398380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.722449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:30.727227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:30.759650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.761050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.761665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.762886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.763364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.763800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.832523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:30.847245 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f1bc605-4a8a-48e2-9030-7c8d00cfe55c tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.487640 Oct 18 13:44:30.853814 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2377/4654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:30 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:31.138281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:31.147588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5f5d5df2-45a8-41b5-9c8e-a4637fb21d31 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1506 microversion: 2.1 time: 0.430024 Oct 18 13:44:31.152091 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2278/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:30 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:31.183642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:31.184441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:31.213836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.213836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.217716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.218531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.219013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.219446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.286503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:31.287128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:31.289088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:31.302793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.309043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.309949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.310959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.311805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.314831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.529061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:31.539429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7257b179-f1cc-4448-a915-2acd04d168f9 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1221 microversion: 2.1 time: 0.256711 Oct 18 13:44:31.555751 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2279/4656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:31 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1221 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:31.859806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0543d0c-7a2f-47b1-a30e-69a14ff87f42 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 204 len: 0 microversion: 2.1 time: 0.678489 Oct 18 13:44:31.863270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2378/4657] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:31 2022] DELETE /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:44:31.886049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:31.888599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:31.894744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:31.894744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.918214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.918704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:32.234324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:32.256680 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f78bdaf-412e-4452-872d-eb27d5e67594 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1512 microversion: 2.1 time: 0.389124 Oct 18 13:44:32.265938 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2280/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:31 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:32.569630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:32.570300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:32.580238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:32.580967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:32.582773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:32.583857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:32.584333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:32.584776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:32.867458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:32.885376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d33f2a3-f6a0-4670-96bc-a6ef40c156f6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1285 microversion: 2.1 time: 0.321683 Oct 18 13:44:32.888291 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2281/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:32 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1285 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:33.140118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:33.165013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6f544d5-5e7c-4c86-9167-e4d61577c2e8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 1.281197 Oct 18 13:44:33.165945 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2379/4660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:31 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:33.289570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:33.290551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:33.314023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.316299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.317550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.318446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.319021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.319952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.917428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:33.918253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:33.929392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.933284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.933997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.934958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.935583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.937249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:34.278619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:34.291416 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe67985d-b618-4045-ba34-e38264647b94 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1283 microversion: 2.1 time: 0.378282 Oct 18 13:44:34.294682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2380/4661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:33 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1283 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:34.314386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:34.315608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:34.339677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:34.340487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:34.346622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:34.349333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:34.352336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:34.359485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:34.995123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:35.004907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0d14d23-7ce0-49ce-8bc6-aef8d06a742e tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.706490 Oct 18 13:44:35.005493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2381/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:34 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:35.030997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:35.061470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e52bb34-d09e-477c-a4ac-dd6399218e1f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 200 len: 1512 microversion: 2.1 time: 1.773399 Oct 18 13:44:35.086266 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2282/4663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:33 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 1512 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:35.321369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31dc009b-a8cf-4222-a045-c71b6bed556d", "name": "network-vif-deleted", "tag": "670e5463-ec84-429e-be01-285018863cb9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:35.338804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:35.339714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:35.341262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:35.372788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] Creating event network-vif-deleted:670e5463-ec84-429e-be01-285018863cb9 for instance 31dc009b-a8cf-4222-a045-c71b6bed556d on n-h2-858383-13 Oct 18 13:44:35.382766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c1b900d-63ad-47f3-95f2-35a95c256a5b tempest-ComputeTenantNetworksTest-1093000961 tempest-ComputeTenantNetworksTest-1093000961-project] Calling method '.version_select at 0x7fb32be86700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:35.400505 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cd6face5-d6db-4486-b961-e1b2ddadde13 req-5c43a082-1960-438a-8f80-6a825f0b3f6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378721 Oct 18 13:44:35.401134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2382/4664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:35.408288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:35.409132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:35.422859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:35.423705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:35.424324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:35.425311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:35.430987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:35.431960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:35.794217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:35.813349 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcf4cc0e-73cf-4fa8-8853-5c45af862fc1 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.410720 Oct 18 13:44:35.814654 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2383/4665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:35 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:35.946449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c1b900d-63ad-47f3-95f2-35a95c256a5b tempest-ComputeTenantNetworksTest-1093000961 tempest-ComputeTenantNetworksTest-1093000961-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.810520 Oct 18 13:44:35.947224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2283/4666] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:44:35 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:35.958758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ca3bb64-8ee1-4f9b-b382-65f9c3a05c83 tempest-ComputeTenantNetworksTest-1093000961 tempest-ComputeTenantNetworksTest-1093000961-project] Calling method '.version_select at 0x7fb32bc171f0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.030503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.031341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:36.046517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.047548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.050655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.052161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.053661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.054914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.188352 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ca3bb64-8ee1-4f9b-b382-65f9c3a05c83 tempest-ComputeTenantNetworksTest-1093000961 tempest-ComputeTenantNetworksTest-1093000961-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/475efd4a-277e-4da9-aaf5-603485b80275" status: 200 len: 139 microversion: 2.1 time: 0.233400 Oct 18 13:44:36.188947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2384/4667] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:44:35 2022] GET /compute/v2.1/os-tenant-networks/475efd4a-277e-4da9-aaf5-603485b80275 => generated 139 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:36.193936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.194805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:36.206012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.206012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.207089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.208899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.209591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.210312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.230742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d HTTP/1.1 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '31dc009b-a8cf-4222-a045-c71b6bed556d'} Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:36.234579 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:44:36.239916 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.241647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:36.243446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5292000a-5031-4bca-bc6c-d9ae8aed9146 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 404 len: 111 microversion: 2.1 time: 0.052966 Oct 18 13:44:36.244748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2385/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:36 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:36.266950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "name": "network-vif-plugged", "status": "completed", "tag": "3faa6c94-5c74-4c7c-8a6b-551e23b6f24c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:36.281137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.287631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.288806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.308723 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] Creating event network-vif-plugged:3faa6c94-5c74-4c7c-8a6b-551e23b6f24c for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:36.316354 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-12859419-6a1a-4a7c-a8e0-51cff6507802 req-b0f36aa8-3dec-4f5f-8fd2-11e6c0007654 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069415 Oct 18 13:44:36.318419 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2386/4669] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:36.327284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.329022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:36.338802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.339824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.340569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.341724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.342409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.343028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.464024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:36.476777 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bb83d84-c72e-4852-9615-0d365ca8b256 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.450024 Oct 18 13:44:36.477633 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2284/4670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:36 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:36.694354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:36.703170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a1e28ac-1f0f-45ec-8d86-986ec63755df tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.383090 Oct 18 13:44:36.703959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2387/4671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:36 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:36.839646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.843371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:36.863588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.864142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.870182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.870645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.871314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.873075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.885695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5988a8ca-c55f-452d-b447-f43ab8a435d8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5988a8ca-c55f-452d-b447-f43ab8a435d8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 163 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": 12345, "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 12345 Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:36.893276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:36.899382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5988a8ca-c55f-452d-b447-f43ab8a435d8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:36.901187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5988a8ca-c55f-452d-b447-f43ab8a435d8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014028 Oct 18 13:44:36.905210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2388/4672] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:36 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:36.928062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:36.934198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:36.954577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.955268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.956063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:36.957652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:36.959278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:36.960186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.195560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:37.205472 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9503e56e-adf8-4933-a666-e9ad832259ba tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.371615 Oct 18 13:44:37.237316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2285/4673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:36 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:37.388890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:37.425902 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f838d4b-84a3-4514-ba62-b6ebf6c63376 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.518191 Oct 18 13:44:37.428403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2389/4674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:36 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:37.459334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:37.460238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:37.469615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.478386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.479155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.480235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.480887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.481669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.501536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:37.505320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:37.514897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.515398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.515841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.516556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.517017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.517447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.931858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:37.946303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0fe0a55-b1c3-44b3-bde2-f6264227082e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.493762 Oct 18 13:44:37.947387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2286/4675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:37 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:38.172490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:38.185969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a460e309-d95a-434e-85c4-2d9fb66c561a tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.689405 Oct 18 13:44:38.186831 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2390/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:37 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:38.240688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:38.241306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:38.250338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:38.251029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:38.251890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.252734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:38.253481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:38.254114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.349124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "name": "network-vif-plugged", "status": "completed", "tag": "be135403-f542-4a7d-930a-0556150fed75"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:38.373697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:38.374452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:38.375979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.396152 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] Creating event network-vif-plugged:be135403-f542-4a7d-930a-0556150fed75 for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:38.402949 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4a9ed639-2e5a-44f2-b13b-98e6635f9a03 req-5be31d3f-e3a5-4b73-8147-85bc0615eae0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058221 Oct 18 13:44:38.409613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2391/4677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:38.486839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:38.516994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f856508-5e61-4e32-8499-c384fbc5de40", "tag": "9d480e0d-c5d6-4d6e-b9d0-d81713071b29"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:38.574548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:38.578357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:38.580870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.621025 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] Creating event network-changed:9d480e0d-c5d6-4d6e-b9d0-d81713071b29 for instance 4f856508-5e61-4e32-8499-c384fbc5de40 on n-h1-858383-13 Oct 18 13:44:38.637820 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-362cecfc-3065-4a4e-902f-ca002c25877d req-65c6b576-0f4a-4762-93ab-c2a4c3884207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156220 Oct 18 13:44:38.638906 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2392/4678] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:38.822575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:38.839250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e0101d7f-076f-469c-b7a0-c00566d6a811 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.602287 Oct 18 13:44:38.840024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2287/4679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:38 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:39.207498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:39.212866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:39.213580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:39.232307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.236308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.238656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:39.240413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.241678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.245962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:39.599538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:39.613363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88642d7f-7bba-4429-b82f-74d1c2ae2b75 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1334 microversion: 2.1 time: 0.407692 Oct 18 13:44:39.618042 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2393/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:39 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1334 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:39.876885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:39.885963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:39.941439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.942521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.942998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:39.947017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.948103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.948986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:40.233642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:40.248915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d147c6a3-ec7f-42e3-93f5-61745ff74da6 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.387186 Oct 18 13:44:40.252158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2288/4681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:39 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:40.646714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:40.647683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:40.677141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:40.699670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:40.699670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:40.699670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:40.700890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:40.707019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:40.708297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.214809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ea9f35a-ceb8-415e-9dfa-8544c0930a66 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Action: 'create', calling method: .version_select at 0x7fb32bcde310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-946263721", "metadata": {"Type": "work"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ea9f35a-ceb8-415e-9dfa-8544c0930a66 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 121 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-946263721", "metadata": {"Type": "work"}}} Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-946263721', 'metadata': {'Type': 'work'}}}} Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '#$%' Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:41.223226 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.228054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ea9f35a-ceb8-415e-9dfa-8544c0930a66 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:41.233696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ea9f35a-ceb8-415e-9dfa-8544c0930a66 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.758031 Oct 18 13:44:41.233696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2394/4682] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:44:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 764 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:41.248274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c8f167a-b1df-4b71-8e90-d474dd58233f tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Action: 'create', calling method: .version_select at 0x7fb32bc1ad30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1124521534", "metadata": {"Type": "work"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c8f167a-b1df-4b71-8e90-d474dd58233f tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 120 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1124521534", "metadata": {"Type": "work"}}} Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1124521534', 'metadata': {'Type': 'work'}}}} Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '0' Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:41.259876 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:44:41.264753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.267903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c8f167a-b1df-4b71-8e90-d474dd58233f tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:41.272459 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c8f167a-b1df-4b71-8e90-d474dd58233f tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033018 Oct 18 13:44:41.280575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2395/4683] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:44:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:41.290631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:41.295933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:41.311420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.312210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.312846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.326381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.327607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.330588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.509085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:41.517690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2cf46ce-4d0f-4db5-a3f7-92398259a4f8 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1669 microversion: 2.1 time: 0.877103 Oct 18 13:44:41.522860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2289/4684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:40 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1669 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:41.545086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-853ef9df-a509-4d7d-8b5a-402bea5df3dd tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Action: 'create', calling method: .version_select at 0x7fb33071c700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-324309326", "metadata": {"Type": "work"}}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-853ef9df-a509-4d7d-8b5a-402bea5df3dd tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 118 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-324309326", "metadata": {"Type": "work"}}} Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-324309326', 'metadata': {'Type': 'work'}}}} Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi '' Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:41.566512 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:44:41.570627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.572521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-853ef9df-a509-4d7d-8b5a-402bea5df3dd tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:41.573561 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-853ef9df-a509-4d7d-8b5a-402bea5df3dd tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.049355 Oct 18 13:44:41.574878 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2290/4685] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:44:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:41.580085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:41.580625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:41.589390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.590179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.590816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.591690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.592507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.593100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.622379 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c043d9e-4626-4ef1-a80b-e76532426823 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706/ips" status: 200 len: 179 microversion: 2.1 time: 0.045922 Oct 18 13:44:41.623811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2291/4686] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:44:41 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706/ips => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:41.629900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee5d3598-966c-4eda-ad25-172b41bd827a tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Calling method '.version_select at 0x7fb32beb55e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:41.685335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-ee5d3598-966c-4eda-ad25-172b41bd827a tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] HTTP exception thrown: Volume tempest-invalid-1787733078 could not be found. Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee5d3598-966c-4eda-ad25-172b41bd827a tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1787733078 HTTP/1.1 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: method: Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: exception: Volume tempest-invalid-1787733078 could not be found. Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'tempest-invalid-1787733078'} Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1787733078 could not be found. (HTTP 404) (Request-ID: req-18dfe40b-f1d0-4c93-a540-a71effab243c) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:44:41.688266 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1787733078 could not be found. Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1787733078 could not be found. Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1787733078 could not be found. Oct 18 13:44:41.692592 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.698327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee5d3598-966c-4eda-ad25-172b41bd827a tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 404 to user: Volume tempest-invalid-1787733078 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:41.699383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee5d3598-966c-4eda-ad25-172b41bd827a tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1787733078" status: 404 len: 99 microversion: 2.1 time: 0.074142 Oct 18 13:44:41.700118 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2292/4687] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:44:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1787733078 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:44:41.711278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:41.712843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:41.735582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.736116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.739814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.739814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.739814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.742751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.779708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:41.838310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:41.852899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78731a59-079d-4864-9af5-995ab7f94aae tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.568811 Oct 18 13:44:41.856427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2396/4688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:41 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:41.864342 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c848f6b-bfd0-499c-8ff1-ab09b4899c00 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008839 Oct 18 13:44:41.873048 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2397/4689] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 13:44:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:44:41.885972 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e5b0411-5b85-47e0-9c2c-6a20846fc9e0 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011551 Oct 18 13:44:41.888103 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2398/4690] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:44:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:44:41.900308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-752f596b-44c1-4873-b29a-e205cbd91084 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Calling method '.version_select at 0x7fb32bc1a8b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:41.945601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-752f596b-44c1-4873-b29a-e205cbd91084 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] HTTP exception thrown: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-752f596b-44c1-4873-b29a-e205cbd91084 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-volumes/abf1e0e9-4525-4298-ae89-c116e370e693 HTTP/1.1 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'abf1e0e9-4525-4298-ae89-c116e370e693'} Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. (HTTP 404) (Request-ID: req-e312d368-ae4d-4a62-9dc8-0fbfdacee914) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:44:41.948256 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-752f596b-44c1-4873-b29a-e205cbd91084 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 404 to user: Volume abf1e0e9-4525-4298-ae89-c116e370e693 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-752f596b-44c1-4873-b29a-e205cbd91084 tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/abf1e0e9-4525-4298-ae89-c116e370e693" status: 404 len: 109 microversion: 2.1 time: 0.055360 Oct 18 13:44:41.963770 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2399/4691] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:44:41 2022] DELETE /compute/v2.1/os-volumes/abf1e0e9-4525-4298-ae89-c116e370e693 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:41.973162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4659f61-884e-4ff9-a06c-f733610f406d tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Calling method '.version_select at 0x7fb32bbc15e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:42.006889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a4659f61-884e-4ff9-a06c-f733610f406d tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] HTTP exception thrown: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4659f61-884e-4ff9-a06c-f733610f406d tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Request method failure captured: Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/fbe8b638-469c-405f-b4f2-12f688d904cc HTTP/1.1 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3I-Ja8vqHcVF1Rpf7j6tXUt00Iz8Kb6xlaHXWp-aooyrtPvr-lfFinNJWecf7zo_bents77XI58Td-pbHZ6hMHsdhCDh2RaHLAViQskJ-Acz2Y_s71yUJpVb8I1q7bqAxy8qSpyd5TtiEoSuiEmMix1lT_61yhELuQKUfcMEOGzNo Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd68dfcc79d646e68a00aaad0cf71e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: fd68dfcc79d646e68a00aaad0cf71e6e Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-927331170 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 267d6820d336477bbb0626e473ac0327 Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-927331170-project Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: exception: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'fbe8b638-469c-405f-b4f2-12f688d904cc'} Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. (HTTP 404) (Request-ID: req-c51f6cc8-01cd-4cd7-b8c1-8d5ca9d624d1) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:44:42.010591 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4659f61-884e-4ff9-a06c-f733610f406d tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] Returning 404 to user: Volume fbe8b638-469c-405f-b4f2-12f688d904cc could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:42.018841 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4659f61-884e-4ff9-a06c-f733610f406d tempest-VolumesNegativeTest-927331170 tempest-VolumesNegativeTest-927331170-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fbe8b638-469c-405f-b4f2-12f688d904cc" status: 404 len: 109 microversion: 2.1 time: 0.051257 Oct 18 13:44:42.025704 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2400/4692] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:44:41 2022] GET /compute/v2.1/os-volumes/fbe8b638-469c-405f-b4f2-12f688d904cc => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:42.181400 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dbcc1f3c-6a99-4441-ab93-3cb3b3ef1844 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 204 len: 0 microversion: 2.1 time: 0.479360 Oct 18 13:44:42.182309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2293/4693] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:41 2022] DELETE /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:44:42.197434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:42.198929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:42.209975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.211483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.213391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.214591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.215598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.217903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.675003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:42.684137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4cceefcd-de84-4b9e-a5d3-675533ef1386 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1675 microversion: 2.1 time: 0.497662 Oct 18 13:44:42.695041 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2401/4694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:42 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1675 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:42.880479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:42.881198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:42.892869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.893385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.893838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.899277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.899277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.899277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.917162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:42.989046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfef0a29-9a8c-4f20-880c-b4e086599cfa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-879749973", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7b1942e3-1b42-40d4-9632-88246dc6c305", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:43.077323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-cfef0a29-9a8c-4f20-880c-b4e086599cfa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfef0a29-9a8c-4f20-880c-b4e086599cfa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 357 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-879749973", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7b1942e3-1b42-40d4-9632-88246dc6c305", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: exception: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-879749973', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7b1942e3-1b42-40d4-9632-88246dc6c305'}], 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:43.085276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. Oct 18 13:44:43.089030 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:43.092012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfef0a29-9a8c-4f20-880c-b4e086599cfa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Block Device 7b1942e3-1b42-40d4-9632-88246dc6c305 is not bootable. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:43.093331 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cfef0a29-9a8c-4f20-880c-b4e086599cfa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.108813 Oct 18 13:44:43.100642 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2402/4695] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:43.108783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:43.110998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:43.139727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.144604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.146235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.147149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.152782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.153853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.230341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:43.239979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22be0201-9501-4406-aaf3-31368cb02283 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.364175 Oct 18 13:44:43.255701 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2294/4696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:42 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:43.494244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:43.507795 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc121d58-6675-49fd-9bd4-80f6495e8855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.403768 Oct 18 13:44:43.509153 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2403/4697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:43.535844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:43.536728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:43.543867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.544378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.544852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.545761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.546414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.547011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.716731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:43.717756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:43.729742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.730422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.731174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.733468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.736233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.736233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.740330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:43.934162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:43.944568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ba51bf3-bae8-44c5-af61-e20a94ec288f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.412916 Oct 18 13:44:43.945610 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2295/4698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:44.266433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:44.267253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:44.274174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:44.274944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:44.275398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:44.276342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:44.277170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:44.277641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:44.470478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:44.480672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0347723c-2e89-4708-a297-df6630a11167 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1675 microversion: 2.1 time: 0.767900 Oct 18 13:44:44.484144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2404/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:43 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1675 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:44.552931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:44.565473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-068599e2-f5b5-4c00-b53d-e66955806145 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.304624 Oct 18 13:44:44.582190 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2296/4700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:44 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:45.137985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "name": "network-vif-deleted", "tag": "be135403-f542-4a7d-930a-0556150fed75"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:45.173310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.174516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.174960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.220382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] Creating event network-vif-deleted:be135403-f542-4a7d-930a-0556150fed75 for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:45.240953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f856508-5e61-4e32-8499-c384fbc5de40", "name": "network-vif-plugged", "status": "completed", "tag": "9d480e0d-c5d6-4d6e-b9d0-d81713071b29"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:45.250990 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cd70b321-7fbe-4e11-ab23-0cc13f26a046 req-65ac4186-5185-4abd-820b-7649aec62ed1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118040 Oct 18 13:44:45.253785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2405/4701] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:45.265974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.271391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.288928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.349799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] Creating event network-vif-plugged:9d480e0d-c5d6-4d6e-b9d0-d81713071b29 for instance 4f856508-5e61-4e32-8499-c384fbc5de40 on n-h1-858383-13 Oct 18 13:44:45.357999 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-cb8be13c-f568-4523-8b49-f8a831886f96 req-73486999-16aa-44b8-90bf-2e48c1bccf22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121502 Oct 18 13:44:45.380837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2297/4702] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:45.513313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:45.514073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:45.529629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.530156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.534523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.536112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.536750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.537517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.589726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:45.590693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:45.608086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.611287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.615490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.618320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:45.621402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:45.624556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.973413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:45.982662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c906ba5a-f113-4c9b-8316-2383bc6b62e5 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.397198 Oct 18 13:44:45.983696 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2298/4703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:45 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:46.042002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:46.052172 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f1a9c8d-d437-4eb2-ac17-a963fb58e481 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1495 microversion: 2.1 time: 0.543360 Oct 18 13:44:46.060047 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2406/4704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:45 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1495 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:47.014725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:47.015359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:47.041281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.042380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.043833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.045209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.046323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.047066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.078099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:47.079122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:47.096361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.097581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.099682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.100728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.101467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.102184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.172333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.173496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.174527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.176173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lazy-loading 'fault' on Instance uuid 603faf76-201e-4019-8dff-8521c8f57706 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:44:47.261008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725680d81f6f43679703425651a3e207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097aa0eadf644bcebb1726180c126259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:47.271756 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcb445aa-2209-4f63-a4e4-7dd829a19365 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 200 len: 1303 microversion: 2.1 time: 0.198904 Oct 18 13:44:47.273708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2407/4705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:47 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:47.297181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f9302f9-9349-4c0d-8d8b-f729fd097630 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-363224072", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "destination_type": "local"}, {"source_type": "volume", "uuid": "f4152b37-34af-4194-bef6-924525948b0b", "destination_type": "invalid"}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f9302f9-9349-4c0d-8d8b-f729fd097630 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 494 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-363224072", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "destination_type": "local"}, {"source_type": "volume", "uuid": "f4152b37-34af-4194-bef6-924525948b0b", "destination_type": "invalid"}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-363224072', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f4152b37-34af-4194-bef6-924525948b0b', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:47.321826 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f9302f9-9349-4c0d-8d8b-f729fd097630 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:47.326002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f9302f9-9349-4c0d-8d8b-f729fd097630 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.049649 Oct 18 13:44:47.328139 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2408/4706] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:47 2022] POST /compute/v2.1/servers => generated 155 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:47.333199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603faf76-201e-4019-8dff-8521c8f57706", "name": "network-vif-deleted", "tag": "3faa6c94-5c74-4c7c-8a6b-551e23b6f24c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:47.418495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:47.436866 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-60e99120-3ac5-41e9-854a-e86bf0eca965 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1325 microversion: 2.1 time: 0.431187 Oct 18 13:44:47.437810 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2299/4707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:47 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:47.445669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:47.445669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:47.457290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.458677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.463045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.464118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.465493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.468657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.626517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.627018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.627460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.641739 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] Creating event network-vif-deleted:3faa6c94-5c74-4c7c-8a6b-551e23b6f24c for instance 603faf76-201e-4019-8dff-8521c8f57706 on n-h2-858383-13 Oct 18 13:44:47.647224 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7ca52bf1-cad5-42fc-b2b0-74a6cd96af00 req-2c7a9b99-6116-4f66-a375-466442e8f16c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318465 Oct 18 13:44:47.649236 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2409/4708] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:47.758174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:47.772069 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf1e9c33-fced-4bd2-991f-4502644f1054 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.332957 Oct 18 13:44:47.773309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2300/4709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:47.803063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:47.803393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:47.821709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.822288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.822752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.823491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.834821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.835320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.168934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:48.191537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3db1098-0fca-43c0-a121-fc59f9a69043 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.391209 Oct 18 13:44:48.194379 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2410/4710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:48.300366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.302704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.311881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.312828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.313512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.314450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.316712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.317762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.335482 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 HTTP/1.1 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '603faf76-201e-4019-8dff-8521c8f57706'} Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:48.337145 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:48.341153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.342907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:48.343944 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-774956a3-f8f9-4774-b468-ff192abef093 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 404 len: 111 microversion: 2.1 time: 0.050281 Oct 18 13:44:48.348620 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2301/4711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:48.458621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7beaf0f0-48cd-42ac-ad6a-3e3baa106856 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1436018740", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:48.461327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.461945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7beaf0f0-48cd-42ac-ad6a-3e3baa106856 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 492 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1436018740", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1436018740', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.472095 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7beaf0f0-48cd-42ac-ad6a-3e3baa106856 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:48.476335 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7beaf0f0-48cd-42ac-ad6a-3e3baa106856 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.032567 Oct 18 13:44:48.482399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.482844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.483555 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2411/4712] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:48 2022] POST /compute/v2.1/servers => generated 624 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:48.483670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.484198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.484572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.485126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.505462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.509167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.531978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.532727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.533186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.537944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.538536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.540469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.791004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:48.791904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:48.817504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9e49435-643d-4621-9e58-740f848caf33 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.330447 Oct 18 13:44:48.819815 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2412/4713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:48.820666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d53ba76-89f8-44d0-97f9-17bff7fff9ef tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1522 microversion: 2.1 time: 0.362278 Oct 18 13:44:48.822551 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2302/4714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:48.864466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.865035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.872117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.878877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.879616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.882485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.886008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.886540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.890608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.892795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.917521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.919359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.922037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.923013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:48.927902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:48.928613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:48.936652 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] HTTP exception thrown: Action 999 not found Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Request method failure captured: Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40/os-instance-actions/999 HTTP/1.1 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq265M0x4EthUn4TEe21Epalflviu8q6xjr6dSItd7J_H9A1t2iAol_HHsqiz1QRnSJRQwt6fV5T9lpn-3XU4HrtBdXshHKGRB-H5hNd1WBzEVDZsfYca6QHFriCzEVDM6bfHnlG1ETY310aQQcgIBmhJwLaUXkREW9OkjJyuovuVOs Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fb29c723cbc249a781905fdbde1b3ad9 Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: exception: Action 999 not found Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '4f856508-5e61-4e32-8499-c384fbc5de40', 'id': '999'} Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 18 13:44:48.948151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:48.954189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Returning 404 to user: Action 999 not found {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:48.957363 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-690a8434-4ca2-4265-9242-0674d795a88f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.106030 Oct 18 13:44:48.958370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2413/4715] 10.222.0.27 () {58 vars in 1308 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40/os-instance-actions/999 => generated 66 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:44:48.970619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '.version_select at 0x7fb32bbc15e0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:48.973369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: efd56e18-ccc4-4579-b8a9-049e12802bb5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:48.982845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] HTTP exception thrown: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Request method failure captured: Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/efd56e18-ccc4-4579-b8a9-049e12802bb5/os-instance-actions HTTP/1.1 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq265M0x4EthUn4TEe21Epalflviu8q6xjr6dSItd7J_H9A1t2iAol_HHsqiz1QRnSJRQwt6fV5T9lpn-3XU4HrtBdXshHKGRB-H5hNd1WBzEVDZsfYca6QHFriCzEVDM6bfHnlG1ETY310aQQcgIBmhJwLaUXkREW9OkjJyuovuVOs Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fb29c723cbc249a781905fdbde1b3ad9 Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: method: Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': 'efd56e18-ccc4-4579-b8a9-049e12802bb5'} Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:49.006362 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Returning 404 to user: Instance efd56e18-ccc4-4579-b8a9-049e12802bb5 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98a3c09c-0066-419f-a812-31da65a963d8 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/efd56e18-ccc4-4579-b8a9-049e12802bb5/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043394 Oct 18 13:44:49.014993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2414/4716] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/efd56e18-ccc4-4579-b8a9-049e12802bb5/os-instance-actions => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:44:49.031468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:49.031468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:49.047413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.049213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.052063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.052959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.054898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.055554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.119311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:49.436069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:49.447827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb4c3f3b-863d-469b-ba9f-65f233bc6c19 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.585797 Oct 18 13:44:49.448439 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2303/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:48 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:49.544254 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c537ab25-5091-45a7-bda9-55f2df65ea0e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 204 len: 0 microversion: 2.1 time: 0.526959 Oct 18 13:44:49.545781 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2415/4718] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:49 2022] DELETE /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:44:49.567844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:49.576708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:49.599925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.600530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.605053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.605053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.605053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.605053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.755935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7fe3367-8046-428a-a894-c862eea1b3e7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7fe3367-8046-428a-a894-c862eea1b3e7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 416 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.765794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:44:49.769544 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:49.775472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7fe3367-8046-428a-a894-c862eea1b3e7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:49.778632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7fe3367-8046-428a-a894-c862eea1b3e7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.027782 Oct 18 13:44:49.779117 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2416/4719] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:49 2022] POST /compute/v2.1/servers => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:49.793314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:49.802135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:49.821232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.822551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.823228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.824309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.825034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.825789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:50.055174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:50.084262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47ab623d-b4dc-44ae-832e-60813945a815 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1528 microversion: 2.1 time: 0.509727 Oct 18 13:44:50.086279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2304/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:49 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:50.381141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:50.394317 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d974bfb7-3afb-4d62-8197-49ab54f3ddda tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.610435 Oct 18 13:44:50.398393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2417/4721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:49 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:50.425633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:50.428427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:50.440613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:50.443312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:50.445575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:50.447218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:50.448969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:50.450384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:50.759527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:50.768457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01fe60b0-6897-4ad1-b791-ad3c5627781d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.346791 Oct 18 13:44:50.772384 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2305/4722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:50 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:50.940537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b58bf8e1-5145-40bf-b2e4-1dc6c27d2290 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1121350106", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": -1, "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:50.960917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b58bf8e1-5145-40bf-b2e4-1dc6c27d2290 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Flavor -1 could not be found. Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b58bf8e1-5145-40bf-b2e4-1dc6c27d2290 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 206 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1121350106", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": -1, "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: exception: Flavor -1 could not be found. Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1121350106', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': -1, 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:50.971663 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b58bf8e1-5145-40bf-b2e4-1dc6c27d2290 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b58bf8e1-5145-40bf-b2e4-1dc6c27d2290 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040064 Oct 18 13:44:50.980244 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2418/4723] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:50 2022] POST /compute/v2.1/servers => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:50.987444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:50.989225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:50.996313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:50.997208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:50.997736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:50.998805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:50.999332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:50.999831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.120448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:51.121194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:51.150708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.151164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.151636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.152372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.163096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.163798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.809768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:51.824330 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8816ecd9-d0c1-4d20-a3f2-ef235f20e091 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.841310 Oct 18 13:44:51.826466 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2306/4724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:50 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:51.851761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:51.854495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:51.865901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.867672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.869788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.873485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.875052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.876700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.246120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:52.246120 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13245541-116f-4bf7-aa5c-2dd668e0a33d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.401773 Oct 18 13:44:52.258721 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2307/4725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:51 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:52.440248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c930348-70cf-4c60-b87b-43b8089cc45f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1186229034", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c930348-70cf-4c60-b87b-43b8089cc45f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 173 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1186229034", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1186229034', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi -1 Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:44:52.457006 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:44:52.474202 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:52.478814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c930348-70cf-4c60-b87b-43b8089cc45f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:52.479904 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c930348-70cf-4c60-b87b-43b8089cc45f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.045349 Oct 18 13:44:52.486824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:52.495804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2308/4726] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:52 2022] POST /compute/v2.1/servers => generated 145 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:44:52.500683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7ef7828-bd18-49f4-bfd3-be26f5a2929e tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1528 microversion: 2.1 time: 1.390818 Oct 18 13:44:52.503891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2419/4727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:51 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1528 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:52.510124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:52.510124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:52.520774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.522180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.522884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.524586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.525814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.526612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.872188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:52.889885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f1449db-a0fa-4891-adcd-888f54d24619 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.392572 Oct 18 13:44:52.890496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2309/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:52 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:52.915798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:52.916919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:52.923536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.927306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.927306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.927306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.927306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.927306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.026558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f856508-5e61-4e32-8499-c384fbc5de40", "name": "network-vif-deleted", "tag": "9d480e0d-c5d6-4d6e-b9d0-d81713071b29"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:53.041681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.047416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.047416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.056754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] Creating event network-vif-deleted:9d480e0d-c5d6-4d6e-b9d0-d81713071b29 for instance 4f856508-5e61-4e32-8499-c384fbc5de40 on n-h1-858383-13 Oct 18 13:44:53.062226 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-156a8cb6-8d83-4ef7-916d-3c858950d19b req-9b123406-fd97-4ee0-97a4-dbd7453f3946 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326373 Oct 18 13:44:53.063222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2420/4729] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:53.143458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:53.152766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a08372e7-a574-4d69-b58f-50adac00285a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.242267 Oct 18 13:44:53.153558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2310/4730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:52 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:53.323301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb982b05-c293-4cb2-b238-36068cd00b56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-667514709", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:53.341152 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-eb982b05-c293-4cb2-b238-36068cd00b56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb982b05-c293-4cb2-b238-36068cd00b56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 215 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-667514709", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-667514709', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.342898 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb982b05-c293-4cb2-b238-36068cd00b56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:53.347426 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb982b05-c293-4cb2-b238-36068cd00b56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.036229 Oct 18 13:44:53.353690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.355872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.374198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:53.377554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.380500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.380785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2421/4731] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:53 2022] POST /compute/v2.1/servers => generated 123 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:53.382354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.385412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.386236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.387881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.472915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.474822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.487214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.487824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.488250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.489193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.489661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.490219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.515881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 HTTP/1.1 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '603faf76-201e-4019-8dff-8521c8f57706'} Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:53.522276 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:53.526907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82766792-7350-44ba-8cef-45221501ec2d tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 404 len: 111 microversion: 2.1 time: 0.061536 Oct 18 13:44:53.528502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2422/4732] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:53 2022] DELETE /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:53.537059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.537687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: 603faf76-201e-4019-8dff-8521c8f57706] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.547255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.547752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.548199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.548905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.549365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.549874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.569803 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 HTTP/1.1 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '603faf76-201e-4019-8dff-8521c8f57706'} Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.571394 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance 603faf76-201e-4019-8dff-8521c8f57706 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac16c7d3-f2c1-4340-969c-d5c591ee5438 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706" status: 404 len: 111 microversion: 2.1 time: 0.043551 Oct 18 13:44:53.575690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2423/4733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/603faf76-201e-4019-8dff-8521c8f57706 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:53.582127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.584371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.591727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.591727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.592315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.593336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.593974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.594536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.637236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.637824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.638377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.638903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lazy-loading 'fault' on Instance uuid 4f856508-5e61-4e32-8499-c384fbc5de40 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:44:53.683989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:53.697996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8230d94-9e32-4b70-a162-a6be7c17c72d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.346418 Oct 18 13:44:53.698837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2311/4734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:53.718012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb29c723cbc249a781905fdbde1b3ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f272b5abc047c49f5eb0bed78f9ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:53.724638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.725208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.727841 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f04597da-a0c7-4adb-aa8c-a7aeb2adc958 tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 200 len: 1315 microversion: 2.1 time: 0.152076 Oct 18 13:44:53.728423 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2424/4735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:53.732000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.732710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.733411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.734522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.735391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.735979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.743043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.746823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.764013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.765605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.769231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.770819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 HTTP/1.1 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd90d5eeb-8691-4863-9f87-f69556c59807'} Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:53.775549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.779609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:53.780503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.780503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.780688 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4051a84a-9b3d-478e-b08f-075c59f2b5bd tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 404 len: 111 microversion: 2.1 time: 0.058720 Oct 18 13:44:53.786092 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2312/4736] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:53 2022] DELETE /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:53.786293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.788916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.793282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] [instance: d90d5eeb-8691-4863-9f87-f69556c59807] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.805721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.806543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.807354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.808247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.809123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.809716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.837274 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] HTTP exception thrown: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Request method failure captured: Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 HTTP/1.1 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq1RIb9T2nO10trcTufA75vNbsj5t9eWDgD0xj1yWdXomwB7Fy3sue1GR8Mq8O7_AVWhyHUp_6bTyjNIlpqmoI7GEWfUe_9UrcEK0iNrfOVr5RnK1lQRmtcBqx_y2al9dFOKSGVEyU4ED-SqyEeLXoJpVYkFQOI-T9Ny0uH4YW96nXQ Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/097aa0eadf644bcebb1726180c126259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/097aa0eadf644bcebb1726180c126259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_097aa0eadf644bcebb1726180c126259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 097aa0eadf644bcebb1726180c126259 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersTestMultiNic-504179570 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 725680d81f6f43679703425651a3e207 Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersTestMultiNic-504179570-project Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd90d5eeb-8691-4863-9f87-f69556c59807'} Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:53.840654 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] Returning 404 to user: Instance d90d5eeb-8691-4863-9f87-f69556c59807 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0aeddb8c-96b6-44c8-b6c7-cbd0d44a8e79 tempest-ServersTestMultiNic-504179570 tempest-ServersTestMultiNic-504179570-project] 10.222.0.27 "GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807" status: 404 len: 111 microversion: 2.1 time: 0.061664 Oct 18 13:44:53.854088 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2313/4737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/d90d5eeb-8691-4863-9f87-f69556c59807 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:54.197982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:54.214815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37a5e986-cf91-40ba-8470-6855c4b12392 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.477821 Oct 18 13:44:54.215397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2425/4738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:54.454426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-562804651", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-key-1389617725", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:54.594938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] validate_networks() for [('f427c4fd-906e-450c-aa93-bc4186f30328', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:54.754555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:54.755417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] [instance: 4f856508-5e61-4e32-8499-c384fbc5de40] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:54.777984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:54.779713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:54.780751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:54.781922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:54.784169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:54.786610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:54.814314 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] HTTP exception thrown: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Request method failure captured: Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 HTTP/1.1 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq265M0x4EthUn4TEe21Epalflviu8q6xjr6dSItd7J_H9A1t2iAol_HHsqiz1QRnSJRQwt6fV5T9lpn-3XU4HrtBdXshHKGRB-H5hNd1WBzEVDZsfYca6QHFriCzEVDM6bfHnlG1ETY310aQQcgIBmhJwLaUXkREW9OkjJyuovuVOs Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51f272b5abc047c49f5eb0bed78f9ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 51f272b5abc047c49f5eb0bed78f9ed2 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2116276945 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: fb29c723cbc249a781905fdbde1b3ad9 Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2116276945-project Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4f856508-5e61-4e32-8499-c384fbc5de40'} Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:54.819343 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. Oct 18 13:44:54.824517 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:54.826181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] Returning 404 to user: Instance 4f856508-5e61-4e32-8499-c384fbc5de40 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:54.829368 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4fb2d418-5819-47a6-a498-bce4451bdb2f tempest-InstanceActionsNegativeTestJSON-2116276945 tempest-InstanceActionsNegativeTestJSON-2116276945-project] 10.222.0.27 "GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40" status: 404 len: 111 microversion: 2.1 time: 0.076010 Oct 18 13:44:54.830566 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2426/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:54 2022] GET /compute/v2.1/servers/4f856508-5e61-4e32-8499-c384fbc5de40 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:44:55.404663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Invalid key_name provided. Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 246 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-562804651", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-key-1389617725", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid key_name provided. Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-562804651', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'key_name': 'tempest-key-1389617725', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1389617725 not found for user d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:55.410088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 18 13:44:55.413908 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:55.421738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid key_name provided. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:55.429824 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19eb53d6-df4c-4ee1-8130-99e74e59f5c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.974753 Oct 18 13:44:55.429824 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2314/4740] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:54 2022] POST /compute/v2.1/servers => generated 70 bytes in 979 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:55.438750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:55.439375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:55.462843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:55.463649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:55.464931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:55.466905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:55.475507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:55.475507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.281254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:56.290767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf1d25ae-fdc8-4765-b9a7-4fce5946b4c5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.856676 Oct 18 13:44:56.291635 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2427/4741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:55 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:56.316619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:56.318758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:56.329776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:56.330814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:56.331430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.333168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:56.333792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:56.334400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.362391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:56.775333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:56.793311 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d33fd2a-22e9-45ef-9e52-05717f706b80 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.480521 Oct 18 13:44:56.795767 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2315/4742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:56 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:56.953041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-752303806", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:57.301058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.security_group_api [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Neutron security group does_not_exist not found {{(pid=121010) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 18 13:44:57.301714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 257 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-752303806", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-752303806', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 18 13:44:57.321752 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:44:57.326344 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:57.333653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:57.333653 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-685e1f9d-be96-4632-8a94-93eea9d74419 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.382066 Oct 18 13:44:57.333653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2428/4743] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:56 2022] POST /compute/v2.1/servers => generated 106 bytes in 384 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:44:57.340874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:57.341980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:57.353994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.355218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.358913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:57.360994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.363079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.363831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:57.925113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:57.933859 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2dce6073-ce4a-4fd9-be99-789b3118d93f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.597570 Oct 18 13:44:57.934478 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2316/4744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:57 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:57.959475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:57.960692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:57.971002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.974718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.975495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:57.976381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.977264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.979690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.015719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:58.209135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:58.224477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24b1bb74-214d-4a99-82fb-5bd166f55ecc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.270104 Oct 18 13:44:58.234332 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2429/4745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:57 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:58.263617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:58.264144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 79ad4c19-d2d8-4158-94c9-6139bb7319e8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:58.292854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/79ad4c19-d2d8-4158-94c9-6139bb7319e8 HTTP/1.1 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '79ad4c19-d2d8-4158-94c9-6139bb7319e8'} Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:58.301237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:44:58.308600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 79ad4c19-d2d8-4158-94c9-6139bb7319e8 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:58.309494 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22e8de79-6071-49d2-92f9-23e2f0966864 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79ad4c19-d2d8-4158-94c9-6139bb7319e8" status: 404 len: 111 microversion: 2.1 time: 0.058693 Oct 18 13:44:58.318310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:58.318850 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2317/4746] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:58 2022] DELETE /compute/v2.1/servers/79ad4c19-d2d8-4158-94c9-6139bb7319e8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:44:58.318957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:58.322436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:58.338263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:58.339058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:58.339621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.340441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:58.344139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:58.344684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.649788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:58.668584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-452cba4b-ac48-476d-b732-bc522fdf6d70 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.354474 Oct 18 13:44:58.670044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2430/4747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:58 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:58.698344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:58.698922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:58.717316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:58.718237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:58.718861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.719799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:58.720634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:58.721525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.951739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:58.965475 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc06274f-fe16-47e5-bb08-043f96269707 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.270725 Oct 18 13:44:58.985124 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2318/4748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:58 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:58.996619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:58.997770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:44:58.998525 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 9223372036854775808 could not be found. Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '9223372036854775808'} Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:44:59.000218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b1873eb-f432-47c6-b583-499f4f7d5a7e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015023 Oct 18 13:44:59.009144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2431/4749] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 18 13:44:58 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:44:59.011861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:59.012505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:59.031410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.031960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.034383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:59.034383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.034383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.034383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:59.499757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:59.522366 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c3cc0d5e-f7a8-4b5a-a0c5-c3c7abbc3d79 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.512425 Oct 18 13:44:59.534084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2319/4750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:59 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:59.555730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:59.555730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:59.579976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.579976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.580411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:59.581130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.590751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.591253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:00.077230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:00.094171 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1a4afcc-b982-4af0-8bbe-13e8093f021f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.545998 Oct 18 13:45:00.094798 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2432/4751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:59 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:00.119486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:00.119982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Failed to fetch instance by id -1 {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:45:00.120472 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance -1 could not be found. Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance -1 could not be found. Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '-1'} Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:00.122255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:00.126282 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:00.126282 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:00.126282 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 18 13:45:00.126282 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:00.127209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:00.128157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3580216-f86b-4844-a44b-b59744690fef tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012540 Oct 18 13:45:00.132957 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2320/4752] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:45:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:45:00.141238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:00.142174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:00.151863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:00.689701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:00.707612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11ab0f26-6158-4f2c-bf9e-605ac9bbc013 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.570035 Oct 18 13:45:00.711334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2433/4753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:00 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:00.747567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:00.749003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:00.764058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:00.765998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:00.766748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:00.769491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:00.771278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:00.772574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:02.495018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:02.521875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af54ffdd-d9a9-4067-a995-5cdcef7a2a67 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 1.783352 Oct 18 13:45:02.524380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2321/4754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:00 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:45:02.547269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:02.549369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: ddb91841-9344-44a2-a2fe-57bc2c7f2d96] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:02.567359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/ddb91841-9344-44a2-a2fe-57bc2c7f2d96/action HTTP/1.1 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 19 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: {"forceDelete": {}} Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ddb91841-9344-44a2-a2fe-57bc2c7f2d96', 'body': {'forceDelete': {}}} Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:02.580270 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:02.586366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:02.586366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:02.586366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. Oct 18 13:45:02.586366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:02.592667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance ddb91841-9344-44a2-a2fe-57bc2c7f2d96 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:02.594019 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0e80948-4836-427b-b7bd-d9be41f5430f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/ddb91841-9344-44a2-a2fe-57bc2c7f2d96/action" status: 404 len: 111 microversion: 2.1 time: 0.052781 Oct 18 13:45:02.595560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2434/4755] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:02 2022] POST /compute/v2.1/servers/ddb91841-9344-44a2-a2fe-57bc2c7f2d96/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:02.603903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:02.604836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:02.622282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:02.632490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:02.634977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:02.636206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:02.637582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:02.640774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:03.111548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:03.127152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31b15a38-b5a3-4caa-8575-eaf6597a383f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.527303 Oct 18 13:45:03.127950 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2322/4756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:02 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:03.156484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:03.157275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:03.174641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.175143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.175614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:03.176363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.176826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.177313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:03.757511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:03.772383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-447f9f96-8588-4286-b794-cadcd14e9130 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.620304 Oct 18 13:45:03.773336 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2435/4757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:03 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:03.802149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:03.805007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 83bb2e51-8ebf-4132-819b-67452798d9f7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:03.823961 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/83bb2e51-8ebf-4132-819b-67452798d9f7/action HTTP/1.1 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 39 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: {"os-getConsoleOutput": {"length": 10}} Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '83bb2e51-8ebf-4132-819b-67452798d9f7', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:03.839376 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 83bb2e51-8ebf-4132-819b-67452798d9f7 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bc16afa-7ea5-4d02-ae75-d36fd7ab3050 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/83bb2e51-8ebf-4132-819b-67452798d9f7/action" status: 404 len: 111 microversion: 2.1 time: 0.045978 Oct 18 13:45:03.847027 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2323/4758] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:03 2022] POST /compute/v2.1/servers/83bb2e51-8ebf-4132-819b-67452798d9f7/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:03.868731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:03.869561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:03.880758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.882369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.883080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:03.884069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.884924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.885639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.094076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:04.103634 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8af6beb0-89a4-417c-9577-eb03f430675f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.249965 Oct 18 13:45:04.104467 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2436/4759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:03 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:04.131169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:04.137057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:04.140558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.141359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.142106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.143081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.143756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.144453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.416437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:04.430094 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f3fb8ed-43c1-478a-b9d2-f730db7df93c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.300950 Oct 18 13:45:04.442652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2324/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:04 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:04.453741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:04.454435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: c3e95cdf-083c-4df6-bbfe-1a83d2ffa615] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:04.472279 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 HTTP/1.1 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c3e95cdf-083c-4df6-bbfe-1a83d2ffa615'} Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:04.474505 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-320bef82-b557-4df9-a7da-1105eda01899 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/c3e95cdf-083c-4df6-bbfe-1a83d2ffa615" status: 404 len: 111 microversion: 2.1 time: 0.026565 Oct 18 13:45:04.478779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2437/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:04 2022] GET /compute/v2.1/servers/c3e95cdf-083c-4df6-bbfe-1a83d2ffa615 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:04.485841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:04.486689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:04.506088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.506627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.507082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.510216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.510709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.511155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.712538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:04.740338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82a1215a-9d18-490e-bf60-c01fd2568855 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.258915 Oct 18 13:45:04.742797 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2325/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:04 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:04.767443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:04.768065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:04.781972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.781972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.782782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.783870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:04.785477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:04.785924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.956362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:04.966164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dfa37f4-460c-49c6-b9ab-6ab56286d56f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.203357 Oct 18 13:45:04.967134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2438/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:04 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:05.609995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd87c133-9fa1-48e4-be5c-6e830f1deb6e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2107442203", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd87c133-9fa1-48e4-be5c-6e830f1deb6e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 238 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2107442203", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2107442203', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.631162 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd87c133-9fa1-48e4-be5c-6e830f1deb6e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd87c133-9fa1-48e4-be5c-6e830f1deb6e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026995 Oct 18 13:45:05.655060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2326/4764] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:05.664485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:05.665417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:05.673467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.673975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.674480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.675202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.675707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.676380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.847686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:05.857257 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e812d459-6de6-418d-b69e-b043065b5ef4 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.196343 Oct 18 13:45:05.870353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2439/4765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:05 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:05.885252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:05.885892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:05.896828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.897617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.898684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.903917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.903917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.903917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:06.072850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:06.082242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5c3f8b5-9b6e-4370-9299-183ee60622ee tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.200983 Oct 18 13:45:06.082943 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2327/4766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:05 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.087960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98b65298-8cc8-441c-a909-a72c4278dbf9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-381755716", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98b65298-8cc8-441c-a909-a72c4278dbf9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 234 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-381755716", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-381755716', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.093828 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:45:07.098637 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.100941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98b65298-8cc8-441c-a909-a72c4278dbf9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:07.101914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98b65298-8cc8-441c-a909-a72c4278dbf9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017804 Oct 18 13:45:07.103342 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2440/4767] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:07 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:07.111487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:07.114334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.119444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.119932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.120375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.121122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.121579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.122289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.273077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:07.281196 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3171f530-1f93-40dd-8429-5d4d1afcb080 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.173925 Oct 18 13:45:07.281765 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2328/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:07 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.306237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:07.312250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.317229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.317892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.318692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.319530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.320066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.320750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.481033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:07.492128 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e48b171-9b9d-4f9b-8eea-8f9e61419635 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.190887 Oct 18 13:45:07.494327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2441/4769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:07 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.515961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:07.516525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07ee3a22-b8b6-433f-a45e-e091486f9d17] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.522388 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/07ee3a22-b8b6-433f-a45e-e091486f9d17/action HTTP/1.1 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 13 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: {"pause": {}} Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '07ee3a22-b8b6-433f-a45e-e091486f9d17', 'body': {'pause': {}}} Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:07.524472 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 07ee3a22-b8b6-433f-a45e-e091486f9d17 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-407956ae-9659-4785-bed8-633e3b5ef65b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07ee3a22-b8b6-433f-a45e-e091486f9d17/action" status: 404 len: 111 microversion: 2.1 time: 0.013857 Oct 18 13:45:07.528562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2329/4770] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:07 2022] POST /compute/v2.1/servers/07ee3a22-b8b6-433f-a45e-e091486f9d17/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:07.549616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:07.555695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.563208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.566257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.566257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.566257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.566257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.566257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.709464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:07.717624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e19ec93-c9ab-4a5b-9785-32753c8e8f38 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.173271 Oct 18 13:45:07.721721 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2442/4771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:07 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.742099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:07.742722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.763550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.764056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.764514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.765206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.766434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.767635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.941705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:07.949613 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-352759f0-296e-42d0-b7bb-f951d7ae82d1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.211768 Oct 18 13:45:07.969388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2330/4772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:07 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.975535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:07.976082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.988373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:08.226603 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c8df557a-4a21-454a-aefd-a612bd2b2446 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.255248 Oct 18 13:45:08.228452 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2443/4773] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:07 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:45:08.237938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:08.238703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:08.245510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:08.246017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:08.246607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:08.247826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:08.248308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:08.248743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:08.442941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:08.451508 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80a420f0-f036-4b1c-9772-a4e56bcbffdb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1510 microversion: 2.1 time: 0.217721 Oct 18 13:45:08.465507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2331/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:08 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:09.476914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:09.477636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:09.483875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:09.484374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:09.484866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:09.485561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:09.486024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:09.486491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:09.625902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:09.634667 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d72951b-32df-42a1-a399-f01ac93a8ff0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1510 microversion: 2.1 time: 0.162872 Oct 18 13:45:09.635609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2444/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:09 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:10.662421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:10.662421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:10.671466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.671967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.673869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:10.674782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.676361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.676809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:10.891528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:10.900662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dcbcd6df-1be8-4c22-8435-9c541c80e931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1490 microversion: 2.1 time: 0.244540 Oct 18 13:45:10.901230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2332/4776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:10 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1490 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:10.926529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:10.927080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.957810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:11.006296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'pause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state paused Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 13 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: {"pause": {}} Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'pause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state paused Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'pause': {}}} Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state paused. Cannot pause while the instance is in this state. Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state paused Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:11.008575 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:11.013693 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:11.013693 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:11.013693 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:11.013693 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state paused Oct 18 13:45:11.013693 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:11.019869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'pause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state paused {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:11.021031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b935038-267e-4733-95ff-99c1dc87372d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 143 microversion: 2.1 time: 0.099813 Oct 18 13:45:11.021625 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2445/4777] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:10 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 143 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:45:11.030904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:11.031505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:11.039216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:11.039717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:11.040162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:11.041377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:11.041945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:11.042441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:11.282207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64e46d0f-d27d-48cd-8198-439bce34ef90 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.255114 Oct 18 13:45:11.287080 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2333/4778] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:11 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:45:11.296122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:11.299941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:11.312044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:11.312671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:11.313712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:11.314708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:11.315960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:11.317033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:11.497694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:11.507556 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f6ce7f2-93e4-4a7d-b75d-bb2fc256d552 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1497 microversion: 2.1 time: 0.217984 Oct 18 13:45:11.512651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2446/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:11 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:12.539686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:12.539686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:12.560286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.565907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.568724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.572212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.575364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.575849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.933366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:12.949500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee6ceb56-6cf8-4efb-a9ba-301cfe842172 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.418684 Oct 18 13:45:12.966678 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2334/4780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:12 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:12.982896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:12.984853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:12.996182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.997502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.999734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.000930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.001945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.002684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.376202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-09d1065d-645d-4ce1-ad8b-746f367a5180 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1036345953", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:13.381422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-09d1065d-645d-4ce1-ad8b-746f367a5180 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] HTTP exception thrown: min_count must be <= max_count Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-09d1065d-645d-4ce1-ad8b-746f367a5180 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Request method failure captured: Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 184 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3ovTH1ZRQU3C9WOpYYsZr8J4CuvQJ5HqHJibkK3o_2gKwNfu3M5rskzwOnISn5Di9thE6kUQfpKsNum8Z6Bofpko9kagW38OdynyjocHlhimnWejv5COPMtw8WNguGB4PFd9dJ9fjYf_TL0BgzshLasqSNFnk07Ts49tHUVbQRv60 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c6645faffbfd4c489cd4bbd7fc49a3ac Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1036345953", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: exception: min_count must be <= max_count Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1036345953', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 18 13:45:13.384909 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.392639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-09d1065d-645d-4ce1-ad8b-746f367a5180 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Returning 400 to user: min_count must be <= max_count {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:13.393750 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-09d1065d-645d-4ce1-ad8b-746f367a5180 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.278651 Oct 18 13:45:13.407097 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2335/4781] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:13 2022] POST /compute/v2.1/servers => generated 74 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:13.533961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:13.543544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcc0e49a-a640-448d-b528-4c0e6e75b94f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.568047 Oct 18 13:45:13.547311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2447/4782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:12 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:13.576052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:13.585403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:13.600636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.603688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.605141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.606778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.608340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.609669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.645605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action HTTP/1.1 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 28 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: {"reboot": {"type": "SOFT"}} Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '31dc009b-a8cf-4222-a045-c71b6bed556d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:13.648093 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bac40b17-e5be-48e0-b1ce-8d5f2ccc5b9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action" status: 404 len: 111 microversion: 2.1 time: 0.079881 Oct 18 13:45:13.652207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2336/4783] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:13 2022] POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:13.658576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:13.665642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:13.666684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.667529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.668212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.669126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.669749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.670403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.673970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab5e77b4-01ab-403c-b0bd-e628b3f90891 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481200625", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "max_count": 0}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab5e77b4-01ab-403c-b0bd-e628b3f90891 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Request method failure captured: Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 167 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3ovTH1ZRQU3C9WOpYYsZr8J4CuvQJ5HqHJibkK3o_2gKwNfu3M5rskzwOnISn5Di9thE6kUQfpKsNum8Z6Bofpko9kagW38OdynyjocHlhimnWejv5COPMtw8WNguGB4PFd9dJ9fjYf_TL0BgzshLasqSNFnk07Ts49tHUVbQRv60 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c6645faffbfd4c489cd4bbd7fc49a3ac Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481200625", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "max_count": 0}} Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-481200625', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'max_count': 0}}} Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 0 Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:13.678432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:13.684237 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.685347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab5e77b4-01ab-403c-b0bd-e628b3f90891 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:13.686413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ab5e77b4-01ab-403c-b0bd-e628b3f90891 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016376 Oct 18 13:45:13.697495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2337/4784] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:13.911626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c08998f4-5cc1-499e-8fba-6929a0d33d12 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-775774678", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "max_count": 2.5}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c08998f4-5cc1-499e-8fba-6929a0d33d12 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Request method failure captured: Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 169 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3ovTH1ZRQU3C9WOpYYsZr8J4CuvQJ5HqHJibkK3o_2gKwNfu3M5rskzwOnISn5Di9thE6kUQfpKsNum8Z6Bofpko9kagW38OdynyjocHlhimnWejv5COPMtw8WNguGB4PFd9dJ9fjYf_TL0BgzshLasqSNFnk07Ts49tHUVbQRv60 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c6645faffbfd4c489cd4bbd7fc49a3ac Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-775774678", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "max_count": 2.5}} Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-775774678', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'max_count': 2.5}}} Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:13.934292 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:13.938708 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:13.943186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c08998f4-5cc1-499e-8fba-6929a0d33d12 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:13.946083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c08998f4-5cc1-499e-8fba-6929a0d33d12 tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038118 Oct 18 13:45:13.957763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:13.957947 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2338/4785] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:13.968033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dc1f630-0830-498e-96e7-1db32fff2307 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.312433 Oct 18 13:45:13.970623 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2448/4786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:13 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:13.995309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:13.996154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:14.006854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.007563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.008188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.008900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.009363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.009796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.236613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:14.242505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:14.250708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f773c215-d276-4d84-867f-77723d41a21a tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115515909", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 0}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f773c215-d276-4d84-867f-77723d41a21a tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Request method failure captured: Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 168 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3ovTH1ZRQU3C9WOpYYsZr8J4CuvQJ5HqHJibkK3o_2gKwNfu3M5rskzwOnISn5Di9thE6kUQfpKsNum8Z6Bofpko9kagW38OdynyjocHlhimnWejv5COPMtw8WNguGB4PFd9dJ9fjYf_TL0BgzshLasqSNFnk07Ts49tHUVbQRv60 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c6645faffbfd4c489cd4bbd7fc49a3ac Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115515909", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 0}} Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2115515909', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'min_count': 0}}} Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 0 Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:14.255955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:45:14.260840 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.272130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f773c215-d276-4d84-867f-77723d41a21a tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:14.274215 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f773c215-d276-4d84-867f-77723d41a21a tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028306 Oct 18 13:45:14.278945 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2449/4787] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:14.279079 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a18873d-23c9-4882-b061-5bf801c91800 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.284430 Oct 18 13:45:14.279079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2339/4788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:13 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:14.303504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:14.308691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:14.315139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/3010c271-1bbf-4b4d-9e02-8e00dbcb1a32/action HTTP/1.1 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 28 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: {"reboot": {"type": "SOFT"}} Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3010c271-1bbf-4b4d-9e02-8e00dbcb1a32', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. Oct 18 13:45:14.318138 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. Oct 18 13:45:14.323019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.324376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 3010c271-1bbf-4b4d-9e02-8e00dbcb1a32 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:14.325411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f275927-2a90-48d2-9c11-4792b5ea2653 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/3010c271-1bbf-4b4d-9e02-8e00dbcb1a32/action" status: 404 len: 111 microversion: 2.1 time: 0.028154 Oct 18 13:45:14.346620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:14.350356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:14.355327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2450/4789] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:14 2022] POST /compute/v2.1/servers/3010c271-1bbf-4b4d-9e02-8e00dbcb1a32/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:14.365497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.367239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.368239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.370860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.372986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.373649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.674283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:14.685495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4d7fbd8-e35b-432c-8bde-a6c25d593397 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.354837 Oct 18 13:45:14.686096 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2340/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:14 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:14.711339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:14.712035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:14.722633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.723145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.723678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.724298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:14.724766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:14.725203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.761942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:14.868090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ec8c15-3217-41df-8b87-b0f776c3115b tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1443250632", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 2.5}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ec8c15-3217-41df-8b87-b0f776c3115b tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Request method failure captured: Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 170 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3ovTH1ZRQU3C9WOpYYsZr8J4CuvQJ5HqHJibkK3o_2gKwNfu3M5rskzwOnISn5Di9thE6kUQfpKsNum8Z6Bofpko9kagW38OdynyjocHlhimnWejv5COPMtw8WNguGB4PFd9dJ9fjYf_TL0BgzshLasqSNFnk07Ts49tHUVbQRv60 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f5ed305028c40ada3e3aaee0be3d381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4f5ed305028c40ada3e3aaee0be3d381 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-881704395 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c6645faffbfd4c489cd4bbd7fc49a3ac Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-881704395-project Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1443250632", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 2.5}} Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1443250632', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'min_count': 2.5}}} Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:14.877373 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:45:14.883627 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:14.890956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ec8c15-3217-41df-8b87-b0f776c3115b tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:14.891839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46ec8c15-3217-41df-8b87-b0f776c3115b tempest-MultipleCreateNegativeTestJSON-881704395 tempest-MultipleCreateNegativeTestJSON-881704395-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028792 Oct 18 13:45:14.892585 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2341/4791] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:15.165840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:15.176904 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0bd60bea-f408-4cfb-b5ed-50f9c0af532c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.470237 Oct 18 13:45:15.178206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2451/4792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:14 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:15.200509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:15.203370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:15.211680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.212438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.213056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.213963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.214707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.215311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.241694 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action HTTP/1.1 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 65 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '31dc009b-a8cf-4222-a045-c71b6bed556d', 'body': {'rebuild': {'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6'}}} Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:45:15.243810 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:15.248186 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a128375-d376-4902-8989-4c727cecc378 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action" status: 404 len: 111 microversion: 2.1 time: 0.049076 Oct 18 13:45:15.258264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:15.258947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:15.261744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2342/4793] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:15 2022] POST /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:15.265183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.266163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.266876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.267908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.268381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.268823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.591521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:15.613865 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29bf6c77-188c-4afd-ac83-f14c76210ee7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.359575 Oct 18 13:45:15.614984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2452/4794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:15 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:15.640262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:15.641201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:15.667804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.669215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.669892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.671211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.671915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.672787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.941878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:15.949807 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c7ad2f6b-3c91-4180-be94-ab80394f2d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.314158 Oct 18 13:45:15.950407 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2343/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:15 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:15.976228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:15.981506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 23c93433-5feb-4a0b-98f7-c9c7c1e55baa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:15.987510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/23c93433-5feb-4a0b-98f7-c9c7c1e55baa/action HTTP/1.1 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 65 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '23c93433-5feb-4a0b-98f7-c9c7c1e55baa', 'body': {'rebuild': {'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6'}}} Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:45:15.989232 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 23c93433-5feb-4a0b-98f7-c9c7c1e55baa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7eb1793-da11-4dfe-84a1-152fe1b241ea tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/23c93433-5feb-4a0b-98f7-c9c7c1e55baa/action" status: 404 len: 111 microversion: 2.1 time: 0.018749 Oct 18 13:45:15.999723 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2453/4796] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:15 2022] POST /compute/v2.1/servers/23c93433-5feb-4a0b-98f7-c9c7c1e55baa/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:16.002457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:16.002457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:16.008781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:16.009283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:16.009924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:16.010828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:16.011450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:16.012044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:16.654111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:16.672514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5134e126-bcc6-4fcb-b5f0-d0d0778fb33c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.676404 Oct 18 13:45:16.674424 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2344/4797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:15 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:16.708633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:16.708633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:16.734986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:16.735503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:16.735970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:16.736700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:16.737173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:16.737614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:17.080566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:17.095596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72e9f533-73a3-4981-92fe-048f2733d483 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.401274 Oct 18 13:45:17.108377 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2454/4798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:16 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:17.130204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:17.131146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 804740cf-99bb-4025-b62f-8bafbe1d8fbf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:17.140551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/804740cf-99bb-4025-b62f-8bafbe1d8fbf/action HTTP/1.1 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 15 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: {"restore": {}} Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '804740cf-99bb-4025-b62f-8bafbe1d8fbf', 'body': {'restore': {}}} Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:17.143208 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:17.150364 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:17.150364 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:17.150364 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. Oct 18 13:45:17.150364 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.152672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 804740cf-99bb-4025-b62f-8bafbe1d8fbf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:17.154607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f03fa322-c67f-42ba-929b-24b13f19af2c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/804740cf-99bb-4025-b62f-8bafbe1d8fbf/action" status: 404 len: 111 microversion: 2.1 time: 0.035650 Oct 18 13:45:17.162760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2345/4799] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:17 2022] POST /compute/v2.1/servers/804740cf-99bb-4025-b62f-8bafbe1d8fbf/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:17.168935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:17.169678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:17.182907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.183432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.183892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:17.184617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.185274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.185872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.258479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:18.290917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19c177d3-f3ca-47de-bde4-f1964bb708cc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 1.125014 Oct 18 13:45:18.292520 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2455/4800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:17 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:18.335234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:18.338329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:18.357502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.359092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.359732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.363487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.364142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.364797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.813383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:18.825868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ef840e5-17a3-4425-9827-522749f5fec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.503865 Oct 18 13:45:18.830149 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2346/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:18 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:18.851771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:18.852384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:18.862195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.869181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.870190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.873283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.876325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.878231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.922622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'restore' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: {"restore": {}} Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'restore' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'restore': {}}} Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state active. Cannot restore while the instance is in this state. Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:18.924329 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:18.929794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'restore' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:18.930932 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43d886a3-fc01-4ab2-93ab-1901b17d38ad tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 145 microversion: 2.1 time: 0.083377 Oct 18 13:45:18.942252 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2456/4802] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:18 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 145 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:45:18.949904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:18.950717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:18.961825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.962445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.962964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.965649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.967119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.967743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:19.279783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:19.293042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1babfee7-8c49-41a8-aafc-98284c9d38c3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.346600 Oct 18 13:45:19.311981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2347/4803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:18 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:19.325330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:19.325964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:19.359833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:20.039034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:20.054932 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e1d944b-0cec-4615-bc69-999f086cfafa tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.727662 Oct 18 13:45:20.055932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2457/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:19 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:20.079273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:20.079832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: c447edd0-0676-491c-b2ca-4b201f4f0b3b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:20.088683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/c447edd0-0676-491c-b2ca-4b201f4f0b3b/action HTTP/1.1 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 14 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: {"resume": {}} Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c447edd0-0676-491c-b2ca-4b201f4f0b3b', 'body': {'resume': {}}} Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:20.105493 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:20.110799 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:20.110799 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:20.110799 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. Oct 18 13:45:20.110799 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:20.112032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance c447edd0-0676-491c-b2ca-4b201f4f0b3b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:20.114008 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30ebe33e-70c3-4bba-86f0-808e601d9b22 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/c447edd0-0676-491c-b2ca-4b201f4f0b3b/action" status: 404 len: 111 microversion: 2.1 time: 0.038823 Oct 18 13:45:20.115022 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2348/4805] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:20 2022] POST /compute/v2.1/servers/c447edd0-0676-491c-b2ca-4b201f4f0b3b/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:20.125189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:20.126191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:20.142088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:20.143683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:20.149403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:20.149403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:20.149403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:20.149403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:20.632429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:20.647517 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b90fe116-1247-4eac-a27c-0ee6f13bb787 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.526269 Oct 18 13:45:20.649255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2458/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:20 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:20.671412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:20.672047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:20.679457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:20.679967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:20.680419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:20.681122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:20.681757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:20.682397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.121209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:21.132491 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d497fd6-a7a3-4a09-bb5f-3e73642f0c82 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.464269 Oct 18 13:45:21.134104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2349/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:20 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:45:21.165515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:21.166411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:21.178269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.185359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.185359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.185359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.185359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.185359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.231612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'resume' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 14 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: {"resume": {}} Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'resume' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'resume': {}}} Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state active. Cannot resume while the instance is in this state. Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:21.238452 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:45:21.244432 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:21.246308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'resume' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:21.252157 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-baf174c4-bfdc-473f-a091-01651441e1a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 144 microversion: 2.1 time: 0.091110 Oct 18 13:45:21.254789 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2459/4808] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:21 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 144 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:45:21.264160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:21.264886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:21.274562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.279257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.280006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.280888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.281516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.283217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.863235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:21.877965 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8172d3f9-1539-4e6e-804e-1207e3e12a36 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.615817 Oct 18 13:45:21.879193 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2350/4809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:21 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:21.915112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:21.918646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:21.929321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.934093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.935993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:21.943857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:21.943857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:21.943857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:22.734725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:22.752841 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d6f388f-725a-4323-8663-bf45b6efdd01 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.843215 Oct 18 13:45:22.755117 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2460/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:21 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:22.982108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcb6c9fb-8291-4638-b357-92fbf27a3602 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcb6c9fb-8291-4638-b357-92fbf27a3602 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 160 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f427c4fd-906e-450c-aa93-bc4186f30328"}]}} Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': '', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'networks': [{'uuid': 'f427c4fd-906e-450c-aa93-bc4186f30328'}]}}} Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi '' Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:45:22.985736 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:45:22.989963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcb6c9fb-8291-4638-b357-92fbf27a3602 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:22.992482 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dcb6c9fb-8291-4638-b357-92fbf27a3602 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.013193 Oct 18 13:45:23.001145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:23.001939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:23.007040 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2351/4811] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:22 2022] POST /compute/v2.1/servers => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:23.008738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:23.011471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:23.011471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:23.011471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:23.011471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:23.011897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:23.959125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:23.967898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a236b3b8-6de6-4663-b2db-eeea7917576a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.971281 Oct 18 13:45:23.968723 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2461/4812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:22 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:23.994536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:23.995217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:24.005407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.006321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.006960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:24.007967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.008569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.009207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:24.227191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:24.239419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-40478eed-a4bd-4a21-a2ea-d87040428f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.246857 Oct 18 13:45:24.240171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2352/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:23 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:24.263176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:24.264329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 27544d19-7d51-44ac-a8d0-20e7ab1ed662] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:24.294783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/27544d19-7d51-44ac-a8d0-20e7ab1ed662/action HTTP/1.1 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 14 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: {"shelve": {}} Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '27544d19-7d51-44ac-a8d0-20e7ab1ed662', 'body': {'shelve': {}}} Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:24.305896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:24.310795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:24.310795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:24.310795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. Oct 18 13:45:24.310795 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:24.311922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 27544d19-7d51-44ac-a8d0-20e7ab1ed662 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:24.312974 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0fbc3b7-e56d-49c3-9224-8da0273bcd00 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/27544d19-7d51-44ac-a8d0-20e7ab1ed662/action" status: 404 len: 111 microversion: 2.1 time: 0.053830 Oct 18 13:45:24.315263 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2462/4814] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:24 2022] POST /compute/v2.1/servers/27544d19-7d51-44ac-a8d0-20e7ab1ed662/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:24.324809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:24.325487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:24.343072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.343684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.345214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:24.345973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.346538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.347434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:24.682111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:24.710827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a401b555-f5c5-4840-9f49-391e4566f196 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.370814 Oct 18 13:45:24.710827 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2353/4815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:24 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:24.736161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:24.737795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:24.745906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.746524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.746982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:24.748241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:24.748719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:24.749168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:25.016859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:25.031701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7eb448d1-ff5f-4701-8e24-29a5b36cbd50 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.299959 Oct 18 13:45:25.035454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2463/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:24 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:25.058359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:25.058887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:25.073570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=74 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:25.079900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:25.079900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:25.079900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:25.079900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:25.079900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:25.080625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:25.115791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lazy-loading 'flavor' on Instance uuid 07c26fbf-017d-4ad0-9aed-9fea80c44317 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:45:25.895870 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86abf73a-fd7c-40f2-94ee-8cf258599fbb tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.843191 Oct 18 13:45:25.897237 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2354/4817] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:45:25 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:45:25.916780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:25.917422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:25.962692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:25.962692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:25.962692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:25.966167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:25.966781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:25.967242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:26.877190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:26.887704 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6cd44da-22ff-42e5-8e45-5825e7b6a615 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.985604 Oct 18 13:45:26.891281 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2464/4818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:25 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:27.918451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:27.919816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:27.935498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:27.937183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:27.938027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:27.943171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:27.943817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:27.944378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:28.448111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:28.472059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f49c2ef2-1ccb-4aaa-bc55-ddaf006aac23 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.558974 Oct 18 13:45:28.491303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2355/4819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:27 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:29.496174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:29.496801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:29.505339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:29.506125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:29.506740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:29.511121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:29.511839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:29.512468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:29.984594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:29.996954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3314e2cd-b6ad-4a09-a551-931f9a2f538f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.504750 Oct 18 13:45:30.016370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2465/4820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:29 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:31.030753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:31.032049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:31.044940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:31.049351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:31.049351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:31.049351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:31.049351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:31.049351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:31.700450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:31.708723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a05ff10-ede3-47c4-beab-5e93806b5684 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.681903 Oct 18 13:45:31.712820 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2356/4821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:31 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:32.744317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:32.744948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:32.755640 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:45:32.755822 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 13:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 (ip 10.222.0.27) !!! Oct 18 13:45:32.757651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=66 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:32.767931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:32.768433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:32.769092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:32.770001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:32.770648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:32.771269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:33.245434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:33.258255 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29cf875e-8d43-47c1-a476-41dc6c55282c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.517761 Oct 18 13:45:33.260230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2466/4822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:32 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:34.291645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:34.293492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:34.302531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:34.303324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:34.303924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:34.304840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:34.305738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:34.306383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:34.617402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:34.659035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a90827d2-43f1-4b2e-a5e4-df35c6e9f412 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.374270 Oct 18 13:45:34.666908 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2357/4823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:34 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:35.698709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:35.699423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:35.721215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:35.726875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:35.734392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:35.734392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:35.735363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:35.735594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:37.632172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:37.648193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b77eb9ff-9ed7-49fd-ada7-3163406ab1b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 1.954440 Oct 18 13:45:37.650426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2467/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:35 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:38.678033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:38.679214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:38.694034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:38.705709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:38.707106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:38.708068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:38.708746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:38.709379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:39.325978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:39.334089 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aafb6be1-60ab-42b4-9b50-65644a2ef117 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.660440 Oct 18 13:45:39.347667 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2358/4825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:38 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:40.386578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:40.388042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:40.401789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:40.406947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:40.406947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:40.406947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:40.414980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:40.416426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:41.181993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:41.192610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bdae8b3f-3da5-4c9f-8c01-1028e843f6e0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.810568 Oct 18 13:45:41.195258 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2468/4826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:40 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:42.223765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:42.225055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:42.232927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:42.233430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:42.234036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:42.234785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:42.235274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:42.235694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:42.256477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:42.841617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:42.857099 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2fd854c-0ff7-486a-8f55-2a31ad1ad66c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.637321 Oct 18 13:45:42.872787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2359/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:42 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:43.890670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:43.892023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:43.903453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:43.909819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:43.912419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:43.914140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:43.914865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:43.916624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:43.958519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Action: 'create', calling method: .version_select at 0x7fb33538fc10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:44.044335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Getting quotas for project b2b1fda987b644a9a17f18abab81eac8. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:44.051497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Getting quotas for user 1403c0b2a05241aaa2eb56c217e00eaa and project b2b1fda987b644a9a17f18abab81eac8. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:44.267851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Getting quotas for project b2b1fda987b644a9a17f18abab81eac8. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:44.294464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Getting quotas for user 1403c0b2a05241aaa2eb56c217e00eaa and project b2b1fda987b644a9a17f18abab81eac8. Resources: {'server_groups'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:44.339414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b393d8b6-7785-4cb3-80eb-e3142262d253 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.674125 Oct 18 13:45:44.347571 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2469/4828] 10.222.0.27 () {62 vars in 1214 bytes} [Tue Oct 18 13:45:43 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:45:44.374240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cefae0da-f4d3-4cbb-885f-c82644ba5e04 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:44.401973 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cefae0da-f4d3-4cbb-885f-c82644ba5e04 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.049544 Oct 18 13:45:44.408802 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2470/4829] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 18 13:45:44 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:45:44.421925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b63f6b7-9b85-4a97-bd61-f7a89c345b5f tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:44.463418 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b63f6b7-9b85-4a97-bd61-f7a89c345b5f tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c" status: 200 len: 235 microversion: 2.64 time: 0.052256 Oct 18 13:45:44.473300 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2471/4830] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Oct 18 13:45:44 2022] GET /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c => generated 235 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:45:44.486586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-131a2c9f-70ed-4408-ad55-7b941ad87af5 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:44.620539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-131a2c9f-70ed-4408-ad55-7b941ad87af5 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c" status: 204 len: 0 microversion: 2.64 time: 0.144147 Oct 18 13:45:44.621138 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2472/4831] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Oct 18 13:45:44 2022] DELETE /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:45:44.629217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:44.635271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5dbc477d-70a3-438b-a570-39ce45ec84c6 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:44.649256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3811e3a9-cbe9-4a93-acd8-20e1d9cc257b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.762070 Oct 18 13:45:44.650516 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2360/4832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:45:44.658815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5dbc477d-70a3-438b-a570-39ce45ec84c6 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] HTTP exception thrown: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5dbc477d-70a3-438b-a570-39ce45ec84c6 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Request method failure captured: Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c HTTP/1.1 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq4HdeE5vmaB3CNBLPKp_F-foZvAX62R0FKBBd5cQd9yhbHcrnPVJZMF6BafdAtXnrnI-rqXzAVaJqVeC0NiUR63r5XC2k51oQ_s32JTXfXipIH6M14vh6hmzxImGtvbc4nykDX-5ygvgtAMDbMGkJGrAu1vZSlZO8tv8pKT0WIKvGQ Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.64 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b2b1fda987b644a9a17f18abab81eac8 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerGroup264TestJSON-114930295 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b2b1fda987b644a9a17f18abab81eac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b2b1fda987b644a9a17f18abab81eac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b2b1fda987b644a9a17f18abab81eac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b2b1fda987b644a9a17f18abab81eac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerGroup264TestJSON-114930295 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b2b1fda987b644a9a17f18abab81eac8 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerGroup264TestJSON-114930295 Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerGroup264TestJSON-114930295-project Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1403c0b2a05241aaa2eb56c217e00eaa Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerGroup264TestJSON-114930295-project Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c468a6d0-4afa-4980-8ef9-cf7f2afea17c'} Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:44.670303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5dbc477d-70a3-438b-a570-39ce45ec84c6 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] Returning 404 to user: Instance group c468a6d0-4afa-4980-8ef9-cf7f2afea17c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5dbc477d-70a3-438b-a570-39ce45ec84c6 tempest-ServerGroup264TestJSON-114930295 tempest-ServerGroup264TestJSON-114930295-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c" status: 404 len: 117 microversion: 2.64 time: 0.047400 Oct 18 13:45:44.685680 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2473/4833] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Oct 18 13:45:44 2022] DELETE /compute/v2.1/os-server-groups/c468a6d0-4afa-4980-8ef9-cf7f2afea17c => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:45:45.684399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:45.685016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:45.723530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:45.730008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:45.730598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:45.734397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:45.737704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:45.760938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:46.927157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:46.946039 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f25a3ee6-83bc-4dd9-af43-069c03b3bd55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 1.268301 Oct 18 13:45:46.958250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2361/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:45 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:47.998358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:47.999543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:48.023134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:48.023645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:48.030138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:48.030138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:48.030138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:48.030138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:48.041161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=90 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:48.607646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:48.629485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2d09f6b-962d-456d-af91-ff5e678e0bb5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.635551 Oct 18 13:45:48.631841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2474/4835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:49.657589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:49.659497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:49.669911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:49.672054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:49.675375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:49.677919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:49.680382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:49.681348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:50.029423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:50.040175 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d2d04c78-a5b0-492a-8f9b-0051fcecb6ce tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.387179 Oct 18 13:45:50.044455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2362/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:49 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:51.102253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:51.102930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:51.183399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:51.184469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:51.186241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:51.189630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:51.192305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:51.193938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:52.326630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:52.341522 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-493e539d-36b9-4a99-9eec-7265f99c62a3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 1.266682 Oct 18 13:45:52.342780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2475/4837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:51 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:53.368179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:53.369386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:53.378771 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 13:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 (ip 10.222.0.27) !!! Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:53.387367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:53.392863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:53.844738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:53.885969 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16df42da-6e2e-4b06-b949-0ae8e882e163 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1532 microversion: 2.1 time: 0.522813 Oct 18 13:45:53.911491 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2363/4838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:53 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1532 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:54.910705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:54.911922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:54.922155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:54.951342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:55.661940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:55.678570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a719579a-7ef1-4a15-b8be-2fd4a13d0931 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.769900 Oct 18 13:45:55.699874 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2476/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:54 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:56.542879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "name": "network-vif-plugged", "status": "completed", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:56.566112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=20 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:56.574687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:56.584290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:56.584941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:56.632129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] Creating event network-vif-plugged:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:45:56.645401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-92d17cef-82e0-4b10-8896-e5b1ec5f89cb req-c8a2d9df-72c7-4d0a-a841-a4f06168bba7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463188 Oct 18 13:45:56.648003 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2364/4840] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:56.710083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:56.710709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:56.728532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:56.734668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:56.738313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:56.740963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:56.743690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:56.745891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:58.571225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:58.586976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19f198f8-901e-4df1-b030-9e9ddce50ff1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 1.881381 Oct 18 13:45:58.591142 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2477/4841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:56 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:59.640984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:59.652809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:59.691260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:59.691991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:59.692453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:59.700213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:59.701670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:59.703580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:01.800206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:01.842598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cee0e848-e07a-49bf-a9a9-a82a06c6faba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 2.205825 Oct 18 13:46:01.846552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2365/4842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:59 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:02.874440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:02.875138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:02.911058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:02.917158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:02.917648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:02.918446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:02.918921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:02.919365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:03.724744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:03.733937 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54db4d43-73c6-414c-86f5-bd544310e220 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.864291 Oct 18 13:46:03.753123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2478/4843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:02 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:04.766158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:04.766158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:04.795073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:04.795073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:04.808519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:04.815594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:04.816292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:04.819301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:05.709519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:05.754205 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2169c2e0-6e8c-4c40-a3f6-3bb37d86efe1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.959349 Oct 18 13:46:05.754205 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2366/4844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:04 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:06.779384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:06.780702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:06.785441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:06.804338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:06.808770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:06.809247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:06.810000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:06.810504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:06.810947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:07.637344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:07.656020 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c690d58d-4961-4d4d-916a-2801162784b8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.880424 Oct 18 13:46:07.662775 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2479/4845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:06 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:08.695533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:08.696635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:08.717104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.717542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.718602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:08.719018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.719691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.720249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:08.919346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:08.928303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-945741f0-2b00-4b86-bb11-bda32a0dd457 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.240686 Oct 18 13:46:08.937792 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2367/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:08 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:09.955804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:09.959185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:09.975764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:09.978807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:09.979472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:09.984455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:09.985149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:09.985775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:10.521889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:10.557478 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e4f581f-4c15-4784-bbaa-72536db3bda0 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.590601 Oct 18 13:46:10.584438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2480/4847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:09 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:11.587675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:11.589182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:11.600002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:11.601630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:11.603905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:11.605841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:11.607304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:11.608812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:12.338842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:12.353489 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-159fa64d-ade8-427f-8da4-e794faef996a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.769897 Oct 18 13:46:12.357173 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2368/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:11 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:13.379735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:13.412158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:13.443205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.445660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.446420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:13.450386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.452154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.453842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:14.043975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:14.075304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4f07d2e-5ec1-4f7c-a890-95b2eebd9269 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.700999 Oct 18 13:46:14.076338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2481/4849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:13 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:15.113685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:15.114572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:15.134355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.143428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.146562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.147588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.148475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.151799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:16.483508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:16.487370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=59 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:16.528224 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-922e694a-d31a-47a3-8e48-a1740f3ddba6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 1.413394 Oct 18 13:46:16.550083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2369/4850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:15 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:17.569293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:17.572644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:17.587802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:17.591381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:17.591381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:17.591381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:17.592285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:17.593823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.613427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:18.657507 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c70bc289-896a-465b-9950-4b94acc98a6f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 1.098705 Oct 18 13:46:18.682146 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2482/4851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:17 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:19.688438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:19.697368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:19.712261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:19.719413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:19.721598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:19.724033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:19.727761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:19.728227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.277075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:20.290034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19187fb8-b4a1-4bc4-bb6b-46de51ce7b51 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.608924 Oct 18 13:46:20.293660 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2370/4852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:19 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:21.333322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:21.333958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:21.352135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:21.352644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:21.353086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:21.353800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:21.354291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:21.354722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:21.441189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=54 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:22.346469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:22.368021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-125de561-b898-4d08-bcf5-14f30e18a567 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 1.044040 Oct 18 13:46:22.369084 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2483/4853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:21 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:23.398164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:23.399434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:23.412776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:23.413849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:23.417400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:23.418445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:23.419090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:23.424774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:24.098378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:24.116794 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6627786f-b30e-4877-98a0-78c65e62358a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.722560 Oct 18 13:46:24.118753 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2371/4854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:23 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:25.144485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:25.146983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:25.163480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:25.164271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:25.164913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:25.166094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:25.166794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:25.167398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:25.768855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:25.777391 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84cde4b8-8d5b-4a7a-93e6-0fd7d3b90442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.637266 Oct 18 13:46:25.780726 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2484/4855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:25 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:26.806712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:26.807875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:26.823786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:26.829183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:26.834887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:26.834887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:26.834887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:26.834887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:27.773123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:27.796260 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6173970a-7644-40b6-8235-98da18266b75 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.981728 Oct 18 13:46:27.801231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2372/4856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:26 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:28.820731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:28.821956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:28.841149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:28.841957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:28.842601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:28.846626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:28.850989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:28.854302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:30.289439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1079349929", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:30.289439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:30.289439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] validate_networks() for [('ed9aafd1-aaa1-4531-915f-bdd4ace6dd4f', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:46:30.502893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:30.511870 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c8271f4-3620-46a8-8e7a-0998a2f6aec5 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 1.695130 Oct 18 13:46:30.523116 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2485/4857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:28 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:31.551703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:31.553049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:31.581953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:31.585920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:31.589873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:31.591089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:31.592078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:31.593036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:32.135261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:32.146742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e4fac89-dbb0-4af8-80f3-1369d43ac566 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.601820 Oct 18 13:46:32.147863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2486/4858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:31 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:32.236178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:46:32.236760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:46:32.237075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:46:32.237496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:46:32.238124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:46:32.260873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:32.269677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:32.271351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:32.272813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:32.273489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:32.274134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:32.303939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:46:32.312608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for user b29dba1f338c4a3ebe1f1b4db9bc45c5 and project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:46:32.335062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:46:32.342299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:46:32.771113 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c572a33-4696-4c8c-8876-f52a27cdf743 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.143182 Oct 18 13:46:32.772109 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2373/4859] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:46:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:46:32.784062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa742540-f50f-46de-aa87-3c90383b20c1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:32.786614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa742540-f50f-46de-aa87-3c90383b20c1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:32.926554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa742540-f50f-46de-aa87-3c90383b20c1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:32.941916 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa742540-f50f-46de-aa87-3c90383b20c1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1222 microversion: 2.1 time: 0.162216 Oct 18 13:46:32.942515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2487/4860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:32 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:33.173870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:33.174666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:33.203880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:33.205041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:33.205659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:33.206746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:33.207391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:33.207988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:33.339419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1590375586", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:33.451916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] validate_networks() for [('ed9aafd1-aaa1-4531-915f-bdd4ace6dd4f', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:46:33.554373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:33.562412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-84beb006-af15-4046-8804-e7b494d27293 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1527 microversion: 2.1 time: 0.393445 Oct 18 13:46:33.563007 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2374/4861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:33 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1527 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:34.585775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:34.587146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:34.607631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:34.610696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:34.615472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:34.616465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:34.617120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:34.618348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:34.832753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:46:34.834168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:46:34.834868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:46:34.835333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:46:34.836314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:46:34.922343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:34.937343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:34.938609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:34.940821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:34.941622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:34.942398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:35.009792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:46:35.029561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for user b29dba1f338c4a3ebe1f1b4db9bc45c5 and project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:46:35.088938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:46:35.092102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:46:35.390305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:35.409251 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e533c532-632c-4f69-b5d3-4d9c5686ea13 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1509 microversion: 2.1 time: 0.826423 Oct 18 13:46:35.425222 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c50f8e40-20de-472e-898b-7c7c7b749f53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.090966 Oct 18 13:46:35.438956 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2375/4862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:34 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1509 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:35.439398 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2488/4863] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:46:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:46:35.456790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43b3a418-27ea-457c-b647-fcc180c4ad20 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:35.459090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-43b3a418-27ea-457c-b647-fcc180c4ad20 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:35.672037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-43b3a418-27ea-457c-b647-fcc180c4ad20 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:35.683968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43b3a418-27ea-457c-b647-fcc180c4ad20 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1222 microversion: 2.1 time: 0.230917 Oct 18 13:46:35.687166 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2376/4864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:35 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:36.466603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:36.467999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:36.479986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:36.480842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:36.487317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:36.487317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:36.487317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:36.487317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:36.710788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a484e3a6-6548-41a4-bcba-6442d3be3c96 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:36.711672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a484e3a6-6548-41a4-bcba-6442d3be3c96 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:36.712740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:36.729262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4111c406-24a8-4e6c-a71e-2b95122ed1bc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1509 microversion: 2.1 time: 0.268536 Oct 18 13:46:36.730806 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2489/4865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:36 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:36.867524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a484e3a6-6548-41a4-bcba-6442d3be3c96 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:36.888963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a484e3a6-6548-41a4-bcba-6442d3be3c96 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1222 microversion: 2.1 time: 0.173973 Oct 18 13:46:36.888963 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2377/4866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:36 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:37.665812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "name": "network-vif-unplugged", "status": "completed", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:37.694390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.695049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.695689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.710810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] Creating event network-vif-unplugged:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:46:37.717035 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3a1bb023-8f7f-408d-a9b2-222c4808d285 req-aed9770f-aa84-4d72-81d9-de53a61e30d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063957 Oct 18 13:46:37.718266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2490/4867] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:37.759425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:37.760231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:37.777161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.779466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.780963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.781913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.783753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.786630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.910137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:37.911599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:37.925419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.926606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.927801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.928765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.929479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.930214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:38.056153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:38.061977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:38.083819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4d14b98-f543-4d2c-9e83-8a0141956bdf tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1509 microversion: 2.1 time: 0.328773 Oct 18 13:46:38.084413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2378/4868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:37 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:38.127448 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e3e44f7-9fcf-4c87-ad57-404b8d5af40b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1226 microversion: 2.1 time: 0.219421 Oct 18 13:46:38.146616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2491/4869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:37 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:39.112292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:39.113086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:39.141262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.142604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.143135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:39.143957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.144493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.145054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:39.161957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:39.163238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:39.181819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.189422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.189422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:39.189422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.189422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.192343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:39.789324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:39.808896 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84925658-0fd9-4001-b740-2c2957dc889f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1274 microversion: 2.1 time: 0.652668 Oct 18 13:46:39.809512 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2492/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:39 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1274 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:40.840677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:40.841513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:40.858531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:40.860048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:40.885686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:40.889562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:40.896437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:40.897001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:40.903233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:41.079633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:41.091233 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ba2ea0e-ea51-414a-9acc-687296f9cf33 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1292 microversion: 2.1 time: 0.256167 Oct 18 13:46:41.092468 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2493/4871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:40 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1292 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:41.370502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:41.378934 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c992666e-e692-4dfa-af5b-0ab4f4786f72 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1509 microversion: 2.1 time: 2.271036 Oct 18 13:46:41.394507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2379/4872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:39 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1509 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:42.118627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:42.124720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:42.145887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.147634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.147634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:42.150638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.153706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.155107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:42.406923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:42.407604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:42.411939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:42.431792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.432819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.433762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:42.434716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.435343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.436412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:43.351530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:43.363977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34453676-e0c6-48c3-9c64-3594f81a0ce6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1452 microversion: 2.1 time: 0.960396 Oct 18 13:46:43.372934 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2380/4873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:42 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1452 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:43.402773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:43.402773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:43.419452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:43.420258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:43.420405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:43.426725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:43.428340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:43.432271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:43.713950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:43.730810 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f40eeae4-9ab0-4547-80e7-af1125ec0a85 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 1.616370 Oct 18 13:46:43.732243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2494/4874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:42 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:44.228223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:44.238425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d52deff-56df-47c4-bad5-75df9b1acd56 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1452 microversion: 2.1 time: 0.849072 Oct 18 13:46:44.248875 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2381/4875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1452 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:44.338350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:44.339101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:44.373806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.379164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.380309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.385343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.385933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.386468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.460739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lazy-loading 'flavor' on Instance uuid 07c26fbf-017d-4ad0-9aed-9fea80c44317 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:46:44.535027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'shelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state shelved_offloaded Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 14 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: {"shelve": {}} Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'shelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state shelved_offloaded Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'shelve': {}}} Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:46:44.539762 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state shelved_offloaded Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state shelved_offloaded Oct 18 13:46:44.552249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:46:44.554476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'shelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state shelved_offloaded {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:44.560740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e84533c-0e38-4455-974b-81e71361c736 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 155 microversion: 2.1 time: 0.226333 Oct 18 13:46:44.566731 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2495/4876] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:46:44 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 155 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:46:44.576001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:44.576914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:44.621392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.622316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.624349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.626732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.631996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.633884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.761621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:44.762802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:44.776135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.776649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.777106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.777837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.791661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.791661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.801609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:46:44.975782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:45.054896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:45.166560 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7a596e97-e839-4ac9-955c-a492317f009d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.593477 Oct 18 13:46:45.167253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2382/4877] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:46:44 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:46:45.186337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:45.191228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:45.222745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.223487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.223952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:45.224706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.225178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.225613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:45.432208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:45.457278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb0e1ccb-f871-4c45-a3c0-246a12e5b45a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.700774 Oct 18 13:46:45.460134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2496/4878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:44 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:45.706785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693e4bf5-4eb5-417a-90c3-f22935c71976", "tag": "7110e7ad-baa1-4881-8880-c0fa3e2a57f9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:45.730341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.738350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.739506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:45.776128 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] Creating event network-changed:7110e7ad-baa1-4881-8880-c0fa3e2a57f9 for instance 693e4bf5-4eb5-417a-90c3-f22935c71976 on n-h2-858383-13 Oct 18 13:46:45.805420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-caf28583-365d-42f9-a18c-6a7e44a5e816 req-328f5ac1-126b-42cf-b0a8-c56c68a3e024 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103443 Oct 18 13:46:45.806246 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2497/4879] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:46.458991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:46.473061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90d6264e-81dc-473a-bfa1-7c44ebdb1d95 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1460 microversion: 2.1 time: 1.297828 Oct 18 13:46:46.482593 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2383/4880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:45 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1460 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:46.494725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:46.498039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:46.503606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:46.505957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:46.507126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:46.508688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:46.509328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:46.509944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:46.989231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:47.005062 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06d0efed-670a-4985-9cc7-9b6bb59ad3f7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.511817 Oct 18 13:46:47.006027 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2498/4881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:46 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:47.505953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:47.506467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:47.509454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:47.525315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:47.526745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:47.527971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:47.530952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:47.531639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:47.533062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:47.868113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9ed5d1-5cac-4d93-8d56-3a1a6a040712", "tag": "c7f3418a-e892-4a4d-b5ba-842aab4cd9dd"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:47.890662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:47.892761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:47.893310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:47.920962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] Creating event network-changed:c7f3418a-e892-4a4d-b5ba-842aab4cd9dd for instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 on n-h2-858383-13 Oct 18 13:46:47.935444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-704e25a6-d0b6-46e2-b989-ae4157c6d8cc req-319adb8b-7391-445b-9553-bc79f2207068 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071078 Oct 18 13:46:47.938933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2499/4882] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:48.034383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:48.036134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:48.050140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:48.064559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:48.066130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:48.069340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:48.070085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:48.073671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:48.307066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:48.322176 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3821c48-fb31-495c-9f2a-b293fe88e9d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.291964 Oct 18 13:46:48.323494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2500/4883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:48 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:48.369124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:48.493210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0a3e791-6baf-4d3f-a8df-8e345b452e5d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1460 microversion: 2.1 time: 0.993540 Oct 18 13:46:48.502607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2384/4884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1460 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:49.355881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:49.356596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:49.378894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.379419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.379887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.382390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.383000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.385686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.535558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:49.538581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:49.559448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.560430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.562941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.565150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.570111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.572324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.802137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:49.806327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e412bb6-6a50-41be-8596-0969a24f449c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.457713 Oct 18 13:46:49.807025 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2501/4885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:49 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:50.264141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:50.264141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:50.270258 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-185f9fc6-00b8-478e-b98e-5f61289313e3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.741553 Oct 18 13:46:50.270855 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2385/4886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:49 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:50.834862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:50.836619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:50.850006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:50.852768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:50.853390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:50.857315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:50.857890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:50.858399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:51.313430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:51.314248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:51.351328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:51.361763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:51.362767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:51.363675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:51.366793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:51.367401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:51.725919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:51.738838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b31f4f9-672c-4aa9-b4b1-fa277183be6a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.431164 Oct 18 13:46:51.748857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2386/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:51 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:52.412424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:52.428394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:52.432736 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a3f94b7-31ac-4024-8a7f-3592fbc4ddee tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 1.597758 Oct 18 13:46:52.447346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2502/4888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:50 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:52.775923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:52.776556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:52.816523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:52.818331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:52.821282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:52.823572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:52.829164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:52.831285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:53.470501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:53.480072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:53.486603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:53.515261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:53.519009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:53.520987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:53.521173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c41f6eac-441c-413b-9868-26f8233de403 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.749273 Oct 18 13:46:53.523492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:53.524297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:53.525309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2387/4889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:52 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:53.527494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:54.306284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:54.315948 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d39f128-a100-4fc6-b7df-bf63775acd24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.858220 Oct 18 13:46:54.328254 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2503/4890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:53 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:54.553843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:54.555094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:54.584639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:54.592179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:54.595314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:54.597405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:54.603048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:54.603324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:55.349208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:55.356452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:55.421822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:55.428840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:55.432329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:55.435569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:55.437049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:55.440572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:55.513468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:55.560303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa658a4d-8d60-4410-af66-2e4080a1985b tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.996339 Oct 18 13:46:55.572230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2388/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:54 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:56.600746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:56.603855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:56.609672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:56.643084 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9fbd3e7-672b-4694-ac13-780749745fc4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 1.305610 Oct 18 13:46:56.660024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:56.660124 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2504/4892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:55 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:56.660218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:56.660218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:56.660218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:56.660218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:56.660218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:56.777977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693e4bf5-4eb5-417a-90c3-f22935c71976", "name": "network-vif-plugged", "status": "completed", "tag": "7110e7ad-baa1-4881-8880-c0fa3e2a57f9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:56.803478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:56.806963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:56.809034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:56.851413 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] Creating event network-vif-plugged:7110e7ad-baa1-4881-8880-c0fa3e2a57f9 for instance 693e4bf5-4eb5-417a-90c3-f22935c71976 on n-h2-858383-13 Oct 18 13:46:56.871280 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9924976e-f6a9-4e25-aa75-b25f9b66d3cc req-488282d5-415f-4b7f-ab80-b819df846bcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097080 Oct 18 13:46:56.871911 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2505/4893] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:57.382930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:57.409791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-278f9e3a-4a84-4a00-a2db-d7197700c442 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.802620 Oct 18 13:46:57.435248 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2389/4894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:56 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:57.694911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:57.696273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:57.713880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:57.720197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:57.720941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:57.723178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:57.726253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:57.729082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:58.445370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:58.446254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:58.465855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:58.467494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:58.468875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:58.476287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:58.478541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:58.521275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:59.217482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:59.234203 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-67a01cb2-3d89-4213-95d0-28c6ec3b58b2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.798432 Oct 18 13:46:59.295949 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2390/4895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:58 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:59.317342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:59.328189 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c60e905-1389-4ac4-b173-6c8d12d1c27a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 1.637795 Oct 18 13:46:59.341326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2506/4896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:57 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:59.361065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ed5d1-5cac-4d93-8d56-3a1a6a040712", "name": "network-vif-plugged", "status": "completed", "tag": "c7f3418a-e892-4a4d-b5ba-842aab4cd9dd"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:59.407301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:59.407301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:59.407301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:59.456498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] Creating event network-vif-plugged:c7f3418a-e892-4a4d-b5ba-842aab4cd9dd for instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 on n-h2-858383-13 Oct 18 13:46:59.484562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-add927ff-1d6a-4701-b352-53bb4a428df5 req-3217a8ac-e104-434d-ab4e-1a4636d5b4ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184271 Oct 18 13:46:59.489905 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2391/4897] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:00.259365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:00.260519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:00.276616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.281040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.282402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:00.291211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.292025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.292716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:00.368587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:00.369474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:00.399231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.399836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.408917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:00.409788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.417380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.420330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:00.961199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:00.976055 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e93e0793-3551-41dd-93f9-24ff19e2bbd9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 0.613398 Oct 18 13:47:00.999159 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2392/4898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:00 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:02.006975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:02.008366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:02.036642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:02.049401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:02.049401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:02.049401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:02.052832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:02.055101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:02.057074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:02.234156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:02.258851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4081ec6b-92b2-4abc-8df0-e34d1b81da89 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 2.003522 Oct 18 13:47:02.265161 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2507/4899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:00 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:03.299622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:03.299622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:03.326618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:03.328909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:03.334093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:03.337636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:03.338429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:03.345021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:03.584384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:03.604090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-00251301-4221-4af7-98cc-bd6ad3eaf169 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1322 microversion: 2.1 time: 1.602100 Oct 18 13:47:03.613036 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2393/4900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:01 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1322 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:03.901861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:03.926259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3aa13d55-fe84-4ec1-a4ae-77bb8e315f20 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.634748 Oct 18 13:47:03.932331 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2508/4901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:03 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:04.640955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:04.641659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:04.675064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.675587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.676046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:04.690722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.691082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.691545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:04.965621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:04.966818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:04.986272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.986797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.987241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:04.987968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.988433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.994926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:05.528548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:05.552373 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d478d76d-2730-4756-918c-327e973e4b17 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1517 microversion: 2.1 time: 0.912607 Oct 18 13:47:05.564721 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2394/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:04 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1517 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:05.600293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:05.621125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:05.630883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:05.640830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0380759a-b4fd-4ce5-8292-f4c1fe16b132 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.680095 Oct 18 13:47:05.647343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2509/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:04 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:05.684027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:05.685007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:05.685606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:05.687623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:05.689760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:05.698998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:05.817864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'flavor' on Instance uuid 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:06.476237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dfdffa54-9ad8-491f-ae3a-f90967d65f6a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action" status: 200 len: 32 microversion: 2.1 time: 0.887722 Oct 18 13:47:06.478205 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2395/4904] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:05 2022] POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action => generated 32 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:47:06.488118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:06.488767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:06.520945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:06.552182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:06.556319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:06.557365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:06.563722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:06.570066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:06.680677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:06.680677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:06.698765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:06.700819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:06.701499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:06.702461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:06.703100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:06.704252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:07.576886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:07.615046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e7c96fd-01ed-4b5f-9e91-4dfeb27f8023 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.943710 Oct 18 13:47:07.619394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2396/4905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:06 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:07.758153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:07.758153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e711696-879f-4be2-9144-02e66ef30503 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 1.206008 Oct 18 13:47:07.758153 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2510/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:06 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:08.764185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:08.764873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:08.766047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:08.766868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:08.780501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.783719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.784489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.785177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.785813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.786466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.787415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.788359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.789003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.789652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.792978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.794617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:09.274297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:09.283267 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a051ca5-7381-48e5-bc41-f28c23983f2e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.525146 Oct 18 13:47:09.300715 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2511/4907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:08 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:09.648637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:09.661249 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ca78e20-9ecf-4d68-b1e6-bc42b3259f7a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.908002 Oct 18 13:47:09.681479 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2397/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:08 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:10.310215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:10.312146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:10.322944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:10.333521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:10.334317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:10.335289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:10.341388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:10.342620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:10.690259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:10.691950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:10.705248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:10.709754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:10.710576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:10.712194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:10.714709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:10.715510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:11.144797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:11.158207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7cc730f2-9e90-4e70-83ff-b667942815fc tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.473092 Oct 18 13:47:11.173053 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2398/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:10 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:11.899959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:11.916933 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a385c69-f0e9-47a5-9b5a-300e35458e9d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 1.611598 Oct 18 13:47:11.918651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2512/4910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:10 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:12.186788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:12.188320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:12.205949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.215174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.215886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:12.216698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.228377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.229215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:12.947107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:12.947774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:12.982741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=40 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:12.986650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.987220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.987649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:12.988384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.998025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.998544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:13.212764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:13.235218 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38418ef4-a37a-4afc-b30e-86466f424c9e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 1.045951 Oct 18 13:47:13.235218 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2399/4911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:12 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:14.261026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:14.261797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:14.274479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:14.275005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:14.279836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:14.280614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:14.281108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:14.281589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:14.395755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:14.408898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9dbeb195-c09a-432c-8423-2508ef31f7d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 1.469803 Oct 18 13:47:14.410299 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2513/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:12 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:14.965111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:14.978259 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8e1e783-2783-4958-afcf-8e16a7716671 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.726035 Oct 18 13:47:14.995367 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2400/4913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:14 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:15.273864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0e268798-bd76-4e56-a76b-fb210264184f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Action: 'create', calling method: .version_select at 0x7fb330f50d30>, body: {"keypair": {"name": "tempest-keypair-245674219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqAVd6Ft+37QHMrTE2x792h9R1ATKB3zPlaghteY0BzDxzZ9ARGcyRkNY1BKbDgmoMJbE2i9yzL/Go6DZDJY84x2tV+vtdTaOSHyN0bnc2SQcX/44lg8LZvyF/ABoxk7A=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:15.312566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0e268798-bd76-4e56-a76b-fb210264184f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Getting quotas for project 3da657bc46794b2c84e755ed48250a86. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:47:15.325948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0e268798-bd76-4e56-a76b-fb210264184f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Getting quotas for user 371dc522b1db4365900595d2fb0df7b8 and project 3da657bc46794b2c84e755ed48250a86. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:47:15.436554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:15.439822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:15.450422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:15.451136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:15.451887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:15.452936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:15.454668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:15.455436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:15.462554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:15.544999 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0e268798-bd76-4e56-a76b-fb210264184f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.283414 Oct 18 13:47:15.546694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2514/4914] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 13:47:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 287 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:47:15.663492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:15.669422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d61a6e3-59c9-4776-8a9c-7850baebc271 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.237318 Oct 18 13:47:15.670792 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2401/4915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:15 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:16.017516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:16.020104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:16.032418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:16.036957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:16.039062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:16.042595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:16.046625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:16.051228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:16.699626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:16.702415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:16.731021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:16.732269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:16.734302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:16.737350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:16.739155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:16.745224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:17.055652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:17.072306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63f58e00-e99f-4b89-b60f-88ca5fee2eed tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 1.061677 Oct 18 13:47:17.077427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2515/4916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:16 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:17.217113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:17.233378 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-03c11650-c3eb-45fb-8310-04292d867608 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.539824 Oct 18 13:47:17.244608 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2402/4917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:16 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:18.047808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "name": "network-vif-plugged", "status": "completed", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:18.084610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:18.085329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:18.091136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.113395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:18.114298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:18.128760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:18.129831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:18.130574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.131575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:18.132359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:18.132743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] Creating event network-vif-plugged:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:47:18.133313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.138781 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-92ca07c4-6603-4191-a468-5ea09dfb74d3 req-6d3a5b0a-d606-469a-85bc-315ce62acacc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098461 Oct 18 13:47:18.139690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2516/4918] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:47:18.270264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:18.276958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:18.302693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:18.306804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:18.307607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.308690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:18.309971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:18.311006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.796142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:18.813392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9926abd8-3432-4d56-8a2f-cd2bfd4efdc6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.556978 Oct 18 13:47:18.819739 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2517/4919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:18 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:19.269254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:19.283709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8745f94d-f1cb-48dd-97da-9fdfee5e7c32 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 1.187129 Oct 18 13:47:19.303569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2403/4920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:18 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:19.845244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:19.845845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:19.864291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:19.869402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:19.870405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:19.877125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:19.880794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:19.881356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:20.308784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:20.310260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:20.321755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:20.326505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:20.327077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:20.328708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:20.329420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:20.332524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:20.541829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:20.552018 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7165d56-1cd2-46ca-844f-a3eedd8bc2ab tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.713228 Oct 18 13:47:20.560701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2518/4921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:19 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:20.976248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:20.985337 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9115050-bae4-421e-ba1c-3cd8ac2847c7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.680733 Oct 18 13:47:21.001215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2404/4922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:20 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:21.586042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2002885845", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:21.597662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:21.598802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:21.648959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:21.649835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:21.654007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:21.659158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:21.661540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:21.663524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:21.861740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:47:22.117726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:22.131754 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4bab99b-2cc3-4139-8b2a-aeb8b8546c57 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.543570 Oct 18 13:47:22.151899 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2405/4923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:21 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:22.193615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:22.194791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:22.215597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:22.216353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:22.216986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:22.218400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:22.219428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:22.220041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:22.585951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:22.602483 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32f50b36-9ad2-4c1d-99dc-6df4d6161eff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1518 microversion: 2.1 time: 0.449962 Oct 18 13:47:22.604092 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2406/4924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:22 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:22.613705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-493992286", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0b95620a-6e54-44be-a1c0-0c607795e9b2"}, {"port": "f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799", "tag": "port-1"}, {"port": "8e22e8f7-5a5d-4467-8094-8f320789781e", "tag": "port-2"}, {"uuid": "682f2e5d-6e2e-4028-853c-8d12619bd81f", "tag": "net-1"}, {"uuid": "682f2e5d-6e2e-4028-853c-8d12619bd81f"}, {"uuid": "4624836f-2a09-43e3-a0fa-a7d3d26cacdc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4624836f-2a09-43e3-a0fa-a7d3d26cacdc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c6289451-c7de-46c1-b5c8-11383aa77ed2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "de333e50-e13e-4e76-9729-4eb7ca085ae3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ba93bf43-dd87-46f1-9756-bbe75554b759", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--319940890"}], "key_name": "tempest-keypair-245674219", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:22.754631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:47:22.756040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:47:22.758635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:47:22.758635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:47:22.758635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:47:22.789372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:22.790685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:22.791693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:22.793079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:22.794009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:22.794911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:22.837960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Getting quotas for project 6cb53c0efe184e22924ac20e3b33934b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:47:22.861960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Getting quotas for user 2c3b398d488848fd83dc89a187f6f393 and project 6cb53c0efe184e22924ac20e3b33934b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:47:22.904818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:47:22.909848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:47:22.950040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] validate_networks() for [('0b95620a-6e54-44be-a1c0-0c607795e9b2', None, None, None, None, None), (None, None, 'f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799', None, None, None), (None, None, '8e22e8f7-5a5d-4467-8094-8f320789781e', None, None, None), ('682f2e5d-6e2e-4028-853c-8d12619bd81f', None, None, None, None, None), ('682f2e5d-6e2e-4028-853c-8d12619bd81f', None, None, None, None, None), ('4624836f-2a09-43e3-a0fa-a7d3d26cacdc', '10.2.2.100', None, None, None, None), ('4624836f-2a09-43e3-a0fa-a7d3d26cacdc', '10.2.2.200', None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:47:23.125415 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-619dd090-caa6-4f5f-916c-d58c420ee240 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551706 Oct 18 13:47:23.130877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2519/4925] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:47:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:47:23.146948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c8daac8-8937-453d-bb5b-890ca35297f1 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:23.147689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c8daac8-8937-453d-bb5b-890ca35297f1 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:23.286726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c8daac8-8937-453d-bb5b-890ca35297f1 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:23.299383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c8daac8-8937-453d-bb5b-890ca35297f1 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1215 microversion: 2.1 time: 0.160807 Oct 18 13:47:23.302406 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2520/4926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:23 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:23.313705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:23.317958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:23.332967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:23.333785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:23.338268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:23.339464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:23.340184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:23.340749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:24.767563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:24.779765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=90 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:24.786248 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9f33e8f-6709-463d-9b0e-c8de6ab1230c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 1.482478 Oct 18 13:47:24.792255 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2521/4927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:23 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:24.814909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:24.819904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:24.839988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:24.845778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:24.846956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:24.848603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:24.851914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:24.853206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.265084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6ca2e58-506b-4a2a-8089-19246b4a7596 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.505881 Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2522/4928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:24 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.322136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.331926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.440446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:25.476704 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5719d46-9aff-487d-a7b3-c1d06f35c938 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1219 microversion: 2.1 time: 0.164303 Oct 18 13:47:25.477379 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2523/4929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:25 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:25.504132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:25.508837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:25.526114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.526716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.527420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.528701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.539607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.540664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.916891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:25.934312 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f35cf03a-162a-4e96-aa94-749391a3810c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.450119 Oct 18 13:47:25.935426 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2524/4930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:25 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:26.014655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:26.018281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:26.066419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.068578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.071362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.076559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.079094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.080896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.482360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:26.499521 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20b350b6-be8b-4185-95f4-5de9050b93dc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.539119 Oct 18 13:47:26.500464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2525/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:25 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:26.506451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:26.507347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:26.515804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.520956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.520956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.520956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.520956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.520956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.954969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:26.963629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13dbde98-1d5e-479f-81fb-32ed90220462 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.461822 Oct 18 13:47:26.983223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2526/4932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:26 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:26.988538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:26.989171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:27.004012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.004345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.004814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.006346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.007775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.008243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.096267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:27.117579 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdf9d8e8-9738-4742-abdd-4755908effbf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1267 microversion: 2.1 time: 0.132673 Oct 18 13:47:27.134573 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2527/4933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:26 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:27.157083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-749359d1-a4dc-4a03-b045-cbc30355aa65 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:27.172080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-749359d1-a4dc-4a03-b045-cbc30355aa65 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-749359d1-a4dc-4a03-b045-cbc30355aa65 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/daba3e4d-e618-4d17-bf5c-56e5bb5d6555/action HTTP/1.1 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: {"os-stop": {}} Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'daba3e4d-e618-4d17-bf5c-56e5bb5d6555', 'body': {'os-stop': {}}} Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:27.186272 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-749359d1-a4dc-4a03-b045-cbc30355aa65 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance daba3e4d-e618-4d17-bf5c-56e5bb5d6555 has no mapping to a cell. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-749359d1-a4dc-4a03-b045-cbc30355aa65 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/daba3e4d-e618-4d17-bf5c-56e5bb5d6555/action" status: 404 len: 117 microversion: 2.1 time: 0.051935 Oct 18 13:47:27.197897 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2528/4934] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:27 2022] POST /compute/v2.1/servers/daba3e4d-e618-4d17-bf5c-56e5bb5d6555/action => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:27.206640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:27.208914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:27.229842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.231248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.233414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.235020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.235958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.236756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.466167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:27.476444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fe1bec9-874e-4b79-93f5-2dbe438f5180 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.277005 Oct 18 13:47:27.489971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2529/4935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:27 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:27.715935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Calling method '.version_select at 0x7fb32bbc1280>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:27.717746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.718447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.721922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.735961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.736806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.737431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.750948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.751769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.752437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.760291 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f25c271-0b80-4a11-9dcd-e49839a9eaec tempest-PortsAdminExtendedAttrsTestJSON-828640228 tempest-PortsAdminExtendedAttrsTestJSON-828640228-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.269061 Oct 18 13:47:27.770393 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2530/4936] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:47:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:27.776075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:27.777022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:27.784747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.785501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.786159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.787223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:27.787922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:27.788586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:27.973731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:28.021874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb277a94-741d-4244-8309-8f4a33d39046 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.248986 Oct 18 13:47:28.025266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2531/4937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:27 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:28.033928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:28.035014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:28.042117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.042967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.043600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.044690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.045371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.046078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.314607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:28.325307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b78ca69b-d904-40cd-abd6-2fa9f9b2ef5a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.298672 Oct 18 13:47:28.326279 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2532/4938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:28 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:28.332552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:28.337993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: b62020a8-3d59-442f-ad0c-717888c39c8e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:28.339800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/b62020a8-3d59-442f-ad0c-717888c39c8e/action HTTP/1.1 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: {"suspend": {}} Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'b62020a8-3d59-442f-ad0c-717888c39c8e', 'body': {'suspend': {}}} Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:28.341864 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:28.348557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:28.348557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:28.348557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. Oct 18 13:47:28.348557 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:28.348557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance b62020a8-3d59-442f-ad0c-717888c39c8e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:28.349350 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-728156bd-7757-42e9-a93d-b06fee7efea8 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/b62020a8-3d59-442f-ad0c-717888c39c8e/action" status: 404 len: 111 microversion: 2.1 time: 0.020833 Oct 18 13:47:28.350446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2533/4939] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:28 2022] POST /compute/v2.1/servers/b62020a8-3d59-442f-ad0c-717888c39c8e/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:28.358686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:28.369158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:28.370696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.371315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.371999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.373796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.374519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.375268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.517934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:28.532029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-391cbad4-3d2b-4b2d-80ce-8fdc4cac1e43 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1273 microversion: 2.1 time: 0.179874 Oct 18 13:47:28.532853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2534/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:28 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:28.548683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:28.549314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:28.569315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.570170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.570791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.572320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.573056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.574378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:29.019495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:29.031535 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac7350ff-e7f3-4cd1-9ef2-c571306c42d3 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.497668 Oct 18 13:47:29.032470 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2535/4941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:28 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:29.073513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:29.074891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:29.085377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:29.087091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:29.087091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:29.089225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:29.090639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:29.091351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:29.550545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:29.568797 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3333b15f-a255-4e5d-b565-eb987d4ab10a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.499596 Oct 18 13:47:29.574530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2536/4942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:29 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:29.584200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:29.585294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:29.600242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:29.604732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:29.605507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:29.608339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:29.609167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:29.610421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.086860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:30.099945 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e87c4164-bbb5-4986-887a-4cbfec321bf1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.522331 Oct 18 13:47:30.101233 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2537/4943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:29 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:30.112645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:30.113274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:30.129849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.130642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.131336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.133768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.134307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.134767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.487820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e829fd9-ea3a-4ab8-b60a-9f12fb5e9748 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1273 microversion: 2.1 time: 0.394407 Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2538/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:30 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.517311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.518045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.550680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lazy-loading 'flavor' on Instance uuid 07c26fbf-017d-4ad0-9aed-9fea80c44317 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:30.673795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:30.912485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3d5b69d-750c-45db-83aa-977a403756a7 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.410097 Oct 18 13:47:30.918863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2539/4945] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:30 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:30.929333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:30.930552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:30.946810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.951818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.952497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.957233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.957956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.960875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.404853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:47:31.407057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:47:31.408180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:31.408735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:47:31.409374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:47:31.409930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:47:31.423990 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d587ede6-533d-4658-b1bd-26afadcb397e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1513 microversion: 2.1 time: 0.503081 Oct 18 13:47:31.424891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2540/4946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:30 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1513 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:31.430156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:31.434468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:31.477120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:31.478865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:31.479489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.480859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:31.486343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:31.486343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.494711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:31.495500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:31.495978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.496732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:31.497210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:31.497648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.558394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Getting quotas for project 3da657bc46794b2c84e755ed48250a86. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:47:31.591985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Getting quotas for user 371dc522b1db4365900595d2fb0df7b8 and project 3da657bc46794b2c84e755ed48250a86. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:47:32.022521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:47:32.025782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c6289451-c7de-46c1-b5c8-11383aa77ed2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='de333e50-e13e-4e76-9729-4eb7ca085ae3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba93bf43-dd87-46f1-9756-bbe75554b759',volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:47:32.299628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:32.325134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1fc9a9af-d51d-4853-8a7a-c3743ed5922c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.895448 Oct 18 13:47:32.336453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2541/4947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:31 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:32.357477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:32.359874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:32.376583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.384831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.391749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.394445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.395204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.397071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.753410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:32.769101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-826bd48d-5775-4218-9376-9f541d5a55da tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.425664 Oct 18 13:47:32.771890 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2542/4948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:32 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:32.781856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:32.782963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:32.790379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.791140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.791786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.793347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.793998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.794619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.826585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:33.105879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:33.122392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b080141c-1125-472d-a67a-57cbbfd32fb2 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1496 microversion: 2.1 time: 0.349174 Oct 18 13:47:33.123251 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2543/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:32 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1496 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:33.154345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:33.166292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:33.173872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.174736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.175373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.176289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.176941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.177558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.246920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lazy-loading 'flavor' on Instance uuid 07c26fbf-017d-4ad0-9aed-9fea80c44317 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:33.266976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'suspend' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state suspended Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: {"suspend": {}} Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'suspend' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state suspended Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'suspend': {}}} Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 18 13:47:33.269393 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state suspended Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state suspended Oct 18 13:47:33.274803 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:33.277789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'suspend' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state suspended {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:33.279607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-855be262-405d-4806-91a9-b94407ee06ba tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 148 microversion: 2.1 time: 0.132223 Oct 18 13:47:33.281734 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2544/4950] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:33 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:47:33.307132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:33.311775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:33.333351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:33.337998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.339222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.341632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.345082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.346088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.347535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.844341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec0535dd-11d9-4ada-9fcf-314ecbcab323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 202 len: 0 microversion: 2.1 time: 0.557432 Oct 18 13:47:33.866127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2545/4951] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:33 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:33.873613 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75286b6d-3fa6-49dc-a2b9-afcd5096509a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.265063 Oct 18 13:47:33.878837 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2407/4952] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Oct 18 13:47:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 11272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:47:33.889458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:33.891390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:33.911312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.912008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.912471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.915022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.915524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.915982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.921396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:33.924701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:33.945745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.947320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.948155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.951673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.953508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.954262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:34.294210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:34.302814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b685610-f56a-42c1-a6ec-d875642f431c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.406504 Oct 18 13:47:34.303405 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2546/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:33 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:34.313197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:34.314474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:34.324107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:34.324910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:34.325546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:34.326498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:34.327154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:34.328855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:34.626834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:34.636992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4243907c-b526-4dbb-a340-a9530280be55 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1502 microversion: 2.1 time: 0.329164 Oct 18 13:47:34.652671 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2547/4954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:34 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:34.652671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:34.652671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:34.679227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:34.697303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c90970b0-d4fa-46b6-a36c-8b85b9db9074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.816573 Oct 18 13:47:34.698967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2408/4955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:33 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:34.706597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:34.993922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:35.010118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:35.012390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:35.016203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea24cdc5-8fb0-4236-94ae-e8b267e02fcc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1284 microversion: 2.42 time: 0.376987 Oct 18 13:47:35.017306 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2548/4956] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:34 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:35.333643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:35.335282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:35.342211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.342719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.343222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.344805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.345802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.346935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.500663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d967e531-28fc-400f-8e96-cce782e5b253", "tag": "bb9e38b4-5ee7-46dc-9297-1d5873d7a882"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:35.512447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.513220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.513866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.530188 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] Creating event network-changed:bb9e38b4-5ee7-46dc-9297-1d5873d7a882 for instance d967e531-28fc-400f-8e96-cce782e5b253 on n-h1-858383-13 Oct 18 13:47:35.538162 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-716b0698-8c6d-4e63-b6ee-8836bec39a3a req-99df7e29-3bc4-4b8a-b70d-9fa21f0c6c2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043003 Oct 18 13:47:35.539032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2549/4957] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:47:35.665475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:35.666208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:35.673584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.674186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.674635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.675577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.676069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.676503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.786726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:35.803061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e22f60f2-46f0-46a1-abd9-660de410fb75 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.473436 Oct 18 13:47:35.804413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2409/4958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:35 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:35.809603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:35.817930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:35.826117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:35.833280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.834932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.835914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.836871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.837424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.838014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:36.084112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.096264 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b5f9f24-e3b4-4355-be37-91fc87c3af45 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.290317 Oct 18 13:47:36.099201 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2410/4959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:35 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:36.106217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:36.110521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:36.175569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.212053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.219318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ad68d51-a49c-4566-aaa6-6aaaf3043fbd tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1502 microversion: 2.1 time: 0.557612 Oct 18 13:47:36.223217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2550/4960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:35 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1502 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:36.257164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.258823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.260320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75e2ec3b-df1b-437f-b796-3fb7e56204d3 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1284 microversion: 2.42 time: 0.159832 Oct 18 13:47:36.260919 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2411/4961] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:36 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:36.837047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:36.837047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:36.873731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:36.874891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:36.875369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:36.876120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:36.878913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:36.886974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.127603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.128906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.139915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.140770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.141427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.142428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.143110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.143752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.360282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.369282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e9ebb53-ffeb-4c95-8f6f-efbe89db1a26 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.245855 Oct 18 13:47:37.369886 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2412/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:37.378685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.379921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.386681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.387194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.387649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.388376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.388845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.389539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.581815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.590570 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d415e977-693f-4e9f-9ada-8f2474fd834d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.215659 Oct 18 13:47:37.591711 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2413/4963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:37.597288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.598371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.609993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.610630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.612311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.614075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.614715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.615368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.708795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.724271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.726655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.727097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff4aecb9-29b0-412b-b9f8-288334c0b8d5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1574 microversion: 2.42 time: 0.134215 Oct 18 13:47:37.727684 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2414/4964] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1574 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:37.732690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.733308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.740902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.741658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.742218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.743171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.743685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.744335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.767352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.777672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08d290a8-412c-4fcc-a59d-98278ab1fbed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.945941 Oct 18 13:47:37.779311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2551/4965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:36 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:37.909957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.919467 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d471f36d-1283-4efa-bd7b-5b686408aa83 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.190439 Oct 18 13:47:37.920074 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2415/4966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:37.943603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:37.943603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 8b1274ec-a303-4cc8-a427-a8c2740d98fe] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.950854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/8b1274ec-a303-4cc8-a427-a8c2740d98fe/action HTTP/1.1 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: {"unpause": {}} Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8b1274ec-a303-4cc8-a427-a8c2740d98fe', 'body': {'unpause': {}}} Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:37.953481 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 8b1274ec-a303-4cc8-a427-a8c2740d98fe could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76088b97-6b84-41e3-adc4-59c904dd454d tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1274ec-a303-4cc8-a427-a8c2740d98fe/action" status: 404 len: 111 microversion: 2.1 time: 0.016978 Oct 18 13:47:37.959559 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2552/4967] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:37 2022] POST /compute/v2.1/servers/8b1274ec-a303-4cc8-a427-a8c2740d98fe/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:37.965716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.967262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.976552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.977066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.978217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.978955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.979610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.980521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.273648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.286663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c581fcbe-f210-4dc2-a64d-ec7edd5fe323 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.324473 Oct 18 13:47:38.310020 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2416/4968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:38.336932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.337690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.348302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.349177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.349925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.350811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.351512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.352991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.402645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.403869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.413813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.414586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.415326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.416303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.416993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.417785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.697103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.708981 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5bb0d911-f33a-4931-b36a-114ecc5b63d7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.312193 Oct 18 13:47:38.718469 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2417/4969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:38 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:38.761491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.762165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.773610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.775533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.776001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.776992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.777648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.778417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.924187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.935604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.944370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df64de0f-2eec-42d8-98f5-0383e800bad1 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.613996 Oct 18 13:47:38.944561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.944968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2553/4970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:38 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:38.954666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.966804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:38.969275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98cbe2a1-7aca-47e3-9423-bd010b6f9888 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1574 microversion: 2.42 time: 0.212775 Oct 18 13:47:38.979368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.983034 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2418/4971] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:38 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:47:38.997828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:38.998352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.998842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.999078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.000146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:39.000352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.010719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.011774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.012459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.013423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.014611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.015249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.025926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.026544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.041921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:39.051192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'unpause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 15 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: {"unpause": {}} Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'unpause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'unpause': {}}} Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state active. Cannot unpause while the instance is in this state. Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:39.053229 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:39.059941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:39.059941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:39.059941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:39.059941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:39.059941 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:39.063902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'unpause' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:39.065070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e12226e-bfc3-4ad1-94f4-424663edb6da tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 145 microversion: 2.1 time: 0.080189 Oct 18 13:47:39.070918 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2419/4972] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:38 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:47:39.082380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:39.083016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:39.095739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.096254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.098942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.099664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.100145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.100608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.363920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:39.388893 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6afdbbd4-1fb9-4da6-a6d7-23cfecf8be3c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.442804 Oct 18 13:47:39.389652 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2554/4973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:38 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:39.411817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:39.420338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-833fb231-cf5f-4f27-8bb9-9a7297758746 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.348262 Oct 18 13:47:39.434666 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2420/4974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:39 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:39.454548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:39.455888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:39.463622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.464616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.465958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.467425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.468324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.469481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.742460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:39.742460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:39.756656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.757174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.757636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.758478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.758963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.759501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.128632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:40.139456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bee940b5-2250-45f1-8f00-68a53a60cd7f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.696448 Oct 18 13:47:40.141091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2555/4975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:39 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:40.147569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:40.148204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:40.180911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:40.191059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.193419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1840286b-4956-4de0-91c6-f990df054441 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.460416 Oct 18 13:47:40.196744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2421/4976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:39 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:40.199621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.201823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.205575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:40.207333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.209096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.210947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: a5de589f-c57d-48bd-b155-3d92510e8774] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:40.214738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.227765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/a5de589f-c57d-48bd-b155-3d92510e8774/action HTTP/1.1 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 18 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: {"unshelve": null} Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'a5de589f-c57d-48bd-b155-3d92510e8774', 'body': {'unshelve': None}} Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:40.229863 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. Oct 18 13:47:40.243693 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:40.245457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance a5de589f-c57d-48bd-b155-3d92510e8774 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:40.246562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bac72658-d116-48bb-a70d-5f09e8b5b5b9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/a5de589f-c57d-48bd-b155-3d92510e8774/action" status: 404 len: 111 microversion: 2.1 time: 0.048547 Oct 18 13:47:40.249024 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2422/4977] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:40 2022] POST /compute/v2.1/servers/a5de589f-c57d-48bd-b155-3d92510e8774/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:40.260722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:40.262823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:40.275703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.278903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.286828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.289987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.289987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.289987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.513297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:40.536065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:40.537983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:40.539453 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e420bd8f-8bcb-4549-9a89-fd1d8e22d715 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1592 microversion: 2.42 time: 0.397339 Oct 18 13:47:40.540223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2556/4978] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:40 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1592 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:40.547541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:40.559144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:40.569654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.570478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.571166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.572076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.572722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.573356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.586015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:41.023510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.033722 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-adb06e40-f3aa-42ca-ae3e-49e934cbdeae tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.776959 Oct 18 13:47:41.051733 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2423/4979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:40 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:41.069547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:41.072962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.085733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.086289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.091833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.092424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.096817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.097396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.247543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.263202 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b82fd066-86dc-405d-a9a0-111ed5b5fe4f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.721699 Oct 18 13:47:41.263808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2557/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:40 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:41.272822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:41.281729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.291145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.291145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.291145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.300957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.301493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.301873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.526100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:41.646072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.665235 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb9c8830-b4d9-4ec0-b853-526396001a24 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.400161 Oct 18 13:47:41.675292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2558/4981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:41 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:41.683788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:41.684480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.707901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.708408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.708860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.709580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.717317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.724417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.725999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.731104 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc484223-b814-4817-a5dc-cdd526e8e80a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.665088 Oct 18 13:47:41.746245 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2424/4982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:41 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:41.760713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:41.761337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.789062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.789898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.795496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.797505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.798037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.798516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.912356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Cannot 'unshelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action HTTP/1.1 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 18 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: {"unshelve": null} Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'unshelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'unshelve': None}} Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 in vm_state active. Cannot unshelve while the instance is in this state. Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:47:41.914027 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 409 to user: Cannot 'unshelve' instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 while it is in vm_state active {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:41.920303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cdfd758-da33-4b9d-870d-824a8b78d900 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action" status: 409 len: 146 microversion: 2.1 time: 0.159270 Oct 18 13:47:41.926516 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2425/4983] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:41 2022] POST /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317/action => generated 146 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:47:41.941437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:41.942785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.963752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.964000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.964352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.965103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.965601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.966046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.174806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:42.187474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:42.192072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:42.204881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b3ef651-daa6-4749-b315-910f01b6c0f5 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1659 microversion: 2.42 time: 0.528363 Oct 18 13:47:42.210983 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2559/4984] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:41 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1659 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:42.293354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:42.294173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:42.308447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.312595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.312595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.312595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.312595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.312595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.883101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:42.903883 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a34f598-7df7-4479-928e-a8a2e39573d0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1523 microversion: 2.1 time: 0.611823 Oct 18 13:47:42.905100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2560/4985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:42 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:42.935936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:42.937651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:42.963486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.964008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.964471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.965209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.965682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.966154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.991913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.000871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68abfda5-b242-4a05-8479-b5a60c490194 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 1.073123 Oct 18 13:47:43.008913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2426/4986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:41 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:43.014201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d967e531-28fc-400f-8e96-cce782e5b253", "name": "network-vif-plugged", "status": "completed", "tag": "bb9e38b4-5ee7-46dc-9297-1d5873d7a882"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:43.043135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.043637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.044820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.058510 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] Creating event network-vif-plugged:bb9e38b4-5ee7-46dc-9297-1d5873d7a882 for instance d967e531-28fc-400f-8e96-cce782e5b253 on n-h1-858383-13 Oct 18 13:47:43.065747 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d0d50b24-319f-425b-96a3-65a0042aa4a6 req-1d99e2f1-87f8-4f21-acf8-baefbaa1d0be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055024 Oct 18 13:47:43.069589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2427/4987] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:43.077355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:43.100239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:43.100239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.100239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.100239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.100999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.101576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.102336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.252313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.289986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-520a17d3-8e33-425b-bde0-3c21f023a074 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.382845 Oct 18 13:47:43.291474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2561/4988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:42 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:43.303834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:43.316920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:43.319522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.320312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.321027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.322022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.330115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.331039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.541661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.558673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-675e512c-adce-4ff3-8045-d0ed8d481b92 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.485751 Oct 18 13:47:43.579109 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2428/4989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:43.587402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1507946675_updated"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:43.591368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: cdf29aba-11d7-4a6a-915b-6273de475dde] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:43.604168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/servers/cdf29aba-11d7-4a6a-915b-6273de475dde HTTP/1.1 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 81 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1507946675_updated"}} Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'cdf29aba-11d7-4a6a-915b-6273de475dde', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1507946675_updated'}}} Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 13:47:43.608532 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance cdf29aba-11d7-4a6a-915b-6273de475dde could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2751959-f92b-4da8-864b-551b12b70877 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "PUT /compute/v2.1/servers/cdf29aba-11d7-4a6a-915b-6273de475dde" status: 404 len: 111 microversion: 2.1 time: 0.028675 Oct 18 13:47:43.620917 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2429/4990] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:47:43 2022] PUT /compute/v2.1/servers/cdf29aba-11d7-4a6a-915b-6273de475dde => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:43.631092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:43.634243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:43.650536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.651051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.651513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.652241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.652720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.653163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.952164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.966726 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9bcb30b-a401-4980-8d19-c9772364a5a9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.345140 Oct 18 13:47:43.971904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2430/4991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:43 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:43.983071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:43.986779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.006877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.008133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.008789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.009989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.010665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.011301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.371858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.403594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.405086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.408191 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c2de9e4-39cf-4fc8-bbe1-6ea744d7325f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1659 microversion: 2.42 time: 1.114697 Oct 18 13:47:44.409965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2562/4992] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:43 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1659 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:44.421887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:44.423130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.439458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.445608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.447570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.452164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.452164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.452164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.550409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.562758 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec6ab5d0-3d41-484f-a136-f7a99208c690 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1503 microversion: 2.1 time: 0.588746 Oct 18 13:47:44.582519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2431/4993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:43 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:44.592314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:44.594953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.601694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.602525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.603262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.604252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.604899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.605606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.872737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.881721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab71b30e-aa19-47cb-8b7d-b8ca76fe55c9 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.469312 Oct 18 13:47:44.890494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2563/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:44 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:44.895520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:44.896143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.917010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.917526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.918137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.918862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.923535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.924491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.003980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:45.068131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:45.084017 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0f9448c-5b9b-4b84-a85e-1b4a3ebebb05 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1315 microversion: 2.1 time: 0.499751 Oct 18 13:47:45.098106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2432/4995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:44 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:45.098106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c0d7f12-231e-45c1-94d5-69036e1a2573 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c0d7f12-231e-45c1-94d5-69036e1a2573 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: request: PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 HTTP/1.1 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 280 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.106291 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c0d7f12-231e-45c1-94d5-69036e1a2573 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c0d7f12-231e-45c1-94d5-69036e1a2573 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 400 len: 619 microversion: 2.1 time: 0.017410 Oct 18 13:47:45.111158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2433/4996] 10.222.0.27 () {60 vars in 1257 bytes} [Tue Oct 18 13:47:45 2022] PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:47:45.133033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:45.134440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.165950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.166667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.167325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.169907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.170612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.171775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.330256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:45.348940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f45a60a-1f47-4ecd-8ca9-3cc04ad40076 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1516 microversion: 2.1 time: 0.456794 Oct 18 13:47:45.350031 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2564/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:44 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:45.384245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:45.391950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 4a1b4407-cb44-4163-a2bf-c1a03128c62b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.401184 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/4a1b4407-cb44-4163-a2bf-c1a03128c62b/action HTTP/1.1 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 14 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: {"rescue": {}} Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '4a1b4407-cb44-4163-a2bf-c1a03128c62b', 'body': {'rescue': {}}} Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.423896 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 404 to user: Instance 4a1b4407-cb44-4163-a2bf-c1a03128c62b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6b4ecc0-b33d-42a6-bbc9-7de6376e3a91 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/4a1b4407-cb44-4163-a2bf-c1a03128c62b/action" status: 404 len: 111 microversion: 2.1 time: 0.047678 Oct 18 13:47:45.434531 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2565/4998] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:45 2022] POST /compute/v2.1/servers/4a1b4407-cb44-4163-a2bf-c1a03128c62b/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:47:45.437407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:45.437806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.455663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.461154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.466808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.467816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.469182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.469937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.847775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00c3038c-922a-4a03-9a0a-aadf484ce340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action" status: 202 len: 0 microversion: 2.1 time: 0.408994 Oct 18 13:47:45.851775 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2566/4999] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:45 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:45.857075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:45.863216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.876323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.887944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.887944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.887944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.887944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.887944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:46.220347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:46.418900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:46.451999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:46.470338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:46.472562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2b6c01c-d02e-404b-8543-86a4567c3856 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1705 microversion: 2.42 time: 0.620815 Oct 18 13:47:46.473210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2567/5000] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:45 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1705 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:46.480044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:46.488314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:46.501257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:46.502236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:46.502952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:46.503946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:46.504693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:46.505443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:46.930028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:46.947002 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68d9d3a9-65e7-43e2-883e-fd0de69a453c tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 1.819361 Oct 18 13:47:46.956132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2434/5001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:45 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:46.984186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:46.991716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:47.014958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:47.028024 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b74cf8e1-cc02-46a6-bc5c-35f83d1cc20e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1501 microversion: 2.1 time: 0.553455 Oct 18 13:47:47.035590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.036547 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2568/5002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:46 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1501 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:47.043853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.048318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.049917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.052864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.062621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.073131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:47.076453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:47.118874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.121899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.127654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.128543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.129026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.129714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.514151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:47.532690 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a5f7b0a-b1c3-4233-9db3-c6f662fb4d4e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.480891 Oct 18 13:47:47.546286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2569/5003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:47 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:47.569507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:47.577040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:47.597440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.598322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.599235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.602806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.604952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.605601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.681480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'flavor' on Instance uuid 693e4bf5-4eb5-417a-90c3-f22935c71976 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:47.699930 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Cannot 'rescue' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state paused Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action HTTP/1.1 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 14 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: {"rescue": {}} Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'rescue' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state paused Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '693e4bf5-4eb5-417a-90c3-f22935c71976', 'body': {'rescue': {}}} Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 in vm_state paused. Cannot rescue while the instance is in this state. Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state paused Oct 18 13:47:47.701934 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state paused Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 409 to user: Cannot 'rescue' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state paused {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab88b228-9d16-4524-beb4-c6d03b5503e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action" status: 409 len: 144 microversion: 2.1 time: 0.139274 Oct 18 13:47:47.709860 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2570/5004] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:47 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action => generated 144 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:47:47.713944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:47.714619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:47.721224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.721738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.722218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.722951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:47.723462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:47.723898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.003080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:48.017265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:48.026183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:48.030329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc9f4e23-875c-4b81-9e8a-420ad0635618 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1705 microversion: 2.42 time: 0.318151 Oct 18 13:47:48.031543 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2571/5005] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:47 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1705 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:48.043778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7285e0f-44db-480c-91a6-b3823864dd78 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7285e0f-44db-480c-91a6-b3823864dd78 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: request: PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 HTTP/1.1 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 24 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": ""}} Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317', 'body': {'server': {'name': ''}}} Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:47:48.050227 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:47:48.056683 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:48.064680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7285e0f-44db-480c-91a6-b3823864dd78 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:48.065859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7285e0f-44db-480c-91a6-b3823864dd78 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 400 len: 108 microversion: 2.1 time: 0.031189 Oct 18 13:47:48.066724 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2572/5006] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:47:48 2022] PUT /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:47:48.066977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:48.079065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:48.079935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:48.081131 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc176877-0dda-4cac-8ae0-3d4f90879abf tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1465 microversion: 2.1 time: 1.123563 Oct 18 13:47:48.081735 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2435/5007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:46 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1465 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:48.090402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:48.093606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.119916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.160009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.160009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.160009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.164312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.170887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.171516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.419590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:48.568476 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f5f8856-6a6c-4ebd-8f91-479fc7a5374a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action" status: 202 len: 0 microversion: 2.1 time: 0.495435 Oct 18 13:47:48.569822 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2573/5008] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:48 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:48.581198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:48.587991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:48.594868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.595426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.595960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.596718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.597188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.597697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.671812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:47:48.910834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:48.954369 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f25c16bc-f49a-44fd-bfca-24d9a2e3680a tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1505 microversion: 2.1 time: 0.844706 Oct 18 13:47:48.954369 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2436/5009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:48 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1505 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:48.970150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:48.970799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:48.980202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.980819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.981200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.981944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.984260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.992030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.351041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-92f34183-bb3b-4fb1-897e-0614503f17a7 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 204 len: 0 microversion: 2.1 time: 0.778267 Oct 18 13:47:49.362120 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2574/5010] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:47:48 2022] DELETE /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:47:49.393674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:49.394774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:49.418995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:49.419700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:49.421594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.422577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:49.423226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:49.423886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.644909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.654746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.659151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.669647 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cf21f18-c8b5-4cbb-8123-57dde20284f1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1705 microversion: 2.42 time: 0.289695 Oct 18 13:47:49.674539 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2575/5011] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:49 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1705 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:49.686310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:49.686985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:49.698227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:49.698227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:49.698227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.699927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:49.699927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:49.700217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.700833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.710663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1484825-07ae-4c6e-899f-4bb21b2a39fc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1508 microversion: 2.1 time: 0.755513 Oct 18 13:47:49.711262 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2437/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:48 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:49.965230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.977439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6130a19-00df-49a9-b1fa-885b6f647c03 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1471 microversion: 2.1 time: 0.301537 Oct 18 13:47:49.995794 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2576/5013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:49 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:50.694383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:50.695207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:50.718926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.719742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.720471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.721683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.722468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.723130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.751007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:50.751978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:50.802001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.807321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.807321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.807321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.807321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.822326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:51.365939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.381375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-762d6c03-d761-422e-8500-80226b009932 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1516 microversion: 2.1 time: 0.644148 Oct 18 13:47:51.382693 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2577/5014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:50 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1516 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:51.386130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.392915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:51.394476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:51.403898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:51.406619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:51.406619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:51.406989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:51.407695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:51.408433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:51.460765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.482284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.489879 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15f1e9a0-3af0-42f6-adc8-68675252c98a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1751 microversion: 2.42 time: 0.800920 Oct 18 13:47:51.526420 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2438/5015] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:50 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1751 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:51.831635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.859098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cab5cab9-982d-49ed-b5fb-cec5ad116419 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1471 microversion: 2.1 time: 0.474704 Oct 18 13:47:51.874085 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2578/5016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:51 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:52.533018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:52.534716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:52.557118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.557948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.559381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.573056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.573056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.573056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.579914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d967e531-28fc-400f-8e96-cce782e5b253", "name": "network-vif-deleted", "tag": "bb9e38b4-5ee7-46dc-9297-1d5873d7a882"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:52.602369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.603574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.613211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.638319 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] Creating event network-vif-deleted:bb9e38b4-5ee7-46dc-9297-1d5873d7a882 for instance d967e531-28fc-400f-8e96-cce782e5b253 on n-h1-858383-13 Oct 18 13:47:52.708588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-74fdab08-3671-4b02-97eb-c416685e86c3 req-1d810a11-46bb-4675-b31c-097f876be1fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132055 Oct 18 13:47:52.710411 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2579/5017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:47:52.892193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:52.893976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:52.947426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.947988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.955019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.961820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.962601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.967592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:53.163826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:53.176526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e00e234-e155-4470-a807-a008aa31b058 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1300 microversion: 2.1 time: 0.291359 Oct 18 13:47:53.177294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2580/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:52 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:53.963843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:53.983229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:53.994805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:53.996738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7fdbd9d3-aaf2-41b5-be61-61639927a052 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1751 microversion: 2.42 time: 1.469391 Oct 18 13:47:54.000324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2439/5019] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:52 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1751 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:54.206688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:54.207393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:54.224688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.224688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.224919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.225533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.226008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.226474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.348874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.349391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.354347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.354894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lazy-loading 'fault' on Instance uuid d967e531-28fc-400f-8e96-cce782e5b253 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:54.714634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3b398d488848fd83dc89a187f6f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb53c0efe184e22924ac20e3b33934b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:54.731399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95b69aef-0654-41dc-a8b8-5a9868090935 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 200 len: 1305 microversion: 2.1 time: 0.529240 Oct 18 13:47:54.738390 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2581/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:54 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 1305 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:55.035263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:55.045993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:55.078669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.078669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.079092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.080106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.081793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.082463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.231338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:55.765786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:55.767135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] [instance: d967e531-28fc-400f-8e96-cce782e5b253] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:55.793007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.799216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.803058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.803865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.804859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.807115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.841257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:55.867335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:55.873463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:55.878333 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f7a2028-4c1a-473f-920a-c4c3a1e4b368 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1797 microversion: 2.42 time: 0.854320 Oct 18 13:47:55.878675 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] HTTP exception thrown: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. Oct 18 13:47:55.879462 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2440/5021] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:55 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1797 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Request method failure captured: Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 HTTP/1.1 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq5lzs-vpWrbO-gq3Q3Pw3ThJSRvPMa6UzpDNjveoDDKqdPoPX479L7Z2uPVxhBcFRKVFk6LkSakVrNNZpGEIEg-bGgbAF9IRL9tYRnNlJROB6ttF4i-LiV1J3mbIgJ-8jH5HLmZ478JTU4W8z8dvFzsyqtInU0I6Lcm77CHsVjbUvw Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6cb53c0efe184e22924ac20e3b33934b Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-739484012 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cb53c0efe184e22924ac20e3b33934b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6cb53c0efe184e22924ac20e3b33934b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6cb53c0efe184e22924ac20e3b33934b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6cb53c0efe184e22924ac20e3b33934b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-739484012 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6cb53c0efe184e22924ac20e3b33934b Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-739484012 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-739484012-project Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 2c3b398d488848fd83dc89a187f6f393 Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-739484012-project Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'd967e531-28fc-400f-8e96-cce782e5b253'} Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:55.885760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] Returning 404 to user: Instance d967e531-28fc-400f-8e96-cce782e5b253 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:55.891411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87abd28d-b079-440b-9490-606ee3259404 tempest-VolumesNegativeTest-739484012 tempest-VolumesNegativeTest-739484012-project] 10.222.0.27 "GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253" status: 404 len: 111 microversion: 2.1 time: 0.128189 Oct 18 13:47:55.909873 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2582/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:55 2022] GET /compute/v2.1/servers/d967e531-28fc-400f-8e96-cce782e5b253 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:56.816018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:56.819271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:56.834005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.835080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.835816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.838339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.854632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.855382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.919942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:56.920588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:56.951594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.965036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.965976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.969715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.970454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.971287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.989545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'flavor' on Instance uuid 693e4bf5-4eb5-417a-90c3-f22935c71976 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:57.494085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32861b52-d515-498c-aadc-a80892197632 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action" status: 200 len: 32 microversion: 2.1 time: 0.682637 Oct 18 13:47:57.500142 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2441/5023] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:56 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action => generated 32 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:47:57.518486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:57.519146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:57.546243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.551263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.554592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:57.555418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.555915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.556366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:58.201073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:58.212460 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88436d38-4698-4ad3-969b-5c3c9613b551 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.710396 Oct 18 13:47:58.219843 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2442/5024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:57 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:58.927066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:58.972812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:58.978444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:58.985207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f51c382-25da-4d1e-b38d-9b0f8f2b870f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1797 microversion: 2.42 time: 2.069077 Oct 18 13:47:58.988029 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2583/5025] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:47:56 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1797 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:47:59.236890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:59.238084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:59.246857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.255126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.256386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:59.261332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.262817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.263824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:59.876415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:59.897551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5affd49-cf81-4c2e-a632-83c55216c7e2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.662802 Oct 18 13:47:59.900166 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2443/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:59 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:00.021644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:00.022521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:00.067637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.068155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.068607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.069336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.069802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.070255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.831208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:00.892027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:00.902666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:00.902666 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84e1f9ac-5d13-4740-b55b-2032f6f93e71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1843 microversion: 2.42 time: 0.886463 Oct 18 13:48:00.902666 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2584/5027] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:00 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1843 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:00.930934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:00.931833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:00.950398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.951533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.955647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.964399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.965574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "0e554e48-ada4-49d5-961d-2ddcc1728ebe"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:00.969305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.971539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.019703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.021424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.024327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.088547 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] Creating event network-changed:0e554e48-ada4-49d5-961d-2ddcc1728ebe for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:01.102373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5e17d93a-a3e1-4727-9b50-3619b2950a4d req-09d9ca42-1d32-4ab0-b2c4-cad866c6136a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143147 Oct 18 13:48:01.103636 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2585/5028] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:01.389259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:01.396143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:01.420335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.426311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.427050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.427989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.430890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.434172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.496315 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d HTTP/1.1 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '31dc009b-a8cf-4222-a045-c71b6bed556d'} Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:01.504537 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.509709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:01.511882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0da4a99e-987d-4289-b142-ea90b9d9ffff tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 404 len: 111 microversion: 2.1 time: 0.124299 Oct 18 13:48:01.512309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2586/5029] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:01 2022] DELETE /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:01.534871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:01.540464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 31dc009b-a8cf-4222-a045-c71b6bed556d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:01.575652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.576187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.576653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.577428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.577904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.578420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.604114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d HTTP/1.1 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '31dc009b-a8cf-4222-a045-c71b6bed556d'} Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:01.610758 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 31dc009b-a8cf-4222-a045-c71b6bed556d could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81a8d9ad-58f8-48b8-b983-546e3666217f tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d" status: 404 len: 111 microversion: 2.1 time: 0.087757 Oct 18 13:48:01.618474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2587/5030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:01 2022] GET /compute/v2.1/servers/31dc009b-a8cf-4222-a045-c71b6bed556d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:01.625144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:01.625824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:01.652487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.657173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.660315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.661090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.662097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.662097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.751796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:48:02.161584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa000cbf-1672-4972-9ba1-f5b69452fd63 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 204 len: 0 microversion: 2.1 time: 0.542404 Oct 18 13:48:02.162682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2588/5031] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:01 2022] DELETE /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:48:02.170891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:02.173498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:02.194726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.195245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.198856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.203238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.205656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.206202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.821832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:02.837955 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c73a782-8a76-4296-9773-e359d724a486 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.912015 Oct 18 13:48:02.840113 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2444/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:00 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:02.854411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:02.857821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:02.876962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.878269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.879525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.881432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.883100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.883621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.954283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:02.992715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.006857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.008166 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-081083d4-49fc-4584-826c-cb857f57b465 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1843 microversion: 2.42 time: 0.843893 Oct 18 13:48:03.027252 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2589/5033] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:02 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1843 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:03.423041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.435603 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83c736da-443a-4f76-b425-f1de50d93469 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 0.591571 Oct 18 13:48:03.452759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2445/5034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:02 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:03.867930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:03.869484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:03.881398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.882267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.882990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.883996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.884671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.885376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.892487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:04.037464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:04.038233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:04.051962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.056582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.056582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:04.056582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.056582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.056582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:05.382764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:05.395199 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa620222-65a0-4e4c-b3a9-3a0099724907 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.531930 Oct 18 13:48:05.396060 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2590/5035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:03 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:05.432096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:05.434711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:05.449780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:05.451036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:05.456406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:05.456406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:05.456965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:05.457680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:05.657483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:05.723305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:05.741465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:05.749193 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2fe259d8-2c56-456b-8e55-484666d9fda8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1864 microversion: 2.42 time: 1.715720 Oct 18 13:48:05.773408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2446/5036] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:04 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1864 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:06.423009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:06.423009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:06.433362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:06.456450 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46c6617a-5474-492e-bb38-f09206dfbf99 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1511 microversion: 2.1 time: 1.054883 Oct 18 13:48:06.459341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.460117 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2591/5037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:05 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1511 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:06.461458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.464849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:06.465917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.466761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.477773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:06.804212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:06.805046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:06.808152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:06.823980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.824947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.827130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:06.829018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.830032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.830752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:07.953253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:07.968032 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d27f437e-14e6-4687-8e0f-656ed6fa70e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.552016 Oct 18 13:48:07.970771 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2447/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:06 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:07.975094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:07.975931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:07.983785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=76 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:07.985637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:07.986367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:07.987084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:07.989386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:07.990182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:07.991586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:08.326552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:08.333866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:08.345808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:08.348030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46ff34e1-a2c6-43ef-99ec-deead37106c6 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1469 microversion: 2.1 time: 0.376759 Oct 18 13:48:08.349608 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2448/5039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:07 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1469 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:08.353202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:08.354868 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61e808b0-6ea0-42d5-bc24-46693bb61b34 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1864 microversion: 2.42 time: 1.557422 Oct 18 13:48:08.359226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:08.378988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2592/5040] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:06 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1864 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:08.387649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:08.389744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:08.390337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:08.455591 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] Creating event network-changed:f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:08.480622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e2054bfb-48b4-4d0b-94a9-5ff401015ca1 req-04cfba74-ca8a-4474-92d3-8a3cc1abf4aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123558 Oct 18 13:48:08.483902 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2449/5041] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:09.019094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:09.024355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:09.034196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.035846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.036848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.037849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.038804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.039637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.386333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:09.389809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:09.412922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.414743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.420307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.424063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.424876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.426539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.542670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.550867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.557524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.558097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lazy-loading 'fault' on Instance uuid 07c26fbf-017d-4ad0-9aed-9fea80c44317 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:09.687237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c668c2b2f43798ab247029a8386e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afceb9a2a5b41cb8a7e59f036f57422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:09.699695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77c310da-6593-481a-9d4f-70d9fdc50b74 tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 200 len: 1307 microversion: 2.1 time: 0.328533 Oct 18 13:48:09.705937 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2450/5042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:09 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:09.726517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:09.732459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:09.746581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.747370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.747981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.749262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:09.749896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:09.750558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.028961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:10.062255 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-318c76a7-49e8-4173-a945-6c2df4f7f93f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.068846 Oct 18 13:48:10.070132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2593/5043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:08 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:10.525319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c26fbf-017d-4ad0-9aed-9fea80c44317", "name": "network-vif-deleted", "tag": "a6e3a070-9205-47e8-a7b7-d6903d14f62e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:10.547689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:10.553147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:10.554092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:10.560940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.568624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:10.570101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:10.571300 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-78915032-4cad-422d-86ec-5b44527e6aca tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1864 microversion: 2.42 time: 0.848788 Oct 18 13:48:10.586536 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2451/5044] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:09 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1864 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:10.607353 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] Creating event network-vif-deleted:a6e3a070-9205-47e8-a7b7-d6903d14f62e for instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 on n-h1-858383-13 Oct 18 13:48:10.635516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7680544e-a9be-47b7-941f-b24250afae46 req-8c1caada-1d5a-42d3-b8f1-a76cecac67bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113641 Oct 18 13:48:10.636169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2594/5045] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:10.728952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:10.729751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] [instance: 07c26fbf-017d-4ad0-9aed-9fea80c44317] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:10.745088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:10.745088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:10.745275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.746138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:10.746699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:10.754746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.784995 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] HTTP exception thrown: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Request method failure captured: Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 HTTP/1.1 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq2OEmT83CGOZrm5jWuwYEmZpGR1zcxmW7vTsWVUZxxixhVY8CRzPIGNVcuvjC73CHoe9eYREwql1xNLudnoJ1lEychY2L3bJFUP9zjQWmGKrm627vGjx3DrRSNF23Y2Qd4yAoducF0yJeYZhqG-rk1XxmyncC8nQVvEZd3USMaF81s Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0afceb9a2a5b41cb8a7e59f036f57422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 0afceb9a2a5b41cb8a7e59f036f57422 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151136805 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d50c668c2b2f43798ab247029a8386e5 Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-151136805-project Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '07c26fbf-017d-4ad0-9aed-9fea80c44317'} Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:10.785356 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] Returning 404 to user: Instance 07c26fbf-017d-4ad0-9aed-9fea80c44317 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a488dd9-bf96-4739-a869-59213d275a2e tempest-ServersNegativeTestJSON-151136805 tempest-ServersNegativeTestJSON-151136805-project] 10.222.0.27 "GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317" status: 404 len: 111 microversion: 2.1 time: 0.061799 Oct 18 13:48:10.790030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2452/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:10 2022] GET /compute/v2.1/servers/07c26fbf-017d-4ad0-9aed-9fea80c44317 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:11.094863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:11.096427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:11.124139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.125094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.125787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:11.126987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.128052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.133292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:11.605378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:11.606786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:11.624933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.624933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.624933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:11.624933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.625825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.627065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:11.754597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:11.766422 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e825e908-0b1c-4cd9-8285-6e3402e1b9a5 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.677140 Oct 18 13:48:11.769303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2595/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:11 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:12.642010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:12.682549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:12.692783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:12.704701 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bf9d62a-c8a1-4ea1-be13-aabb08a2a9cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1885 microversion: 2.42 time: 1.102076 Oct 18 13:48:12.726180 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2453/5048] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:11 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1885 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:12.798403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:12.799067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:12.832358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:12.832954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:12.833426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:12.836377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:12.838936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:12.845641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:13.452513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:13.468141 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-30b2f63c-2d35-47f3-a505-3e4dc224263b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.673098 Oct 18 13:48:13.470653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2596/5049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:12 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:13.769016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:13.769883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:13.779050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:13.780816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:13.782927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:13.784472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:13.786163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:13.786972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:14.010020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "8e22e8f7-5a5d-4467-8094-8f320789781e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:14.043525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:14.043525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:14.043525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:14.060315 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] Creating event network-changed:8e22e8f7-5a5d-4467-8094-8f320789781e for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:14.070884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ef7b9e49-e07b-4899-afe5-d84496f34ed5 req-a51cea97-8dcd-4bbe-8289-8ecfd60ffc51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066214 Oct 18 13:48:14.076076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2597/5050] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:14.495756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:14.497122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:14.536121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:14.541606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:14.549204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:14.559480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:14.562369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:14.568373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:15.175589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:15.185610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:15.201242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:15.206554 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-67b4daf0-1cf5-4b1c-92aa-76dfabfcb170 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1885 microversion: 2.42 time: 1.447555 Oct 18 13:48:15.209112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2454/5051] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:13 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1885 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:15.226945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:15.254231 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63f06a7d-b898-4105-bfa3-0e54df57658c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.749236 Oct 18 13:48:15.255318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2598/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:14 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:16.251630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:16.260142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:16.284040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:16.284839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:16.286300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:16.291612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:16.293375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:16.299312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:16.306369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:16.306369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:16.306683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:16.306683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:16.306683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:16.307329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:16.315056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:16.315776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:16.895359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:16.914224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:16.923301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:16.925520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:16.927170 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b56dfc75-24b5-4735-bbe6-a2fca0f662a4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1885 microversion: 2.42 time: 0.689484 Oct 18 13:48:16.936775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c38e5b7-2bda-4f4b-8933-5701006830b7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.658480 Oct 18 13:48:16.939719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2599/5053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:16 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:16.955041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2455/5054] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:16 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1885 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:17.973497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:17.974014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:17.976856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:17.977664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:18.002958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.003480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.003948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.004674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.006133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.006578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.008400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.019567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.020456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.020562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.020562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.020724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.046645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:18.471198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:18.497870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:18.504094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:18.509265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27e8da6c-0bae-4856-8626-47a2940e4bfa tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.546278 Oct 18 13:48:18.514739 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2600/5055] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:17 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:18.607460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "fe2f25a5-5cfb-4924-aec8-35d88168e3a1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:18.643554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.643554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.643554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.656936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] Creating event network-changed:fe2f25a5-5cfb-4924-aec8-35d88168e3a1 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:18.663950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-aafbc7b4-1ccd-4538-bcd5-ec1f6376ecbd req-e0df2356-7f9c-4ea0-800d-8bf59a9c91f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060852 Oct 18 13:48:18.665071 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2601/5056] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:19.369313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:19.426312 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea217670-6094-4429-aea2-0bc199aef3a2 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.462695 Oct 18 13:48:19.440468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2456/5057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:17 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:19.537878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:19.539337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:19.559145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:19.559145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:19.559381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:19.565719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:19.566816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:19.571174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:19.886955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:19.905890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:19.907385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:19.908929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c093803a-e264-4881-8e02-dc12efea362c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.375802 Oct 18 13:48:19.911893 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2602/5058] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:19 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:20.468149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:20.469956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:20.483885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.484814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.488236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.489229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.489916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.492157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.942798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:20.944473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:20.956663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.969663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.975150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.976113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.977537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.980759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.241132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.262706 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4388e75f-8488-4cc9-a684-11fc02b280da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1502 microversion: 2.1 time: 0.799183 Oct 18 13:48:21.264214 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2457/5059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:20 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1502 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:21.295087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b18db818-4aba-4b3a-a56b-0a6dd92ecd84"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:21.299005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:21.312356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.362752 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Cannot 'attach_volume' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state rescued Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/os-volume_attachments HTTP/1.1 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 74 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: {"volumeAttachment": {"volumeId": "b18db818-4aba-4b3a-a56b-0a6dd92ecd84"}} Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'attach_volume' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state rescued Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': '693e4bf5-4eb5-417a-90c3-f22935c71976', 'body': {'volumeAttachment': {'volumeId': 'b18db818-4aba-4b3a-a56b-0a6dd92ecd84'}}} Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 18 13:48:21.365048 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state rescued Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state rescued Oct 18 13:48:21.369859 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:48:21.375043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 409 to user: Cannot 'attach_volume' instance 693e4bf5-4eb5-417a-90c3-f22935c71976 while it is in vm_state rescued {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:21.377271 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-928f69b6-a07c-4da2-93f6-a461f31c8e3d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087621 Oct 18 13:48:21.380316 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2458/5060] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:48:21 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:48:21.390426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:21.400436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:21.400436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.400436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.400436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.401344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.402120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.402955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.407866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.426683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.432545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.433137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-975d8d8e-c612-4589-b22f-67d558cf49e6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.496467 Oct 18 13:48:21.434634 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2603/5061] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:20 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:21.674711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59d3b9b0-eb5f-4956-a3e0-e8fcceadf6f6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action" status: 202 len: 0 microversion: 2.1 time: 0.288856 Oct 18 13:48:21.676641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2459/5062] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:48:21 2022] POST /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:48:21.686797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:21.699013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:21.719532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.720614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.721312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.722381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.723183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.730805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:22.491434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:22.492377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:22.516472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:22.517283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:22.518015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:22.519805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:22.520488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:22.522573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:22.878071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:22.885692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0c7022a-0b65-46b2-b82e-0453d483c1e3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1510 microversion: 2.1 time: 1.204886 Oct 18 13:48:22.886840 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2604/5063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:21 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1510 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:22.908083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "16c31a93-099e-4fde-90af-e06403098c14"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:22.976099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:22.976985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:22.977658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:23.023748 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] Creating event network-changed:16c31a93-099e-4fde-90af-e06403098c14 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:23.036016 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-620367b1-46be-47dc-87bc-c0b30138faf9 req-56a61aef-3928-4fcd-9863-88b0babe0f31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147785 Oct 18 13:48:23.037034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2605/5064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:23.288112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:23.322994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:23.327931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:23.333455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-865bcfec-4c1f-4c73-9292-0d6ae7843033 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.867775 Oct 18 13:48:23.334861 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2460/5065] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:22 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:23.914930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:23.915642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:23.931773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:23.932274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:23.932725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:23.933528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:23.933991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:23.934520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.366297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:24.366921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:24.375146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.375646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.376128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.376835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.388225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.388225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.788302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:24.806790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a08a6bb-2355-4e94-a2c8-7017e4cc4686 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1510 microversion: 2.1 time: 0.890372 Oct 18 13:48:24.825674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2606/5066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:23 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:24.927870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:24.959322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:24.959322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:24.959322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46bd8fb6-cdab-4405-b8d3-f27ae6af453e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.594538 Oct 18 13:48:24.982536 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2461/5067] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:24 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:25.837798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:25.845628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:25.864365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:25.876829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:25.884235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:25.884235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:25.884235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:25.884235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:25.884698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "919992b6-961d-4b56-b221-39037094820b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:25.907373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:25.908298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:25.908804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:25.934325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] Creating event network-changed:919992b6-961d-4b56-b221-39037094820b for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:25.954844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0746b8ba-40fd-4431-aea6-60c48fab8c9c req-d648d2ed-482b-4577-9b0a-2a74463cbe9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075276 Oct 18 13:48:25.955475 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2462/5068] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:25.989078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:25.989809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:26.005984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.011879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.013545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.014580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.015278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.016042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.955810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:26.968987 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f895b410-3c6e-425d-9d6a-d53634c5526f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1510 microversion: 2.1 time: 1.136088 Oct 18 13:48:26.976932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2607/5069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:25 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1510 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:27.170640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:27.204895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:27.206401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:27.207673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f664de68-89e8-4199-9dd2-84c725176cee tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.223054 Oct 18 13:48:27.210715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2463/5070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:25 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:28.000685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:28.001317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:28.008015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.008512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.008957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.009665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.016642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.022642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.245502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:28.246620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:28.270891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.272453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.274260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.276734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.281614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.282316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.483220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:28.524108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9927adaa-c95d-4242-a440-1777f853d443 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1516 microversion: 2.1 time: 0.524151 Oct 18 13:48:28.525960 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2608/5071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:27 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:29.291951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:29.322261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:29.330748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:29.332968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c9f04a9-45dc-4c55-9842-f214386c9745 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.095247 Oct 18 13:48:29.334194 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2464/5072] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:28 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:30.083239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "39b5ec15-de28-4bcb-bb72-646633b92ed0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:30.140858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.144115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.146611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:30.184849 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] Creating event network-changed:39b5ec15-de28-4bcb-bb72-646633b92ed0 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:48:30.198477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2dde8224-0ea6-4e23-8177-151950292c0c req-d10c5e78-096a-4722-9d58-d4561463234d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136518 Oct 18 13:48:30.210035 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2609/5073] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:30.387997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:30.391047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:30.411094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.411610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.412062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:30.412994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.417664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.419855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:31.878582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:31.934531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:31.937342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:31.938699 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-120a2641-cea6-4c4d-9348-37373f03ea6c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.555858 Oct 18 13:48:31.966529 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2465/5074] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:30 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:32.985462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:32.985462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:32.993009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:32.993672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.003193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:33.004075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:33.004798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.005036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:33.021473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:33.085231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d07cb331-eec7-418b-98ab-849dee71c340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: .version_select at 0x7fb330b343a0>, body: {"keypair": {"name": "tempest-keypair-1450612589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP6hD1yJi7uQY5Y/pqNexTsKxiKsZUCIKtLmEZvIyBu+zuhIWPbn6L0Wgq4IyMIEdeoikuOd4TAIyttw/HQT8aCTbdoU4npFm5lJzXXWNcXuQXGEaEcAyDyy4J7AEimQA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:33.157988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d07cb331-eec7-418b-98ab-849dee71c340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for project 6742e113ada149739d921ce92ff153ec. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:33.180865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-d07cb331-eec7-418b-98ab-849dee71c340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for user b29dba1f338c4a3ebe1f1b4db9bc45c5 and project 6742e113ada149739d921ce92ff153ec. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:33.346410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d07cb331-eec7-418b-98ab-849dee71c340 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.264716 Oct 18 13:48:33.347782 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2466/5075] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:48:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:33.950821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-908d942c-094b-406e-baa0-0cbb899e5f60 tempest-ExtensionsTest-1235624762 tempest-ExtensionsTest-1235624762-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:33.950821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-908d942c-094b-406e-baa0-0cbb899e5f60 tempest-ExtensionsTest-1235624762 tempest-ExtensionsTest-1235624762-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.340544 Oct 18 13:48:33.950821 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2467/5076] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 18 13:48:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:33.961310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13392042-5807-4dc0-87ea-8cfeaacb193a tempest-ExtensionsTest-1235624762 tempest-ExtensionsTest-1235624762-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:33.964035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13392042-5807-4dc0-87ea-8cfeaacb193a tempest-ExtensionsTest-1235624762 tempest-ExtensionsTest-1235624762-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007830 Oct 18 13:48:33.965466 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2468/5077] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:48:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:48:34.190866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:34.204896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:34.206792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:34.208118 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2daa4641-8693-4b49-8b3f-b274723c2e45 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.233208 Oct 18 13:48:34.209198 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2610/5078] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:32 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:35.236085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:35.236967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:35.258726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.260266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.264724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:35.265987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.266802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.267480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.389449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:36.400037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:36.401490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:36.402734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0074fad7-0c95-4730-ad59-df76223bb8bb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.173491 Oct 18 13:48:36.414252 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2469/5079] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:35 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:37.431790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:37.432473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:37.435277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=38 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:37.441970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.442859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.443541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.444472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.445334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.446037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.986076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.013205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.017921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.020099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c981ab43-ffe0-4aef-a9a4-26d4676b5e3b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.592345 Oct 18 13:48:38.022950 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2611/5080] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:37 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:39.057980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:39.058871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:39.065664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:39.077314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.077764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.078871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.081903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.082853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.083567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.760630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:39.792607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1925341551", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed9aafd1-aaa1-4531-915f-bdd4ace6dd4f"}], "security_groups": [{"name": "tempest-securitygroup--348960931"}], "key_name": "tempest-keypair-1450612589", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:39.795846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:39.803286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:39.803958 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cdb32f42-6e01-4019-ad01-dc2d6e0f334b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.750884 Oct 18 13:48:39.804561 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2470/5081] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:39 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:40.150407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] validate_networks() for [('ed9aafd1-aaa1-4531-915f-bdd4ace6dd4f', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:48:40.834038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:40.835409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:40.844646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:40.858751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:40.862387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:40.862387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:40.862387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:40.862387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.299067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:48:41.300101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:48:41.300801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:48:41.301566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:48:41.302236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:48:41.316776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.318296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.319926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.321865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.322659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.323313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.361331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:41.384289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Getting quotas for user b29dba1f338c4a3ebe1f1b4db9bc45c5 and project 6742e113ada149739d921ce92ff153ec. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:41.415782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:41.433443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:41.436275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:41.443292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48189ea0-4874-4967-a2a8-1697eda74efd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.610707 Oct 18 13:48:41.445379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:48:41.447129 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2471/5082] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:40 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:41.458131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:48:41.702951 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4dc5f19-2ee8-436e-b9d2-a66fee1f8f35 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.919531 Oct 18 13:48:41.713577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2612/5083] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:48:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:48:41.716442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91de104f-0d65-4103-908c-2a131565e5a8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:41.717855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-91de104f-0d65-4103-908c-2a131565e5a8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:41.874818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91de104f-0d65-4103-908c-2a131565e5a8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:41.911763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91de104f-0d65-4103-908c-2a131565e5a8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1246 microversion: 2.1 time: 0.179635 Oct 18 13:48:41.911763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2472/5084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:41 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1246 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:42.477938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:42.478690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:42.511175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:42.516767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:42.517353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:42.524677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:42.529829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:42.530811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:42.923587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd804605-eeb4-462e-ada8-bdeda5eba722 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:42.924562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd804605-eeb4-462e-ada8-bdeda5eba722 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:43.113196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:43.126213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:43.132711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:43.136099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19ea00d7-cfad-418b-88a5-6dbabcb1208e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.664949 Oct 18 13:48:43.142851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2613/5085] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:42 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:43.176644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd804605-eeb4-462e-ada8-bdeda5eba722 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:43.189537 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd804605-eeb4-462e-ada8-bdeda5eba722 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1246 microversion: 2.1 time: 0.268239 Oct 18 13:48:43.206799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2473/5086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:42 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1246 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:44.171980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:44.173206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:44.185268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:44.189945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:44.190744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:44.193386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:44.195077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:44.195733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:44.221688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:44.221688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:44.234764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:44.235291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:44.235752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:44.236487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:44.247142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:44.248840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:44.440496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:44.507236 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2893e7e3-6906-42af-aa26-a3c1bb2f0f41 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1242 microversion: 2.1 time: 0.265299 Oct 18 13:48:44.508071 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2474/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:44 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1242 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:45.020112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:45.037925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:45.039696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:45.050827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d6299a8-0b72-4fea-9a97-ff71d55aeaec tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.885908 Oct 18 13:48:45.078764 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2614/5088] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:44 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:45.545159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:45.545789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:45.561340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:45.561849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:45.562328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:45.563041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:45.564697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:45.567508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:45.942939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:45.954394 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4abc8b10-dc7a-432f-8a93-f0e0694e0bfd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1306 microversion: 2.1 time: 0.413694 Oct 18 13:48:45.962475 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2475/5089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:45 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1306 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:46.092873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:46.095267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:46.120854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:46.126097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:46.126097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:46.126097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:46.126097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:46.126097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:46.864652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:46.885392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:46.889051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:46.892565 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97dab41d-2df2-460c-925f-e64de5f92abf tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.815778 Oct 18 13:48:46.893925 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2615/5090] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:46 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:46.993632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:46.994990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:47.017291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:47.018239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:47.018968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:47.019954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:47.020652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:47.022672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:47.317909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:47.346702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59da9c5a-d04a-436c-a2d2-094a116e4129 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1304 microversion: 2.1 time: 0.356641 Oct 18 13:48:47.357738 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2476/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:46 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:47.941198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:47.942482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:47.963817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:47.964337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:47.964808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:47.965556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:47.974449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:47.979575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:48.283024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:48.298495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:48.302856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:48.307203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-971d4b90-c583-4a03-b56c-9b88d24d4a63 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.372417 Oct 18 13:48:48.307956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2616/5092] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:47 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:48.374965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:48.376108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:48.391828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:48.392833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:48.393466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:48.394405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:48.395030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:48.395627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:48.635205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:48.640819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:48.657417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef1963e5-a4e3-479f-ac8c-2a6ebcc4df5d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1304 microversion: 2.1 time: 0.281767 Oct 18 13:48:48.677852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2477/5093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:48 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:49.336791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:49.338161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:49.351896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:49.352626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:49.353246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:49.358492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:49.361457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:49.361457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:49.689481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:49.690156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:49.731019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:49.731790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:49.733797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:49.734826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:49.738319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:49.740671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:50.590686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:50.600485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:50.605240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c030b06e-ce94-446e-b173-24934402bccb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.921488 Oct 18 13:48:50.606142 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2478/5094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:49 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:50.618400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:50.619952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:50.621395 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31238e18-eba1-4a8b-9405-293e64a6a779 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.288521 Oct 18 13:48:50.622173 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2617/5095] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:49 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:51.636157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:51.636838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:51.652293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:51.652948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:51.656229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:51.657760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:51.677149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.677763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.681143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.681933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.682458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.682914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.690169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.690710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.691156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.691943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.698259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.698259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:52.391903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:52.407610 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f76c3e45-3cf7-4560-84be-489761eb6ae4 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.776817 Oct 18 13:48:52.408661 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2479/5096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:51 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:52.769879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:52.792067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:52.794305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:52.801367 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b190597a-4b8b-4fa8-9b27-bbf5a07d6bfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.150400 Oct 18 13:48:52.801367 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2618/5097] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:51 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:53.445102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:53.456627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:53.471492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:53.475208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.476833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.491795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:53.495451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.497371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.498938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:53.826269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:53.827608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:53.836648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.837788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.839469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:53.840378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.840910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.842043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:54.151055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:54.173473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9da9ce5-d7eb-49f7-a7c1-44f1136e79b8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.739633 Oct 18 13:48:54.185665 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2480/5098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:53 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:54.222004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:54.246610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:54.248041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:54.251631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:54.261317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:54.287666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:54.294272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] Creating event network-changed:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:48:54.301809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:54.303993 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb612379-38c3-459f-be23-304c746e4809 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.483426 Oct 18 13:48:54.327404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4e94f981-92bb-45dd-ac20-c46d965d3b5a req-a912735a-53cf-4ab8-8f2f-6775c22313d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095026 Oct 18 13:48:54.327404 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2481/5099] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:54.328277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2619/5100] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:53 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:55.207052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:55.207829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:55.251581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:55.257306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:55.257590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.258384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:55.267784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:55.268260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.338662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:55.339275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:55.351201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:55.351752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:55.352203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.352927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:55.370388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:55.379753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.753849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:55.777563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:55.781798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:55.784105 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a9855dc-6b88-43d2-9e6c-e8ccb1f86c02 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.449271 Oct 18 13:48:55.801570 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2620/5101] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:55 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:48:56.822153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:56.831501 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-44384c1d-1e12-487c-ae43-3279705b8cb7 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 1.630807 Oct 18 13:48:56.832872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:56.834666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:56.837410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2482/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:55 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:56.878407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:56.881819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:56.884891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:56.887726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:56.889147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:56.892851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:57.602976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:57.627287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:57.627287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:57.628728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b43aa799-8a38-4afe-90b0-6cbb80b0e33f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.802809 Oct 18 13:48:57.629625 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2621/5103] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:56 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:48:57.861337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:57.862778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:57.878311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:57.879190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:57.879939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:57.882608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:57.883395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:57.885025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:58.249927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:58.266611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4257ad7-67c8-4d75-8f25-db7c26fd08eb tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.409834 Oct 18 13:48:58.288853 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2622/5104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:57 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:58.323199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c987460-bcaf-48a0-97fe-70683d90671f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: .version_select at 0x7fb330b8c940>, body: {"keypair": {"name": "tempest-keypair-754014266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhYdfABgKe1KJACqmU+cYtDeCTsv64jclvCNm0tEVoC7gPmya5uqDTMQRd+TymxlQMXuwRahH6OKhaA37Ewisg6XCCZFwQXmrlpjYZrlVXNWcQlOdBjdyK72Rs/UrA66A=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:58.346674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3c987460-bcaf-48a0-97fe-70683d90671f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:58.353934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3c987460-bcaf-48a0-97fe-70683d90671f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for user d3ed4523fb1d423abcf98fdb30b37b0a and project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:58.506770 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c987460-bcaf-48a0-97fe-70683d90671f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.867344 Oct 18 13:48:58.506770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2483/5105] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:48:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:58.656189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:58.656924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:58.671686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:58.672310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:58.675523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:58.676326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:58.676807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:58.677444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:58.754106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dcdd2c2b-37a3-4f15-8c10-b150a9ddc158 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: .version_select at 0x7fb3314f39d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-482659141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwSiMkRY8SZWunJMeHv6/B62WzLb7Xr8jKDdulxW7hd9tCx8lIkv6yxLJFTcnJ1WFJJsU/PjypQO8I/PAozip6N79npuLNpU9es8hX32nhwM+9499wpHArhnik8+zAWJw=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:58.821903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dcdd2c2b-37a3-4f15-8c10-b150a9ddc158 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:58.831325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-dcdd2c2b-37a3-4f15-8c10-b150a9ddc158 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:59.023337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dcdd2c2b-37a3-4f15-8c10-b150a9ddc158 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.665279 Oct 18 13:48:59.042325 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2623/5106] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:48:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:59.312954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:59.313777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:59.327822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:59.330408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:59.331828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:59.332465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:59.334898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:59.335643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:59.339172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:59.349191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:59.350317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:59.351586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a57f7f11-c366-47f9-9c59-0a5da6b2b8e9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.700910 Oct 18 13:48:59.352171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2484/5107] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:48:58 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:00.074601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:00.085986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7798821d-ce3b-4976-bd60-e50def2c4193 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.777119 Oct 18 13:49:00.087641 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2624/5108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:59 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:00.398998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:00.400593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:00.418268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:00.418809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:00.419304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:00.423008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:00.423488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:00.426506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:01.113286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:01.114613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:01.129120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:01.131296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:01.135482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:01.135872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:01.136461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:01.137567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:01.508788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:01.526584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-966406aa-d97b-4787-ac66-0e02d15a1789 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.418091 Oct 18 13:49:01.533474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2625/5109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:01 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:01.748093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:01.777201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:01.779262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:01.791206 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81b6ae12-a146-489a-bfa1-dda3135f9d42 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.397020 Oct 18 13:49:01.792198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2485/5110] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:00 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:02.564893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:02.564893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:02.571264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:02.572089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:02.572665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:02.573495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:02.574083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:02.574759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:02.821294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:02.821948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:02.844684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:02.845193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:02.845653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:02.846410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:02.846879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:02.847323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:02.963208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:02.973636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43df7c71-a26f-4b51-9c7f-dc31f9cec512 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.415787 Oct 18 13:49:02.974628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2626/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:02 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:03.421704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:03.452625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:03.466841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:03.469798 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c131147-86bc-4372-8291-ecf6ee03dc89 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.653720 Oct 18 13:49:03.487594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2486/5112] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:02 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:04.001086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:04.002225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:04.019031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:04.020006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:04.020483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:04.027361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:04.036368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:04.037410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:04.050703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=92 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:04.521648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:04.523348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:04.536977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:04.543153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:04.549614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:04.549614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:04.549614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:04.549614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:06.258246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:06.273618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:06.275171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:06.286618 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fd14a4a-bb72-4611-bdc5-31707321d20f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.773428 Oct 18 13:49:06.287269 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2487/5113] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:04 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:06.505267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:06.510010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1354229761", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "526d0f91-3a2e-4117-a301-95a6393f15b3"}], "security_groups": [{"name": "tempest-securitygroup--195089301"}], "key_name": "tempest-keypair-754014266", "user_data": "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:06.523148 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc96367a-8302-4c2a-8769-8f8a55d038d3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 2.529036 Oct 18 13:49:06.532144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2627/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:03 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:07.040874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] validate_networks() for [('526d0f91-3a2e-4117-a301-95a6393f15b3', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:49:07.324225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:07.328318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:07.350255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:07.357830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:07.358888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:07.361356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:07.364762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:07.367116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:07.924172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:07.946204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:07.970905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:07.970905 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1fa6559-e4bf-4022-a489-82f53bf8ebe8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.638410 Oct 18 13:49:07.970905 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2628/5115] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:07 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:07.977481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:07.982526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:07.995898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:07.999923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:08.000858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:08.003189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:08.005076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:08.006344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:08.007023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:08.330815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:49:08.331366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:49:08.332086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:49:08.332524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:49:08.332961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:49:08.361363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:08.362354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:08.363443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:08.364687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:08.365547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:08.366229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:08.391870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:49:08.399836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for user d3ed4523fb1d423abcf98fdb30b37b0a and project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:49:08.420714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:08.431644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:49:08.434093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:49:08.436430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-adf12808-417a-4723-9203-9ea68da28f1d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.480519 Oct 18 13:49:08.438446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2629/5116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:07 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:08.652250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc58a5e7-41be-4362-aefa-0e82e17c6597 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.152016 Oct 18 13:49:08.654155 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2488/5117] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:49:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:49:08.673224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-746c2e95-752f-437d-a5fb-eeb5414a10b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:08.674670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-746c2e95-752f-437d-a5fb-eeb5414a10b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:08.826502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-746c2e95-752f-437d-a5fb-eeb5414a10b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:08.837123 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-746c2e95-752f-437d-a5fb-eeb5414a10b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1237 microversion: 2.1 time: 0.175946 Oct 18 13:49:08.837730 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2489/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:08 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1237 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:08.857744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8760c07e-97db-4f6d-a67c-751c0716b692 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Action: 'create', calling method: .version_select at 0x7fb331562820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-399537597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhupZEiWBlU9PVVIMWkLbTn79Xsr60ontRuWRbU7RscSQQ9dS3DzROnKGOTB4NJXRl1dbuGvWZfRE7OGdrNIxYCBIZcyFppiaQiiWn61q1v/z6e9ho+PwnQgCl9tdk6TA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:08.884795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:08.904843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8760c07e-97db-4f6d-a67c-751c0716b692 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:49:08.912479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8760c07e-97db-4f6d-a67c-751c0716b692 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for user ce62c03899e040bab1f041aba0187227 and project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:49:08.982211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:08.983125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:08.991921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:08.994204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:08.996121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:08.997568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:09.004714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:09.005407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:09.039330 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8760c07e-97db-4f6d-a67c-751c0716b692 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.595131 Oct 18 13:49:09.039330 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2630/5119] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:49:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:09.351899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:09.373203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:09.380601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:09.382839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3013aaf0-192f-47d7-b4a8-b0b9fd1cae03 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.404208 Oct 18 13:49:09.399658 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2490/5120] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:08 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:09.471104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:09.473202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:09.483252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:09.484316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:09.485072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:09.486230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:09.486871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:09.487479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:09.861421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4e560e81-87b6-4f57-8bfd-457cff1b1794 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:09.862070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4e560e81-87b6-4f57-8bfd-457cff1b1794 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:09.867900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:09.926651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4e560e81-87b6-4f57-8bfd-457cff1b1794 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:09.957586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4e560e81-87b6-4f57-8bfd-457cff1b1794 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1237 microversion: 2.1 time: 0.099916 Oct 18 13:49:09.976851 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2491/5121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:09 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:10.001360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:10.025886 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8cff235-dc8c-4a71-8bea-e158dd1298c3 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.565441 Oct 18 13:49:10.029729 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2631/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:09 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:10.416072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:10.419257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:10.434154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:10.440058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:10.441739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:10.443574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:10.447113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:10.461820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:11.006594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:11.008422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:11.039172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:11.039699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:11.040166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:11.040912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:11.041397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:11.041842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:11.255171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:11.276831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:11.280127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:11.283030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ff4c58c-080b-47ed-8e71-099b549b6740 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.870655 Oct 18 13:49:11.286625 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2492/5123] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:10 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:11.299380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:11.300879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:11.308726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:11.310826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:11.311489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:11.312662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:11.313320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:11.313958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:11.369064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:11.384274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b905225e-4b81-4ab3-a6fc-160345e5e7dc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1233 microversion: 2.1 time: 0.385210 Oct 18 13:49:11.385112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2632/5124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:10 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1233 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:11.938614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:11.951482 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-342a96c1-7776-4892-9ab0-214bc04a1b56 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.662678 Oct 18 13:49:11.952580 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2493/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:11 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:12.347034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:12.354278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:12.367537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:12.368066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:12.369367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:12.370174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:12.371197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:12.372524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:12.445433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:12.446134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:12.503670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:12.506103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:12.508020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:12.511615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:12.512540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:12.513506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:12.729265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:12.748801 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da23432a-df08-40f5-ab67-b88aab914a3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1297 microversion: 2.1 time: 0.312831 Oct 18 13:49:12.760801 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2494/5126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:12 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1297 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:12.987480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:12.989117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:12.998493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:12.999669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:13.000529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:13.001792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:13.003108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:13.004636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:13.031447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:13.051520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:13.052988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:13.054434 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d97c07e8-e3f1-45d6-b594-f15e3a492114 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.714782 Oct 18 13:49:13.067235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2633/5127] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:12 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:13.778346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:13.779331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:13.788483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:13.789544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:13.790551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:13.791939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:13.792954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:13.793679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:13.917013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:13.929213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:13.933900 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bc55a3c-ca97-4d23-b235-57c2154a8a00 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.952590 Oct 18 13:49:13.938322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2495/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:12 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:13.956251 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf1b243f-7799-4c37-9298-eaec83cfced1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1295 microversion: 2.1 time: 0.182454 Oct 18 13:49:13.956857 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2634/5129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:13 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:14.086379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:14.087500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:14.099792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.100299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.100793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:14.102854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.105330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.108674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:14.666761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:14.681746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:14.685618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:14.689891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a77dfd7c-c782-44e5-b130-5f19dde75e07 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.608310 Oct 18 13:49:14.691296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2496/5130] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:14 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:14.962308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:14.963023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:14.978731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.979247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.979757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:14.983715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.984019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:14.984663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:14.985005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.985679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:14.991398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.992095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.992796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:14.996069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:14.996669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:14.998259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:15.494477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:15.535648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fa79555-e1af-4a4d-9208-1d77a2bc1ba2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.555476 Oct 18 13:49:15.541728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2497/5131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:14 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:15.717462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:15.718037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:15.728593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:15.729119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:15.729600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:15.737264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:15.738160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:15.738828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:15.806658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:15.826696 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2597d17a-8f47-4e96-bb81-9d005d5eee04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.868180 Oct 18 13:49:15.837661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2635/5132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:14 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:16.607745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:16.609979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:16.623041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:16.625209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:16.630076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:16.632674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:16.633588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:16.634568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:16.820193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:16.829714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:16.839848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:16.841456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:16.842762 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f54f332-cc32-4463-94c9-099db78af07f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.129743 Oct 18 13:49:16.851304 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2498/5133] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:15 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:16.862467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:16.866956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:16.884969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:16.889555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:16.889555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:16.889555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:16.889555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:16.889555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:17.421709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:17.423507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:17.438454 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9cbc519-290b-4bc4-a1b6-47256f8f8fef tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.582634 Oct 18 13:49:17.438599 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99b7bf5e-31e3-42f3-b363-eb03dbcda974 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.872414 Oct 18 13:49:17.438927 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2499/5134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:16 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:17.456502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "39b5ec15-de28-4bcb-bb72-646633b92ed0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:17.461466 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2636/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:16 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:17.498296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:17.513177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:17.513177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:17.546427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] Creating event network-vif-plugged:39b5ec15-de28-4bcb-bb72-646633b92ed0 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:17.556021 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3ef19ab7-a571-4e3e-be1d-de68721cd0bb req-621d6d18-8329-4aed-88c7-a0ee384d700e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107163 Oct 18 13:49:17.560208 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2500/5136] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:17.895410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:17.896931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:17.909469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:17.913509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:17.921257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:17.921257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:17.921257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:17.921257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:18.479994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:18.481619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:18.485139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:18.528810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:18.535152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:18.537664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:18.538950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:18.541436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:18.552151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:18.911311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:18.947853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:18.949761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:18.952928 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08b9e8d9-3777-4168-a749-5d66f51ae17e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 1.061657 Oct 18 13:49:18.954113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2637/5137] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:17 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:18.967013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:18.968180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:19.007706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:19.008547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:19.009241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:19.010206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:19.010865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:19.011478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:19.163723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:19.174328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac3f4b68-d28e-47cc-bdc3-34ace86f5c98 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.713273 Oct 18 13:49:19.187476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2501/5138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:18 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:19.198778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb11d9b-3339-4d7f-a5fa-680e6538247c", "tag": "eacd5472-7c10-45e5-a9e9-502dd05c2a40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:19.213028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:19.213944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:19.214625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:19.232241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] Creating event network-changed:eacd5472-7c10-45e5-a9e9-502dd05c2a40 for instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c on n-h2-858383-13 Oct 18 13:49:19.238810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8d09d7c8-be10-45ba-9602-e2bd68a7d698 req-8a2af2f1-04c3-46fb-912c-afb515ce1c10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049317 Oct 18 13:49:19.239735 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2502/5139] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:19.674393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "0e554e48-ada4-49d5-961d-2ddcc1728ebe"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:19.693603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:19.706930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:19.707697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:19.738043 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] Creating event network-vif-plugged:0e554e48-ada4-49d5-961d-2ddcc1728ebe for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:19.760023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-769dd0f4-3026-4006-837b-57fe04364509 req-eb85d393-943e-4771-bcf3-5a5b179fc881 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089890 Oct 18 13:49:19.760960 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2503/5140] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:19.938532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:19.980636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:19.986124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:19.987110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:20.005006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:20.142858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:20.155047 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33df92c4-963e-47bc-b39e-8826a9f6f4d6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 1.198472 Oct 18 13:49:20.162799 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2638/5141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:18 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:20.205492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:20.206253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:20.232329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:20.233154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:20.236071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:20.242682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:20.243393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:20.245841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:20.658778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:20.674941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:20.676443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:20.681023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e810c6a4-4ca5-4a97-8cc3-0c20fa62e488 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.700267 Oct 18 13:49:20.682198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2504/5142] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:19 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:20.743060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:20.754581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5cf4d2b-62ba-4e96-9c02-1312ed1f64a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.555548 Oct 18 13:49:20.754581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2639/5143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:20 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:21.189564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:21.190229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:21.201919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.221593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.221593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:21.221593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.221593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.221593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:21.478438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:21.486901 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b018087a-5863-4f92-9e44-2ac5e96c7348 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.301715 Oct 18 13:49:21.498848 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2505/5144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:21 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:21.710683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:21.711370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:21.719441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.720258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.720883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:21.721821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.722495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.726615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:21.781005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:21.783533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:21.790869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.791370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.793606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:21.794651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:21.795358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:21.796385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:22.119546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:22.153183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:22.159046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2bf479a-17fb-4d5e-a231-fe5a3310c6da tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.383539 Oct 18 13:49:22.162685 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2506/5145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:21 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:22.172453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "919992b6-961d-4b56-b221-39037094820b"}, {"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "fe2f25a5-5cfb-4924-aec8-35d88168e3a1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:22.180768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:22.186621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:22.189992 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44343094-63a4-40d7-987f-777482437907 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.483607 Oct 18 13:49:22.204584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:22.204772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2640/5146] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:21 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:22.204894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:22.204894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:22.236986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Creating event network-vif-plugged:919992b6-961d-4b56-b221-39037094820b for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:22.238114 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] Creating event network-vif-plugged:fe2f25a5-5cfb-4924-aec8-35d88168e3a1 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:22.246739 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2008d584-8f62-4dc7-913f-df23e1b5f6b7 req-5a432b07-a62e-4805-9ea6-5ab888b51041 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081784 Oct 18 13:49:22.248534 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2507/5147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:22.514090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:22.514959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:22.540227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:22.553452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:22.556184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:22.560565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:22.562590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:22.565023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:22.962121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:22.996326 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b1acd0c-0f96-4581-8d20-11914a8b4dbf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.487078 Oct 18 13:49:23.007169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2641/5148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:22 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:23.186342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:23.186831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:23.194481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:23.200387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:23.200387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:23.200387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:23.200387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:23.200387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:23.223661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:23.223661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:23.233041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:23.233567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:23.234032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:23.234786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:23.235263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:23.235702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:23.736255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:23.747606 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63475208-f512-4f3c-b489-c0f832fae9fa tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.565623 Oct 18 13:49:23.762518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2508/5149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:23 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:23.787383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:23.802300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:23.804499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:23.806036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c300831-d45c-4646-95c6-0056d63c59ef tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.588703 Oct 18 13:49:23.807171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2642/5150] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:23 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:24.027091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:24.028169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:24.046546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.047296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.047944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.049519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.051474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.052455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.310369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "name": "network-vif-plugged", "status": "completed", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:24.325963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.327027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.327864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.342439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] Creating event network-vif-plugged:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:49:24.349595 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f0799a85-6840-4487-8497-a78874703efb req-b8df300e-6985-464c-883a-c8935db2c88d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041243 Oct 18 13:49:24.349595 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2643/5151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:49:24.762778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:24.772113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:24.772841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:24.776349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e3b4ed3-635e-426a-87ee-ea219b6beafb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.756866 Oct 18 13:49:24.777230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2509/5152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:24 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:24.796566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.797068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.797522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.798293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.798766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.799207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.839955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:24.842264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:24.854487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.855256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.855847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:24.856742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:24.857879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:24.858452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:25.069928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:25.088683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3e2eb8b-c635-49bb-9a62-832abf34e5ed tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.314137 Oct 18 13:49:25.088683 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2644/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:24 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:25.466965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:25.494274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:25.500327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:25.502625 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b87cae36-1723-4344-ad4e-c7b4a19bb771 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.673230 Oct 18 13:49:25.516325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2510/5154] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:24 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:25.812955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:25.814511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:25.830089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:25.830756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:25.831503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:25.832972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:25.833839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:25.845346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:25.890185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:26.124837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:26.126227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:26.170194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:26.170194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:26.170194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:26.172714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:26.176565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:26.178839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:26.261669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:26.325182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec6df9ad-e2b7-4ff1-9e9e-227cf45596b6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.527411 Oct 18 13:49:26.343472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2645/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:25 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:26.523379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "16c31a93-099e-4fde-90af-e06403098c14"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:26.554410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:26.555248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:26.555731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:26.592170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] Creating event network-vif-plugged:16c31a93-099e-4fde-90af-e06403098c14 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:26.609793 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-39c6ef8b-d3f9-4d5c-a1bf-fe32f89dd088 req-b0b082fb-a69c-4f6b-bf04-d23e99baa4e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086678 Oct 18 13:49:26.612689 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2646/5156] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:49:26.639299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:26.640426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:26.660369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:26.660369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:26.660369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:26.662967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:26.663445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:26.665971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:27.069913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:27.088744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba2c388a-2b75-4113-8bf6-363e4dd6937c tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1371 microversion: 2.1 time: 0.978639 Oct 18 13:49:27.089963 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2511/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:26 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1371 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:27.096587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-288897590", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "11bd469a-f8df-4f4d-9a13-45c2dbcd7eb8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-482659141", "security_groups": [{"name": "tempest-secgroup-smoke-1474190092"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:27.337686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:27.368531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:27.370845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:27.373125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0efe32b-6178-4494-9cf3-9aa0a17216b0 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.756314 Oct 18 13:49:27.408122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2647/5158] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:26 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:27.419534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:27.422749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:27.436747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:27.439898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:27.440694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:27.444351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:27.445168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:27.453799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:27.855661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:27.874015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8432d947-297b-49d5-8b1e-8a126f7f987e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.463770 Oct 18 13:49:27.876344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2648/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:27 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:27.919158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] validate_networks() for [('11bd469a-f8df-4f4d-9a13-45c2dbcd7eb8', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:49:28.115770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:28.116551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:28.145723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:28.146284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:28.148541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:28.150755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:28.152656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:28.153404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:28.712248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:28.724922 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0bd817b8-aa06-4fd0-a08f-5044e451a4a0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1565 microversion: 2.1 time: 0.612843 Oct 18 13:49:28.726024 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2649/5160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:28 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1565 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:28.732184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:28.733244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:28.740730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:28.741611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:28.742726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:28.743894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:28.751853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:28.753007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:29.419164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:29.439435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:29.445846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:29.475195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61e40dbc-4a5b-430d-91ec-16e5a9a365ce tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.720422 Oct 18 13:49:29.491542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2650/5161] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:28 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:29.505326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:29.506101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:29.515716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:29.517369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:29.518550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:29.519511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:29.520221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:29.520878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:29.988753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ebe77e9c-770e-4a6f-a914-28f251255c03 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.495261 Oct 18 13:49:29.989948 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2651/5162] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:49:29 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-interface => generated 284 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:30.005843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:30.008841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:30.028421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.030618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.033416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.036395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.038668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.043269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.620740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:30.702005 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b5fca87-dbb4-4d24-bbdb-e1f0b8d3c6ff tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.652420 Oct 18 13:49:30.702005 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2652/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:29 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:30.702005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "8e22e8f7-5a5d-4467-8094-8f320789781e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:30.723655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:49:30.723655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:49:30.723655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:49:30.723655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:49:30.723655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:49:30.735675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.737575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.738400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.739099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.740096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.740796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.741477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.743681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.744063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.770348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:49:30.772230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] Creating event network-vif-plugged:8e22e8f7-5a5d-4467-8094-8f320789781e for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:30.782395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:49:30.803494 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-30dcc56b-42c6-4ae9-9e08-adc3a9f6735b req-bb06ad7d-5a25-47cc-9696-1f804a9f0a55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125726 Oct 18 13:49:30.805286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2653/5164] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:30.810614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:49:30.813418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:49:30.822478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:30.825254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:30.845332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.849622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.850663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:30.852934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:30.855378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:30.859370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:31.021744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49f0c484-0d61-44c2-88d9-f947d12e14ea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.929406 Oct 18 13:49:31.022980 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2512/5165] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:49:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 3932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:49:31.036856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4958068c-ef82-48ee-9bbb-7a43095f8240 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:31.037779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4958068c-ef82-48ee-9bbb-7a43095f8240 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:31.195351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4958068c-ef82-48ee-9bbb-7a43095f8240 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:31.213436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4958068c-ef82-48ee-9bbb-7a43095f8240 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1265 microversion: 2.1 time: 0.180786 Oct 18 13:49:31.215226 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2513/5166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:31 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:31.488795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:31.518839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:31.534658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:31.538774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65acd18f-5976-4d5a-82ab-34b263b54df4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.731798 Oct 18 13:49:31.539370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2654/5167] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:30 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:31.693796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:31.695528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:31.716498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:31.722968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:31.723622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:31.724547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:31.725770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:31.726478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:32.242180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54eda29c-3ba8-4f6b-9954-4475b42647c6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:32.242443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54eda29c-3ba8-4f6b-9954-4475b42647c6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:32.931328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54eda29c-3ba8-4f6b-9954-4475b42647c6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:32.986786 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54eda29c-3ba8-4f6b-9954-4475b42647c6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1265 microversion: 2.1 time: 0.747556 Oct 18 13:49:32.988675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2655/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:32 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1265 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:33.005865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:33.006639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:33.040520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:33.041213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:33.041700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:33.042727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:33.043539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:33.043890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:33.383794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:33.420241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-feac34fb-d21e-4d9b-909b-8221c0b5ba79 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 1.731672 Oct 18 13:49:33.426704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2514/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:31 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:33.460767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb11d9b-3339-4d7f-a5fa-680e6538247c", "name": "network-vif-plugged", "status": "completed", "tag": "eacd5472-7c10-45e5-a9e9-502dd05c2a40"}, {"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-plugged", "status": "completed", "tag": "f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:33.487548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:33.488117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:33.490368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:33.514452 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Creating event network-vif-plugged:eacd5472-7c10-45e5-a9e9-502dd05c2a40 for instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c on n-h2-858383-13 Oct 18 13:49:33.515499 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] Creating event network-vif-plugged:f9ede1f8-4ce2-4c9d-b21b-2aa8b44d0799 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:33.522561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:33.538316 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b3f02968-6903-4d7d-ab00-9d135b2aea24 req-c18ff786-5811-4d87-8b2d-2734e613b632 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109494 Oct 18 13:49:33.539270 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2515/5170] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:33.564750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:33.578830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:33.580435 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26fd1309-5b1f-4a5a-9620-8508bd6b338f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.590512 Oct 18 13:49:33.584558 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2656/5171] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:32 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:34.028453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:34.029995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:34.046112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.047929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.055161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.056360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.058007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.059421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.213587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:34.224890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be8fb802-4609-4b35-90f3-733411baaa05 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1317 microversion: 2.1 time: 0.202563 Oct 18 13:49:34.228110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2516/5172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:34 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:34.456762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:34.458137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:34.485364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.485819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.486323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.487054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.493827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.494330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.613602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:34.614280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:34.625380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.628754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.630490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.631299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:34.631883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:34.632330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:34.979296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:35.013004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d25a9e0-697e-4607-bc3e-60595bdd7331 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1362 microversion: 2.1 time: 0.563342 Oct 18 13:49:35.013004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2657/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:34 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1362 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:35.019288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:35.031928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:35.032466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:35.032926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:35.049409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] Creating event network-changed:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:49:35.055678 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1d6290dc-4cdf-4172-80a2-de950e9f1e4b req-89caaecc-7408-4abb-9587-aaf7a9c28d92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041495 Oct 18 13:49:35.056603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2658/5174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:35.230740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:35.247886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:35.250076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:35.251568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c68a4911-e417-4f53-9cb2-93e244f57f27 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1873 microversion: 2.42 time: 0.644138 Oct 18 13:49:35.252388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2517/5175] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:34 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1873 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:49:35.262825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:35.262825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:35.270855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:35.273809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:35.275022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:35.276414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:35.277211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:35.278914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:35.374177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:35.385848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4714748-e37e-4ae7-8308-0f8ef02282b8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1317 microversion: 2.1 time: 0.131486 Oct 18 13:49:35.403866 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2659/5176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:35 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:36.037823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:36.038546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:36.072306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.072746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.073209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.073950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.074993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.075442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.280676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:36.281326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:36.298014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.298589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.299139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.299828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.302461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.302971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.741513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:36.754102 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8c70446-5a83-48ea-a6e1-7b80b1beb6a1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1548 microversion: 2.1 time: 0.720126 Oct 18 13:49:36.776663 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2518/5177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:36 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1548 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:36.788397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:36.789395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:36.798787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.799923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.800634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.802890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:36.808707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:36.808707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:36.950824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:36.965239 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6b55a68-4eac-493b-aa2b-b262d68729e2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1323 microversion: 2.1 time: 0.181657 Oct 18 13:49:36.978938 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2519/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:36 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:36.984507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:36.985336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:37.014183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:37.015544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:37.022357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:37.022357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:37.022357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:37.022357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:37.022357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:37.031392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:37.033523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:37.037337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe2a521d-b57c-4566-b13b-d16c1748b74a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2831 microversion: 2.42 time: 0.761528 Oct 18 13:49:37.038563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:37.043149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2660/5179] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:49:36 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2831 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:37.071246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:37.072009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:37.083744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:37.084615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:37.091378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:37.091378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:37.091378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:37.091378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:37.276615 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d4496e1-2411-4b32-9e85-ff7bf57a34f6 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.209483 Oct 18 13:49:37.280408 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2661/5180] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:49:37 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c/os-interface => generated 1832 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:49:37.325381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6831c24d-4615-4904-88da-0d269e1bfa0e tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.344877 Oct 18 13:49:37.326562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2520/5181] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:49:36 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:37.896707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-698889519-access_point-957685813", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "6ec6f1fc-269c-4865-a713-9d9355283879"}], "key_name": "tempest-TestSecurityGroupsBasicOps-399537597", "security_groups": [{"name": "tempest-secgroup_access--621566043"}, {"name": "tempest-secgroup_general--1425991832"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:38.002975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:38.003880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:38.026208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:38.026723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:38.027180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:38.027997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:38.028473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:38.028919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:38.222792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:38.235993 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27bee708-a4d6-46a7-bbd7-806729f4fa56 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1323 microversion: 2.1 time: 0.237962 Oct 18 13:49:38.237426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2521/5182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:37 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:39.238798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "tag": "0e554e48-ada4-49d5-961d-2ddcc1728ebe"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:39.281637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:39.283076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:39.284200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:39.318861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] Creating event network-changed:0e554e48-ada4-49d5-961d-2ddcc1728ebe for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:49:39.333915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6d8e02fa-c6e9-4b50-bc7c-a1c9b0a8be7f req-5acb7811-4877-4f76-bee4-16eb3c3a5e2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103417 Oct 18 13:49:39.334568 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2522/5183] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:49:39.353027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:39.353784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:39.368245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:39.368751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:39.369199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:39.369926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:39.370475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:39.378762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:39.535033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] validate_networks() for [('6ec6f1fc-269c-4865-a713-9d9355283879', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:49:40.584057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:40.604282 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4357aeef-91b8-4bcb-881c-7b5ed7803e70 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 1.265662 Oct 18 13:49:40.606368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2523/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:39 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:41.116311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:41.626455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:41.630443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:41.638762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:41.640776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:41.646355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:41.653891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:41.655036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:41.655702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:41.656670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:41.657372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:41.658009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:42.378501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:42.391125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1e8fe67-2c9f-4644-813a-14673e5c1773 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.765559 Oct 18 13:49:42.407249 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2524/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:41 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:42.440787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:49:42.441421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:49:42.441798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:49:42.442545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:49:42.444182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:49:42.466859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:42.467755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:42.468467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:42.469728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:42.470505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:42.471271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:42.557195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:49:42.565951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for user ce62c03899e040bab1f041aba0187227 and project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:49:42.588130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:49:42.591633 n-d-858383-13 devstack@n-api.service[121010]: WARNING nova.utils [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-698889519-access_point-957685813 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-698889519-acc Oct 18 13:49:42.592859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:49:42.873661 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5dff445-e846-4764-8bb1-2363647d8d59 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 4.977717 Oct 18 13:49:42.874876 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2662/5186] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:49:37 2022] POST /compute/v2.1/servers => generated 457 bytes in 4986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:49:42.897883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4093f9ec-1b54-428c-8c4d-7ec2c1e944ee tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:42.898858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4093f9ec-1b54-428c-8c4d-7ec2c1e944ee tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:43.185620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4093f9ec-1b54-428c-8c4d-7ec2c1e944ee tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:43.205994 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4093f9ec-1b54-428c-8c4d-7ec2c1e944ee tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1292 microversion: 2.1 time: 0.321181 Oct 18 13:49:43.211378 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2525/5187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:42 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:43.684280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb11d9b-3339-4d7f-a5fa-680e6538247c", "tag": "eacd5472-7c10-45e5-a9e9-502dd05c2a40"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:43.684280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:43.684280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:43.684280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:43.687398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:43.687398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:43.688644 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] Creating event network-changed:eacd5472-7c10-45e5-a9e9-502dd05c2a40 for instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c on n-h2-858383-13 Oct 18 13:49:43.689397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:43.689397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:43.690223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-16af5bbf-094d-4d70-b325-0938e3880d15 req-8237986a-791a-4351-b2eb-96b05f513f44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384140 Oct 18 13:49:43.691075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:43.692232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2663/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:43.692356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:43.692356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:43.692356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:43.957240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:43.973906 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5eb10f9b-3d48-4947-afec-afb223dcf181 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.560865 Oct 18 13:49:43.992039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2526/5189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:43 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:44.244447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3737a9a-5520-446d-b1f8-e3d894866aca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:44.245534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3737a9a-5520-446d-b1f8-e3d894866aca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:44.388273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3737a9a-5520-446d-b1f8-e3d894866aca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:44.398610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3737a9a-5520-446d-b1f8-e3d894866aca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1292 microversion: 2.1 time: 0.167542 Oct 18 13:49:44.418622 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2664/5190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:44 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:45.012069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:45.013268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:45.024671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.024671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.032061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.033129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.033852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.034480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.426268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:45.427797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:45.436759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.437668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.438162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.438907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.439556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.440181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.523632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:45.535674 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9fc2437-d507-43f2-842c-6daf15d0e2d1 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1296 microversion: 2.1 time: 0.113741 Oct 18 13:49:45.536930 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2665/5191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:45 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:45.541969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:45.552724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.553898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.554657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.579337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] Creating event network-changed:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h2-858383-13 Oct 18 13:49:45.585371 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6f3bef4c-d2be-497b-9a46-8ae6063a24a1 req-d3a672f7-7af7-4805-99bf-6f16b7c79d4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046923 Oct 18 13:49:45.586239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2666/5192] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:45.719621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:45.729014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c187a57-d7b6-4829-9d1a-ab66aa813aa0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.721939 Oct 18 13:49:45.729900 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2527/5193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:45 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:46.559964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:46.560612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:46.569118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:46.569764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:46.615087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:46.615087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:46.615087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:46.615087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:46.757418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:46.759767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:46.770452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:46.771253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:46.772053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:46.773134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:46.773809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:46.774468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:46.978042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:47.008035 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32897459-5e47-4b40-92d1-0aad140b1b3d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1344 microversion: 2.1 time: 0.451918 Oct 18 13:49:47.010364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2667/5194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:46 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1344 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:47.158317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:47.170790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aac4a435-3258-48de-832d-6f457b48f165 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.419379 Oct 18 13:49:47.172798 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2528/5195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:46 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:49:48.035165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:48.035911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:48.046149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.047644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.048603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.050175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.050854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.051486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.151186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:48.159775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:48.167793 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4e0e990-c61e-4d04-a746-aef15af5807c tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1350 microversion: 2.1 time: 0.138036 Oct 18 13:49:48.168852 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2668/5196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:48 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:48.207723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:48.210044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:48.222859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.224187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.225395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.227197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.229064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.229638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.820228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:48.865181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3a3fa00-2e2a-4e12-af33-4a92d594baae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.667109 Oct 18 13:49:48.894576 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2529/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:48 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:49.195060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:49.195982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:49.220740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:49.221391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:49.223249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:49.231573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:49.232427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:49.235007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:49.535901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:49.568111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe662f2e-76ea-4784-b915-dddf080fa515 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.378553 Oct 18 13:49:49.571981 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2669/5198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:49 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:49.897517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:49.898274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:49.918176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:49.920325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:49.923024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:49.927911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:49.930868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:49.934786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:50.356540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:50.388044 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-390172ed-23a2-4f88-8770-b8a380ab4b6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 0.493923 Oct 18 13:49:50.389935 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2530/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:49 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:50.597670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:50.598956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:50.606485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:50.606986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:50.607436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:50.608156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:50.608625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:50.609064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:50.642472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "name": "network-vif-plugged", "status": "completed", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:50.662872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:50.663570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:50.668993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:50.690541 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] Creating event network-vif-plugged:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h2-858383-13 Oct 18 13:49:50.701338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8b208704-4d89-477d-94a3-7f4e5c4a4969 req-797cc93a-1f86-4409-8c00-b0cb64609fd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063297 Oct 18 13:49:50.701995 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2531/5200] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:51.051842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:51.067085 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1871d2f0-bfd9-4377-98c2-7642691cc51d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.473319 Oct 18 13:49:51.067972 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2670/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:50 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:51.428247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:51.437156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:51.468203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:51.469547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:51.470685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:51.473976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:51.475178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:51.476291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:52.053735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1f1b15-0f41-4175-bc63-1946ffd10278", "tag": "7b5298c9-cc22-4fb0-91be-dd17c1af0640"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:52.070342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:52.072106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:52.072728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:52.097021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] Creating event network-changed:7b5298c9-cc22-4fb0-91be-dd17c1af0640 for instance fa1f1b15-0f41-4175-bc63-1946ffd10278 on n-h1-858383-13 Oct 18 13:49:52.103242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-69ff64f4-89d2-45a3-80ab-8356bceea6d8 req-cc112586-c082-4aba-9fbe-6071a0059822 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053334 Oct 18 13:49:52.105270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2671/5202] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:49:52.115991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:52.117858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:52.151791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:52.152570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:52.153101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:52.155438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:52.157843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:52.158455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:52.411385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:52.418610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:52.428538 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efb95a3e-2ee7-4050-bdfc-54214b0e0499 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.321288 Oct 18 13:49:52.434565 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2672/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:52 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:52.448831 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ce9dbf09-5bc0-4b98-beff-95aae66f9268 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1391 microversion: 2.1 time: 1.040619 Oct 18 13:49:52.451665 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2532/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:51 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1391 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:53.455254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:53.461329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:53.462123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:53.475409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.477095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.477786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.478884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.479917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.481104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.483289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:53.483988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:53.493613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:53.496537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.507345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.510077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.511469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.526434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.526434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.731030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:53.741466 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8343c93d-1299-47ea-afde-32b93f035c7a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1564 microversion: 2.1 time: 0.263048 Oct 18 13:49:53.742913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2533/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:53 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:53.770126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:53.771507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:53.779028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.780000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.780725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.781621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:53.782331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:53.782979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:53.938625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:53.958706 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee19e3a5-ed1a-4e45-aa9b-3ddc678e9455 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.507455 Oct 18 13:49:53.961104 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2673/5206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:53 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:54.048740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:54.060555 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f366558-96bb-4509-980d-b2160fd2c359 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1564 microversion: 2.1 time: 0.296484 Oct 18 13:49:54.061784 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2534/5207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:53 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1564 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:54.988513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:54.989630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:55.004987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:55.008548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:55.009377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:55.010340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:55.012178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:55.013063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:55.013829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:55.446151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:55.461332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7462bc1e-abb8-4491-8ce1-4687da23010a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.478097 Oct 18 13:49:55.464699 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2674/5208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:54 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:56.494954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:56.495676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:56.503362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:56.503867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:56.506708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:56.506708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:56.506708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:56.506708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:56.793586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:56.802992 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-409af0bc-85e2-4385-993e-1baa9e1c612a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.315885 Oct 18 13:49:56.817657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2535/5209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:56 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:56.897220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:56.897902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:56.909268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:56.909799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:56.910296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:56.911042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:56.911510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:56.911973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:57.301522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:57.314103 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5eb68d0-b2d2-4969-aa90-4b05706881a9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1564 microversion: 2.1 time: 0.423657 Oct 18 13:49:57.314713 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2675/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:56 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1564 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:57.443420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:57.467555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:57.468042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:57.468495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:57.522094 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] Creating event network-changed:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h2-858383-13 Oct 18 13:49:57.548028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a0063de2-0070-44b9-82cf-7415a700e28e req-3124f8f7-54c6-467c-849a-1834e91656a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.654292 Oct 18 13:49:57.554139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2536/5211] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:57.833307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:57.833948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:57.851221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:57.851737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:57.852196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:57.852924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:57.853393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:57.853830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:58.238570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:58.250688 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00562d3e-eea3-4fe1-9c78-5c2b4e948221 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.420888 Oct 18 13:49:58.251767 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2676/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:57 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:49:58.971874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1f1b15-0f41-4175-bc63-1946ffd10278", "name": "network-vif-plugged", "status": "completed", "tag": "7b5298c9-cc22-4fb0-91be-dd17c1af0640"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:58.993785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:58.994618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:58.995346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:59.011125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] Creating event network-vif-plugged:7b5298c9-cc22-4fb0-91be-dd17c1af0640 for instance fa1f1b15-0f41-4175-bc63-1946ffd10278 on n-h1-858383-13 Oct 18 13:49:59.017356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1639be4e-c105-484a-aab1-6a7ca09bdc8d req-9b3167f7-6655-47a5-ab4b-fc6f989dad69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051918 Oct 18 13:49:59.018742 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2537/5213] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:59.285540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:59.286212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:59.304597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:59.305296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:59.306188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:59.309688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:59.310893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:59.313678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:59.762893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:49:59.818765 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62128a98-d13b-4fce-b273-bf817d3bfe21 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1469 microversion: 2.1 time: 0.530734 Oct 18 13:49:59.831604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2677/5214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:49:59 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:00.854385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:00.856755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:00.871772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:00.873758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:00.875307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:00.876597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:00.877397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:00.878126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:01.147678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:01.157049 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d5e1f8b-7239-44a4-b333-00dad342bc48 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1640 microversion: 2.1 time: 0.313447 Oct 18 13:50:01.157969 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2538/5215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:00 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1640 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:01.182655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:01.183991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:01.191458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:01.193163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:01.193908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:01.194889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:01.195562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:01.196529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:01.383686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:01.393692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-062645c4-34da-408e-929e-239ca44fd34d tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1640 microversion: 2.1 time: 0.215727 Oct 18 13:50:01.394675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2678/5216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:01 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1640 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:01.421737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:01.422472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:01.430646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:01.432423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:01.433809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:01.434970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:01.435556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:01.442187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:02.209320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c95318a-7fb8-4014-a3e9-2c4661724cd4"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:02.211876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd149720-61d0-4ce7-80e7-1556c1b3041a tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1793 microversion: 2.1 time: 0.795620 Oct 18 13:50:02.212984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:02.229231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2539/5217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:01 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1793 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:02.229959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:03.319023 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b572f49f-83d1-4f82-8649-7c82c1818904 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114115 Oct 18 13:50:03.321065 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2679/5218] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:50:02 2022] POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:07.494506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1f1b15-0f41-4175-bc63-1946ffd10278", "tag": "7b5298c9-cc22-4fb0-91be-dd17c1af0640"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:07.534619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:07.538029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:07.538807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:07.565271 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] Creating event network-changed:7b5298c9-cc22-4fb0-91be-dd17c1af0640 for instance fa1f1b15-0f41-4175-bc63-1946ffd10278 on n-h1-858383-13 Oct 18 13:50:07.574918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6f032d93-f802-47c6-b946-48cbc9c811b9 req-3dbaeb07-692a-45f3-beca-bd9118bc2380 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084812 Oct 18 13:50:07.580196 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2540/5219] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:14.468907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:14.470265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:14.481698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:14.482861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:14.486292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:14.487192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:14.488267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:14.489558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:14.490199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:14.490731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:14.529580 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7665b977-2e63-46c1-84e9-6cba33f474fb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/ips" status: 200 len: 146 microversion: 2.1 time: 0.070873 Oct 18 13:50:14.530664 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2680/5220] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:50:14 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/ips => generated 146 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:50:17.883016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:17.885698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:17.899900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=35 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:17.900445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:17.905441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:17.907457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:17.907926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:17.908660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:17.909127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:17.909603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:17.952472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'flavor' on Instance uuid 5504fad3-f01a-4b91-af43-bc71719884bd {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:50:18.405882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5cfa343-ccc6-4683-8210-3d310cf5e89d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/action" status: 200 len: 32 microversion: 2.1 time: 0.527484 Oct 18 13:50:18.416238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:18.418178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:18.420329 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2541/5221] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:17 2022] POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:50:18.428388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:18.429420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:18.430046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:18.430849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:18.436337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:18.436337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:18.687177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:18.697053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f8acd49-155c-469f-8db8-1faba590a096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.284685 Oct 18 13:50:18.702089 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2681/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:18 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:18.873352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b817e200-d574-4f3d-9e8e-b730a9abb01f"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:18.876135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:18.894364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:18.894951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:18.899263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:18.899263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:18.899263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:18.899263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.722292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:19.722939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:19.732138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.732619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.733107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.733977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.734643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.735077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.883033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:19.894126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2576771-ce10-4728-91d0-3192e7c873cc tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.175850 Oct 18 13:50:19.910409 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2682/5223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:19 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:19.965588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:19.968531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:19.974985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.975486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.976158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.976875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.977343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.977782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.034684 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-279dce39-e395-41b3-9709-75cccc4ba8a3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action" status: 200 len: 24510 microversion: 2.1 time: 0.073367 Oct 18 13:50:20.035895 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2683/5224] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:19 2022] POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action => generated 24510 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:50:20.096749 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aecd47b3-1c3b-4fba-95e9-be70f1091f4f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.228078 Oct 18 13:50:20.097878 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2542/5225] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:50:18 2022] POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:20.919883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:20.921374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:20.931244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.932112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.933101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.934296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.935014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.935929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:21.229881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:21.265975 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bbf22f01-06b2-44fe-870e-3548b0458941 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.350730 Oct 18 13:50:21.267110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2684/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:20 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:22.299800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:22.300675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:22.322565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:22.323937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:22.324538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:22.325649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:22.326211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:22.329364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:22.562348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:22.571122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1894252b-5d4e-4b89-bfc1-7d69daf4f2e8 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.276759 Oct 18 13:50:22.571716 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2543/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:22 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:23.598149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:23.602150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:23.608629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:23.609123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:23.609577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:23.610316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:23.610775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:23.611206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:23.802418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:23.811738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f81ac6a3-cdeb-45c3-b282-5922e95e1f09 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.217510 Oct 18 13:50:23.812315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2685/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:23 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:24.835430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:24.836052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:24.844346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:24.844839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:24.845287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:24.845990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:24.848887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:24.849345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:25.076858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:25.086024 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4895fcc6-3201-42e0-b7ff-82bbf71973ff tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.254324 Oct 18 13:50:25.086730 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2544/5229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:24 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:26.111384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:26.121764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:26.121764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:26.122338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:26.122770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:26.123581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:26.124399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:26.124945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:26.313340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:26.324405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa0b899d-3bd5-4d5c-b34d-c67f9911a16a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.218816 Oct 18 13:50:26.325246 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2686/5230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:26 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:27.349322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:27.349952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:27.357154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:27.358220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:27.358337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:27.361480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:27.361480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:27.361480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:27.514231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:27.523107 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d272e75-2537-41e2-ae94-73dcb9b42ef6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.178120 Oct 18 13:50:27.523697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2545/5231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:27 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:28.549539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:28.550754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:28.558774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:28.559665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:28.560241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:28.561362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:28.562356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:28.563144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:28.741625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:28.758960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5161eb86-a7d6-4da7-b3c3-f453501cd2f9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.214211 Oct 18 13:50:28.759470 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2687/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:28 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:29.787147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:29.787981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:29.800543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:29.804718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:29.807288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:29.809374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:29.809374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:29.809374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:30.058648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:30.067584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a05adfd6-fdba-4ef0-933a-e8b29748cdac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.285750 Oct 18 13:50:30.068183 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2546/5233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:29 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:31.010338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:31.012939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:31.028427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.028855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.029307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.030035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.030982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.031695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.091934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:31.093713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:31.102791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.104819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.105643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.106582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.107403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.108042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.505484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:31.519355 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b567b34-8da1-4fc2-936f-e61cdaf0ffd1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.431479 Oct 18 13:50:31.520558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2547/5234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:31 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:31.575640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2612d5f9-344c-4654-959a-99f55a12c6fe tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1835 microversion: 2.1 time: 0.569193 Oct 18 13:50:31.577679 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2688/5235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:31 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1835 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:31.606089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:31.607147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:31.616759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.617542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.619401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.620161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:31.620825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:31.621438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.056994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:32.068585 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07b0a412-8781-440d-8262-6b6729502d07 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1682 microversion: 2.1 time: 0.467304 Oct 18 13:50:32.070710 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2548/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:31 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1682 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:32.235686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:32.239229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:32.253703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.254488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.255125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.256017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.256667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.257260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.337221 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4899c24c-8aed-420a-8c35-da53794fba1f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action" status: 200 len: 32583 microversion: 2.1 time: 0.105322 Oct 18 13:50:32.346347 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2689/5237] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:32 2022] POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action => generated 32583 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:50:32.525621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:32.532810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:32.548388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:32.549099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:32.563524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.563524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.563524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.565491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.566000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.566477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.567482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.568114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.569499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.569963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.572109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.572624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.689738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e75b5e687b894134be5eaf009f055a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2751b46cd5d74e5ea29be04ae823f86f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:32.690698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] flavor_id is None. Assuming migration. {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:50:32.691290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:50:32.913495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:32.924384 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8bda1f4-abe9-44ef-bdd4-737e13cb6b04 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.380170 Oct 18 13:50:32.931327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2690/5238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:32 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:33.230721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:33.240239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.241026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.241803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.301765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:50:33.522876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2af55d6-77f2-46a9-9af4-b16d5f7e921f tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action" status: 202 len: 0 microversion: 2.1 time: 1.009802 Oct 18 13:50:33.532563 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2549/5239] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:32 2022] POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:33.546598 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12655c87-2be6-419d-9edf-1927c02b680a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action" status: 202 len: 0 microversion: 2.1 time: 0.323850 Oct 18 13:50:33.546598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2691/5240] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:33 2022] POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:33.553315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:33.555064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:33.570088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:33.571853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:33.588081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.588740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.589440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.590468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.592249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.595378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.606706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.607468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.608093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.608989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.610232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.610819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.863851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:33.878864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e062f5c-7961-4d26-8f98-ef27f7f12bf8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.328395 Oct 18 13:50:33.883949 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2692/5241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:33 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:33.955032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:33.957495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:33.986216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.986216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.986216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.987992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.988678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.991065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:34.188234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:34.200570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c6c308c-7ef2-4849-bede-30578debbc24 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.255073 Oct 18 13:50:34.201717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2693/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:33 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:34.440811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:34.453226 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7379df19-dce7-4110-be4f-ae7b0e159c4c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1691 microversion: 2.1 time: 0.914658 Oct 18 13:50:34.454165 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2550/5243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:33 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1691 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:34.913042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:34.918255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:34.950396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:34.950396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:34.953775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:34.959302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:34.960105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:34.962716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.245174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:35.248268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:35.309713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:35.314246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:35.315056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.326088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:35.355509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:35.355509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:35.376451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.382470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-909d23e5-0877-44ca-a694-8daafe935d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.472321 Oct 18 13:50:35.384027 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2694/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:34 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:35.483778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:35.484409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:35.490819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:35.491563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:35.492156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.493041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:35.493654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:35.494375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.705039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:35.714415 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39dc183c-db5e-4961-913d-0921624a1d16 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1691 microversion: 2.1 time: 0.236055 Oct 18 13:50:35.715008 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2695/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:35 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:35.799469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:35.814572 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1aafbdc6-8077-4fb6-ad4b-dbe88d378215 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.588219 Oct 18 13:50:35.815841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2551/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:35 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:36.411759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:36.412657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:36.425144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.426147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.426840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.427704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.428275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.428933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.475148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:36.647054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:36.660545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec2337de-fb78-4376-b002-67ecfe6eccd6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.253115 Oct 18 13:50:36.661549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2696/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:36 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:36.739133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:36.740313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:36.748391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.749538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.750223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.751089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.751798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.752430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.795025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:36.840953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:36.841531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:36.854513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.855358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.856756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.857700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.858637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.859241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:37.133676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:37.144724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46c11969-2756-435c-b209-ac8843e14356 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1736 microversion: 2.1 time: 0.307905 Oct 18 13:50:37.146442 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2697/5248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:36 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:37.215071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:37.229056 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18757eeb-dcfc-4601-968f-a3e14fbb5925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1691 microversion: 2.1 time: 0.494070 Oct 18 13:50:37.242564 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2552/5249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:36 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1691 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:37.689512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:37.690727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:37.698013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:37.699132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:37.699587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:37.700515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:37.700975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:37.701405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.172361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:38.172982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:38.193509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.213784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.220074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.221916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.222460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.222918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.470088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:38.483239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-443be6af-530e-40bc-aacc-240eea8bddfe tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.801326 Oct 18 13:50:38.486252 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2698/5250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:37 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:38.492125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:38.493789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:38.513657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.521508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.522429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.523376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.524182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.525204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.687853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:38.699202 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be5c2e95-a60a-42a6-9f43-488b5a1ad43a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1716 microversion: 2.1 time: 0.530745 Oct 18 13:50:38.720741 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2553/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:38 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1716 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:38.756414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:38.769061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae43809b-ddaf-4eb7-a548-5026c55fe2c3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1691 microversion: 2.1 time: 0.281508 Oct 18 13:50:38.770681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2699/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:38 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:38.874708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:38.875559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:38.882856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.883857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.884565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.885659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.887175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.887836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.015921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Cannot 'detach_volume' instance 5504fad3-f01a-4b91-af43-bc71719884bd while it is in vm_state rescued Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments/4c95318a-7fb8-4014-a3e9-2c4661724cd4 HTTP/1.1 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'detach_volume' instance 5504fad3-f01a-4b91-af43-bc71719884bd while it is in vm_state rescued Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': '5504fad3-f01a-4b91-af43-bc71719884bd', 'id': '4c95318a-7fb8-4014-a3e9-2c4661724cd4'} Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5504fad3-f01a-4b91-af43-bc71719884bd in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5504fad3-f01a-4b91-af43-bc71719884bd while it is in vm_state rescued Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:50:39.017538 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5504fad3-f01a-4b91-af43-bc71719884bd while it is in vm_state rescued Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 409 to user: Cannot 'detach_volume' instance 5504fad3-f01a-4b91-af43-bc71719884bd while it is in vm_state rescued {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:50:39.027389 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99b275ad-067a-4e79-a6bc-96c9580ed87e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments/4c95318a-7fb8-4014-a3e9-2c4661724cd4" status: 409 len: 152 microversion: 2.1 time: 0.155540 Oct 18 13:50:39.037044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:39.037694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.046871 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2554/5253] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:50:38 2022] DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments/4c95318a-7fb8-4014-a3e9-2c4661724cd4 => generated 152 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:50:39.059005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.059798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.060429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.061861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.063302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.066714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.370125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b5ddeca-aaaf-4247-b833-ba26a9ffd413 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/action" status: 202 len: 0 microversion: 2.1 time: 0.338430 Oct 18 13:50:39.371541 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2700/5254] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:39 2022] POST /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:39.384853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:39.388142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.423105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.426961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.430559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.431525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.436900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.438512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.512964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:39.514834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.548170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.554900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.556713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.560748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.564595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.565371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.768750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:39.779109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c44abd73-e0da-4ddd-a9d5-4cbe266fe180 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.271090 Oct 18 13:50:39.780330 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2701/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:39 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:39.801078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:39.801840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.810102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.810631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.811087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.812004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.824546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.825409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:40.025656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:40.034761 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99ac5a5f-7f77-47da-96eb-312e7338c55c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.244773 Oct 18 13:50:40.053848 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2702/5256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:39 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:40.307190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:40.316662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e2ff469-1220-4a04-8d93-be7e12b581c9 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1724 microversion: 2.1 time: 0.938240 Oct 18 13:50:40.320354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2555/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:39 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1724 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:40.819691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:40.820367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:40.845126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:40.845897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:40.847143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:40.848276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:40.849199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:40.850224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.054288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:41.061632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:41.065487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:41.074420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6fa792b0-ffb6-4962-b610-ec77c10742cb tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.271909 Oct 18 13:50:41.095949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.096338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2703/5258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:40 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:41.097055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.097579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.098345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.101109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.101773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.343997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:41.349265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:41.365564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.366163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.366606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.367431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.368972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.369566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.398090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:41.409604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6c446de-3fec-4ca9-a452-b6a4ebb62c23 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.352704 Oct 18 13:50:41.417496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2556/5259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:41 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:41.649162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:41.658392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0da56283-0296-48d4-9811-13ea4db5933f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1724 microversion: 2.1 time: 0.320537 Oct 18 13:50:41.659326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2704/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:41 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:42.108817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:42.112179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:42.116475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.116975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.117424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.118277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.118738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.119216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.285606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:42.302988 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-507d5add-7119-4b51-900e-24ac2e8dc22c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.195698 Oct 18 13:50:42.303654 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2557/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:42 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:42.443466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:42.444798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:42.453357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.454047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.454747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.455645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.456288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.456899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.648122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:42.658048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9cd7ca87-eb2f-47a3-962a-4479b086b1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.218690 Oct 18 13:50:42.658893 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2705/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:42 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:42.683953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:42.684959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:42.691603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.692313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.692958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.693844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.697406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.697406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.901318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:42.912896 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c683a811-6800-4e73-bc16-aca067822231 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1724 microversion: 2.1 time: 0.233056 Oct 18 13:50:42.913874 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2558/5263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:42 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:43.337302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:43.339561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:43.356574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.357197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.357726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.358597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.359273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.359855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.684422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:43.685864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:43.694964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.695976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.696879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.697886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.698795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.699426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.898469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:43.934552 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40b831e2-1bc5-45f2-9b1d-d04cff8f9bd8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1723 microversion: 2.1 time: 0.603850 Oct 18 13:50:43.939185 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2706/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:43 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1723 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:43.953448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:43.954103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:43.960747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.961280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.961911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.962812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.963515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.965527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.178157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:44.187065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98977083-ddb8-431f-bbd6-a53304a7ec2e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.508066 Oct 18 13:50:44.206222 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2559/5265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:43 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:44.365832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:44.379864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d931391-55b2-422f-8993-429b1c7b88fd tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1730 microversion: 2.1 time: 0.439416 Oct 18 13:50:44.381404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2707/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:43 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1730 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:44.404849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:44.405383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:44.412213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.412702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.413155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.413909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.414443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.415047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.592845 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4509b2f5-f97d-4e6f-8a0f-260635515a64 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192739 Oct 18 13:50:44.603948 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2560/5267] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:50:44 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:50:44.964206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:44.965453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:44.977565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.980990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.981743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.984393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.986132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.986786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.222679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:45.223213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:45.232488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:45.233044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:45.233501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.234288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:45.234922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:45.235588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.501106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:45.513612 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29d0a1ea-6a43-4cc3-800c-88ba805aba8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.296355 Oct 18 13:50:45.514606 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2561/5268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:45 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:45.779134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:45.788933 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-872dfbb2-7c48-47b9-aa12-b8024311f048 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1700 microversion: 2.1 time: 0.829970 Oct 18 13:50:45.790066 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2708/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:44 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1700 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:45.829239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:45.835226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:45.835966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:45.836562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.876733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:50:46.213666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3495466f-3067-43ad-ac83-34aa05274dc1 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action" status: 202 len: 0 microversion: 2.1 time: 0.388352 Oct 18 13:50:46.220112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2562/5270] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:50:45 2022] POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:46.232931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:46.233996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:46.242267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.243109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.246237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.246237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.246237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.246237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.552220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:46.552943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:46.576405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.577111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.577719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.579346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.580128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.580711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.590505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:46.626834 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6cb966aa-7ac2-4b2e-aaaa-851da127a9cd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1709 microversion: 2.1 time: 0.392176 Oct 18 13:50:46.627737 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2709/5271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:46 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1709 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:47.202793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:47.227700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.236206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.237700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:47.265068 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] Creating event network-changed:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:50:47.272101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-208f004c-bb19-412d-a37e-e7d25d8fcb3f req-e7593014-791e-4a8e-bf98-9f158281adad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073656 Oct 18 13:50:47.273482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2710/5272] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:47.471930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:47.489052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e7dac1d-01c4-42db-85a7-e23b4a9a882b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.950699 Oct 18 13:50:47.511630 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2563/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:46 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:47.666214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:47.667814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:47.681983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.682851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.683746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:47.685437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.703375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.703375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:48.008628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:48.018793 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-348c24b6-7890-4c85-ae2c-7b251ff81a07 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1709 microversion: 2.1 time: 0.357938 Oct 18 13:50:48.035796 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2711/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:47 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1709 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:48.523726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:48.525015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:48.538484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=49 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:48.550425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:48.551956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:48.552739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:48.553910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:48.554475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:48.554916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:48.734895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:48.746101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c212521f-079b-4b7f-9e29-e091d16fa0ca tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.226309 Oct 18 13:50:48.747118 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2564/5275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:48 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:49.043449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:49.044201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:49.051898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.053175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.053864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.054853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.056593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.056593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.333606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:49.344842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:49.345315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:49.357254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.357893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.358396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.362266 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1dd8936d-ee56-4aca-b57f-b9e3907bc6d4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1709 microversion: 2.1 time: 0.322981 Oct 18 13:50:49.363314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2712/5276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:49 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1709 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:49.387632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] Creating event network-changed:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:50:49.393019 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6adcefa6-f0a7-4d61-b813-8168b2ac0ca3 req-17b3c914-d1b1-4e74-a84d-6a218673592c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063171 Oct 18 13:50:49.393985 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2565/5277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:50:49.777826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:49.782291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:49.784838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=67 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:49.801062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.801580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.802040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.805290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.805800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.806359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:50.113454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:50.123838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36362b21-28ea-4415-8ef8-721e00410310 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.353753 Oct 18 13:50:50.124701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2713/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:49 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:50.392101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:50.392818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:50.400359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:50.402138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:50.402503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:50.404201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:50.404908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:50.405559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:50.712792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:50.729426 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b130d8f-f74c-4058-a9d0-90dfae5e4341 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1713 microversion: 2.1 time: 0.342773 Oct 18 13:50:50.730374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2566/5279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:50 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1713 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:51.153160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:51.155283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:51.165445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:51.166513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:51.166876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:51.167828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:51.168570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:51.169151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:51.470372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:51.486170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abadb799-9217-4fd8-8132-d190c085a6f1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1696 microversion: 2.1 time: 0.333767 Oct 18 13:50:51.488468 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2714/5280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:51 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1696 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:52.513929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:52.515293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:52.535792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.536553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.537925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:52.538941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.540213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.541177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:53.146770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:53.158687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c0aa0c9-a488-4010-882c-318d1bae0831 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1695 microversion: 2.1 time: 0.649396 Oct 18 13:50:53.159213 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2567/5281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:52 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1695 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:54.068747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "name": "network-vif-unplugged", "status": "completed", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:54.094461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.094990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.095436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.117741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Creating event network-vif-unplugged:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h1-858383-13 Oct 18 13:50:54.126272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:50:54.139544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-111dd176-785b-4c4a-85bc-3363733b7dea req-b694f086-a029-4d29-8c95-76a2569b54ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075746 Oct 18 13:50:54.142980 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2715/5282] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:50:54.189469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:54.190764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:54.199992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.200501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.201183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.201913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.202409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.202852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.951050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:54.959897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17ddc124-de0b-4240-9489-870c0cb5f29f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1695 microversion: 2.1 time: 0.778753 Oct 18 13:50:54.960939 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2568/5283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:54 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1695 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:55.992957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:55.996074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:56.027339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:56.027858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:56.028309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:56.029046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:56.029785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:56.030315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:56.197650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:56.233377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:56.234232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:56.235001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:56.264394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:56.277007 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Creating event network-changed:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h1-858383-13 Oct 18 13:50:56.290323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:50:56.324792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0ac254f1-1419-456d-8589-0f53afba5534 req-4f7f9202-3805-4204-9184-f639deaad22c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131118 Oct 18 13:50:56.326677 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2569/5284] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:50:56.952006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:56.968590 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f23aaf5f-2160-44f4-8ebf-b13b72684e6d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1695 microversion: 2.1 time: 0.983460 Oct 18 13:50:56.969205 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2716/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:55 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1695 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:57.819156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1453597245", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "7fb4395b-0902-46d4-9354-c43d903aca83"}], "key_name": "tempest-TestSecurityGroupsBasicOps-399537597", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fa1f1b15-0f41-4175-bc63-1946ffd10278"]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:57.903111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] validate_networks() for [('7fb4395b-0902-46d4-9354-c43d903aca83', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:50:57.998165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:57.998786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:58.011911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.017163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.017914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.024499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.024499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.024499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.386074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:58.402840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43fa6f22-6166-4b50-980a-550fd58664b7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1695 microversion: 2.1 time: 0.409554 Oct 18 13:50:58.424058 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2717/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:57 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1695 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:59.007711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:50:59.008315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:50:59.008563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:50:59.009135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:50:59.009879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:50:59.022024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.022789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.024337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:59.024337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.024884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.025467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:59.047345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:50:59.053710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Getting quotas for user ce62c03899e040bab1f041aba0187227 and project 67095bbb7a4647ca994ab52dc948d83b. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:50:59.070334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:50:59.073339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:50:59.348444 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef493447-3aa2-4b5f-802d-e2eda0ff6ec9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.531008 Oct 18 13:50:59.352588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2570/5287] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:50:57 2022] POST /compute/v2.1/servers => generated 361 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:50:59.364504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c1b1af2-f648-47d5-9cf3-ed46f014d6ca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:59.367298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c1b1af2-f648-47d5-9cf3-ed46f014d6ca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:59.429247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:59.429972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:59.473815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.476246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.480155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:59.481033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.488174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.489115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:59.802947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:59.811801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c1b1af2-f648-47d5-9cf3-ed46f014d6ca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:59.817258 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3259c9eb-f884-4784-a5fb-8e54fdc414bc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1693 microversion: 2.1 time: 0.393760 Oct 18 13:50:59.818744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2571/5288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:59 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1693 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:59.832518 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c1b1af2-f648-47d5-9cf3-ed46f014d6ca tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1241 microversion: 2.1 time: 0.472018 Oct 18 13:50:59.833229 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2718/5289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:59 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1241 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:00.847002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:00.848398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:00.858120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.858643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.859032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:00.859412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.859656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:00.859970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.860701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.861212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.913453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.913978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.914480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.915218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.915688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.916118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:01.488159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:01.502097 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dec9cb86-403e-41a9-a1b0-9263d7dfdeb4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1245 microversion: 2.1 time: 0.647776 Oct 18 13:51:01.522894 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2719/5290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:00 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1245 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:01.535423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:01.564723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22729a83-7491-4ea4-b8d9-78f58fc682f9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1693 microversion: 2.1 time: 0.710236 Oct 18 13:51:01.566532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2572/5291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:00 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1693 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:02.530600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:02.531447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:02.546905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:02.552377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:02.556249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:02.558459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:02.559779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:02.575949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:02.590098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:02.590835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:02.614705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:02.615481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:02.616922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:02.619892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:02.622339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:02.627408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:02.935751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:02.959566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-26afa8af-647f-493b-a5c5-eff2f6332bb6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1690 microversion: 2.1 time: 0.374130 Oct 18 13:51:02.963095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2573/5292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:02 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1690 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:02.992296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:02.993150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:03.001061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.014421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.014421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.014421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.014421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.014421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.196495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:03.205270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e514285-e689-4ebf-a540-582e0f4eaa30 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1293 microversion: 2.1 time: 0.679047 Oct 18 13:51:03.205742 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2720/5293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:02 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1293 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:03.289945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-50a6e248-afe7-4586-bab4-d3720e390cea tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action" status: 204 len: 0 microversion: 2.1 time: 0.302589 Oct 18 13:51:03.293083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2574/5294] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:02 2022] POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:03.308800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:03.309629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:03.319626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.320126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.320565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.324375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.325067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.325656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.809590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:03.821314 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5442838a-e5cc-487a-ae78-21bb2ae01d2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1690 microversion: 2.1 time: 0.516885 Oct 18 13:51:03.824598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2721/5295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:03 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1690 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:04.231333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:04.233936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:04.248311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.249498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.250239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.252139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.252802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.253398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.544297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:04.556320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31e1368c-1c21-4006-bcf7-702b9b078a07 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.331143 Oct 18 13:51:04.559515 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2575/5296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:04 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:04.858232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:04.859706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:04.898949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.899513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.900312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.900726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.901404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.901893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:05.529254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:05.538113 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17aa780b-eb26-4637-a5f2-0b97ebe08e11 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1690 microversion: 2.1 time: 0.689471 Oct 18 13:51:05.542970 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2722/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:04 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1690 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:05.587775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:05.589019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:05.606473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:05.613050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:05.615723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:05.617932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:05.619833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:05.621691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:05.898566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:05.907437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5c1802e-1001-4b07-9218-80bce00b14f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.323954 Oct 18 13:51:05.908019 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2723/5298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:05 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:06.032175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "name": "network-vif-plugged", "status": "completed", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:06.067132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:06.067657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:06.068106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:06.132894 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Creating event network-vif-plugged:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h1-858383-13 Oct 18 13:51:06.164299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:51:06.197550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c77d431c-6e3b-4bc2-adbd-3888adc52d47 req-07754678-5b37-4ced-869a-b736af1eb645 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.760793 Oct 18 13:51:06.200100 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2576/5299] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:06.575638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:06.576702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:06.587132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:06.588021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:06.590242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:06.590242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:06.590242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:06.592064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:06.941671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:06.942890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:06.954531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:06.955378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:06.958109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:06.959480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:06.960348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:06.961748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:07.016424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:07.025027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5076de03-69f3-4f6d-9805-4b17d74b8df0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1690 microversion: 2.1 time: 0.456030 Oct 18 13:51:07.026465 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2724/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:06 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1690 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:07.128391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:07.148101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-72095227-80fd-413b-801b-a735d654d11a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.215298 Oct 18 13:51:07.149001 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2577/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:06 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:07.811769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05bb674-03e3-47b3-8de0-61593485fa76", "tag": "4eb81378-4b93-4f75-86f6-e04f221a835e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:07.824787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:07.825342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:07.825947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:07.841206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] Creating event network-changed:4eb81378-4b93-4f75-86f6-e04f221a835e for instance d05bb674-03e3-47b3-8de0-61593485fa76 on n-h2-858383-13 Oct 18 13:51:07.850838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-643c12d2-03f1-48a7-8ff1-95dd68902187 req-d055323b-38ea-4b22-8aa1-6a2f59c11361 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046965 Oct 18 13:51:07.850838 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2725/5302] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:08.057390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:08.058239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:08.067692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:08.068285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:08.068903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:08.069628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:08.077743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:08.080475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:08.175352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:08.176611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:08.187527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:08.188491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:08.188949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:08.190134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:08.190805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:08.191445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:08.256055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:08.270333 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d6bcc3f-e7cf-4007-b2e4-2b5e1b37ba81 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1682 microversion: 2.1 time: 0.220309 Oct 18 13:51:08.272374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2578/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:08 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:08.473757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:08.486885 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab46aed0-7f40-4f54-8227-1accef10a9e9 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.317600 Oct 18 13:51:08.488342 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2726/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:08 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:09.513842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:09.516271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:09.525099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:09.526531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:09.531170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.532470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.533301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.534422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.535198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.535921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.985009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:09.995940 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-452777b8-2bd6-4fd1-924d-d33d2f5ea1d4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.485916 Oct 18 13:51:09.996562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2579/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:09 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:11.021398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:11.022044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:11.025250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:11.047004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:11.048092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:11.049259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:11.050313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:11.051086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:11.051800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:11.213194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:11.224437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7987fd7f-f43a-48b0-9c94-17b0517b24f4 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.207900 Oct 18 13:51:11.225182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2727/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:11 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:12.253972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:12.255284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:12.270022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:12.272021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:12.272972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:12.274453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:12.276192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:12.277119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:12.420391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:12.431060 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1aad895d-c0a7-422b-8000-92cb798a0c7a tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.181861 Oct 18 13:51:12.432409 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2580/5307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:12 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:13.460976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:13.463049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:13.480863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:13.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:13.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:13.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:13.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:13.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:13.675005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:13.696182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0503f1a-f012-44a9-af5a-d5fe092ec155 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.243011 Oct 18 13:51:13.702866 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2728/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:13 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:14.491446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05bb674-03e3-47b3-8de0-61593485fa76", "name": "network-vif-plugged", "status": "completed", "tag": "4eb81378-4b93-4f75-86f6-e04f221a835e"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:14.504846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:14.505386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:14.506007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:14.519577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] Creating event network-vif-plugged:4eb81378-4b93-4f75-86f6-e04f221a835e for instance d05bb674-03e3-47b3-8de0-61593485fa76 on n-h2-858383-13 Oct 18 13:51:14.527732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f0e0a4b1-74a7-4ff8-b1e6-3fd772649de1 req-91d48b29-cdbf-45d0-bfbd-c7bcd0add25e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039145 Oct 18 13:51:14.527732 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2581/5309] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:14.747236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:14.748507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:14.761556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:14.762395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:14.763089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:14.763974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:14.764858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:14.765449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:14.923271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:14.933651 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3eaae067-eb79-450c-880a-33c9e375a095 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.192109 Oct 18 13:51:14.940996 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2729/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:14 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:15.975961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:15.978596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:15.991149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:15.991851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:15.992954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:15.994221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:15.998827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:16.001010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:16.130391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:16.147320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fb4d9d0-e599-42b2-af36-bf77c8965d09 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1299 microversion: 2.1 time: 0.188325 Oct 18 13:51:16.148749 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2582/5311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:15 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:17.176174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:17.177586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:17.185705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.186242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.186700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.187485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.188156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.188931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.363242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:17.406740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15b376b9-9b2e-4520-bd7d-0c6fe335c832 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1472 microversion: 2.1 time: 0.231995 Oct 18 13:51:17.418847 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2730/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:17 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:17.434654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:17.436130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:17.444879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.448477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.449693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.450674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.456921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.457668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.515623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:17.516526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:17.528101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.528988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.529657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.530753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.531432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.532148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.566526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:17.683448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'services' on Instance uuid 5504fad3-f01a-4b91-af43-bc71719884bd {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:17.735727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:17.751411 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-034206c6-732f-4b96-9ff7-856b7d4fb008 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1472 microversion: 2.1 time: 0.320555 Oct 18 13:51:17.755724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2583/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:17 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:17.775594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:17.776488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:17.783655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.784511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.785192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.786223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.786930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.787629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.044669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02212eec-6ac6-4bb9-a581-6e8769d4bcc8 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1625 microversion: 2.1 time: 0.271456 Oct 18 13:51:18.045450 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2584/5314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:17 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1625 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:18.072032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:18.073334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:18.081568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.081568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.081568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.081568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.082365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.082365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.118814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6298d04b-fc34-45a0-8a25-940c477b56ac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments/4c95318a-7fb8-4014-a3e9-2c4661724cd4" status: 202 len: 0 microversion: 2.1 time: 0.607850 Oct 18 13:51:18.121484 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2731/5315] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:51:17 2022] DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments/4c95318a-7fb8-4014-a3e9-2c4661724cd4 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:18.147579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:18.153034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:18.162043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.163049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.163563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.164503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.165305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.184446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.207252 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96d90b04-8004-415b-bb1a-7763b2bdc01e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070843 Oct 18 13:51:18.214363 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2732/5316] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:18 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:18.353101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdef0ea8-f7b0-4eeb-9d56-e3cc07399cf1 tempest-TestSecurityGroupsBasicOps-1742746000 tempest-TestSecurityGroupsBasicOps-1742746000-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1912 microversion: 2.1 time: 0.284822 Oct 18 13:51:18.354278 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2585/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:18 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1912 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:18.479700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:18.480519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:18.497204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.500198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.501500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.503174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.504681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.505210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.539411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:19.006908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06e85278-4525-4594-b6cc-63daf63dc810 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 204 len: 0 microversion: 2.1 time: 0.556980 Oct 18 13:51:19.011809 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2733/5318] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:18 2022] DELETE /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:19.018890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:19.019526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:19.035770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.037921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.045303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:19.046460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.046983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.047456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:19.200126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:19.203686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:19.222723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f050cda4-acbf-42fc-87a7-538a66c2bea2 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1478 microversion: 2.1 time: 0.202197 Oct 18 13:51:19.227758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:19.228305 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2586/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:19 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:19.239757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:19.272758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.279750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.281007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:19.281968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.282629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.287688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:19.373013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc2962ac-5ed8-4b77-9aec-79a79af95402 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150811 Oct 18 13:51:19.373881 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2734/5320] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:19 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:20.255846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:20.256479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:20.265700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:20.274475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:20.276639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:20.277837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:20.278595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:20.279248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:20.387049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:20.389967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:20.410143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:20.410963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:20.415344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:20.420871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:20.421639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:20.422401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:20.425226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:20.437947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-daede8db-4520-4ac7-bea7-904990cc9ed7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1478 microversion: 2.1 time: 0.185941 Oct 18 13:51:20.439829 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2587/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:20 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1478 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:20.495994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-867c136c-ead6-4268-a236-fd80272d29c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112653 Oct 18 13:51:20.506259 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2735/5322] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:20 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:21.484243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:21.484243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:21.493170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:21.510710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:21.518237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:21.518378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.518378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.519896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.520724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.524449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:21.526038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.526647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.542736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.543241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.543686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.551826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.552349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.552801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.664784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d69d239-b997-46a1-ae55-87c2f068abad tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159291 Oct 18 13:51:21.669044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2736/5323] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:21 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:21.704930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05bb674-03e3-47b3-8de0-61593485fa76", "name": "network-vif-deleted", "tag": "4eb81378-4b93-4f75-86f6-e04f221a835e"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:21.732975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.736538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.737312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.787359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] Creating event network-vif-deleted:4eb81378-4b93-4f75-86f6-e04f221a835e for instance d05bb674-03e3-47b3-8de0-61593485fa76 on n-h2-858383-13 Oct 18 13:51:21.799084 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-33aafe58-4eb3-41e4-914a-2e6967670dc6 req-d8b45242-8d6c-444e-a13e-ad6ae54a6945 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095932 Oct 18 13:51:21.804149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2737/5324] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:21.832119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:21.848657 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0db510de-353f-49bd-a6d4-8102e87203c7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1478 microversion: 2.1 time: 0.383704 Oct 18 13:51:21.853282 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2588/5325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:21 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1478 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:22.680772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:22.684793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:22.714422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.715323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.716032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.720186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.721442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.722732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.817253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-256ab9b6-5663-4821-b1ac-0364c9e24436 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141824 Oct 18 13:51:22.817846 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2589/5326] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:22 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:22.881185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:22.882589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:22.889868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.890747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.891501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.892567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.893246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.894026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.909316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:22.909316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:22.919599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.920106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.924187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.924977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.925515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.925961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.001881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:23.001881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:23.001881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.001881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lazy-loading 'fault' on Instance uuid d05bb674-03e3-47b3-8de0-61593485fa76 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:23.096196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:23.107272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49a1330d-8a99-420c-adc7-4b3a7d7ba122 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 200 len: 1331 microversion: 2.1 time: 0.229972 Oct 18 13:51:23.125412 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2590/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:22 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 1331 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:23.315898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:23.329742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:23.332534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:23.334071 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c726fee5-6cdc-43a7-81cb-f3ed21e3a519 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2950 microversion: 2.42 time: 0.829051 Oct 18 13:51:23.336026 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2738/5328] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:51:22 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2950 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:51:23.366626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:23.371435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:23.379354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:23.380145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:23.380608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.381333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:23.382837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:23.383618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.647067 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71728fe7-ac36-471d-8d75-8b4aff711974 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.286111 Oct 18 13:51:23.648150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2591/5329] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 13:51:23 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c/os-interface => generated 1832 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:51:23.839497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:23.841871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:23.873414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:23.874995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:23.876180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.877632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:23.878433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:23.879054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.951953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dda5a52b-fe68-4dc1-a792-2a696dc6b15f tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116203 Oct 18 13:51:23.952673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2739/5330] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:23 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:24.132288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:24.133508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: d05bb674-03e3-47b3-8de0-61593485fa76] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:24.142174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.149518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.150897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.151922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.152562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.153169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.191843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] HTTP exception thrown: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Request method failure captured: Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 HTTP/1.1 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Q6lvX5pGiD9EpI7s3A-AqtEBbFZThE5-71nUFOc2K6lsCEBzUl_9yiqmJfdUXDS49_zYbJlvvcAM81gL0wwjZMHuwueIdhhCFjdfnBii8xaPL4mtdtnWfYsCg_DuMOeJb_3Cugj_OYFwAeusWqpq350gzmRT1CNDJGdEQ6u3WYlw Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 67095bbb7a4647ca994ab52dc948d83b Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 67095bbb7a4647ca994ab52dc948d83b Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestSecurityGroupsBasicOps-698889519-project Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ce62c03899e040bab1f041aba0187227 Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestSecurityGroupsBasicOps-698889519-project Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd05bb674-03e3-47b3-8de0-61593485fa76'} Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:24.193544 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Returning 404 to user: Instance d05bb674-03e3-47b3-8de0-61593485fa76 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c20f35e9-d64a-495c-bce1-5878ad1648c0 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76" status: 404 len: 111 microversion: 2.1 time: 0.067701 Oct 18 13:51:24.201652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2592/5331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:24 2022] GET /compute/v2.1/servers/d05bb674-03e3-47b3-8de0-61593485fa76 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:51:24.226278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:24.229823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:24.243379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.246009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.246450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.249971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.251473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.252408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.438852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lazy-loading 'services' on Instance uuid 0eb11d9b-3339-4d7f-a5fa-680e6538247c {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:24.845512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e95a80c2-c665-454c-9f3c-86222189af98 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments/b817e200-d574-4f3d-9e8e-b730a9abb01f" status: 202 len: 0 microversion: 2.1 time: 0.634455 Oct 18 13:51:24.846879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2740/5332] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:51:24 2022] DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments/b817e200-d574-4f3d-9e8e-b730a9abb01f => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:24.971396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:24.982457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:25.010847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:25.018703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:25.020714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:25.022412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:25.026989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:25.028220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:25.129668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2d73e041-9327-420c-b3f8-6414ca9d3d92 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166497 Oct 18 13:51:25.138260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2593/5333] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:24 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:26.163842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:26.169938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:26.193726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:26.194447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:26.195220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:26.196159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:26.198793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:26.199520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:26.276156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e3e0062-0aff-48eb-8314-0db741853629 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134511 Oct 18 13:51:26.281150 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2741/5334] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:26 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:27.295249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:27.299422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:27.309909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.310708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.311358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.312330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.313599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.314261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.381470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b03d6551-0e6b-4b2a-a0bf-e0c0490e1c53 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083732 Oct 18 13:51:27.381470 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2594/5335] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:51:27 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:51:27.524358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:27.527478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:27.552384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.552982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.553720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.555155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.559459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.560197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.639239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Cannot 'reboot' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action HTTP/1.1 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 28 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: {"reboot": {"type": "HARD"}} Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: exception: Cannot 'reboot' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8d9ed5d1-5cac-4d93-8d56-3a1a6a040712', 'body': {'reboot': {'type': 'HARD'}}} Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:51:27.653384 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.656858 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.661233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 409 to user: Cannot 'reboot' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:27.662548 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65e663e6-4412-40f1-88f6-57f5d902e65e tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action" status: 409 len: 145 microversion: 2.1 time: 0.142882 Oct 18 13:51:27.663713 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2742/5336] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:27 2022] POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action => generated 145 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:51:27.674410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:27.678145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:27.694982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.697567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.698386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.700206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.703887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.704657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.772870 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Cannot 'rebuild' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action HTTP/1.1 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 65 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: exception: Cannot 'rebuild' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '8d9ed5d1-5cac-4d93-8d56-3a1a6a040712', 'body': {'rebuild': {'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6'}}} Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:51:27.775405 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued Oct 18 13:51:27.778903 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:27.802153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 409 to user: Cannot 'rebuild' instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 while it is in vm_state rescued {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:27.803495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9bda643b-9cf8-45d9-a2a0-7fb7b28c9b1b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action" status: 409 len: 146 microversion: 2.1 time: 0.133944 Oct 18 13:51:27.804759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2595/5337] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:27 2022] POST /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:51:27.821171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:27.821893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:27.836551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.837057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.837526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.843140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.844271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.845544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.874682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1573955051", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:27.907666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:27.977596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] validate_networks() for None {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:51:28.461608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28a7610f-4c73-4a34-9e7b-90f28030153d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 204 len: 0 microversion: 2.1 time: 0.649783 Oct 18 13:51:28.478788 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2743/5338] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:27 2022] DELETE /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:28.485684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:28.488175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:28.493297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:28.493810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:28.494380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:28.495117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:28.495787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:28.496368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:28.561701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:29.089629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:29.116112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5600e930-7255-4668-a0ca-4ad809048cb0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1690 microversion: 2.1 time: 0.633787 Oct 18 13:51:29.116922 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2744/5339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:28 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1690 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:29.149164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:29.158003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:29.174618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:29.175303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:29.175923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:29.176800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:29.178135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:29.182630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:29.297143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:51:29.297655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:51:29.309995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:51:29.309995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:51:29.309995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:51:29.338722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:29.343455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:29.344733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:29.345658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:29.346215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:29.346667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:29.414447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Getting quotas for project 2da00e8c79804846a4c913cce8015690. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:51:29.433862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Getting quotas for user b01b6239b8a94b2791b537d9fb6a0085 and project 2da00e8c79804846a4c913cce8015690. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:51:29.461254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:51:29.465186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:51:29.626407 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6175593-a6ae-4c61-905b-56a28d0f4bbb tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.754311 Oct 18 13:51:29.631293 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2596/5340] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:51:29.638857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ebb6c34-f995-4ec1-84d3-c542f78f34d3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:29.641861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ebb6c34-f995-4ec1-84d3-c542f78f34d3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:29.733050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ebb6c34-f995-4ec1-84d3-c542f78f34d3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:29.743113 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ebb6c34-f995-4ec1-84d3-c542f78f34d3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1214 microversion: 2.1 time: 0.108115 Oct 18 13:51:29.744748 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2597/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:29 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:30.394746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:30.396054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:30.416006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.416716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.417220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:30.417969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.418478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.418933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:31.122200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:31.167970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e2c64a4-b3ce-4eb8-96df-962595c4fd1a tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1690 microversion: 2.1 time: 1.024353 Oct 18 13:51:31.173560 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2598/5342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:30 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1690 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:31.191725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3e806e9-aef8-43d6-9de9-ad5db8e2c020 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:31.192364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3e806e9-aef8-43d6-9de9-ad5db8e2c020 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:31.311432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d3e806e9-aef8-43d6-9de9-ad5db8e2c020 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:31.323388 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3e806e9-aef8-43d6-9de9-ad5db8e2c020 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1214 microversion: 2.1 time: 0.150456 Oct 18 13:51:31.324365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2599/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:31 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:31.638385 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17acc487-e014-4d4d-b7da-7c91d78590e7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action" status: 200 len: 24569 microversion: 2.1 time: 2.506632 Oct 18 13:51:31.639602 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2745/5344] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:29 2022] POST /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245/action => generated 24569 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:51:32.209075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:32.210604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:32.224744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:32.227881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:32.229198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.230875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:32.233742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:32.244084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.349856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:32.350653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:32.362786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:32.366464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:32.371144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.372160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:32.374810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:32.375399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.796057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:32.816210 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83e8c8f5-acbd-49c7-b34a-e56c402fe635 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1210 microversion: 2.1 time: 0.467184 Oct 18 13:51:32.816866 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2746/5345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:32 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1210 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:33.046032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:33.067581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7853caeb-341b-4561-8b16-5d821ab5e74b tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1690 microversion: 2.1 time: 0.862963 Oct 18 13:51:33.087816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2600/5346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:32 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1690 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:33.860985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:33.861615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:33.890588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:33.905424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:33.926504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:33.927748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:33.928432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:33.929041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.093034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:34.093667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:34.114349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.115563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.118266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.125047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.125598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.127656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.225654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:34.241789 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-112922d3-1cb1-4041-8fa7-85db4f722343 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1623 microversion: 2.1 time: 0.154395 Oct 18 13:51:34.265163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:34.284151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-774ce871-edac-4fcf-9f7c-679178e0e9e0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1274 microversion: 2.1 time: 0.437684 Oct 18 13:51:34.284602 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2601/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:34 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1623 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:34.284774 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2747/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:33 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1274 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:34.322224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:34.323098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:34.330031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.331037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.331703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.332644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.333280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.334747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.377011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5504fad3-f01a-4b91-af43-bc71719884bd", "name": "network-vif-deleted", "tag": "8dd5aaf4-7b67-4dfa-ac06-4776fabe9918"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:34.391196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.391797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.392426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.474100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] Creating event network-vif-deleted:8dd5aaf4-7b67-4dfa-ac06-4776fabe9918 for instance 5504fad3-f01a-4b91-af43-bc71719884bd on n-h1-858383-13 Oct 18 13:51:34.499944 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-21426bd6-b5de-48d4-9a42-7bcb32aca33c req-74d579ad-2af4-4223-8c75-842693b49071 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115979 Oct 18 13:51:34.501178 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2748/5349] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:34.509151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:34.520179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.520738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.521206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.563228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:51:34.667487 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76418da9-84bf-4b3a-810a-d03d213e648d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1835 microversion: 2.1 time: 0.349189 Oct 18 13:51:34.682692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2602/5350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:34 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1835 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:34.921004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e564025d-6dc9-4e52-81d5-52c3ae193f33 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action" status: 202 len: 0 microversion: 2.1 time: 0.418070 Oct 18 13:51:34.921963 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2749/5351] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:34 2022] POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:34.930074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:34.930937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:34.942629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.952609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.953351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:34.954286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:34.956318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:34.957009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.240222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:35.254905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-47873c12-b50a-4cb6-a866-1f7177937a77 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.328588 Oct 18 13:51:35.259046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2603/5352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:34 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:35.272584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:35.273449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:35.288941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:35.292094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:35.292094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.292442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:35.295025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:35.295187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.319830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:35.320756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:35.332708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:35.336296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:35.336970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.338944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:35.341016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:35.343378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.373498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:35.376068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:35.378743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:35.384717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'fault' on Instance uuid 5504fad3-f01a-4b91-af43-bc71719884bd {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:35.515264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:35.524449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-114121ab-fdfe-41fa-a7aa-97182574a651 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1272 microversion: 2.1 time: 0.209873 Oct 18 13:51:35.539363 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2604/5353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:35 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:35.700836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:35.718932 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7daf7ae-f52d-46c3-908f-1be03b7d15e1 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 200 len: 1336 microversion: 2.1 time: 0.451211 Oct 18 13:51:35.719828 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2750/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:35 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 1336 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:36.284330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:36.285062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:36.297899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.298153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.298508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.299245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.299713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.300155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.550367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:36.551146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:36.573669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.573669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.574015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.574836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.580031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.581103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.714799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:36.728710 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d7942ff-9a77-4b3e-b81d-c288387a362a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.447633 Oct 18 13:51:36.734670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2605/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:36 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:36.753328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:36.765582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 5504fad3-f01a-4b91-af43-bc71719884bd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:36.781353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.782182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.783330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.788222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:36.788869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:36.798982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:36.819833 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd HTTP/1.1 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5504fad3-f01a-4b91-af43-bc71719884bd'} Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:36.823669 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. Oct 18 13:51:36.827645 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:36.835045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 404 to user: Instance 5504fad3-f01a-4b91-af43-bc71719884bd could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:36.864702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fce74fb3-2e11-4df1-a804-ea9eefde3444 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd" status: 404 len: 111 microversion: 2.1 time: 0.117020 Oct 18 13:51:36.864702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2606/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:36 2022] GET /compute/v2.1/servers/5504fad3-f01a-4b91-af43-bc71719884bd => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:36.872335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0634ccd9-975e-45af-97e8-508489412017 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '.version_select at 0x7fb330b3c0d0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:36.971071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0634ccd9-975e-45af-97e8-508489412017 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450612589" status: 202 len: 0 microversion: 2.1 time: 0.101775 Oct 18 13:51:36.971803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2607/5357] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450612589 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:51:37.133616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:37.134411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:37.144489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:37.152973 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99de3c9f-a253-44bd-85c5-fc5665a7e356 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1272 microversion: 2.1 time: 0.607918 Oct 18 13:51:37.159241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.160538 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2751/5358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:36 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1272 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:37.162429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.163463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.165882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:37.167146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.168760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.169224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.193365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.194648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.198439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.212677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:37.222527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:37.229239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] Creating event network-changed:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h1-858383-13 Oct 18 13:51:37.245627 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-db215f34-d84e-487e-bb9b-fd4ec55d212a req-c283dc6d-d94d-4cb7-80d2-0c2b5567dbcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083587 Oct 18 13:51:37.247056 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2752/5359] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:37.701876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ae3ea81-2269-4d1a-bc3a-943d6379c264 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 204 len: 0 microversion: 2.1 time: 0.572809 Oct 18 13:51:37.704854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2608/5360] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:37 2022] DELETE /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:51:37.719553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:37.720261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:37.736746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.737598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.738316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.739259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.739928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.740563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.764438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:37.765706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:37.785034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.785566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.790187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:37.793137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:37.793703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:37.794184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:38.202254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:38.218758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e87acf7-7555-4382-9d5e-abc18873c462 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1688 microversion: 2.1 time: 0.502970 Oct 18 13:51:38.222876 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2753/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:37 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1688 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:38.233295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:38.235337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:38.246126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:38.247508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:38.248115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:38.254990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:38.254990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:38.254990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:38.336345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:38.346540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8e64ba1-5abb-4ebb-b5ff-3b76114b6a0c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.588897 Oct 18 13:51:38.351760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2609/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:37 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:38.691150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:38.722945 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b563b53b-bbfd-4cb0-a2bf-afb7d8337283 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1272 microversion: 2.1 time: 0.497136 Oct 18 13:51:38.723582 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2754/5363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:38 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1272 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:39.250477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:39.252581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:39.267958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.268548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.269054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.269777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.270273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.270749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.372166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:39.372797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:39.377071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:39.384277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.386296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.387678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.390147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.391256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.396215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.823942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:39.868065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4cca9371-4aef-4735-b92e-2fc2115c4a6b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1688 microversion: 2.1 time: 0.621793 Oct 18 13:51:39.892190 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2610/5364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:39 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1688 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:39.897387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:39.906162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:39.924975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.925585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.926236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.927100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:39.927664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:39.928199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:39.985994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:40.039242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:40.052893 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-011c30ba-d729-4d2d-a16d-35255c8e3f69 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.685617 Oct 18 13:51:40.059204 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2755/5365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:39 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:40.070767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1f1b15-0f41-4175-bc63-1946ffd10278", "tag": "7b5298c9-cc22-4fb0-91be-dd17c1af0640"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:40.113429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.118470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.119888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:40.159960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] Creating event network-changed:7b5298c9-cc22-4fb0-91be-dd17c1af0640 for instance fa1f1b15-0f41-4175-bc63-1946ffd10278 on n-h1-858383-13 Oct 18 13:51:40.178048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4898591b-952f-4fc4-8768-7ca953b703bc req-9048a0a9-678d-461f-a17b-9bb1ac22f7ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116251 Oct 18 13:51:40.180002 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2756/5366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:40.190622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:40.192186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:40.209422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.210604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.211651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:40.213277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.214401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.215621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:40.452159 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9fbbc264-348f-4779-a478-4f636c437936 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 204 len: 0 microversion: 2.1 time: 0.558173 Oct 18 13:51:40.458638 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2611/5367] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:39 2022] DELETE /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:40.469039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:40.469039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:40.490355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.491092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.491327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:40.492104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.492586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.493032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:40.892388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:40.924215 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f9f02b9-0a23-4c65-a8d0-f5fe429c88d5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.742157 Oct 18 13:51:40.925660 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2757/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:40 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:40.962111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:40.968513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:40.995029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:40.998316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:40.998951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:41.001959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:41.004100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:41.004803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:41.039038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:41.048192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-05276a47-f0d2-4259-ba48-7e90532abb37 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1765 microversion: 2.1 time: 0.586028 Oct 18 13:51:41.054187 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2612/5369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:40 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1765 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:41.085191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:41.086932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:41.128827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:41.129727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:41.132524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:41.133117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:41.137223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:41.138109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:41.320086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:41.359345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:41.378471 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f37487b7-dae2-42ec-974c-919468bf34d9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1620 microversion: 2.1 time: 0.436039 Oct 18 13:51:41.381984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2758/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:40 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1620 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:41.436011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:41.449007 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-150f468f-cc12-43b0-ab63-cc58b43d7a9a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.366674 Oct 18 13:51:41.449817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2613/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:41 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:41.955937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:41.956560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:41.972926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:41.984875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:41.984875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:41.984875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:41.987619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:41.990610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.081221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:42.082567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:42.097246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.097852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.103514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.104482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.105068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.105477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.289297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:42.303195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33b133bc-27f3-407a-8983-df408bec78d4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.351930 Oct 18 13:51:42.318097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2759/5372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:41 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:42.318097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed0a00-e854-401c-bd3f-c71bff18e245", "name": "network-vif-deleted", "tag": "14b400b0-5598-45ff-aafb-3e13341a02f2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:42.321905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.322438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.323477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.376083 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] Creating event network-vif-deleted:14b400b0-5598-45ff-aafb-3e13341a02f2 for instance 88ed0a00-e854-401c-bd3f-c71bff18e245 on n-h1-858383-13 Oct 18 13:51:42.400745 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1e508b52-daba-4958-ba5f-3aef30dfb6cf req-4e41ef29-9d1e-4534-9b6c-77657ef1954b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088992 Oct 18 13:51:42.401496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2760/5373] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:42.417076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3", "tag": "76aec5c9-5b9a-4c7e-8e44-33c68fd840f7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:42.437873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.438397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.438853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.498440 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] Creating event network-changed:76aec5c9-5b9a-4c7e-8e44-33c68fd840f7 for instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 on n-h2-858383-13 Oct 18 13:51:42.505310 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c20f4ee0-4bc4-4599-bf24-2540e3518dd3 req-bf426613-2e51-405e-8a9e-7583789afe5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101872 Oct 18 13:51:42.506775 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2761/5374] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:42.514103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:42.515248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:42.522766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.523549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.524179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.525821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.526663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.527435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.571386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.572092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.572703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.573577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lazy-loading 'fault' on Instance uuid 88ed0a00-e854-401c-bd3f-c71bff18e245 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:42.787647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:42.805160 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5174d4da-780b-4932-bd9d-7ae18e536570 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 200 len: 1355 microversion: 2.1 time: 0.296284 Oct 18 13:51:42.822759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2762/5375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:42 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 1355 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:42.836014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:42.836651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:42.847606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.848291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.849318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.850348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:42.851093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:42.851783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:42.859865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:42.959358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:42.992037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bdfd0be-9cf4-4979-ab26-274a9c53ebf5 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1765 microversion: 2.1 time: 0.914455 Oct 18 13:51:43.008295 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2614/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:42 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1765 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:43.302108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:43.318969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a29a59e-8f14-496b-a25a-2684217ef338 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.489030 Oct 18 13:51:43.319563 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2763/5377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:42 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:43.331406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:43.332635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:43.341039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:43.341809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:43.342441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:43.343361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:43.344003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:43.344599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:43.718925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:43.728675 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-665ff956-d13c-4bbe-82f2-1f4df0347190 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.401099 Oct 18 13:51:43.730694 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2615/5378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:43 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:43.837136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:43.839711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 88ed0a00-e854-401c-bd3f-c71bff18e245] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:43.848423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:43.849328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:43.850140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:43.851075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:43.851613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:43.852200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:43.872738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] HTTP exception thrown: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Request method failure captured: Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 HTTP/1.1 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq7IGBlDKyARK9VA6W2bq45YJNmQP5lsBo3jK6nNFchQFCp7WqlbDx9FWzSYmi1RbzwwhLUSCg8_4yT2NzxnUBwLIYE1M-wa8UW8IDq3k-Ysb5tQcdQ0OSPZx8bR8xoXaXFiyazPea2eTVrjs1McVHg0DkpMgDyTtLesBx_HAIgMSq4 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 69a2792ee20e450e877d4f016c031768 Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '88ed0a00-e854-401c-bd3f-c71bff18e245'} Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:43.875083 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. Oct 18 13:51:43.879486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:51:43.880627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Returning 404 to user: Instance 88ed0a00-e854-401c-bd3f-c71bff18e245 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:43.881676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-069258df-17aa-4e0b-8296-27a69726524e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245" status: 404 len: 111 microversion: 2.1 time: 0.049161 Oct 18 13:51:43.882598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2764/5379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:43 2022] GET /compute/v2.1/servers/88ed0a00-e854-401c-bd3f-c71bff18e245 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:44.030235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:44.031219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:44.039669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.041026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.041716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.043459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.048343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.048343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.143088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:44.152552 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91fa2c30-fdbd-4b15-af4b-33e58563eee7 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1527 microversion: 2.1 time: 0.127771 Oct 18 13:51:44.153141 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2616/5380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:44 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1527 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:44.348859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:44.349475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:44.357300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.357796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.358279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.358990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.359452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.359958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.467115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1f1b15-0f41-4175-bc63-1946ffd10278", "name": "network-vif-deleted", "tag": "7b5298c9-cc22-4fb0-91be-dd17c1af0640"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:44.487457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.488229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.489479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.504849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] Creating event network-vif-deleted:7b5298c9-cc22-4fb0-91be-dd17c1af0640 for instance fa1f1b15-0f41-4175-bc63-1946ffd10278 on n-h1-858383-13 Oct 18 13:51:44.513506 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-dd8ae2f8-f544-49d3-9ff7-a5f432f01753 req-588f9cf3-546f-4f60-95b8-b197e0b74fe3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050009 Oct 18 13:51:44.514831 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2617/5381] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:51:44.754222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:44.758216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:44.767881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:44.772178 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea8f0026-7905-4e9c-b0d7-815f4a03e2b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1677 microversion: 2.1 time: 0.427008 Oct 18 13:51:44.795176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.795407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2765/5382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:44 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1677 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:44.796147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.796754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:44.797631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:44.798635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:44.799362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:45.017384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:45.026311 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62c59dfb-f518-4b6c-a64b-128b63ef1fdc tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.276869 Oct 18 13:51:45.027254 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2618/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:44 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:45.177901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:45.177901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:45.194031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:45.205060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:45.205582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:45.210602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:45.210602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:45.210602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:45.280609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:45.281377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:45.281987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:45.282710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lazy-loading 'fault' on Instance uuid fa1f1b15-0f41-4175-bc63-1946ffd10278 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:45.391713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce62c03899e040bab1f041aba0187227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67095bbb7a4647ca994ab52dc948d83b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:45.451979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a6e8d8e-a232-49f6-9553-8799b48bd74b tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 200 len: 1382 microversion: 2.1 time: 0.278454 Oct 18 13:51:45.462504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2766/5384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:45 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 1382 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:45.803133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:45.803878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:45.821676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:45.822205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:45.822884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:45.823774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:45.824420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:45.825033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.050784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:46.051649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:46.069927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.070723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.071349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.072259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.072875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.073454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.117446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:46.149446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37dc230f-64bc-4812-a279-e3566d8a1cd7 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1654 microversion: 2.1 time: 0.343037 Oct 18 13:51:46.149446 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2619/5385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:45 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1654 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:46.189705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:46.203268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.204177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.204792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.257878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:51:46.489555 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85a1dfb0-be67-4e68-a22a-5e178681ad49 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action" status: 202 len: 0 microversion: 2.1 time: 0.308241 Oct 18 13:51:46.490594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2620/5386] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:51:46 2022] POST /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:46.501622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:46.503702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] [instance: fa1f1b15-0f41-4175-bc63-1946ffd10278] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:46.507001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:46.518455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:46.526611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.529867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.530525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.532350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.533096 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5b96545-77b7-480a-ae37-2d27b6a14252 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.483795 Oct 18 13:51:46.533864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.534338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.536759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2767/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:46 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:46.559581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:46.560491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:46.572326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.574150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.574726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.577745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:46.577745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:46.577745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:46.591610 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] HTTP exception thrown: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Request method failure captured: Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 HTTP/1.1 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Q6lvX5pGiD9EpI7s3A-AqtEBbFZThE5-71nUFOc2K6lsCEBzUl_9yiqmJfdUXDS49_zYbJlvvcAM81gL0wwjZMHuwueIdhhCFjdfnBii8xaPL4mtdtnWfYsCg_DuMOeJb_3Cugj_OYFwAeusWqpq350gzmRT1CNDJGdEQ6u3WYlw Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 67095bbb7a4647ca994ab52dc948d83b Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67095bbb7a4647ca994ab52dc948d83b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 67095bbb7a4647ca994ab52dc948d83b Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-698889519 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestSecurityGroupsBasicOps-698889519-project Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: ce62c03899e040bab1f041aba0187227 Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestSecurityGroupsBasicOps-698889519-project Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'fa1f1b15-0f41-4175-bc63-1946ffd10278'} Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:46.600621 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. Oct 18 13:51:46.605747 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:46.620574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Returning 404 to user: Instance fa1f1b15-0f41-4175-bc63-1946ffd10278 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:46.623815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eaf61c5d-088d-4190-8afe-0601b0d5ca91 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278" status: 404 len: 111 microversion: 2.1 time: 0.129412 Oct 18 13:51:46.623815 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2621/5388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:46 2022] GET /compute/v2.1/servers/fa1f1b15-0f41-4175-bc63-1946ffd10278 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:47.144684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:47.157381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-afebf3ce-7285-491a-9231-93705eabd8cf tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1663 microversion: 2.1 time: 0.614367 Oct 18 13:51:47.167954 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2768/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:46 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1663 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:47.580020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:47.584589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:47.591960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:47.592858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:47.593958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:47.595024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:47.595676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:47.596361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:47.627943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:47.887873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:47.901046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b7dcd20-ca00-4dd0-8af5-5dce3489474f tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.323538 Oct 18 13:51:47.909890 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2622/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:47 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:48.183871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:48.184804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:48.204465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:48.204991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:48.205453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:48.206221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:48.206698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:48.207138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:48.428356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:48.438654 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c5a3610-41a6-44a8-bcd5-cc8a47f9b37b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1663 microversion: 2.1 time: 0.260143 Oct 18 13:51:48.439184 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2769/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:48 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1663 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:48.930317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:48.931871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:48.952107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:48.952858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:48.953717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:48.954675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:48.955382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:48.959431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.401388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3", "name": "network-vif-plugged", "status": "completed", "tag": "76aec5c9-5b9a-4c7e-8e44-33c68fd840f7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:49.413815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:49.414606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:49.416604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.453409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] Creating event network-vif-plugged:76aec5c9-5b9a-4c7e-8e44-33c68fd840f7 for instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 on n-h2-858383-13 Oct 18 13:51:49.467324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f21eaa95-89bb-45a9-a1d8-3c218d2fde89 req-3a4e6574-6cad-4808-95f7-b57fe39433a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070329 Oct 18 13:51:49.470469 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2770/5392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:49.488102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:49.488973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:49.496365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:49.497052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:49.497497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.498398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:49.498862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:49.499833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.752389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:49.768199 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c5470a4-7532-42f5-8237-f8eb27a27da7 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.843861 Oct 18 13:51:49.768813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2623/5393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:48 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:49.785819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:49.786394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:49.806239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:49.809577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:49.810139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.812382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:49.814494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:49.818567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:49.823350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:49.823986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c40f5a3-9108-4dab-a38f-ff3fbcd24e2a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1667 microversion: 2.1 time: 0.346353 Oct 18 13:51:49.839850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2771/5394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:49 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1667 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:49.878700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:50.355488 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8af8a80-77a0-445a-b29d-a7ed7831c810 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 204 len: 0 microversion: 2.1 time: 0.583083 Oct 18 13:51:50.358951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2624/5395] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:49 2022] DELETE /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:50.369266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:50.370413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:50.380808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:50.381772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:50.382500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:50.383971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:50.385793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:50.386461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:50.656712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:50.665862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bbbfe3e-1195-46d6-8c16-74ed484efcda tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1509 microversion: 2.1 time: 0.302327 Oct 18 13:51:50.666494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2772/5396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:50 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:50.794024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:50.797527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:50.800945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:50.801572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:50.802027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:50.802755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:50.803222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:50.803660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:51.117689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:51.130704 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e0d029f-0cd8-4a19-858c-93219588a862 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1314 microversion: 2.1 time: 0.339008 Oct 18 13:51:51.152578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2625/5397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:50 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:51.690366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:51.694907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:51.704887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:51.705416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:51.705877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:51.707821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:51.708310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:51.708767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:51.998106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:52.013727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5901a2fa-e669-4d0f-bdec-2ed1dec9cc18 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1509 microversion: 2.1 time: 0.328485 Oct 18 13:51:52.022803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2773/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:51 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:52.157058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:52.158902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:52.168730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:52.173550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:52.173550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:52.173550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:52.173550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:52.174186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:52.405630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:52.430262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa397a00-2c53-4642-bc21-4cc3d2bc51f9 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1464 microversion: 2.1 time: 0.263525 Oct 18 13:51:52.430262 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2626/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:52 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:52.430509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9036954c-4dce-4d4d-a9b2-2e51d07721e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '.version_select at 0x7fb32bb9c940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:52.434240 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9036954c-4dce-4d4d-a9b2-2e51d07721e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [25cc2e65-4a13-4993-a360-6a7b8c9c97d6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:51:52.443695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d367085-d2f9-41ff-9487-07a229431a08", "device": "/dev/sdb"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:52.447484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:52.469351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:52.470292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:52.470956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:52.472275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:52.473019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:52.473666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.443362 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-9036954c-4dce-4d4d-a9b2-2e51d07721e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [25cc2e65-4a13-4993-a360-6a7b8c9c97d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34056. Oct 18 13:51:53.467635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:53.544167 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9036954c-4dce-4d4d-a9b2-2e51d07721e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-482659141" status: 202 len: 0 microversion: 2.1 time: 1.123146 Oct 18 13:51:53.546403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2774/5400] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 13:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-482659141 => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:53.561163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:53.561803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:53.578980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d76d8a41-9b1c-4195-9877-9586bbe692a5 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "POST /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141416 Oct 18 13:51:53.582377 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2627/5401] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:51:52 2022] POST /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:53.599677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7a03283-2d0d-4530-ab39-d0b63e9bee3f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: .version_select at 0x7fb33526e040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2037050484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8VEy+cej10zvlVgjP5ZL5oqu907uluCBGCWwR4ztMKSKL5V6oVecOVKSlaJENrQidDqiYaolOLKH2KHkNyW9y1VWvE5hLnWHHtOO1sU8TiiCMWFs044osiFgZPf31kXg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:53.611884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:53.613614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:53.615400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.617896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:53.621843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:53.622537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.652001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b7a03283-2d0d-4530-ab39-d0b63e9bee3f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:51:53.662529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b7a03283-2d0d-4530-ab39-d0b63e9bee3f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:51:53.793023 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7a03283-2d0d-4530-ab39-d0b63e9bee3f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.202562 Oct 18 13:51:53.794359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2628/5402] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:51:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:53.946797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:53.951651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ed5d1-5cac-4d93-8d56-3a1a6a040712", "name": "network-vif-deleted", "tag": "c7f3418a-e892-4a4d-b5ba-842aab4cd9dd"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:53.958698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a21915e5-1cbd-4a65-bd4c-060ed8a78096 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1467 microversion: 2.1 time: 0.410960 Oct 18 13:51:53.960351 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2775/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:53 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:53.967597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:53.968017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:53.968457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.982728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] Creating event network-vif-deleted:c7f3418a-e892-4a4d-b5ba-842aab4cd9dd for instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 on n-h2-858383-13 Oct 18 13:51:53.988717 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b09575f0-bb0a-4510-afcd-3635d82dbed2 req-2c21a8ed-3b1c-43f0-84f3-a0d592341ed9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045120 Oct 18 13:51:53.989327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2629/5404] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:54.985869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:54.987920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:55.008367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:55.009789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:55.010197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:55.015376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:55.016128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:55.016816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:55.093976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:55.094753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:55.095456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:55.098746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'fault' on Instance uuid 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:55.208777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:55.218154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de16009c-629a-4a9d-958b-3e9a86e521f0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 200 len: 1312 microversion: 2.1 time: 0.236689 Oct 18 13:51:55.224344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2776/5405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:54 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:56.250847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:56.252756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:56.269197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.276966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.277515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.278789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.283988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.284467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.319452 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 HTTP/1.1 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '8d9ed5d1-5cac-4d93-8d56-3a1a6a040712'} Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:56.322553 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. Oct 18 13:51:56.327178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:51:56.332315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 404 to user: Instance 8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:56.333291 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65d1fc16-ecc8-4af2-9247-d04008d19b14 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712" status: 404 len: 111 microversion: 2.1 time: 0.095922 Oct 18 13:51:56.337521 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2630/5406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:56 2022] GET /compute/v2.1/servers/8d9ed5d1-5cac-4d93-8d56-3a1a6a040712 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:56.346529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:56.347118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:56.373924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.374508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.375323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.376188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.376521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.376959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.414580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:56.460151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8afe18da-648d-43f0-998f-e0555f699738 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] Calling method '.version_select at 0x7fb331ad8310>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:56.564201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8afe18da-648d-43f0-998f-e0555f699738 tempest-TestSecurityGroupsBasicOps-698889519 tempest-TestSecurityGroupsBasicOps-698889519-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-399537597" status: 202 len: 0 microversion: 2.1 time: 0.108638 Oct 18 13:51:56.565164 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2631/5407] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-399537597 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:51:56.813462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ba97783-1d37-4065-9542-e11c120ac7a6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "DELETE /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 204 len: 0 microversion: 2.1 time: 0.470715 Oct 18 13:51:56.818208 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2777/5408] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:56 2022] DELETE /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:56.823305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:56.823934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:56.831670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.832509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.833288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.834249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.834898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.835531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:57.018699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:57.033184 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e02dfa61-14eb-40f5-b753-0182c0e128c0 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.213853 Oct 18 13:51:57.038543 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2632/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:56 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:58.066646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:58.067370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:58.078650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:58.082563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:58.082563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:58.082563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:58.082563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:58.082563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:58.345501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:58.358115 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0fb582c7-845d-443a-b2ba-4b2d2eed04be tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 0.297520 Oct 18 13:51:58.358115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2778/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:58 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:59.379895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:59.380649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:59.404460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:59.404822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:59.405370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:59.406247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:59.409489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:59.410769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:00.453446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:00.482352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1eff8955-f2ab-43c0-b42d-cd2aa88f8525 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1522 microversion: 2.1 time: 1.105143 Oct 18 13:52:00.486150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2633/5411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:59 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1522 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:01.515589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:01.516981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:01.538578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:01.539432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:01.540061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:01.540865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:01.541351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:01.541799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:01.807374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:01.816758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:01.821274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d53b028c-a348-4eac-96da-6bf710f07f0d tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1480 microversion: 2.1 time: 0.311609 Oct 18 13:52:01.822243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2779/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:01 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1480 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:02.102242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693e4bf5-4eb5-417a-90c3-f22935c71976", "name": "network-vif-deleted", "tag": "7110e7ad-baa1-4881-8880-c0fa3e2a57f9"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:02.128914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:02.129410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:02.129858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:02.156578 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] Creating event network-vif-deleted:7110e7ad-baa1-4881-8880-c0fa3e2a57f9 for instance 693e4bf5-4eb5-417a-90c3-f22935c71976 on n-h2-858383-13 Oct 18 13:52:02.168118 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-cf0c0179-66e1-4d6c-8660-e2d2c7af5b05 req-a8ef8d16-de63-4317-9488-eba085ec6e4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069964 Oct 18 13:52:02.170342 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2634/5413] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:02.847074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:02.847776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:02.859025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:02.885096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:02.885096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:02.885096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:02.885096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:02.885754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:02.986777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:02.987292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:02.987931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:02.989089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lazy-loading 'fault' on Instance uuid 693e4bf5-4eb5-417a-90c3-f22935c71976 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:52:03.047742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba1f338c4a3ebe1f1b4db9bc45c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6742e113ada149739d921ce92ff153ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:03.055790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f2d897f-b013-4c1b-b8d4-896885715ce6 tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 200 len: 1312 microversion: 2.1 time: 0.212530 Oct 18 13:52:03.056384 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2780/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:02 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:04.077552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:04.082166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:04.082882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] [instance: 693e4bf5-4eb5-417a-90c3-f22935c71976] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:04.096006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:04.096519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:04.096978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:04.097778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:04.098299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:04.098799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:04.123218 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] HTTP exception thrown: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Request method failure captured: Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 HTTP/1.1 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq41vyQuoyG18bmIjRUXjIp1Me_KKNOk-MhmMbs4jEq3QU-1ub-9Brh37y80qpQX61QLA5Q3Mzyc52mWSNlI27ez--NR5Yem_AmhiwQ0EbJjSgFIlI1jaJegU1mz-qLLU51AO_qak2bTPivmOsa9UC773A8A8QboMQQFC4RzY83m8Bo Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6742e113ada149739d921ce92ff153ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6742e113ada149739d921ce92ff153ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6742e113ada149739d921ce92ff153ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6742e113ada149739d921ce92ff153ec Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-165486834 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b29dba1f338c4a3ebe1f1b4db9bc45c5 Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerRescueNegativeTestJSON-165486834-project Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '693e4bf5-4eb5-417a-90c3-f22935c71976'} Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:04.138164 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] Returning 404 to user: Instance 693e4bf5-4eb5-417a-90c3-f22935c71976 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7fbc1f71-097a-4fab-b5c6-f1cd57764bac tempest-ServerRescueNegativeTestJSON-165486834 tempest-ServerRescueNegativeTestJSON-165486834-project] 10.222.0.27 "GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976" status: 404 len: 111 microversion: 2.1 time: 0.053256 Oct 18 13:52:04.141717 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2635/5415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:04 2022] GET /compute/v2.1/servers/693e4bf5-4eb5-417a-90c3-f22935c71976 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:10.754244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-346316260", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "bb2d20b5-202f-4151-8ddf-cb50e65eae3b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2037050484", "security_groups": [{"name": "tempest-secgroup-smoke-902731045"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:11.075895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] validate_networks() for [('bb2d20b5-202f-4151-8ddf-cb50e65eae3b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:52:12.073432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:52:12.074505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:52:12.075878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:52:12.076489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:52:12.078088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:52:12.092655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:12.093590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:12.094312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:12.096394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:12.097947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:12.098615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:12.127028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:52:12.134898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:52:12.151138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:52:12.154324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:52:12.340867 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [4d750013-115b-448d-b629-0d9eec324e94] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:52:13.360448 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [4d750013-115b-448d-b629-0d9eec324e94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34252. Oct 18 13:52:13.366533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b271b605-761d-440f-9cb6-59bcfb811fdf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.616412 Oct 18 13:52:13.368305 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2781/5416] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:52:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:52:13.381714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d380055-26e2-47f3-8995-8a609bf816d8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:13.384171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d380055-26e2-47f3-8995-8a609bf816d8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:13.940929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d380055-26e2-47f3-8995-8a609bf816d8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:13.951462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d380055-26e2-47f3-8995-8a609bf816d8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1266 microversion: 2.1 time: 0.575480 Oct 18 13:52:13.960634 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2636/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:13 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1266 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:14.981352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bfb60b35-5ef1-4f3d-a4ea-c3c59af5a762 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:14.982652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bfb60b35-5ef1-4f3d-a4ea-c3c59af5a762 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:15.099762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bfb60b35-5ef1-4f3d-a4ea-c3c59af5a762 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:15.112134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bfb60b35-5ef1-4f3d-a4ea-c3c59af5a762 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1266 microversion: 2.1 time: 0.140750 Oct 18 13:52:15.127130 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2782/5418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:14 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:16.152792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:16.153546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:16.164030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:16.167420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:16.179967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:16.181140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:16.187083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:16.187707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:16.188394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:16.411613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:16.432186 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1262 microversion: 2.1 time: 0.273404 Oct 18 13:52:16.433349 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2637/5419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:16 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1262 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:17.476651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:17.477338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:17.498617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:17.499431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:17.500295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:17.510532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:17.511342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:17.511986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:17.878809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:17.887473 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73464174-347e-4dfd-83ae-47adb3363188 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1336 microversion: 2.1 time: 0.423771 Oct 18 13:52:17.890337 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2783/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:17 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1336 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:18.473220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:18.474545 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6490ca7d-bcce-48ec-b26b-370cb6c10254 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001690 Oct 18 13:52:18.475000 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2638/5421] 10.222.0.27 () {56 vars in 886 bytes} [Tue Oct 18 13:52:18 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:52:18.926332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:18.926958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:18.948906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:18.956580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:18.958140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:18.959382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:18.960954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:18.964286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:19.853647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:19.867286 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a690be53-e7af-47ec-89e1-89f202228e80 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1324 microversion: 2.1 time: 0.949225 Oct 18 13:52:19.883053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2784/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:18 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1324 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:20.903695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:20.904296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:20.907120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:20.921366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:20.921870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:20.922345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:20.923067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:20.929857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:20.931134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:21.377164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:21.389609 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7377f5e-d289-4bba-9f39-f141ef9e0c8a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.492141 Oct 18 13:52:21.411467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2639/5423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:20 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:22.422775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:22.424131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:22.433478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:22.437792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:22.441913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:22.442653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:22.443686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:22.451189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:22.451699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:22.909279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:22.921360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4da7c83-a440-4705-8ae6-fe33609c8857 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.502324 Oct 18 13:52:22.922002 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2785/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:22 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:23.949871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:23.950815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:23.965291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:23.969052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:23.970439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:23.972502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:23.973416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:23.980604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:23.982966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:24.533562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:24.560553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f18e8930-dd0b-4fd9-b834-1885ff9d08ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.606034 Oct 18 13:52:24.561749 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2640/5425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:23 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:24.786638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:24.809350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:24.811141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:24.811735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:24.826680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] Creating event network-changed:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:52:24.833466 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a965a34c-c8c7-4f27-b298-08366496f4ad req-bc60edb0-86f2-4f2e-9207-12ffe40a2902 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051350 Oct 18 13:52:24.834757 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2786/5426] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:25.347643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:25.363358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:25.395837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.396449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.396919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.402708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.403296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.405687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.497293 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ebfad6a7-1b2b-4920-ae95-d118f99072a3 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154682 Oct 18 13:52:25.504166 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2641/5427] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:25 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:52:25.594963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:25.603279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:25.603994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:25.611774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.646033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.646033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.646033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.646033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.646033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.703922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:25.704448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:25.717808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.718352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.718805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.723980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.724892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.725407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.801547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:52:26.062205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:26.075592 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11babb0f-c554-4709-b271-e2ea72b18fef tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.481464 Oct 18 13:52:26.076500 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2787/5428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:25 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:26.307356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71e501fa-e6f8-4d42-92bb-65abe728273a tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 204 len: 0 microversion: 2.1 time: 0.607467 Oct 18 13:52:26.313416 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2642/5429] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:52:25 2022] DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:52:26.363424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:26.364061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:26.375351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:26.397791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.398262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.398762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.399494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.412324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.413557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.706290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:26.717980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ec211bb-b8b2-4cac-b46e-79741658cde8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1673 microversion: 2.1 time: 0.366606 Oct 18 13:52:26.719300 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2788/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:26 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1673 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:27.109253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:27.112596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:27.123707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:27.124549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:27.125406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:27.126241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:27.126772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:27.133601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:27.307380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:27.316124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6170cea5-19f3-44ef-9b2a-bf293e7e02ff tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.211458 Oct 18 13:52:27.327068 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2643/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:27 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:27.744581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:27.746035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:27.767307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:27.768364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:27.768978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:27.771488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:27.772144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:27.772790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:28.255832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:28.304545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3a7b42c-e159-44ab-aa65-37df4685a03d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1673 microversion: 2.1 time: 0.565575 Oct 18 13:52:28.311549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2789/5432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:27 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1673 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:28.342590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:28.343343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:28.355276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:28.358404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:28.359043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:28.360154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:28.360780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:28.364584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:29.149033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:29.167516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58fdf1c7-a78e-410d-9eb9-83a5530bb9fe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.825463 Oct 18 13:52:29.168774 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2644/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:28 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:29.345424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:29.345424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:29.383699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:29.387568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:29.387568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:29.397688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:29.398996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:29.399485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:29.905374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:29.923159 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e63ec11e-d191-4484-9b49-a1635893eb6c tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1673 microversion: 2.1 time: 0.583046 Oct 18 13:52:29.926475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2790/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:29 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1673 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:30.217184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:30.229437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:30.252044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:30.258534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:30.259104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:30.261301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:30.265587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:30.267179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:30.747075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:30.759849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65a4d99d-5ad3-40eb-949e-9a20abcf0ec3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.570010 Oct 18 13:52:30.761582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2645/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:30 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:30.951602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:30.952346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:30.971941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:30.977252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:30.977981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:30.979216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:30.987481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:30.988256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.287651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:31.296881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ab0f9c4-b60c-422f-94c4-b138dc41beb9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1606 microversion: 2.1 time: 0.349493 Oct 18 13:52:31.298132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2791/5436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:30 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1606 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:31.783357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb11d9b-3339-4d7f-a5fa-680e6538247c", "name": "network-vif-deleted", "tag": "eacd5472-7c10-45e5-a9e9-502dd05c2a40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:31.787978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:31.788597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:31.799864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.800377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.800831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.801576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.805052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.806647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.827588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.828083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.832609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.866577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] Creating event network-vif-deleted:eacd5472-7c10-45e5-a9e9-502dd05c2a40 for instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c on n-h2-858383-13 Oct 18 13:52:31.884235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a65f540f-17e5-46f0-a1ca-de0abe074389 req-5ee3b00c-822a-49b0-b884-39d94e2a3deb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102354 Oct 18 13:52:31.886250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2646/5437] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:32.300781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:32.325842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:32.327288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:32.332636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9c6fe5b-ccb5-4878-9d02-d49273927056 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.531952 Oct 18 13:52:32.337537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:32.338045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:32.338523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:32.339244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:32.339711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:32.340148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:32.343013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2792/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:31 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:32.391508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:32.392016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:32.392551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:32.392915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lazy-loading 'fault' on Instance uuid 0eb11d9b-3339-4d7f-a5fa-680e6538247c {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:52:32.536081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:32.557913 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93551989-e415-44f4-8522-3172999a6544 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 200 len: 1327 microversion: 2.1 time: 0.231773 Oct 18 13:52:32.558826 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2647/5439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:32 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 1327 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:33.372762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:33.375707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:33.410463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:33.412634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:33.414843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:33.416362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:33.423936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:33.429660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:33.587895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:33.602361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:33.612038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:33.614796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:33.617625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:33.619078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:33.620594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:33.621264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:33.666013 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c HTTP/1.1 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0eb11d9b-3339-4d7f-a5fa-680e6538247c'} Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:33.671392 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:33.678946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de134257-0417-43e2-b075-752c4bac6440 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 404 len: 111 microversion: 2.1 time: 0.093381 Oct 18 13:52:33.686179 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2648/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:33 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:52:33.711943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3aff5a8-3b49-4efb-8b2e-4ea2c3bf7436 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '.version_select at 0x7fb3314b5af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:33.848080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:33.859316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-423d31ec-997e-4ceb-a6bc-71937dd11e39 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.491665 Oct 18 13:52:33.862578 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2793/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:33 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:33.969080 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3aff5a8-3b49-4efb-8b2e-4ea2c3bf7436 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754014266" status: 202 len: 0 microversion: 2.1 time: 0.277553 Oct 18 13:52:33.971045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2649/5442] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754014266 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:52:34.765940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-plugged", "status": "completed", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:34.788807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:34.794315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:34.795142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:34.824978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] Creating event network-vif-plugged:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:52:34.836370 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b3a57a2f-4215-4c44-92e2-0b94f7719503 req-9cb27269-d8d2-4d16-83de-ae7bf059d823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075962 Oct 18 13:52:34.839861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2794/5443] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:34.890091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:34.891534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:34.915308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:34.916904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:34.919816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:34.921892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:34.922696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:34.923206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:35.604347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:35.634734 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-972c7e44-8119-4a45-9fd0-f1d2065c81f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.748950 Oct 18 13:52:35.644045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2650/5444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:34 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:36.631385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ac03961-71c9-4250-9f6a-cb39e7f8dbbc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: .version_select at 0x7fb3352cb040>, body: {"keypair": {"name": "tempest-keypair-131953692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs0r63eSofBKJVMRqnMbSjEftKFGLu0NgSxpgu2o3/DtTi3yQ6/06wCpl2GcwgCw3fbd6Zbp0ppBqQ+aOFaMdiGEl4T6mi7qeqS37UJqnY+OWHqH/OobCBhSpb1Ld2+sQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:36.674205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:36.679506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:36.680514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ac03961-71c9-4250-9f6a-cb39e7f8dbbc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:52:36.687852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7ac03961-71c9-4250-9f6a-cb39e7f8dbbc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for user d3ed4523fb1d423abcf98fdb30b37b0a and project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:52:36.700624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:36.701431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:36.701954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:36.702918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:36.703588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:36.704240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:36.904082 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ac03961-71c9-4250-9f6a-cb39e7f8dbbc tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280448 Oct 18 13:52:36.904709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2795/5445] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:52:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:36.961477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:36.972174 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-556cc422-ea2e-4404-9192-d56b05d462b2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1391 microversion: 2.1 time: 0.302970 Oct 18 13:52:36.972770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2651/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:36 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:38.000250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:38.001065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:38.017185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:38.020461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:38.021001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:38.024137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:38.026094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:38.026569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:38.443305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:38.464457 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c403ca9-75ce-4273-b00c-ea560a3a9ffc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1563 microversion: 2.1 time: 0.467071 Oct 18 13:52:38.473863 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2796/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:37 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1563 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:38.490972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:38.493963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:38.514614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:38.520179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:38.520179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:38.520179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:38.520179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:38.520179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:38.862558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:38.888102 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-196cc118-7b64-4525-97e3-fffb051a0277 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1563 microversion: 2.1 time: 0.387180 Oct 18 13:52:38.888102 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2652/5448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:38 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1563 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:39.282453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:39.284290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:39.284875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:39.285513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:39.286999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:39.288576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:39.289815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:39.353576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d350ffe6-82fd-49e3-9042-28d9a5653179 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.722651 Oct 18 13:52:39.356274 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2797/5449] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Oct 18 13:52:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:39.586847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-546162097", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-13", "networks": [{"uuid": "c7f78d60-680d-45ea-9bb7-2914c3dcfbb0"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:39.666805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] validate_networks() for [('c7f78d60-680d-45ea-9bb7-2914c3dcfbb0', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:52:41.271130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:52:41.271812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:52:41.272037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:52:41.277289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:52:41.288961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:52:41.291125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:41.291634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:41.292093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:41.292847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:41.293502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:41.294129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:41.345654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Getting quotas for project cfddc60d5b974578a119f6602f7556f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:52:41.353290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Getting quotas for user 61faf6ad6e7848799bf63a6fe0697f97 and project cfddc60d5b974578a119f6602f7556f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:52:41.386700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:52:41.391381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:52:41.688292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36576c03-f253-48c1-9260-8eb5fe38b78e tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.108052 Oct 18 13:52:41.691879 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2653/5450] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:52:41.704303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccaef047-d753-4694-91f5-61a5f91ebb0d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:41.705711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccaef047-d753-4694-91f5-61a5f91ebb0d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:42.022776 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccaef047-d753-4694-91f5-61a5f91ebb0d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1328 microversion: 2.1 time: 0.322783 Oct 18 13:52:42.025443 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2798/5451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:41 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:43.051852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a225105e-3e94-4ad8-a406-cbfda70a4ca7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:43.054327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a225105e-3e94-4ad8-a406-cbfda70a4ca7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:43.207173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a225105e-3e94-4ad8-a406-cbfda70a4ca7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1328 microversion: 2.1 time: 0.153010 Oct 18 13:52:43.225455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2654/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:43 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:43.262100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1703797247", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "526d0f91-3a2e-4117-a301-95a6393f15b3"}], "security_groups": [{"name": "tempest-securitygroup--1441801207"}], "key_name": "tempest-keypair-131953692", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:43.509909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] validate_networks() for [('526d0f91-3a2e-4117-a301-95a6393f15b3', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:52:44.233717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:44.234982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:44.249627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.250982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.256115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.256115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.256115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.256115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.498350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-326d5bb6-5378-4495-891f-2cdc04e3a07a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1345 microversion: 2.1 time: 0.268495 Oct 18 13:52:44.507085 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2655/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:44 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1345 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:44.733994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:44.734880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:44.748300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.752958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.753643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.755577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.758032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.761669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.803389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:52:44.803936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:52:44.806082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:52:44.807132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:52:44.807807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:52:44.830485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.833022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.833022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.833022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.835174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.836599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.842244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.858556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=83 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.884580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:52:44.892473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Getting quotas for user d3ed4523fb1d423abcf98fdb30b37b0a and project b9380daa22eb489dbb2b7e27806c8bb3. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:52:44.916706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:52:44.920066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:52:45.205108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa257a5c-f6f8-4a84-b199-ed68f33c1bb4 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.949084 Oct 18 13:52:45.213312 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2799/5454] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:52:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:52:45.218747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:45.235569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:45.236086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:45.236749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:45.247520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:45.258112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94ba9139-4498-4e45-bde5-4ef7e38758f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1563 microversion: 2.1 time: 0.528803 Oct 18 13:52:45.260334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2656/5455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:44 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1563 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:45.272348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] Creating event network-changed:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:52:45.282402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dd630766-20f9-4aad-8768-9ed3a5a2f65e req-16594240-4e56-46cc-a592-bfc93b4bb1d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067588 Oct 18 13:52:45.283681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2800/5456] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:45.324227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f401f7a-442e-4ea0-9141-2b1c0fd78efd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:45.327422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0f401f7a-442e-4ea0-9141-2b1c0fd78efd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:45.536814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0f401f7a-442e-4ea0-9141-2b1c0fd78efd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:45.542878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:45.544096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:45.547112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f401f7a-442e-4ea0-9141-2b1c0fd78efd tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1237 microversion: 2.1 time: 0.285399 Oct 18 13:52:45.552047 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2657/5457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:45 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1237 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:45.558481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:45.559235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:45.560278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:45.562236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:45.562962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:45.563975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:45.784402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95180b65-3d36-4583-841e-67c56312063d tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1417 microversion: 2.1 time: 0.248484 Oct 18 13:52:45.803988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2801/5458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:45 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1417 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:46.582140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ecf50d34-49f2-4572-ba3c-d517345e10ad tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:46.583394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ecf50d34-49f2-4572-ba3c-d517345e10ad tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:46.818763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:46.820662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:46.838494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:46.839265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:46.839736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:46.840493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:46.840982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:46.845212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:46.961762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecf50d34-49f2-4572-ba3c-d517345e10ad tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:46.989526 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ecf50d34-49f2-4572-ba3c-d517345e10ad tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1237 microversion: 2.1 time: 0.405407 Oct 18 13:52:46.993763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2658/5459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:46 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1237 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:47.015894 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ce70521-0d50-4b52-9dea-8db5ce60fdfc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1425 microversion: 2.1 time: 0.201431 Oct 18 13:52:47.019140 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2802/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:46 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1425 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:48.022307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:48.023883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:48.048428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:48.049234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:48.050502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:48.051131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:48.052248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:48.052934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:48.053048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:48.053811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:48.076392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:48.084237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:48.085561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:48.088397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:48.092019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:48.093214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:48.426018 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-adafc60d-aafa-42cc-8996-42a6a50fe35a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.381580 Oct 18 13:52:48.428170 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2803/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:48 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:48.493830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:48.525578 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17b53246-9fc3-4f69-8aa9-249719f63f3b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1233 microversion: 2.1 time: 0.503289 Oct 18 13:52:48.538185 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2659/5462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:48 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1233 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:49.454967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:49.456530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:49.465443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:49.466360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:49.466829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:49.467568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:49.468045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:49.468492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:49.553477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:49.555470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:49.575501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:49.576956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:49.580655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:49.581627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:49.582243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:49.584187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:49.783874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:49.797716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc767727-8515-40ab-98cd-54cbe2ac2bf9 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1297 microversion: 2.1 time: 0.248308 Oct 18 13:52:49.799191 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2660/5463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:49 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1297 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:50.193884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a", "tag": "192df5c9-da18-461d-99ce-56415afc6c3b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:50.211842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:50.213742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:50.214806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:50.243913 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] Creating event network-changed:192df5c9-da18-461d-99ce-56415afc6c3b for instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a on n-h1-858383-13 Oct 18 13:52:50.282549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7aa27409-9714-41bc-8345-bbf38cbed11f req-58503d1a-0258-41da-8a97-c33f97736ae1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091877 Oct 18 13:52:50.284131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2661/5464] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:52:50.348479 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-058d2371-014c-40f8-8cc2-c5540e9a6dc6 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.894914 Oct 18 13:52:50.352513 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2804/5465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:49 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:50.824434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:50.825748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:50.834878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:50.836316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:50.837220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:50.837936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:50.839172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:50.840213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:50.964576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:50.977112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ff89adc-a99e-4b3c-9c8f-d21d96100f75 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1295 microversion: 2.1 time: 0.156462 Oct 18 13:52:50.979613 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2662/5466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:50 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:51.376257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:51.376940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:51.391670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:51.392543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:51.393592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:51.395849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:51.399891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:51.400812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:51.649892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51cf68e3-94ac-48e2-8ef5-c45d21deefa2 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.279042 Oct 18 13:52:51.650532 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2805/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:51 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:52.001884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.003053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:52.006360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:52.016941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.017538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.018015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.020939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.021673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.022331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.401547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:52.425855 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f79d1d2f-000b-417b-a8d0-565dd40362b0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.427246 Oct 18 13:52:52.427001 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2663/5468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:51 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:52.675756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.676934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:52.689915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.690692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.693080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.697456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.697881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.698581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.206777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d95befd4-3821-44e9-94e2-817ab4b420e1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.534703 Oct 18 13:52:53.208124 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2806/5469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:52 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:53.388723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c135375-66c4-4729-a698-28c60928fce9", "tag": "1e7fc791-3498-4107-83c4-1c15b7983178"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:53.448707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.449554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.458841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.477984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:53.479754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:53.491321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.492573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.493370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.494285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.494913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.495583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.529081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] Creating event network-changed:1e7fc791-3498-4107-83c4-1c15b7983178 for instance 5c135375-66c4-4729-a698-28c60928fce9 on n-h2-858383-13 Oct 18 13:52:53.552807 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e269bb08-3fec-4e9b-bddb-43bb3b64e2ca req-56e7e3e7-96dd-44d5-9215-e487f7fe9e30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168910 Oct 18 13:52:53.554893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2664/5470] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:53.894496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:53.915986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2746bb8d-9eec-4e52-aa8a-5ecf57a67a97 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.464170 Oct 18 13:52:53.918317 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2807/5471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:53 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:54.243439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:54.249368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:54.256884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:54.259795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:54.260279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:54.261045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:54.261531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:54.261974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:54.393831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a", "name": "network-vif-plugged", "status": "completed", "tag": "192df5c9-da18-461d-99ce-56415afc6c3b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:54.423034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:54.423748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:54.427284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:54.453846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] Creating event network-vif-plugged:192df5c9-da18-461d-99ce-56415afc6c3b for instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a on n-h1-858383-13 Oct 18 13:52:54.468014 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-848e4f1b-6977-4747-bb97-c7bac7f02fad req-8dfff0e5-7d69-44f1-9cd0-4a71cd36367a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077278 Oct 18 13:52:54.469690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2808/5472] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:52:54.525809 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-456fc103-46da-4e10-ae8f-e68de5ebed54 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.286321 Oct 18 13:52:54.528165 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2665/5473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:54 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:52:54.940233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:54.940970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:54.945444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:54.946185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:54.953174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:54.953685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:54.954199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:54.954921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:54.955508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:54.955879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:55.136566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:55.144590 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d1dd834-2b52-4c60-83ae-57953a27344d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.206342 Oct 18 13:52:55.145327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2809/5474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:54 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:55.555695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:55.556649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:55.560591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:55.566437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:55.567167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:55.568047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:55.570355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:55.571330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:55.571907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:55.713381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf52b0a7-5d74-4067-a2cb-845e1ae26587 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1465 microversion: 2.1 time: 0.162265 Oct 18 13:52:55.714040 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2666/5475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:55 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:56.168693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:56.169220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:56.176861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.177395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.177857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:56.178607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.179133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.179580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:56.368293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:56.377257 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00e739ad-8954-4321-9e4f-6f36ae0c0ac8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.213700 Oct 18 13:52:56.378324 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2810/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:56 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:56.737159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:56.737892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:56.746482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.747048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.747495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:56.748204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.748747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.749189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:56.945828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e1d1ba7-e813-4092-9d67-b9244d0e1a25 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1649 microversion: 2.1 time: 0.210840 Oct 18 13:52:56.957425 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2667/5477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:56 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1649 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:56.969168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:56.969797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:56.976713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.977215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.977662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:56.978414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:56.978887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:56.979320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:57.137792 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2a8a601-fcac-4d4b-b2a8-59e421188d99 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1649 microversion: 2.1 time: 0.172571 Oct 18 13:52:57.138412 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2811/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:56 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:57.164225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:57.165312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:57.168340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:57.176689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:57.177511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:57.178646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:57.180874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:57.181673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:57.182591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:57.360636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f833686b-3296-4f29-9142-c61ce3286ddc tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1649 microversion: 2.1 time: 0.203839 Oct 18 13:52:57.361346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2668/5479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:57 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1649 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:57.404085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:57.404789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:57.411857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:57.412352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:57.412806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:57.414062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:57.414570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:57.415004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:57.484159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1068044938", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-13", "networks": [{"uuid": "c7f78d60-680d-45ea-9bb7-2914c3dcfbb0"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:57.593490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] validate_networks() for [('c7f78d60-680d-45ea-9bb7-2914c3dcfbb0', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:52:57.644474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:57.655907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a12b130-c067-4a03-b680-37c744f20d0f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.255730 Oct 18 13:52:57.656958 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2812/5480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:57 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:58.009531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:52:58.016501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:52:58.017376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:52:58.017832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:52:58.018286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:52:58.042237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:58.043178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:58.043845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:58.045236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:58.046226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:58.046898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:58.070774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Getting quotas for project cfddc60d5b974578a119f6602f7556f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:52:58.077156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Getting quotas for user 61faf6ad6e7848799bf63a6fe0697f97 and project cfddc60d5b974578a119f6602f7556f8. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:52:58.097938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:52:58.102282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:52:58.228246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8d32c45-1ad9-4f5d-9d82-4bee456038ea tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753377 Oct 18 13:52:58.228904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2669/5481] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:52:58.241314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94ece4c8-fa0e-4e88-831d-c58fdb4758d7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:58.242750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94ece4c8-fa0e-4e88-831d-c58fdb4758d7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:58.316411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94ece4c8-fa0e-4e88-831d-c58fdb4758d7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1329 microversion: 2.1 time: 0.079894 Oct 18 13:52:58.317003 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2813/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:58 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1329 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:58.681446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:58.681611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:58.688401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:58.688899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:58.689344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:58.690108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:58.690548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:58.690980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:58.856822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c135375-66c4-4729-a698-28c60928fce9", "name": "network-vif-plugged", "status": "completed", "tag": "1e7fc791-3498-4107-83c4-1c15b7983178"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:58.904843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:58.906344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:58.911128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:58.912039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:58.922725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14819630-28f4-4cf5-86b4-58d287d294f8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.246464 Oct 18 13:52:58.923328 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2670/5483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:58 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:58.927699 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] Creating event network-vif-plugged:1e7fc791-3498-4107-83c4-1c15b7983178 for instance 5c135375-66c4-4729-a698-28c60928fce9 on n-h2-858383-13 Oct 18 13:52:58.933400 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0df1c46a-b40d-43ee-8d8f-6b2df84b4af1 req-a595ce53-70b5-4185-a2bd-a6e74bb33147 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093085 Oct 18 13:52:58.934232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2814/5484] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:59.341664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76cfed96-366c-4f1b-80f6-1533f0f0e21f tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:59.342390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76cfed96-366c-4f1b-80f6-1533f0f0e21f tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:59.508191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76cfed96-366c-4f1b-80f6-1533f0f0e21f tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1329 microversion: 2.1 time: 0.171948 Oct 18 13:52:59.508873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2671/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:59 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1329 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:59.961149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:59.963555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:59.982606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:59.986583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:59.986583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:59.989017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:59.990558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:59.992876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:00.197472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:00.206399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d259a78-a6ec-4867-8420-704b819ee60f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1363 microversion: 2.1 time: 0.260920 Oct 18 13:53:00.207147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2815/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:59 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:00.533690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:00.534890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:00.548059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:00.548748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:00.549204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:00.549916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:00.550436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:00.550877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:00.625275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9b87ee6-2d30-48ce-a88a-49696aad222b tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1418 microversion: 2.1 time: 0.096128 Oct 18 13:53:00.625870 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2672/5487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:00 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1418 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:01.231985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:01.232782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:01.234979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:01.239817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.240321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.240775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.241553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.242301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.242698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.549500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:01.557725 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb572ae4-d17e-46ad-a11d-261b2dc2d9ac tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1550 microversion: 2.1 time: 0.331415 Oct 18 13:53:01.558340 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2816/5488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:01 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1550 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:01.586796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:01.587433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:01.593512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.594007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.594498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.595370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.595681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.596745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.650946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:01.651787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:01.667598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.671075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.671879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.673478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.674440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.675231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.713587 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-297937a5-bf3e-4cab-b4d2-c0ad343535df tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132524 Oct 18 13:53:01.714385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2673/5489] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:53:01 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:01.771725 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf2bb87e-1cfd-4b7a-bce9-ca72cb450c96 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1436 microversion: 2.1 time: 0.125349 Oct 18 13:53:01.782430 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2817/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:01 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1436 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:01.879552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:01.883016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:01.904340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.905180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.905762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:01.911418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:01.912359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:01.912971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.004677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3fdc1e5f-9db2-4df1-8771-01de934f0575 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action" status: 200 len: 24567 microversion: 2.1 time: 0.129640 Oct 18 13:53:02.005818 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2674/5491] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:53:01 2022] POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action => generated 24567 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:53:02.812282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:02.815193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:02.827138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.827894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.837452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.837452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.837452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.837452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:03.340881 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-febe5038-3e00-4416-b6ed-88ebd0fceddb tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.534640 Oct 18 13:53:03.341584 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2818/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:02 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:03.654926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c135375-66c4-4729-a698-28c60928fce9", "tag": "1e7fc791-3498-4107-83c4-1c15b7983178"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:03.686294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:03.686294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:03.686294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:03.708883 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] Creating event network-changed:1e7fc791-3498-4107-83c4-1c15b7983178 for instance 5c135375-66c4-4729-a698-28c60928fce9 on n-h2-858383-13 Oct 18 13:53:03.720428 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4787904e-104b-4b86-9d25-3e7a458cc3a6 req-b2320230-181b-4147-9e40-006c1df92fc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069615 Oct 18 13:53:03.721640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2675/5493] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:04.128048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a", "tag": "215f7838-af40-4e27-a722-41809c6b3591"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:04.138502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:04.139001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:04.150493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:04.151281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] Creating event network-changed:215f7838-af40-4e27-a722-41809c6b3591 for instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a on n-h2-858383-13 Oct 18 13:53:04.156356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0a31ef59-7a8a-4995-9f4f-7258216e89a6 req-cb5eee3a-8bb6-4ba7-ba2a-8efa58fab177 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Oct 18 13:53:04.157362 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2819/5494] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:53:04.377126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:04.377861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:04.388550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:04.391102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:04.391378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:04.392148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:04.392630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:04.393067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:04.625355 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-33fc5375-946e-430a-a918-c19f11bbe8ff tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.254348 Oct 18 13:53:04.630790 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2676/5495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:04 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:05.660189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:05.661880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:05.676707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:05.677231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:05.677695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:05.678560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:05.683797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:05.684096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:05.689958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:05.828934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-435dc35b-669f-4969-bfd4-47ed039df6af tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.173542 Oct 18 13:53:05.829503 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2820/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:05 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:06.853583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:06.854253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:06.861523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:06.867133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:06.867133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:06.867133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:06.867133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:06.867133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:07.188085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d39bed77-040f-4e2d-b2ad-5136fbf14478 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.338917 Oct 18 13:53:07.191777 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2677/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:06 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:08.215100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:08.215735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:08.223742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:08.224240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:08.224685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:08.225389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:08.225849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:08.226303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:08.313723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:08.432285 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e50abda-782e-4cb2-bd83-e3fbb057dc79 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.220961 Oct 18 13:53:08.434678 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2821/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:08 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:08.859832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a", "name": "network-vif-plugged", "status": "completed", "tag": "215f7838-af40-4e27-a722-41809c6b3591"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:08.873812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:08.876610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:08.878014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:08.878014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:08.900742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] Creating event network-vif-plugged:215f7838-af40-4e27-a722-41809c6b3591 for instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a on n-h2-858383-13 Oct 18 13:53:08.906198 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fa7f4159-73b7-46b8-837c-316088a5e88d req-b8a7844b-0d93-4cc0-aeec-9829b96ff38f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051114 Oct 18 13:53:08.906847 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2678/5499] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:09.456956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:09.457335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:09.467116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:09.467116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:09.467116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:09.468041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:09.468750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:09.469427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:09.630381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd91fb02-a53f-4a5e-9236-3d517b7adb45 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1466 microversion: 2.1 time: 0.177823 Oct 18 13:53:09.630967 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2822/5500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:09 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1466 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:10.654229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:10.654964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:10.657245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:10.665208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:10.665942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:10.666815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:10.667583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:10.676275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:10.676275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:10.825285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59f211b3-5894-4768-bced-c29e46f50732 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1650 microversion: 2.1 time: 0.174724 Oct 18 13:53:10.826420 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2679/5501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:10 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:10.848770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:10.851592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:10.861463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:10.862105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:10.862660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:10.863609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:10.864230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:10.864776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.015666 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fbcde22-f059-4b5b-9c05-5967b4e72ba8 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1650 microversion: 2.1 time: 0.170426 Oct 18 13:53:11.016486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2823/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:10 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1650 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:11.039522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:11.040148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:11.046457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.046962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.047408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.048109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.048571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.049004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.054489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:11.270376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8458498e-7428-4b49-881d-8437933408aa tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1650 microversion: 2.1 time: 0.234971 Oct 18 13:53:11.271359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2680/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:11 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1650 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:11.293657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:11.294213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:11.300661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.301164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.301692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.302430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.302903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.303379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.332981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:53:11.862727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ad549dc-0b42-4094-9947-59e515a29c9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 204 len: 0 microversion: 2.1 time: 0.570058 Oct 18 13:53:11.865018 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2824/5504] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:53:11 2022] DELETE /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:11.873756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:11.874410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:11.882884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.883598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.884184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:11.885052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:11.885510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:11.886125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:12.027106 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ecde2eb9-c652-4e0e-9b70-76fc754350a7 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1656 microversion: 2.1 time: 0.157290 Oct 18 13:53:12.027693 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2681/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:11 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:12.933877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:12.934624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:12.942110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:12.942617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:12.943071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:12.943785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:12.944356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:12.944802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.050924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:13.050924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:13.067804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.068695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.069735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.071221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.071889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.073098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.119958 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06d855e2-907e-43ff-9eda-878b55f98da0 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1835 microversion: 2.1 time: 0.190045 Oct 18 13:53:13.124862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2825/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:12 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1835 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:13.143207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:13.144117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:13.150500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.151181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.151811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.152695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.153322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.153924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.266093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ed709f4-a042-4fdf-9269-c285d2e7b1f1 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1656 microversion: 2.1 time: 0.220106 Oct 18 13:53:13.267064 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2682/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:13 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1656 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:13.344063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:13.348896 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94dacbfb-a7d2-48b3-9da4-19b7c8599df3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1682 microversion: 2.1 time: 0.209584 Oct 18 13:53:13.349475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2826/5508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:13 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:13.510536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:13.513206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:13.520473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.521294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.522943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.523911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.524587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.525109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.597690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28de8cbc-96ad-41d2-a007-d6bce0414b2a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action" status: 200 len: 32635 microversion: 2.1 time: 0.091928 Oct 18 13:53:13.602603 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2683/5509] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:53:13 2022] POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action => generated 32635 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:53:13.777037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:13.777627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:13.783627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.784116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.784559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.785252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:13.785729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:13.786214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:13.829443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e75b5e687b894134be5eaf009f055a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2751b46cd5d74e5ea29be04ae823f86f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:13.830140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 9251d756-13d8-42b3-b436-b640806aa606] flavor_id is None. Assuming migration. {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:53:13.830545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:53:14.047144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a", "name": "network-vif-deleted", "tag": "215f7838-af40-4e27-a722-41809c6b3591"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:14.066750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:14.081484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:14.088104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:14.114410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] Creating event network-vif-deleted:215f7838-af40-4e27-a722-41809c6b3591 for instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a on n-h2-858383-13 Oct 18 13:53:14.121001 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0db8ad14-75c0-4c0e-aa20-4488d7cbfb45 req-19e6da2a-4e33-4dd7-8d2a-99a452a2f80e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079899 Oct 18 13:53:14.134123 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2684/5510] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:53:14.291640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:14.292353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:14.298743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:14.299244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:14.299692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:14.300390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:14.300855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:14.301392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:14.382376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-805ff7c4-9dc4-4e20-b5ee-79ed8e892bfd tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 200 len: 1451 microversion: 2.1 time: 0.095764 Oct 18 13:53:14.383490 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2685/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:14 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 1451 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:14.421804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79f35933-e5fb-4c5a-abfd-753b25bbfcc9 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action" status: 202 len: 0 microversion: 2.1 time: 0.648558 Oct 18 13:53:14.422856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2827/5512] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:53:13 2022] POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:53:14.436494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:14.438743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:14.451289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:14.452244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:14.453474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:14.454538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:14.455263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:14.456992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:14.620096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:14.629701 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a81f5d05-ad35-4233-986a-fc91eab43a96 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1691 microversion: 2.1 time: 0.202873 Oct 18 13:53:14.630674 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2686/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:14 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:15.410413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:15.411047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:15.420340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.420861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.421306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.422395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.423530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.423969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.439464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] HTTP exception thrown: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Request method failure captured: Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a HTTP/1.1 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq-mZ9RUYLfCQ73XVA3m7mP-6GBD6FYK-84VJjrUIMULvFAzKGCkgixRW8HZxuKKQzy5rp2dtgWNd9TK8gvrOQtjNH-Ici5bmuMKJu_qAiMi1HHSKZY4w38P_rBBFBPtkJQloVnzuEaIQay4fvP2LXE2jLhL0p_b7hhFUCwR8M9HeSs Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: cfddc60d5b974578a119f6602f7556f8 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestServerMultinode-391705351 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestServerMultinode-391705351 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: cfddc60d5b974578a119f6602f7556f8 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestServerMultinode-391705351 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestServerMultinode-391705351-project-admin Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 61faf6ad6e7848799bf63a6fe0697f97 Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestServerMultinode-391705351-project-admin Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a'} Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:15.441189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Returning 404 to user: Instance 9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50124d83-17b2-4fb0-99bd-7eb0bd0e9313 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a" status: 404 len: 111 microversion: 2.1 time: 0.036870 Oct 18 13:53:15.449218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2828/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:15 2022] GET /compute/v2.1/servers/9b22cd5d-5018-48c1-9b1b-71a9dfcd6b6a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:53:15.455532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:15.455532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:15.463460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.463962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.464407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.465118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.465624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.466261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.502412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:53:15.654564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:15.655195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:15.661822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.662318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.662772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.664055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.664519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.664953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.863462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:15.872337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3462e414-9950-4724-b894-e58014cd472e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1691 microversion: 2.1 time: 0.221811 Oct 18 13:53:15.874132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2829/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:15 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:15.877869 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d66072e-fc4f-479a-ac56-9fccffd794b5 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 204 len: 0 microversion: 2.1 time: 0.429290 Oct 18 13:53:15.878530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2687/5516] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:53:15 2022] DELETE /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:15.894652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:15.897571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:15.905059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.905557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.906213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:15.907250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:15.907878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:15.915561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:16.050470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d3e0d04-2f1d-4dcf-8457-fd19f39db262 tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1655 microversion: 2.1 time: 0.163114 Oct 18 13:53:16.051075 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2830/5517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:15 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:16.898469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:16.899391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:16.907589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:16.908083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:16.908547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:16.909252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:16.909709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:16.910158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:17.074458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:17.075643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:17.083857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:17.084083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:17.084083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:17.084083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:17.084527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:17.085694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:17.086336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:17.098823 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-50d32c96-a05c-4d8e-8221-1c869313cad9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1691 microversion: 2.1 time: 0.205282 Oct 18 13:53:17.099433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2688/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:16 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:17.242272 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-001bd00f-501e-40c1-b92f-e5ec3cd83e9c tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1655 microversion: 2.1 time: 0.171509 Oct 18 13:53:17.242839 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2831/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:17 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:17.987904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a", "name": "network-vif-deleted", "tag": "192df5c9-da18-461d-99ce-56415afc6c3b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:18.005590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:18.009754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:18.011809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:18.048858 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] Creating event network-vif-deleted:192df5c9-da18-461d-99ce-56415afc6c3b for instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a on n-h1-858383-13 Oct 18 13:53:18.053838 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-725afc51-3395-404d-98a4-9c09f20d658f req-7a24f320-3e12-4242-941b-f1fc6b7f0cbd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069651 Oct 18 13:53:18.055181 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2689/5520] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:18.125474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:18.126253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:18.135162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:18.135995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:18.136667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:18.137607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:18.138370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:18.139028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:18.269532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:18.270465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:18.277470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:18.279587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:18.279587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:18.279587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:18.280135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:18.280683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:18.357978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:18.370440 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7af5524a-13a5-49ce-9a26-b920b35bdeab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1691 microversion: 2.1 time: 0.249427 Oct 18 13:53:18.371650 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2832/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:18 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:18.420419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8927cbe0-aebe-4fd5-8a74-76f23e2134ab tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 200 len: 1450 microversion: 2.1 time: 0.157939 Oct 18 13:53:18.423241 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2690/5522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:18 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:19.399916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:19.400577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:19.410242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:19.410242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:19.410242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:19.410242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:19.410534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:19.410809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:19.457347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:19.457804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] [instance: af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:19.478012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:19.478704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:19.479261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:19.480465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:19.480953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:19.481404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:19.501238 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] HTTP exception thrown: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Request method failure captured: Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a HTTP/1.1 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq-mZ9RUYLfCQ73XVA3m7mP-6GBD6FYK-84VJjrUIMULvFAzKGCkgixRW8HZxuKKQzy5rp2dtgWNd9TK8gvrOQtjNH-Ici5bmuMKJu_qAiMi1HHSKZY4w38P_rBBFBPtkJQloVnzuEaIQay4fvP2LXE2jLhL0p_b7hhFUCwR8M9HeSs Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: cfddc60d5b974578a119f6602f7556f8 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestServerMultinode-391705351 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cfddc60d5b974578a119f6602f7556f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestServerMultinode-391705351 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: cfddc60d5b974578a119f6602f7556f8 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestServerMultinode-391705351 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestServerMultinode-391705351-project-admin Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 61faf6ad6e7848799bf63a6fe0697f97 Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestServerMultinode-391705351-project-admin Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a'} Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:19.503359 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] Returning 404 to user: Instance af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c7cb752-8312-41cb-b54b-edecf0d7784a tempest-TestServerMultinode-391705351 tempest-TestServerMultinode-391705351-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a" status: 404 len: 111 microversion: 2.1 time: 0.060200 Oct 18 13:53:19.511905 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2691/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:19 2022] GET /compute/v2.1/servers/af0a5fc3-1ed9-4af0-9ad9-6de0ca4b1d2a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:53:19.732766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:19.743485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72517ce5-5649-4a30-8170-a79b1adf4c25 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.348475 Oct 18 13:53:19.746039 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2833/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:19 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:20.769275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:20.770609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:20.779539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:20.780136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:20.780870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:20.781866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:20.782719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:20.783403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:20.995743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:21.004998 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e7719d2-d5bc-4d74-869f-2bbe28b276eb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.239875 Oct 18 13:53:21.018999 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2692/5525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:20 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:22.032732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:22.033492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:22.054587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:22.055305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:22.055767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:22.056522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:22.058493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:22.058971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:22.112375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:22.356666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:22.373334 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4f39096-0152-44ac-824a-3f947a2d5134 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.345195 Oct 18 13:53:22.390198 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2834/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:22 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:23.405968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:23.405968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:23.416263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:23.416756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:23.417514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:23.420516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:23.421408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:23.422012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:23.679251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:23.687882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02d01d5b-7c68-4be7-8eaa-316dafbdb028 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.288650 Oct 18 13:53:23.701313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2693/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:23 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:24.712645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:24.714235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:24.733279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:24.733279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:24.733970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:24.734458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:24.735143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:24.735664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:24.971550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:24.979917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c5ae1bc-aa42-4274-86da-ff729138d78d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.272289 Oct 18 13:53:24.980817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2835/5528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:24 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:26.003907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:26.004660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:26.014632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:26.020124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:26.020671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:26.021440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:26.021950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:26.022978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:26.216417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:26.226211 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-657dd290-3f4e-48cd-b241-493e258bbe49 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.226185 Oct 18 13:53:26.226799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2694/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:25 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:27.253515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:27.256537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:27.272880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:27.274543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:27.275000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:27.275729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:27.281594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:27.281594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:27.534097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:27.545710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e47ad3e0-0473-4ab2-bf80-8a60680db318 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.298389 Oct 18 13:53:27.549306 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2836/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:27 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:28.573037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:28.573614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:28.580552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:28.581111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:28.581517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:28.582256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:28.582720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:28.583155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:28.742338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:28.757868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63d45f84-20f9-497b-812d-8339b341257d tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.189383 Oct 18 13:53:28.762552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2695/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:28 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:28.832594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:28.833824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:28.842505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:28.843259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:28.843927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:28.844918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:28.845388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:28.845825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:28.879475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:53:29.342304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58d71b39-9cff-41b7-839c-9f2d9e9ec46f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 204 len: 0 microversion: 2.42 time: 0.509826 Oct 18 13:53:29.343542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2837/5532] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:53:28 2022] DELETE /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:53:29.352711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:29.353449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:29.360161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:29.361157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:29.362794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:29.364028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:29.364952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:29.365787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:29.691797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:29.714875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:29.720030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:29.723598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6d26566-79f8-4b40-a3ba-8a4bfdcd8a6a tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2956 microversion: 2.42 time: 0.374603 Oct 18 13:53:29.723598 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2696/5533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:29 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2956 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:29.787090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:29.788600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:29.795557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:29.796057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:29.796510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:29.797565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:29.798297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:29.798956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:30.041180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:30.049318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7e324a3-c78c-47b6-8740-4dffd72a7e14 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.266726 Oct 18 13:53:30.062597 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2838/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:29 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:30.755910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:30.757909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:30.760881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:30.768171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:30.768986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:30.769610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:30.771015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:30.771497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:30.772673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:30.848915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:31.037206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:31.047575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:31.048366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:31.049725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b471626-7841-4546-847d-c4e43989e4cb tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2956 microversion: 2.42 time: 0.297991 Oct 18 13:53:31.050609 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2697/5535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:30 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2956 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:31.080248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:31.080248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:31.093727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:31.094268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:31.094726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:31.095449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:31.095916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:31.099859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:31.286350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:31.296138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-824cdc14-6b41-48a2-8d78-5dc1399b9563 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.224785 Oct 18 13:53:31.306685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2839/5536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:31 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:32.082989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:32.083621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:32.091881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:32.092395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:32.092846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:32.093559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:32.094027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:32.094512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:32.322287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:32.323739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:32.338626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:32.384913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:32.399799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:32.405252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:32.409499 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d24d662a-c5b6-4bc7-af3d-1cec8d844708 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2956 microversion: 2.42 time: 0.328223 Oct 18 13:53:32.418127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2698/5537] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:32 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2956 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:32.549768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:32.560584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b7da831-c5a9-4d75-9098-badfb50460c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.243410 Oct 18 13:53:32.561767 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2840/5538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:32 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:33.442859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:33.444312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:33.455750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:33.456763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:33.457430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:33.459395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:33.460094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:33.461538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:33.585963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:33.594549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:33.611909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:33.617157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:33.618426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:33.619104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:33.620085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:33.621553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:33.623425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:33.959567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:33.970124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:33.986790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb12c166-d472-4b5d-b22f-96f3fd13d71b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.403563 Oct 18 13:53:33.989087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:33.999450 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2841/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:33 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:34.005176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:34.011703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ce54c822-483d-4c5a-be5e-d2394629234b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2935 microversion: 2.42 time: 0.570420 Oct 18 13:53:34.012779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2699/5540] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:33 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2935 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:35.016365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:35.017987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:35.035049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:35.038361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:35.039075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:35.040014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:35.043284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:35.044136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:35.044681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:35.045302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:35.125636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:35.127850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:35.128459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:35.134763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:35.136125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:35.142730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:35.309633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:35.319452 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28f79610-cc9c-45fe-8ebd-2409085c2914 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.307347 Oct 18 13:53:35.320501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2842/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:35 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:35.325569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-deleted", "tag": "39b5ec15-de28-4bcb-bb72-646633b92ed0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:35.340290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:35.341145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:35.341826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:35.358714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] Creating event network-vif-deleted:39b5ec15-de28-4bcb-bb72-646633b92ed0 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:35.365466 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2bb3a1e6-066e-4c41-8e2c-53e171a0f033 req-98b34ed2-f837-45ac-9553-f55b4daa8d17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043161 Oct 18 13:53:35.366338 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2843/5542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:35.447061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:35.456830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:35.460939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:35.462925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9cc401e7-4dbc-4342-b03a-b6b012e595ab tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2868 microversion: 2.42 time: 0.424311 Oct 18 13:53:35.478686 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2700/5543] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:35 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2868 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:36.350683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:36.351411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:36.372030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.372554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.372997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.373714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.374213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.374653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.494204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:36.495015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:36.507679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.508859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.509421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.510399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.510971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.511516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.614918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:36.628232 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6718f0ae-ceeb-4e05-a511-be8ca346ff33 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1696 microversion: 2.1 time: 0.286063 Oct 18 13:53:36.643226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2844/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:36 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1696 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:36.773505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-unplugged", "status": "completed", "tag": "0e554e48-ada4-49d5-961d-2ddcc1728ebe"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:36.786876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.788210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.788802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.802175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] Creating event network-vif-unplugged:0e554e48-ada4-49d5-961d-2ddcc1728ebe for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:36.809135 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-44250e3f-e065-4fa0-9079-29ba32c49a97 req-c5a90261-f0df-4795-83ea-4d8f3b0862ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039708 Oct 18 13:53:36.814037 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2845/5545] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:36.917016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:36.934208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:36.938101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:36.941856 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0615c067-932c-4013-b09c-ba868281f8de tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2708 microversion: 2.42 time: 0.452861 Oct 18 13:53:36.942472 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2701/5546] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:36 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2708 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:37.613459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-unplugged", "status": "completed", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:37.649675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.651489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.652396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.679305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:37.679959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:37.681480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Creating event network-vif-unplugged:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h2-858383-13 Oct 18 13:53:37.689934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] Instance 9251d756-13d8-42b3-b436-b640806aa606 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:53:37.706440 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cd3cc172-b9e0-43c5-a623-fc4047490373 req-b12ab18b-c70c-48de-b648-7c2355c93a69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102357 Oct 18 13:53:37.707717 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2846/5547] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:37.714145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.714145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.714145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.714145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.714145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.714707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.746932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-deleted", "tag": "16c31a93-099e-4fde-90af-e06403098c14"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:37.762148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.763387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.775416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.801754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] Creating event network-vif-deleted:16c31a93-099e-4fde-90af-e06403098c14 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:37.812611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8fb2ca47-a38a-4507-b9b6-ba67c037bb4b req-6824ff85-be92-4a1f-a6c3-d8e234ad41d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071658 Oct 18 13:53:37.814722 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2847/5548] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:37.973430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:37.974327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:37.989508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.990030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.990546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.992075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.992075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.998136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:38.045214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:38.076275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5524aa75-da6e-473a-b607-0e66d0c190f3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1695 microversion: 2.1 time: 0.404468 Oct 18 13:53:38.076909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2702/5549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:37 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1695 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:38.476008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:38.514149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:38.515452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:38.516703 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1480e75-8946-444a-afac-7dfa7ceac8ae tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2548 microversion: 2.42 time: 0.547573 Oct 18 13:53:38.523823 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2848/5550] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:37 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2548 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:38.824696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-unplugged", "status": "completed", "tag": "919992b6-961d-4b56-b221-39037094820b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:38.845855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:38.846885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:38.847598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:38.887673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] Creating event network-vif-unplugged:919992b6-961d-4b56-b221-39037094820b for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:38.894177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-aef68b7e-c44a-443e-b5d0-32f263cc673d req-cb0ec43b-25af-42c1-84bd-37c6d83bd936 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072886 Oct 18 13:53:38.895102 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2703/5551] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:39.110691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:39.111539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:39.125588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.126166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.126631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.127381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.127859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.128308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.492303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:39.504003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b57e1e6a-7f76-45b5-b2d0-833ab6216970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1695 microversion: 2.1 time: 0.400647 Oct 18 13:53:39.506969 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2849/5552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:39 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1695 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:39.557312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:39.557956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:39.565413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.565413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.565834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.566569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.567213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.567651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.691817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:39.708271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:39.713428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:39.718266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ecb65e25-036a-4a22-87ec-cfba206e0e7e tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 2435 microversion: 2.42 time: 0.167786 Oct 18 13:53:39.721513 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2704/5553] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:39 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 2435 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:39.867341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:39.868404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:39.877114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-deleted", "tag": "fe2f25a5-5cfb-4924-aec8-35d88168e3a1"}, {"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-deleted", "tag": "919992b6-961d-4b56-b221-39037094820b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:39.883458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.884273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.884963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.885934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.888342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.889101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.898208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.898700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.899142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.943875 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8aa9e0d3-aa05-44d4-8984-e992f69d436b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/ips" status: 200 len: 147 microversion: 2.1 time: 0.081466 Oct 18 13:53:39.945789 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2850/5554] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:53:39 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/ips => generated 147 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:39.947871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Creating event network-vif-deleted:fe2f25a5-5cfb-4924-aec8-35d88168e3a1 for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:39.950275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] Creating event network-vif-deleted:919992b6-961d-4b56-b221-39037094820b for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:39.962479 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4bbe7808-abb7-4347-a164-ca3a4bc2f28a req-019d5e5d-228c-4eb6-8bb5-cbc83a2a6622 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091107 Oct 18 13:53:39.968455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2705/5555] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:53:40.199258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:40.247114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.247766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.248329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.275576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Creating event network-changed:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h2-858383-13 Oct 18 13:53:40.282500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] Instance 9251d756-13d8-42b3-b436-b640806aa606 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:53:40.343796 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-57f81c2a-a038-4971-aa91-47eb728d7a34 req-9fd46e4f-4932-4885-8022-b6e959ed3a06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149330 Oct 18 13:53:40.345032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2851/5556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:40.547157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:40.548289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:40.594073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.594694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.596623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.603323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.608273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.614014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.762291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:40.763149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:40.795226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.799296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.799965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.802353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.805838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.812854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.825735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:41.004929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:41.015180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:41.016690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:41.030188 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08937acf-f534-46c8-8549-940b6e0cf94f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.260273 Oct 18 13:53:41.031309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2852/5557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:40 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:41.384969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:41.398954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b61144f-f189-4284-a443-396428cd6256 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1695 microversion: 2.1 time: 0.868841 Oct 18 13:53:41.400577 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2706/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:40 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1695 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:42.012859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af9bb32-2796-4377-a4cc-ddb7d2a7333c", "name": "network-vif-deleted", "tag": "0e554e48-ada4-49d5-961d-2ddcc1728ebe"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:42.059796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:42.060421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:42.068227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.071663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.072812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.073316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.073763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:42.074021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:42.074513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.074977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.075410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:42.194046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] Creating event network-vif-deleted:0e554e48-ada4-49d5-961d-2ddcc1728ebe for instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c on n-h1-858383-13 Oct 18 13:53:42.236815 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-77958c40-0462-44df-a0eb-a3793605f74b req-ecf1def3-699c-49db-b40b-2f6df007e58b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242509 Oct 18 13:53:42.243730 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2853/5559] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:42.304793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:42.325251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:42.327132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:42.328569 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-365ae9a5-e4a4-4606-9c2c-f20a8a9e2c80 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.272869 Oct 18 13:53:42.332574 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2707/5560] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:42 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:42.432342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:42.436118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:42.464728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.472134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.473186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:42.475476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.478880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.479347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:43.235787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:43.248447 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35adb54b-c170-4c64-99cd-bb0d5c90343a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1693 microversion: 2.1 time: 0.824797 Oct 18 13:53:43.251295 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2854/5561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:42 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1693 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:43.382754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:43.385070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:43.397748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:43.398527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:43.399189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:43.400134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:43.400837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:43.401478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:43.576372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:43.592430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:43.598599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:43.600130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4eb9b662-16b9-4591-a253-6d3a0b18c95c tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.224696 Oct 18 13:53:43.605974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2708/5562] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:43 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:44.278507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:44.279872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:44.287669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.288260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.288790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.289576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.290156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.290839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.415079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6b3adca-d174-4d9f-9a85-0ce39f967b2c"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:44.417440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:44.424438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.424943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.425671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.426097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.443455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.444026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.565340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:44.586762 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b8744e0b-a2d8-424c-aa53-0f6159f0be74 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1690 microversion: 2.1 time: 0.312596 Oct 18 13:53:44.587896 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2855/5563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:44 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1690 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:44.633706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:44.634286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:44.641013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.650111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.652352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.663043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.663689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.664299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.182486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-366766cd-5765-4530-803c-0f6e6de74016 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action" status: 202 len: 0 microversion: 2.1 time: 0.553359 Oct 18 13:53:45.183121 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2856/5564] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:53:44 2022] POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:53:45.235755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:45.236507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:45.262869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.263889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.265717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.267519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.270278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.271295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.380671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:45.402484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:45.403977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:45.405182 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9cd9ecc5-617f-4536-a69e-44de136c55b2 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.220573 Oct 18 13:53:45.406214 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2857/5565] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:45 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:45.427428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:45.430719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:45.477723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.477723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.477723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.478037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.478483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.478916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.656031 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f46c4f5-0729-4093-b4eb-2a6518ba1304 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.245970 Oct 18 13:53:45.656991 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2709/5566] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:53:44 2022] POST /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 194 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:45.666769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-plugged", "status": "completed", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:45.685831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.686568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.687172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.701012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Creating event network-vif-plugged:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h2-858383-13 Oct 18 13:53:45.707399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] Instance 9251d756-13d8-42b3-b436-b640806aa606 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:53:45.721252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-985ce674-3a0c-47be-a104-540e9fb7e736 req-15505eef-242a-47ed-8af9-075390fe6054 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063311 Oct 18 13:53:45.723965 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2710/5567] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:45.877949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:45.913612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49409c82-acbc-486c-ba16-c64702a47c22 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.497669 Oct 18 13:53:45.918495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2858/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:45 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:46.438655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:46.439852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:46.487895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.490663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.491362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:46.492329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.497079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.499937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:46.598824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:46.631235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:46.663492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:46.663492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9febcef3-cf53-4d72-8ca7-16e65821e3ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.220923 Oct 18 13:53:46.663492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2711/5569] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:46 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:46.954238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:46.955997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:46.970746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.975544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.975544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:46.975544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.975544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.975544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:47.196841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:47.206593 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f565f7b-c18b-4b3e-a709-8510f2c10675 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.258069 Oct 18 13:53:47.207359 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2859/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:46 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:47.685778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:47.686653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:47.714669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:47.715942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:47.719204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:47.719204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:47.719204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:47.719204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:47.815790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:47.834964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:47.836821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:47.838340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-440eb370-e576-438a-bcf8-07e538b32802 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.158769 Oct 18 13:53:47.839722 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2712/5571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:47 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:48.230712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:48.231334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:48.244547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.245052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.245665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.246240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.253348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.264388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.510433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:48.521826 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-906e11ef-f747-4855-b9d3-7f2ed348292a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.294828 Oct 18 13:53:48.523218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2860/5572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:48 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:48.870349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:48.871853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:48.893063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.893575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.894031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.894936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.895547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.895995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.007833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:49.048024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:49.051458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:49.057137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9cc05195-8e04-4701-aacf-40c6b328dbfe tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.192423 Oct 18 13:53:49.057620 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2713/5573] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:48 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:49.243191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Calling method '.version_select at 0x7fb330c26160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:49.243191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:49.247889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:49.247889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.264717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:49.265215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:49.266091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.279968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:49.280479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:49.280922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.288486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e518b716-6cba-4ebb-aa83-93da01413cc9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1448174718-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.271985 Oct 18 13:53:49.289362 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2861/5574] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:53:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:49.548399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:49.549362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:49.560350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:49.560858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:49.561542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.562545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:49.563227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:49.563893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:49.588909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:49.745600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:49.772268 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf320dca-f954-4a05-abfe-032e5d3a6dd4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.224839 Oct 18 13:53:49.773334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2714/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:49 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:50.100055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:50.100581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:50.108458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:50.109262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:50.109855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:50.110756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:50.111404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:50.111993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:50.204440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:50.237814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:50.244049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:50.245262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-479b9203-1441-41e8-a5e6-34138119aedc tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.149443 Oct 18 13:53:50.266076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2862/5576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:50 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:50.765609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-unplugged", "status": "completed", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:50.779674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:50.780434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:50.781203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:50.799010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:50.799883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:50.814020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:50.814880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:50.815504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:50.815894 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Creating event network-vif-unplugged:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:53:50.818280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:50.819735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:50.821793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:50.830740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] Instance 9251d756-13d8-42b3-b436-b640806aa606 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:53:50.856550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-42d11c6c-f76b-4095-8068-77b5a8e02c07 req-b31ae889-cf12-4bf2-bd0c-90673cf6219e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096094 Oct 18 13:53:50.857160 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2715/5577] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:51.010045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:51.021597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6cee317c-42a3-4595-a39e-a2c77ebd53d4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.226414 Oct 18 13:53:51.023069 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2863/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:50 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:51.280281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:51.281171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:51.288226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:51.288724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:51.289171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:51.290096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:51.290752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:51.291190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:51.397262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:51.415046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:51.420619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:51.420619 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4510b4bd-eb94-40ce-a629-45250c78ad88 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.143404 Oct 18 13:53:51.420619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2716/5579] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:51 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:52.054675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:52.058628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:52.075868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:52.076379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:52.076834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:52.077592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:52.078072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:52.078514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:52.304097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:52.312947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da617727-ced7-4bf7-8f7b-7af54e825f4b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.269715 Oct 18 13:53:52.313779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2864/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:52 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:52.460276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:52.460926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:52.470106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:52.470542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:52.471190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:52.472076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:52.472705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:52.473305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:52.552798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:52.562868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:52.568555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:52.568555 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6338458-0732-400c-8837-bfb4bcb332ba tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.111996 Oct 18 13:53:52.568555 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2717/5581] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:52 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:52.872655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:52.883050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:52.883383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:52.883819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:52.896107 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Creating event network-changed:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:53:52.902660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] Instance 9251d756-13d8-42b3-b436-b640806aa606 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:53:52.914041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-12fc5abf-8247-4a23-ab8b-9741373870f4 req-bcb5ff05-b9d1-4955-b372-d11d16f35ec4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044862 Oct 18 13:53:52.915653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2865/5582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:53.338772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:53.339545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:53.346683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:53.347304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:53.347857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:53.349210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:53.349950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:53.350501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:53.523640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:53.534882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86b14714-ba36-4546-9e5b-520188442125 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.200076 Oct 18 13:53:53.536136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2718/5583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:53 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:53.595290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:53.596043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:53.603663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:53.604296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:53.604747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:53.605450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:53.605947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:53.606394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:53.703903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:53.719108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:53.721171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:53.722833 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0f3bda9-d388-479d-86b5-68b1a404dff8 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.133695 Oct 18 13:53:53.723962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2866/5584] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:53 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:54.560575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:54.561492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:54.568508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:54.569004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:54.569446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:54.570372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:54.571092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:54.571671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:54.754604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:54.756719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:54.766314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:54.767119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:54.769137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:54.770501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:54.771173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:54.772297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:54.809173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:54.830103 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-563bd1cd-8d04-4eb3-a080-4d474dfcd30e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1689 microversion: 2.1 time: 0.273546 Oct 18 13:53:54.838136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2719/5585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:54 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:53:54.875100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:54.884705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:54.888772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:54.890865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:54.892146 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9abf4971-601a-4f51-b9c1-92c3d153d754 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.145601 Oct 18 13:53:54.906229 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2867/5586] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:54 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:55.864388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:55.867221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:55.876681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:55.877422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:55.878772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:55.879901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:55.881287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:55.882008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:55.918647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:55.919360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:55.928283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:55.931585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:55.931585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:55.931585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:55.931585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:55.932781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:56.059983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:56.071581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:56.073110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:56.075164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3605abcb-1f5f-4d08-b56a-c53327551dbd tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.160555 Oct 18 13:53:56.077030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2868/5587] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:55 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:56.168255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:56.195019 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfe1ce53-0864-4e00-8ba0-563bb571756f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1682 microversion: 2.1 time: 0.326114 Oct 18 13:53:56.202409 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2720/5588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:55 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1682 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:57.104994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:57.106511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:57.149290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:57.156373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:57.158691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:57.160935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:57.163980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:57.166755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:57.359451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:57.375801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:57.377363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:57.378629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69a5549f-1576-4770-9d5d-3bb33f945116 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.277682 Oct 18 13:53:57.379720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2869/5589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:57 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:53:58.405310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:58.406626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:58.414630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:58.415308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:58.415951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:58.416824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:58.417444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:58.418102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:58.494168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:58.510071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:58.515482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:58.515482 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bd2c67e-67b9-43bd-a551-df417333c646 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.112854 Oct 18 13:53:58.515482 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2721/5590] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:58 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:53:58.620795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-plugged", "status": "completed", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:58.632688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:58.633182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:58.633618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:58.658681 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] Creating event network-vif-plugged:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:53:58.664272 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-52e55b1c-46f6-4bce-8395-3b65a96f49f1 req-f12c7334-1daa-4905-a038-78ad3b545d39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047865 Oct 18 13:53:58.665771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2870/5591] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:59.541530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:59.546861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:59.556850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:59.557710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:59.558351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:59.559578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:59.562234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:59.562852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:59.686826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:59.696664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:59.698163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:59.704732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-271d519e-f14d-49cc-b260-dc161831f607 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.168022 Oct 18 13:53:59.719867 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2722/5592] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:53:59 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:00.738298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:00.740441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:00.748585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:00.749332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:00.750070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:00.751344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:00.752026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:00.752643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:00.859019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:00.869886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:00.871464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:00.872756 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09ceb357-521a-4711-b237-24fdb5dcf148 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.141292 Oct 18 13:54:00.886995 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2871/5593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:00 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:01.225893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:01.228057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:01.236659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.241072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.241072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:01.241072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.241072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.241072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:01.288379 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0c1aa99-2b83-465d-9543-f6ed7983d533 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066830 Oct 18 13:54:01.299633 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2723/5594] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:54:01 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:01.301595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:01.316364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:01.330135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.333544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.334531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:01.335300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.335778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.336224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:01.390907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4efd7561-22fd-4285-92b3-3afa04dbdb28 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c" status: 200 len: 194 microversion: 2.1 time: 0.092013 Oct 18 13:54:01.394262 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2872/5595] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 18 13:54:01 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:54:01.902178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:01.904733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:01.912178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.913011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.913677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:01.914611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:01.915087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:01.916149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:02.008341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:02.019737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:02.022259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:02.023626 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-265b570f-f05c-45be-93f5-3be70c23e2c1 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.127972 Oct 18 13:54:02.030261 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2724/5596] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:01 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:03.050868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:03.052089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:03.071983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:03.072705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:03.073103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:03.073965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:03.074401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:03.075047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:03.155264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:03.168564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:03.170302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:03.171715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19851b9f-bcc7-47a0-b3fb-ac746f1b6ab7 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.125118 Oct 18 13:54:03.173052 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2873/5597] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:03 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:04.205533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:04.206522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:04.215865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=56 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:04.218806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:04.219779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:04.220752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:04.221869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:04.222932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:04.223668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:04.344805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:04.361217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:04.362833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:04.364119 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ac557d8-695a-4324-9799-3c8af9c25db4 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.164530 Oct 18 13:54:04.365583 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2725/5598] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:04 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:04.456158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1aab370-fd08-4fdb-b70c-a7e6206df5a1"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:04.465808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:04.465808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=72 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:04.477836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:04.479945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:04.482457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:04.483308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:04.484878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:04.485366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:05.395205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:05.396099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:05.410774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:05.411295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:05.412544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:05.415385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:05.416884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:05.418358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:05.548864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:05.612621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:05.612621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:05.612621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac2a6d2d-7d94-4dba-9600-f30942142e0b tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.217055 Oct 18 13:54:05.612621 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2726/5599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:05 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:05.813855 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a757f983-4e15-4dcc-ac24-10bc0beedbc5 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "POST /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.361732 Oct 18 13:54:05.822708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2874/5600] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 13:54:04 2022] POST /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 194 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:06.638793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:06.639687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:06.654183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:06.658329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:06.665660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:06.666756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:06.667263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:06.675859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:06.816590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:06.835106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:06.840889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:06.844666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4524d20b-7404-4431-b9f9-9d2b7ce817d9 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.207669 Oct 18 13:54:06.858249 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2727/5601] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:06 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:07.886676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:07.888017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:07.902695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:07.913776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:07.913776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:07.913776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:07.913776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:07.913776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:08.011463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:08.033133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:08.034717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:08.037403 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e7aa850-b408-4d25-b67c-a35b8902a34f tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1603 microversion: 2.42 time: 0.165314 Oct 18 13:54:08.037965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2875/5602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:07 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1603 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:09.065205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:09.066704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:09.074230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:09.074956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:09.075562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:09.076462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:09.077096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:09.077529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:09.123952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:09.124445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:09.125071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:09.125952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lazy-loading 'fault' on Instance uuid 8af9bb32-2796-4377-a4cc-ddb7d2a7333c {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:09.190810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:09.212096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:09.214856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '371dc522b1db4365900595d2fb0df7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da657bc46794b2c84e755ed48250a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:09.217507 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e86a787-3d10-491a-939c-95e1e7bb8a60 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 200 len: 1608 microversion: 2.42 time: 0.155830 Oct 18 13:54:09.228532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2728/5603] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:09 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:54:10.247450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:10.248070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:10.255852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:10.256541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:10.256888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:10.257646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:10.258138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:10.258577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:10.278664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] HTTP exception thrown: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Request method failure captured: Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c HTTP/1.1 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3zK_PsYCgSlfWApKyRVt1NHlDrMFpFtmBsSYUDCb8WY5dMlAu9pUFFmgtqHhfKuCEuWsZ-zE5949Yqhx4yMmq_vqbuVchoxfk18blme17LPJU3YZgXM3nnNq4LwAe3F2ZiozDdtZ6n3r6RKRcNsWGVkU-YuWli-gsXsjkputm4PCI Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3da657bc46794b2c84e755ed48250a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 371dc522b1db4365900595d2fb0df7b8 Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8af9bb32-2796-4377-a4cc-ddb7d2a7333c'} Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:10.280729 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Returning 404 to user: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c3adbe1-b5fc-46cc-a02d-4014a18ee55d tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 404 len: 111 microversion: 2.42 time: 0.041535 Oct 18 13:54:10.296197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2876/5604] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:10 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:54:10.300812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18d62c19-e5e5-4ba6-befe-bb918eb52098 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '.version_select at 0x7fb32bdc8670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:10.407867 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18d62c19-e5e5-4ba6-befe-bb918eb52098 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245674219" status: 204 len: 0 microversion: 2.42 time: 0.112036 Oct 18 13:54:10.408939 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2729/5605] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 18 13:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245674219 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:54:11.828273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:11.829579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:11.840652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:11.841384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:11.842167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:11.843085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:11.843743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:11.844496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:11.969983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lazy-loading 'services' on Instance uuid f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:12.271509 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-440e9331-caf7-496a-adbb-ea102e637218 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3/os-volume_attachments/4d367085-d2f9-41ff-9487-07a229431a08" status: 202 len: 0 microversion: 2.1 time: 0.447341 Oct 18 13:54:12.284734 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2877/5606] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:54:11 2022] DELETE /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3/os-volume_attachments/4d367085-d2f9-41ff-9487-07a229431a08 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:54:16.155611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:16.156661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:16.172843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:16.180979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:16.181810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:16.182768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:16.183416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:16.184015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:16.202938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] HTTP exception thrown: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Request method failure captured: Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c HTTP/1.1 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq3zK_PsYCgSlfWApKyRVt1NHlDrMFpFtmBsSYUDCb8WY5dMlAu9pUFFmgtqHhfKuCEuWsZ-zE5949Yqhx4yMmq_vqbuVchoxfk18blme17LPJU3YZgXM3nnNq4LwAe3F2ZiozDdtZ6n3r6RKRcNsWGVkU-YuWli-gsXsjkputm4PCI Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3da657bc46794b2c84e755ed48250a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 371dc522b1db4365900595d2fb0df7b8 Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '8af9bb32-2796-4377-a4cc-ddb7d2a7333c'} Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:16.205177 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.210938 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.213162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Returning 404 to user: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:16.214305 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-798a819c-ee29-450c-8dc2-7f10cb6a1c91 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 404 len: 111 microversion: 2.42 time: 0.066942 Oct 18 13:54:16.215114 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2730/5607] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 13:54:16 2022] DELETE /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:54:16.225125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:16.230274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] [instance: 8af9bb32-2796-4377-a4cc-ddb7d2a7333c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:16.258567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:16.259143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:16.259611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:16.262834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:16.263383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:16.263846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:16.301478 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] HTTP exception thrown: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Request method failure captured: Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c HTTP/1.1 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq3zK_PsYCgSlfWApKyRVt1NHlDrMFpFtmBsSYUDCb8WY5dMlAu9pUFFmgtqHhfKuCEuWsZ-zE5949Yqhx4yMmq_vqbuVchoxfk18blme17LPJU3YZgXM3nnNq4LwAe3F2ZiozDdtZ6n3r6RKRcNsWGVkU-YuWli-gsXsjkputm4PCI Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3da657bc46794b2c84e755ed48250a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3da657bc46794b2c84e755ed48250a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 3da657bc46794b2c84e755ed48250a86 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-108963587 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 371dc522b1db4365900595d2fb0df7b8 Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TaggedBootDevicesTest_v242-108963587-project Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '8af9bb32-2796-4377-a4cc-ddb7d2a7333c'} Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.306151 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] Returning 404 to user: Instance 8af9bb32-2796-4377-a4cc-ddb7d2a7333c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:16.310019 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6b0da4d-8b75-49fe-b824-634eb84dcc71 tempest-TaggedBootDevicesTest_v242-108963587 tempest-TaggedBootDevicesTest_v242-108963587-project] 10.222.0.27 "GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c" status: 404 len: 111 microversion: 2.42 time: 0.088256 Oct 18 13:54:16.312661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2878/5608] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 13:54:16 2022] GET /compute/v2.1/servers/8af9bb32-2796-4377-a4cc-ddb7d2a7333c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:54:18.514012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:18.515239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:18.536010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:18.539105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:18.542305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:18.543580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:18.544274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:18.544941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:18.620048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:54:18.669068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:18.985825 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e862fa1-63f3-43ad-bfd1-3b7dd3fa54a3 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 204 len: 0 microversion: 2.1 time: 0.476361 Oct 18 13:54:18.986458 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2731/5609] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:54:18 2022] DELETE /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:54:18.995762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:18.997024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:19.014242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:19.199234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:19.210354 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ee8096a-0c96-4432-b77a-d999748779a4 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1470 microversion: 2.1 time: 0.218363 Oct 18 13:54:19.211673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2879/5610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:18 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:20.237120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:20.237120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:20.248808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:20.249335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:20.249781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:20.250785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:20.251249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:20.251682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:20.401408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:20.410914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53f252a1-c243-4f89-83cd-b303c8a0f711 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1470 microversion: 2.1 time: 0.180465 Oct 18 13:54:20.411858 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2732/5611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:20 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:20.696295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:20.699453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:20.706129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:20.706705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:20.707396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:20.708238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:20.708768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:20.709269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:20.796611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6d2ebb9-42c8-4ac3-bb55-3fb9e3480ea8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action" status: 200 len: 63179 microversion: 2.1 time: 0.373822 Oct 18 13:54:20.807791 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2880/5612] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:54:20 2022] POST /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606/action => generated 63179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:54:21.438436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:21.439317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:21.452769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:21.462795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:21.462795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:21.462795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:21.462795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:21.462795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:21.612912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:21.622587 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1f94162-9f15-45f3-a1e5-093f1326a434 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1470 microversion: 2.1 time: 0.190153 Oct 18 13:54:21.623378 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2733/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:21 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:21.953900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3", "name": "network-vif-deleted", "tag": "76aec5c9-5b9a-4c7e-8e44-33c68fd840f7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:21.965797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:21.968078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:21.979091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:21.980487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:21.981098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:21.981960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:21.982605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:21.983194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:21.991727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:21.992707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:21.993356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.009286 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] Creating event network-vif-deleted:76aec5c9-5b9a-4c7e-8e44-33c68fd840f7 for instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 on n-h2-858383-13 Oct 18 13:54:22.015936 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dc364c6b-e68e-43aa-98a1-cd139e689dfb req-434e9c28-4646-4514-be1e-ecf2ea45e40d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066008 Oct 18 13:54:22.020213 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2881/5614] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:22.027052 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-946cc839-d61f-4af2-9dc7-0048057a2dda tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065666 Oct 18 13:54:22.027680 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2734/5615] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:54:21 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:22.175490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:22.176091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:22.185936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.190045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.192669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.192669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.192669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.195508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.256708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33b0ce7a-5d15-431c-bbfe-79c00dc58d5f tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c" status: 200 len: 194 microversion: 2.1 time: 0.087026 Oct 18 13:54:22.257841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2882/5616] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 18 13:54:22 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:22.269019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:22.269774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:22.281606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.288158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.288158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.288158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.288158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.288158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.468515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lazy-loading 'services' on Instance uuid 5c135375-66c4-4729-a698-28c60928fce9 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:22.646906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:22.647927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:22.655045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.655884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.656569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.657666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.658386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.659063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.703028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:22.704460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:22.705610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:22.706829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lazy-loading 'fault' on Instance uuid f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:22.805054 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36758e4b-a7d4-40c0-bd51-47c302ea2257 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c" status: 202 len: 0 microversion: 2.1 time: 0.540488 Oct 18 13:54:22.805676 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2735/5617] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:54:22 2022] DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b6b3adca-d174-4d9f-9a85-0ce39f967b2c => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:54:23.113695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01b6239b8a94b2791b537d9fb6a0085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da00e8c79804846a4c913cce8015690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:23.127013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2789599b-f9be-404a-ade8-c850621adfa0 tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 200 len: 1304 microversion: 2.1 time: 0.483886 Oct 18 13:54:23.127921 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2883/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:22 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 1304 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:54:24.153763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:24.155101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] [instance: f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:24.163734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:24.164405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:24.165089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:24.165976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:24.166797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:24.167392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:24.183805 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] HTTP exception thrown: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Request method failure captured: Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 HTTP/1.1 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq9aqha2rZtfWwKYLrRUGGkKez2Yr-cng3WJPSU12PVrv6ZvitrvMS7n1h4DXpWHJjt_IgwYOM_VBiqq7oPd70cAeaG1YIfs8Deso8CiNHKkmTGJwHYTmiCf-7RC1K-DKNCG8JyBHwjORrjaFxPQKw-e2d_r1DUhXmp8uHGOAGz2ovw Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2da00e8c79804846a4c913cce8015690 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesBackupsTest-521510734 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2da00e8c79804846a4c913cce8015690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2da00e8c79804846a4c913cce8015690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2da00e8c79804846a4c913cce8015690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2da00e8c79804846a4c913cce8015690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesBackupsTest-521510734 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2da00e8c79804846a4c913cce8015690 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesBackupsTest-521510734 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesBackupsTest-521510734-project Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b01b6239b8a94b2791b537d9fb6a0085 Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesBackupsTest-521510734-project Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3'} Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:24.187169 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. Oct 18 13:54:24.193549 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:24.200179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] Returning 404 to user: Instance f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:24.200179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5038e7dc-a7ed-4fce-b536-5fb1428a197c tempest-VolumesBackupsTest-521510734 tempest-VolumesBackupsTest-521510734-project] 10.222.0.27 "GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3" status: 404 len: 111 microversion: 2.1 time: 0.045978 Oct 18 13:54:24.200179 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2736/5619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:24 2022] GET /compute/v2.1/servers/f9ee849b-c0b5-4dbc-a0a5-a8df8515e4c3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:54:27.434381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:27.435179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:27.443207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:27.443931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:27.444483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:27.445497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:27.446190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:27.446887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:27.449976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:27.691854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1fd9729-f69e-4b2b-b858-7ce2f149bb3d tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1835 microversion: 2.1 time: 0.509715 Oct 18 13:54:27.693109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2884/5620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:27 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1835 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:29.552675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:29.553828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:29.562549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.563463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.564078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.564971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.565746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.566644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.612495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-816ed95d-78ff-4bed-b96b-7052ae74878d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b1aab370-fd08-4fdb-b70c-a7e6206df5a1" status: 200 len: 194 microversion: 2.1 time: 0.064581 Oct 18 13:54:29.613404 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2737/5621] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 18 13:54:29 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b1aab370-fd08-4fdb-b70c-a7e6206df5a1 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:29.624477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:29.625928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:29.639454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.640138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.640533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.641313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.641792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.642452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.714312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:29.715786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:29.730368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.740192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.742266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.743301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:29.747612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:29.751636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:29.826720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:54:29.833345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lazy-loading 'services' on Instance uuid 5c135375-66c4-4729-a698-28c60928fce9 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:30.272348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-735bcd14-5915-45a2-9fd2-4312d616c312 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b1aab370-fd08-4fdb-b70c-a7e6206df5a1" status: 202 len: 0 microversion: 2.1 time: 0.651678 Oct 18 13:54:30.273733 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2885/5622] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 13:54:29 2022] DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments/b1aab370-fd08-4fdb-b70c-a7e6206df5a1 => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:54:30.301097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:30.349453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:30.349954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:30.350480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:30.353568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3722fce-5cba-429f-9c55-950c7c6dfde1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 204 len: 0 microversion: 2.1 time: 0.642847 Oct 18 13:54:30.355637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2738/5623] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:54:29 2022] DELETE /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:54:30.365858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:30.375349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:30.420072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:30.420584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:30.421032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:30.421775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:30.422281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:30.422723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:30.434860 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] Creating event network-changed:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:54:30.472008 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-745d2865-f8e1-4040-8849-ce8c6edffe2a req-d5e93d2d-88d8-4fff-9ce9-c8114430e311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196510 Oct 18 13:54:30.472628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2886/5624] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:30.966291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:30.984361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ec073a4-acdb-4fb2-a48a-47c5d3bba27b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1688 microversion: 2.1 time: 0.620956 Oct 18 13:54:30.990662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2739/5625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:30 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1688 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:32.028528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:32.028528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:32.039796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:32.045612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:32.046423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:32.047431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:32.052285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:32.057404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:32.368123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:32.377965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2887df3f-d821-426e-99ab-a77e3dec8fcf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1688 microversion: 2.1 time: 0.364841 Oct 18 13:54:32.406849 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2887/5626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:32 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1688 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:33.405920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:33.407247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:33.418785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:33.424354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:33.425472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:33.427458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:33.430870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:33.431524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:34.478095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:34.490297 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9baa2ac0-03dd-4765-8178-42400dac64a6 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1621 microversion: 2.1 time: 1.088187 Oct 18 13:54:34.506313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2740/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:33 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1621 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:34.740358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9251d756-13d8-42b3-b436-b640806aa606", "name": "network-vif-deleted", "tag": "43850001-e1f0-47cf-a4c2-8805a38f698d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:34.757201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=30 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:34.764875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:34.769319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:34.772016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:34.796760 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] Creating event network-vif-deleted:43850001-e1f0-47cf-a4c2-8805a38f698d for instance 9251d756-13d8-42b3-b436-b640806aa606 on n-h1-858383-13 Oct 18 13:54:34.809788 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-739e1a84-5dc8-4a0d-818d-728778fddc39 req-d71cdd12-4ffb-4599-a5e4-811743129cbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074058 Oct 18 13:54:34.810769 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2888/5628] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:35.525509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:35.526951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:35.539095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:35.546131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:35.548606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:35.548606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:35.549626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:35.550409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:35.551711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:35.651987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:35.654960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:35.656093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:35.657056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lazy-loading 'fault' on Instance uuid 9251d756-13d8-42b3-b436-b640806aa606 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:35.822814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:35.838573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-50358782-cc9e-47f3-aa8f-1e471ddfae3a tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 200 len: 1356 microversion: 2.1 time: 0.317008 Oct 18 13:54:35.856016 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2741/5629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:35 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 1356 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:36.865770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:36.866893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 9251d756-13d8-42b3-b436-b640806aa606] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:36.889709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:36.890450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:36.891908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:36.894562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:36.896826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:36.900274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:36.934428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] HTTP exception thrown: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Request method failure captured: Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 HTTP/1.1 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq7IGBlDKyARK9VA6W2bq45YJNmQP5lsBo3jK6nNFchQFCp7WqlbDx9FWzSYmi1RbzwwhLUSCg8_4yT2NzxnUBwLIYE1M-wa8UW8IDq3k-Ysb5tQcdQ0OSPZx8bR8xoXaXFiyazPea2eTVrjs1McVHg0DkpMgDyTtLesBx_HAIgMSq4 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 69a2792ee20e450e877d4f016c031768 Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '9251d756-13d8-42b3-b436-b640806aa606'} Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:36.937815 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. Oct 18 13:54:36.943366 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:54:36.944815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Returning 404 to user: Instance 9251d756-13d8-42b3-b436-b640806aa606 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:36.946680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-41f8d6d3-f0fc-4f6d-b7f5-1fba043c63d1 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606" status: 404 len: 111 microversion: 2.1 time: 0.085328 Oct 18 13:54:36.947828 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2889/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:36 2022] GET /compute/v2.1/servers/9251d756-13d8-42b3-b436-b640806aa606 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:54:40.935389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:40.938285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:40.959771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:40.960536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:40.961155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:40.962143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:40.962962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:40.963587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.013480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c558e1d3-19d6-4d61-95e7-9f06e0f36453 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080804 Oct 18 13:54:41.013480 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2742/5631] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:54:40 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:54:41.205093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:41.208104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:41.217652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:41.221598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:41.224075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.226713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:41.228214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:41.230024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.279403 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf8192f0-627a-4472-ac45-46740d2ed73d tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078795 Oct 18 13:54:41.280809 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2890/5632] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:54:41 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:54:41.432287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:41.432287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:41.456085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:41.456618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:41.458339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.468465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:41.469105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:41.469577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.570391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:54:42.003383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ef303c3-9127-4919-aa2c-8f1e6a2c0490 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 204 len: 0 microversion: 2.1 time: 0.595766 Oct 18 13:54:42.006533 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2743/5633] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:54:41 2022] DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:54:42.028091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:42.029099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:42.039084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:42.045028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:42.054370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:42.057156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:42.060178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:42.060701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:42.539338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:42.566644 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43f9cf47-d58e-41b7-b5a1-c7e8bdcf9667 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1675 microversion: 2.1 time: 0.549261 Oct 18 13:54:42.568524 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2891/5634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:42 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1675 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:43.596911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:43.597813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:43.615587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:43.616101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:43.616578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:43.617307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:43.617777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:43.618250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:43.708404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:44.319579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:44.329412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aacc76bb-2bc2-4fa3-b80f-cf6e8ea16c64 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1675 microversion: 2.1 time: 0.736990 Oct 18 13:54:44.333644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2744/5635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:43 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1675 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:45.360027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:45.362731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:45.374239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:45.375027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:45.375966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:45.376904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:45.377595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:45.378279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:45.472076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:45.491997 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e86d7de-54bc-4a40-9421-921018e814f0 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1607 microversion: 2.1 time: 0.132084 Oct 18 13:54:45.518745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2892/5636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:45 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1607 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:45.995309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c135375-66c4-4729-a698-28c60928fce9", "name": "network-vif-deleted", "tag": "1e7fc791-3498-4107-83c4-1c15b7983178"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:46.016568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.021485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.033421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.058985 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] Creating event network-vif-deleted:1e7fc791-3498-4107-83c4-1c15b7983178 for instance 5c135375-66c4-4729-a698-28c60928fce9 on n-h2-858383-13 Oct 18 13:54:46.067518 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ae28dbf2-9d72-4685-9af9-9c3c458635bd req-cfd4060c-82a2-474e-b35b-cea67cb9e9c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269707 Oct 18 13:54:46.069027 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2745/5637] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:54:46.528148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:46.528148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:46.542828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.544402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.549760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.551806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.553538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.555321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.696360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.697300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.697946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.698607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lazy-loading 'fault' on Instance uuid 5c135375-66c4-4729-a698-28c60928fce9 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:54:46.866782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3ed4523fb1d423abcf98fdb30b37b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9380daa22eb489dbb2b7e27806c8bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:46.875505 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0750e0d8-c2a8-410c-a6d6-8c2ad2d85786 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 200 len: 1327 microversion: 2.1 time: 0.355122 Oct 18 13:54:46.893268 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2893/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:46 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 1327 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:47.917131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:47.918312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:47.935396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:47.938417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:47.939229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:47.941620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:47.944564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:47.949263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:47.976794 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 HTTP/1.1 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5c135375-66c4-4729-a698-28c60928fce9'} Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:54:47.979501 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:54:47.983905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0f05f812-c7ce-4071-9244-172f9ba2abf6 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 404 len: 111 microversion: 2.1 time: 0.068719 Oct 18 13:54:47.987866 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2746/5639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:47 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:54:47.992463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0648713c-20d1-41c2-9203-37ab3c8cf4e8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '.version_select at 0x7fb32bd0ae50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:48.091154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0648713c-20d1-41c2-9203-37ab3c8cf4e8 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-131953692" status: 202 len: 0 microversion: 2.1 time: 0.105173 Oct 18 13:54:48.091780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2894/5640] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:54:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-131953692 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:54:48.225041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80a977fa-80d3-4089-bb0c-7fcc81f0dac8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '.version_select at 0x7fb32bdeb430>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:48.331222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80a977fa-80d3-4089-bb0c-7fcc81f0dac8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2037050484" status: 202 len: 0 microversion: 2.1 time: 0.113582 Oct 18 13:54:48.332066 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2747/5641] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 18 13:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2037050484 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:54:48.373896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2169646-66b7-457a-a85e-b01e401f8ff9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: .version_select at 0x7fb330d758b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-309171070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQwZHpjvKvLIr8u8UXYNFhn4Kskr7wd/xB7obw4oJHcWhDarW3N3UHUivgGcW4w6+CuTlTZIGNP8N3wJ5lJPLw9igxBfoLix57C6Bw1VIEMwFGGOH46MoEIbxBOeXNJ1g=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:48.436277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a2169646-66b7-457a-a85e-b01e401f8ff9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:54:48.458585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a2169646-66b7-457a-a85e-b01e401f8ff9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:54:48.575165 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2169646-66b7-457a-a85e-b01e401f8ff9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.205681 Oct 18 13:54:48.575791 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2895/5642] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:54:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:00.866728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:00.867896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:00.903982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:00.907329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:00.911525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:00.913977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:00.915834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:00.919548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:00.920284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:00.922750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:00.994441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 HTTP/1.1 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5c135375-66c4-4729-a698-28c60928fce9'} Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:00.997133 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.002492 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.007500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:01.009543 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-312d2c99-413a-4d4f-9e84-b885315a74b2 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 404 len: 111 microversion: 2.1 time: 0.148600 Oct 18 13:55:01.020603 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2748/5643] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:00 2022] DELETE /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:01.021582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:01.022515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:01.023606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:01.027872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:01.030232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 5c135375-66c4-4729-a698-28c60928fce9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:01.054661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:01.056253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:01.059868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:01.061353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:01.064011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:01.065764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:01.103559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 HTTP/1.1 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5c135375-66c4-4729-a698-28c60928fce9'} Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:01.105431 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. Oct 18 13:55:01.110430 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:01.111711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 5c135375-66c4-4729-a698-28c60928fce9 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:01.112980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-edd5be59-fc92-44db-a410-a48befcaa82b tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9" status: 404 len: 111 microversion: 2.1 time: 0.093528 Oct 18 13:55:01.114644 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2896/5644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:01 2022] GET /compute/v2.1/servers/5c135375-66c4-4729-a698-28c60928fce9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:08.859592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:08.860376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:08.880334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:08.883893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:08.886371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:08.888624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:08.890569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:08.891463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:08.932855 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c HTTP/1.1 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0eb11d9b-3339-4d7f-a5fa-680e6538247c'} Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:08.942545 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8faa475-bed6-4565-81a3-4cd39ac997fa tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 404 len: 111 microversion: 2.1 time: 0.091911 Oct 18 13:55:08.959136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2749/5645] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:08 2022] DELETE /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:08.961029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:08.961029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] [instance: 0eb11d9b-3339-4d7f-a5fa-680e6538247c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:08.991314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:08.991314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:08.991314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:08.991314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:08.991314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:08.994469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:09.057702 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] HTTP exception thrown: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Request method failure captured: Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c HTTP/1.1 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTq7Jq5vDnKiHkLLW2EjIm3znGftcrBFI6DPqgJ_x87osKxvL8M5v1GKZjGIrGHvrpBYm13FFqrb6J5zkUIdBuOLUhI5hKQNC4o8HFghZlMJ0gexy3ZPt1cYhfiLD24ROCtEkHebEYEcxPqCf7v9m9VzuQ-tTPgsQLPTQKWrTlqTabkE Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9380daa22eb489dbb2b7e27806c8bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b9380daa22eb489dbb2b7e27806c8bb3 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-588876596 Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: d3ed4523fb1d423abcf98fdb30b37b0a Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-588876596-project Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0eb11d9b-3339-4d7f-a5fa-680e6538247c'} Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:09.059354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] Returning 404 to user: Instance 0eb11d9b-3339-4d7f-a5fa-680e6538247c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:09.073129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7a8553d-7ce5-4b43-bf37-35f44595ba15 tempest-AttachVolumeTestJSON-588876596 tempest-AttachVolumeTestJSON-588876596-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c" status: 404 len: 111 microversion: 2.1 time: 0.106729 Oct 18 13:55:09.075197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2897/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:08 2022] GET /compute/v2.1/servers/0eb11d9b-3339-4d7f-a5fa-680e6538247c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:09.462107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-71331746", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "4e5f8999-9705-4128-a4f2-ae52a4446ece"}], "key_name": "tempest-TestNetworkAdvancedServerOps-309171070", "security_groups": [{"name": "tempest-secgroup-smoke-2107182868"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:09.705511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] validate_networks() for [('4e5f8999-9705-4128-a4f2-ae52a4446ece', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:55:11.021832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:55:11.022921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:55:11.026870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:55:11.026870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:55:11.026870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:55:11.043981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:11.044760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:11.045391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:11.046418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:11.047044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:11.047642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:11.096498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:55:11.103851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:55:11.165299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:55:11.170171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:55:11.481143 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9164591f-6dcf-400f-9c0a-281a867d51a5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.023379 Oct 18 13:55:11.494163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2750/5647] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:55:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:55:11.509586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8163e0ee-4bf8-4552-bd4a-ff89f815a11c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:11.511690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8163e0ee-4bf8-4552-bd4a-ff89f815a11c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:11.695860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8163e0ee-4bf8-4552-bd4a-ff89f815a11c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:11.732438 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8163e0ee-4bf8-4552-bd4a-ff89f815a11c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1264 microversion: 2.1 time: 0.225950 Oct 18 13:55:11.747144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2898/5648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:11 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:12.772097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8fbd1d46-a6fd-4080-9612-c365bf13beab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:12.781165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8fbd1d46-a6fd-4080-9612-c365bf13beab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:12.881237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8fbd1d46-a6fd-4080-9612-c365bf13beab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:12.889100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8fbd1d46-a6fd-4080-9612-c365bf13beab tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1264 microversion: 2.1 time: 0.121353 Oct 18 13:55:12.889805 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2751/5649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:12 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1264 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:13.915055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:13.921029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:13.949970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:13.950803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:13.952076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:13.957140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:13.958816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:13.960562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:14.307951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:14.317174 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16becc2b-2fb1-4f70-87b3-1de4e5cb53b3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1260 microversion: 2.1 time: 0.407273 Oct 18 13:55:14.321154 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2899/5650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:13 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1260 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:15.353614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:15.355220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:15.376532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:15.378984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:15.382951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:15.384685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:15.386943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:15.387957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:15.727473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:15.751058 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57edeb74-ae77-4565-9ed2-94bd5ed36925 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1316 microversion: 2.1 time: 0.401664 Oct 18 13:55:15.777679 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2752/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:15 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:16.775471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:16.776301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:16.791042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:16.791788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:16.792266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:16.793023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:16.793492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:16.793924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:16.973996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:16.986606 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8af9eb0-09dc-4845-afc6-1b0d6673ac8e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1322 microversion: 2.1 time: 0.215217 Oct 18 13:55:17.001823 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2900/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:16 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:17.733368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-208067727", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "1c44c71f-c3e6-44f3-ae07-e5106abb2277"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:17.839564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] validate_networks() for [('1c44c71f-c3e6-44f3-ae07-e5106abb2277', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:55:18.025015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:18.026387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:18.040948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:18.041866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:18.042581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:18.047733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:18.049305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:18.050594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:18.214190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:18.223720 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1dc3785c-c31b-451e-ba26-f795588a2779 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1322 microversion: 2.1 time: 0.202477 Oct 18 13:55:18.224329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2901/5653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:18 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:55:19.100111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:55:19.100784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:55:19.102935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:55:19.104502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:55:19.105234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:55:19.120020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.127695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.128437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.129382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.129971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.133255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.156452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Getting quotas for project e7caeabfa27f4070843694f55f857581. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:55:19.163552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Getting quotas for user b58627a63ea04c6a8a7a62c0f28208c2 and project e7caeabfa27f4070843694f55f857581. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:55:19.218526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Going to run 3 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:55:19.228648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:55:19.252890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:19.270478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:19.294659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.295438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.296900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.302228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.308243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.309076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.511641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:55:19.642096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:19.652761 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-279bbd83-99e3-4611-94f7-1e35eff84f12 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.404481 Oct 18 13:55:19.653386 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2902/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:19 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:19.680581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=2e3b2fac-feca-45ca-999b-5532d5606c48,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:55:19.906907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb45e9eb-f694-4cd5-a760-f212c47cc9dd tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420143 Oct 18 13:55:19.911852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2753/5655] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:55:19.922867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:19.929162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:19.933773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:19.960678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.961424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.962263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.963407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.986412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.989895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:20.027737 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-383c405d-e9a9-42f8-83c8-4bde9493044e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.108991 Oct 18 13:55:20.038339 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2903/5656] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:55:19 2022] GET /compute/v2.1/servers => generated 1015 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:20.044332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-770a4965-64ad-488d-94d3-9aac711e48e6 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:20.045009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-770a4965-64ad-488d-94d3-9aac711e48e6 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:20.242638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-770a4965-64ad-488d-94d3-9aac711e48e6 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:20.261779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-770a4965-64ad-488d-94d3-9aac711e48e6 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1222 microversion: 2.1 time: 0.222822 Oct 18 13:55:20.264761 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2754/5657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:20 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:55:20.680393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:20.682686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:20.702612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:20.703416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:20.704078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:20.705506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:20.706242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:20.706881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:21.046235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:21.058124 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6ee732f-163d-4b32-8c4f-206524e98907 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.386257 Oct 18 13:55:21.074101 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2904/5658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:20 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:21.290455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c3cd603-3309-4110-be6c-cd92802b37bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:21.291060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c3cd603-3309-4110-be6c-cd92802b37bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:21.357596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c3cd603-3309-4110-be6c-cd92802b37bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:21.366386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c3cd603-3309-4110-be6c-cd92802b37bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1222 microversion: 2.1 time: 0.080703 Oct 18 13:55:21.379365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2755/5659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:21 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:21.709515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:21.879336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:21.881682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:21.901023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:21.905982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:21.966750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] Creating event network-changed:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h1-858383-13 Oct 18 13:55:21.975756 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0647d5bf-6b72-4048-816c-bd0025039db0 req-d531ccf4-cddf-4dda-89d7-d1a0ddaa911c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.578391 Oct 18 13:55:21.982110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2905/5660] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:22.085836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:22.086843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:22.107363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:22.399423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fccfbf50-03a2-407b-aabe-63f925c9ab89 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:22.400777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fccfbf50-03a2-407b-aabe-63f925c9ab89 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:22.406002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:22.437223 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa500d32-7b46-406a-a28e-d4398f857276 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.355625 Oct 18 13:55:22.442174 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2756/5661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:22 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:22.529819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fccfbf50-03a2-407b-aabe-63f925c9ab89 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:22.541347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fccfbf50-03a2-407b-aabe-63f925c9ab89 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1222 microversion: 2.1 time: 0.147228 Oct 18 13:55:22.542286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2906/5662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:22 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:23.469950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:23.471458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:23.481783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:23.482519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:23.487006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:23.493192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:23.495580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:23.497811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:23.569509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15ab1721-fdd4-4f8e-be0d-9722daec7711 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:23.570818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15ab1721-fdd4-4f8e-be0d-9722daec7711 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:23.701301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15ab1721-fdd4-4f8e-be0d-9722daec7711 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:23.722960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15ab1721-fdd4-4f8e-be0d-9722daec7711 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1222 microversion: 2.1 time: 0.161152 Oct 18 13:55:23.730281 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2907/5663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:23 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:24.060341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:24.074232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12704d6e-6200-40ad-8f43-886518e0c673 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.609279 Oct 18 13:55:24.075352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2757/5664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:23 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:24.756058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:24.756677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:24.774964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:24.775468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:24.777418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:24.778306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:24.778780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:24.779217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:24.935689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:24.964516 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bece2be0-806b-439f-921e-7fb2eb2ce4da tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1226 microversion: 2.1 time: 0.205107 Oct 18 13:55:24.969989 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2908/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:24 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1226 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:25.105364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:25.106745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:25.119445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.120925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.121564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.122505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.123152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.124037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.444685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:25.464010 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17bd0bf0-a0a4-4309-b172-a307a8c37ba7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.359426 Oct 18 13:55:25.480566 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2758/5666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:25 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:25.995255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:25.996488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:26.010723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.011336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.011784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:26.012741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.013416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.014014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:26.154666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:26.164589 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a77832c8-dbbe-4850-a782-fede8103bfcc tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1274 microversion: 2.1 time: 0.173153 Oct 18 13:55:26.168886 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2909/5667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:25 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:26.492916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:26.494387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:26.506947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.510406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.510406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:26.510406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.510406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.511473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:27.200753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:27.201396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:27.218317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:27.218932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:27.219422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:27.220179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:27.220648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:27.221086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:27.227165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:27.254891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5637c01-1e8b-468f-8d26-814305a3f226 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.769338 Oct 18 13:55:27.258656 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2759/5668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:26 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:27.431186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:27.447970 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33b97974-216e-4aa6-8c4b-50a16afc23c7 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1280 microversion: 2.1 time: 0.250727 Oct 18 13:55:27.450309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2910/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:27 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:28.288596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:28.289915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:28.300776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:28.301533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:28.302176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:28.303061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:28.304106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:28.304992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:28.482617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:28.482617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:28.512897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:28.585837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:28.598690 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ef6a936-44d2-434c-9fa2-0b4683fdab31 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.316277 Oct 18 13:55:28.599673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2760/5670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:28 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:28.691002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:28.708546 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f833950-43ba-4c35-9020-634a797dc655 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1280 microversion: 2.1 time: 0.225698 Oct 18 13:55:28.718534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2911/5671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:28 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:29.169193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "name": "network-vif-plugged", "status": "completed", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:29.178594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:29.183196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:29.186301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:29.186993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:29.204575 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] Creating event network-vif-plugged:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h1-858383-13 Oct 18 13:55:29.212804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4224f719-21d9-4f80-8c86-aabcb20a4d54 req-d86874b1-dd1e-40ed-8634-63738f080890 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055054 Oct 18 13:55:29.219330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2761/5672] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:29.623347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:29.623980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:29.633338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:29.634142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:29.634795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:29.636008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:29.636654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:29.637261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:29.737459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:29.737459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:29.740969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:29.741681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:29.742603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:29.743505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:29.744137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:29.744852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:29.996852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:30.006723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2fca725f-4ab4-4612-81d1-cfc781cfe25c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.281931 Oct 18 13:55:30.015020 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2762/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:29 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:55:30.016020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:30.137472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:30.146624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c62b8b79-b112-448b-8f45-bc0ef31be8cb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1390 microversion: 2.1 time: 0.527148 Oct 18 13:55:30.147694 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2912/5674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:29 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1390 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:30.573191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c", "tag": "e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:30.592964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:30.594067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:30.594556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:30.611229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] Creating event network-changed:e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de for instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c on n-h2-858383-13 Oct 18 13:55:30.635477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2af48b37-b449-424b-8f47-2af3299e6a21 req-6d7d0aa9-b163-4683-978f-777484e18585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065659 Oct 18 13:55:30.636503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2763/5675] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:30.972364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3b2fac-feca-45ca-999b-5532d5606c48", "tag": "ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:30.996695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.006344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.006920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.026610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] Creating event network-changed:ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca for instance 2e3b2fac-feca-45ca-999b-5532d5606c48 on n-h1-858383-13 Oct 18 13:55:31.033983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:31.038158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:31.055658 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5dce3acf-8df5-4534-8e20-9d7ad33d1fee req-55f5e2c8-1943-428a-9dc2-9fe892917ef0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088208 Oct 18 13:55:31.057318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.057838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.058332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.065114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.065114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.065114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.065809 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2913/5676] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:55:31.171410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:31.172322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:31.185223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.185728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.191411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.191411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.191411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.191411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.366572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:31.547921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:31.561298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-848e0ef4-f4c1-465a-ace6-93e5c0d726ad tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.533005 Oct 18 13:55:31.562936 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2764/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:31 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:31.605653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:31.615046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4a2ff94-eb9d-46d2-ab59-ec50bf89d1d2 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1562 microversion: 2.1 time: 0.447853 Oct 18 13:55:31.619442 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2914/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:31 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1562 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:31.638684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:31.639311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:31.646721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.647557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.648104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.648926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:31.649463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:31.650007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:31.969409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:31.977624 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a24eeda9-53e5-40ef-b0a7-d5451d399d82 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1562 microversion: 2.1 time: 0.342840 Oct 18 13:55:31.978224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2765/5679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:31 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1562 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:32.590582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:32.595094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:32.632699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:32.641161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:32.641161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:32.641161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:32.641161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:32.641161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:32.694074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0956497-0eff-48b3-9822-498d130cb266", "tag": "a6df9661-5d87-4fcf-8130-41abd274c131"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:32.709756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:32.713444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:32.713444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:32.731660 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] Creating event network-changed:a6df9661-5d87-4fcf-8130-41abd274c131 for instance f0956497-0eff-48b3-9822-498d130cb266 on n-h2-858383-13 Oct 18 13:55:32.740495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-438a668e-9bef-4ed0-8ecd-e15f81dac711 req-d3659cf1-0b82-41b9-b30b-cae1a5762219 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052549 Oct 18 13:55:32.742203 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2766/5680] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:55:32.860645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:32.881856 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b1dc646-4d22-4fb1-baf4-83f9737bd522 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.290923 Oct 18 13:55:32.881856 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2915/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:32 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:33.900678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:33.903616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:33.947054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:33.947900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:33.949055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:33.950375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:33.952660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:33.953343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:34.342436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:34.351088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-599c8114-4bc3-4af8-ad62-1f8da19cfeec tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.456175 Oct 18 13:55:34.351692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2767/5682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:33 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:35.374017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:35.376344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:35.380485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:35.393612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:35.394142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:35.394597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:35.398639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:35.399370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:35.401362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:35.652913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:35.654130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:35.671852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:35.674294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:35.675441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:35.678753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:35.680419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:35.681835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:35.867827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:35.878230 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c621c4f-799f-4d4d-9d18-bb81ebc88a49 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.507740 Oct 18 13:55:35.879385 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2916/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:35 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:35.920102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:35.982482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:35.985753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:35.987670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:36.032820 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] Creating event network-changed:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h1-858383-13 Oct 18 13:55:36.050229 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c20f0ef8-27b5-486b-904c-60246738c9a6 req-2f1c3e10-1c2c-468f-8491-29dca2c53f81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157607 Oct 18 13:55:36.051360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2917/5684] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:36.074352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:36.093038 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-323373b2-1d7d-4dd4-83f0-98da923f6e88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1562 microversion: 2.1 time: 0.445871 Oct 18 13:55:36.097692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2768/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:35 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1562 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:36.909882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:36.910604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:36.922832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:36.925994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:36.926751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:36.930038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:36.930724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:36.931331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:37.294392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3b2fac-feca-45ca-999b-5532d5606c48", "name": "network-vif-plugged", "status": "completed", "tag": "ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:37.323293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:37.323293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:37.324762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:37.354149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] Creating event network-vif-plugged:ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca for instance 2e3b2fac-feca-45ca-999b-5532d5606c48 on n-h1-858383-13 Oct 18 13:55:37.359682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:37.367242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-cae6f9eb-8a9f-4cca-9954-363a22ced7d2 req-6efd1008-0ffc-4475-bdbf-45b408ae5341 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077152 Oct 18 13:55:37.369720 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2769/5686] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:37.379709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06fca19a-914c-4787-9d1c-e9b26f6f7210 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.473544 Oct 18 13:55:37.381665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2918/5687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:36 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:38.416719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:38.418190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:38.437223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:38.439239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:38.441483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:38.444310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:38.445706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:38.447698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:38.765923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:38.774634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1eec197-e379-46ad-9d97-a2d810aa525e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.363239 Oct 18 13:55:38.785081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2770/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:38 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:39.798943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:39.808340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:39.812043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:39.812552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:39.812996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:39.813718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:39.814223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:39.814623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:39.835689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:39.982506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:40.008010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f98bf054-648a-4943-b179-137c15fdb0ed tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.211611 Oct 18 13:55:40.028406 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2919/5689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:39 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:40.182099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0956497-0eff-48b3-9822-498d130cb266", "name": "network-vif-plugged", "status": "completed", "tag": "a6df9661-5d87-4fcf-8130-41abd274c131"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:40.195455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:40.197719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:40.198758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:40.199358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:40.209288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=89 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:40.218496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] Creating event network-vif-plugged:a6df9661-5d87-4fcf-8130-41abd274c131 for instance f0956497-0eff-48b3-9822-498d130cb266 on n-h2-858383-13 Oct 18 13:55:40.226120 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0767424b-e61d-4ab0-bc40-aa5dc8eb0ea8 req-dc5861f9-7e8c-4b3c-96d3-d94f352d2ba6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049701 Oct 18 13:55:40.226732 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2771/5690] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:41.036782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:41.037898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:41.045786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:41.046305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:41.046750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:41.047484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:41.048180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:41.048622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:41.219884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:41.237193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-edd548de-5ac2-4f47-bc22-ea4881b705de tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1322 microversion: 2.1 time: 0.205024 Oct 18 13:55:41.237790 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2920/5691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:41 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:42.245385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c", "name": "network-vif-plugged", "status": "completed", "tag": "e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:42.258355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.259105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.259711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.272492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] Creating event network-vif-plugged:e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de for instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c on n-h2-858383-13 Oct 18 13:55:42.285150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0c1a07e6-03f1-4691-bb52-161f4e3b3414 req-543629dc-e25b-48f6-9418-29b1528dd565 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045580 Oct 18 13:55:42.286778 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2772/5692] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:42.298013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:42.299299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:42.307425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=57 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.314230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.609242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:42.622630 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3d697a6-3039-484e-95ca-ed5eee1a3066 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 200 len: 1514 microversion: 2.1 time: 0.350006 Oct 18 13:55:42.625053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2921/5693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:42 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:42.654020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:42.656427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:42.670160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.670984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.671659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.672618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.673287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.674941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.873376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:42.882245 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a772f1e-4496-40cc-a668-6c2653b828bb tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 200 len: 1513 microversion: 2.1 time: 0.235310 Oct 18 13:55:42.907016 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2773/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:42 2022] GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:42.907981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:42.908571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:42.916406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.917000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.917402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:42.918669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:42.919192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:42.919646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:43.092683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:43.102458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd832ba5-8a13-495a-adc2-f0826456c787 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 200 len: 1322 microversion: 2.1 time: 0.198389 Oct 18 13:55:43.103353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2922/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:42 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:44.125882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:44.128626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:44.138443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:44.139327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:44.139970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:44.142170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:44.143785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:44.144719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:44.304465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:44.313245 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c8c75df-95ed-46d5-84c5-39eafefd3620 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 200 len: 1513 microversion: 2.1 time: 0.191569 Oct 18 13:55:44.327916 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2774/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:44 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:44.338167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:44.338691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:44.346607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:44.347307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:44.347753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:44.348466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:44.348926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:44.349356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:44.740008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:55:45.162432 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7944f7d6-d196-4c4b-868a-42239d3a284c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 204 len: 0 microversion: 2.1 time: 0.826841 Oct 18 13:55:45.166581 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2923/5697] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:44 2022] DELETE /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 0 bytes in 830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:55:45.171256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:45.171886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:45.189661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:45.190218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:45.190669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:45.191387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:45.191898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:45.192338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:45.500037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:45.513969 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2689647c-b990-47ff-b3e6-f9da84d0cf9b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 200 len: 1519 microversion: 2.1 time: 0.346432 Oct 18 13:55:45.514654 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2775/5698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:45 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:55:46.541422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:46.542765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:46.558141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:46.558985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:46.561016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:46.562525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:46.564488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:46.567989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:47.156249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:47.175654 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3206f2fe-bcb7-44f8-a137-3e2a3cbaf556 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 200 len: 1519 microversion: 2.1 time: 0.639655 Oct 18 13:55:47.176253 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2924/5699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:46 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:47.293200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c", "name": "network-vif-deleted", "tag": "e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:47.334693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:47.335249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:47.339747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:47.371658 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] Creating event network-vif-deleted:e0cf9c8e-6fac-4c75-bc7b-1d0bef5504de for instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c on n-h2-858383-13 Oct 18 13:55:47.379157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-dd45c8d3-04c6-4c9a-937d-0b9cef584d7a req-bd6b42af-2d98-4a42-9690-5ca3b127bb2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091292 Oct 18 13:55:47.379922 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2776/5700] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:48.201654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:48.203323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:48.211340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:48.212095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:48.212928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:48.214043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:48.214922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:48.215699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:48.254181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:48.254943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:48.255617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:48.256245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lazy-loading 'fault' on Instance uuid 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:55:48.317872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:48.332504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ef3fcb0-f630-42a0-86f1-d4328694e376 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 200 len: 1312 microversion: 2.1 time: 0.133620 Oct 18 13:55:48.333095 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2925/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:48 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 1312 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:49.369399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.369399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:49.377167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.378953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.380347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.381466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.382994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.383831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.400524 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] HTTP exception thrown: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c HTTP/1.1 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c'} Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.404872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 404 to user: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07065a5c-4a6f-4faf-b74a-4734c49e3988 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 404 len: 111 microversion: 2.1 time: 0.048976 Oct 18 13:55:49.409830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2777/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:49.415728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.421244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:49.422267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:49.429784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.430593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.431228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.431987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.432461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.432904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.523491 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88353fe4-f3ea-4b61-96a4-4f01413d87d5 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.113065 Oct 18 13:55:49.524502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2926/5703] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:55:49.543329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3504411d-11de-4983-8d19-2e0fd0fdb55b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3504411d-11de-4983-8d19-2e0fd0fdb55b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:55:49.547402 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3504411d-11de-4983-8d19-2e0fd0fdb55b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:49.552954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3504411d-11de-4983-8d19-2e0fd0fdb55b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011884 Oct 18 13:55:49.553948 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2778/5704] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:55:49.562099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.567683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:49.569149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:49.575932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.576432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.576878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.577613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.578140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.578521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.605538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:55:49.642489 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-800a1715-25bc-47cb-b666-b2da8e09629c tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.084563 Oct 18 13:55:49.643562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2927/5705] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers => generated 681 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:49.660565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.672581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:49.675182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.servers [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Removing options 'limit' from query {{(pid=121009) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:55:49.676945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:49.695448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.697235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.700564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.706409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.707130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.707749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.740350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:55:49.772139 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61b15404-b992-4cf5-8cfd-46bd74ed3100 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.120134 Oct 18 13:55:49.772830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2779/5706] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:55:49.786892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03a8f7c8-f197-420b-98d0-b14931eab16e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03a8f7c8-f197-420b-98d0-b14931eab16e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: action_args: {} Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '-1' Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:55:49.791142 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03a8f7c8-f197-420b-98d0-b14931eab16e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03a8f7c8-f197-420b-98d0-b14931eab16e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010273 Oct 18 13:55:49.795540 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2928/5707] 10.222.0.27 () {58 vars in 1142 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:55:49.804110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12ccb697-7876-4bbb-bebb-a52ed9de6396 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12ccb697-7876-4bbb-bebb-a52ed9de6396 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: action_args: {} Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'testing' Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:55:49.808403 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12ccb697-7876-4bbb-bebb-a52ed9de6396 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12ccb697-7876-4bbb-bebb-a52ed9de6396 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010354 Oct 18 13:55:49.812830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2780/5708] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:55:49.823485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7781282a-9e47-4265-8233-0185f383b94f tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.824533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7781282a-9e47-4265-8233-0185f383b94f tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:49.825221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7781282a-9e47-4265-8233-0185f383b94f tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:49.832782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.servers [None req-7781282a-9e47-4265-8233-0185f383b94f tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Flavor 'non_existing_flavor' could not be found {{(pid=121010) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 18 13:55:49.833811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7781282a-9e47-4265-8233-0185f383b94f tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018230 Oct 18 13:55:49.834656 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2929/5709] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:55:49.850580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:49.857192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:49.858612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:49.869770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.870593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.871321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.873097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:49.873854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:49.874596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:49.979008 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29019324-b8d9-415d-a91f-21e7e71e498d tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.132514 Oct 18 13:55:49.980380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2781/5710] 10.222.0.27 () {58 vars in 1174 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:55:49.995638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.008728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:50.009460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:50.039557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.040190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.041007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.042013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.042545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.043123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.140059 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e8b0b03-1ea4-4da5-810b-188ac93bdb55 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.148681 Oct 18 13:55:50.141638 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2930/5711] 10.222.0.27 () {58 vars in 1184 bytes} [Tue Oct 18 13:55:49 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:55:50.156405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.161930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:50.163666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:50.169813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.175178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.175178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.175178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.175178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.175178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.233861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:55:50.316186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:50.324552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.325050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.325585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.577666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-225bc243-3110-451b-a177-a01838005d74 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 0.425857 Oct 18 13:55:50.583785 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2782/5712] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:55:50 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:50.615612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-127a8d80-9d19-4762-8f1f-ec45f30f7eb1 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.620717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-127a8d80-9d19-4762-8f1f-ec45f30f7eb1 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:50.621752 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-127a8d80-9d19-4762-8f1f-ec45f30f7eb1 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011017 Oct 18 13:55:50.627959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2931/5713] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Oct 18 13:55:50 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:55:50.649763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.656875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:50.659468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Searching by: {'deleted': False, 'project_id': 'e7caeabfa27f4070843694f55f857581'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:55:50.673216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.676413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.677031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.681106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.681897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.682804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.715240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:55:50.765257 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da1dcd7b-7787-4b84-96bb-49277e608f7e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.125190 Oct 18 13:55:50.766290 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2783/5714] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:55:50 2022] GET /compute/v2.1/servers => generated 681 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:50.781771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.785585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:50.797122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.797637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.798953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.800408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.805053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.805521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.825462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] HTTP exception thrown: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c HTTP/1.1 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c'} Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:50.827100 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 404 to user: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-caafb691-8daf-4e00-8da8-b49916300986 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 404 len: 111 microversion: 2.1 time: 0.052991 Oct 18 13:55:50.831501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2932/5715] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:50 2022] DELETE /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:50.843310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:50.844459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:50.853130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.855482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.857523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.858462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:50.860214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:50.861180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:50.903562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:55:51.252827 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94b3de65-904f-4fa2-b65f-40d553f0e2fe tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 204 len: 0 microversion: 2.1 time: 0.413613 Oct 18 13:55:51.254360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2784/5716] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:50 2022] DELETE /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:55:51.264535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:51.266599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:51.286528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.287449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.288115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:51.290355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.291554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.292233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:51.326967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:55:51.783629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5ef7e6b-314c-4577-8eb7-f7c22c2bb34e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 204 len: 0 microversion: 2.1 time: 0.524919 Oct 18 13:55:51.784908 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2933/5717] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:55:51 2022] DELETE /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:55:51.793426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:51.794432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:51.804287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.804287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.804287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:51.804287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.804287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.804665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:51.819647 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] HTTP exception thrown: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c HTTP/1.1 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c'} Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:51.821552 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 404 to user: Instance 93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:51.825824 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ade72bb-d58c-4528-8dbc-177cfeead404 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c" status: 404 len: 111 microversion: 2.1 time: 0.034002 Oct 18 13:55:51.827030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2785/5718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:51 2022] GET /compute/v2.1/servers/93d71ed9-7a88-4d8c-9ab2-9f0475d1b56c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:51.832412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:51.833160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:51.841214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.841806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.842445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:51.843213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:51.843847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:51.844562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:52.164496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:52.179918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78c5da4c-ed38-402a-a4c5-a4673e952a83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 200 len: 1519 microversion: 2.1 time: 0.350025 Oct 18 13:55:52.196493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2934/5719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:51 2022] GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:53.209096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:53.211901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:53.227996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:53.229316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:53.231068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:53.232525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:53.233738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:53.235189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:53.527102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:53.543621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-489360d6-c4da-4dd3-972b-16e75f446831 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 200 len: 1519 microversion: 2.1 time: 0.338922 Oct 18 13:55:53.545675 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2786/5720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:53 2022] GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:53.669742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3b2fac-feca-45ca-999b-5532d5606c48", "name": "network-vif-deleted", "tag": "ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:53.706668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:53.710875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:53.710875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:53.736801 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] Creating event network-vif-deleted:ef08e7e0-955b-4ec4-b6c9-8b1daaaab4ca for instance 2e3b2fac-feca-45ca-999b-5532d5606c48 on n-h1-858383-13 Oct 18 13:55:53.758105 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d0726e08-4fb2-41b5-a52a-b21c0bc8c892 req-41910133-08d0-4912-80cb-1ddee5b55697 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091887 Oct 18 13:55:53.758917 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2935/5721] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:54.434114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0956497-0eff-48b3-9822-498d130cb266", "name": "network-vif-deleted", "tag": "a6df9661-5d87-4fcf-8130-41abd274c131"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:54.459077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:54.460111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:54.467028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:54.489680 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] Creating event network-vif-deleted:a6df9661-5d87-4fcf-8130-41abd274c131 for instance f0956497-0eff-48b3-9822-498d130cb266 on n-h2-858383-13 Oct 18 13:55:54.504859 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a0d9d328-f81e-4601-8913-dbf6289ed28a req-7af44747-6233-43ec-b90b-3abea2b2869e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074291 Oct 18 13:55:54.506794 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2787/5722] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:54.581345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:54.581345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:54.607636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:54.607636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:54.607636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:54.607636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:54.608244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:54.608447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:54.684869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:54.686778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:54.687389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:54.688256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lazy-loading 'fault' on Instance uuid 2e3b2fac-feca-45ca-999b-5532d5606c48 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:55:54.748108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58627a63ea04c6a8a7a62c0f28208c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7caeabfa27f4070843694f55f857581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:54.758685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eeb02fcc-a17e-464b-9a7f-02bb05abee8e tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 200 len: 1312 microversion: 2.1 time: 0.189431 Oct 18 13:55:54.761065 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2936/5723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:54 2022] GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:55.788331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:55.789892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: 2e3b2fac-feca-45ca-999b-5532d5606c48] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:55.806661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:55.808233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:55.810417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:55.811339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:55.813489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:55.815641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:55.835929 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] HTTP exception thrown: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 HTTP/1.1 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '2e3b2fac-feca-45ca-999b-5532d5606c48'} Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.838635 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. Oct 18 13:55:55.843864 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.847984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 404 to user: Instance 2e3b2fac-feca-45ca-999b-5532d5606c48 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:55.849689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8dfc185e-2645-43cb-b742-3a2528022e83 tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48" status: 404 len: 111 microversion: 2.1 time: 0.068855 Oct 18 13:55:55.853862 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2788/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:55 2022] GET /compute/v2.1/servers/2e3b2fac-feca-45ca-999b-5532d5606c48 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:55:55.860951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:55.861754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] [instance: f0956497-0eff-48b3-9822-498d130cb266] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:55.872982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:55.876443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:55.878594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:55.885181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:55.885797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:55.888257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:55.907680 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] HTTP exception thrown: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Request method failure captured: Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 HTTP/1.1 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrBFT7LgGYVqc9ppMYz7CEAWFPD1BXd33lE4cyAG0C9skdnpI8q9mc_NgJsiTPxragHcY-nSpTDQhIVqk6YkNI2Z5-F3020ghiAZIdM3YUl4fUXkM00010GM9rmjKanVidTPs7uEXA5zwQWKXSsC95wh8LWZbKYr12MvU9K3oVPfloo Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7caeabfa27f4070843694f55f857581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7caeabfa27f4070843694f55f857581"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7caeabfa27f4070843694f55f857581"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: e7caeabfa27f4070843694f55f857581 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206899134 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: b58627a63ea04c6a8a7a62c0f28208c2 Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ListServersNegativeTestJSON-1206899134-project Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'f0956497-0eff-48b3-9822-498d130cb266'} Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.909835 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] Returning 404 to user: Instance f0956497-0eff-48b3-9822-498d130cb266 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-faa5445c-73be-4437-b81a-4928c626c45b tempest-ListServersNegativeTestJSON-1206899134 tempest-ListServersNegativeTestJSON-1206899134-project] 10.222.0.27 "GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266" status: 404 len: 111 microversion: 2.1 time: 0.056623 Oct 18 13:55:55.917038 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2937/5725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:55 2022] GET /compute/v2.1/servers/f0956497-0eff-48b3-9822-498d130cb266 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:55:56.598862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:56.598862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:56.609640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:56.609979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:56.610573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:56.612124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:56.612786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:56.613497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:56.712077 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-edd65924-a4fd-4a26-95c3-237c6dcc8cbe tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action" status: 200 len: 24566 microversion: 2.1 time: 0.124954 Oct 18 13:55:56.742662 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2789/5726] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:55:56 2022] POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action => generated 24566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:56:07.850400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:07.857635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:07.870928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:07.871763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:07.872688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:07.874411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:07.874941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:07.875402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:07.876620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:07.879937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:07.880625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:08.827350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:08.841693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d9d2c9f-7f83-4e92-a3cc-2918141c1806 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1679 microversion: 2.1 time: 0.993800 Oct 18 13:56:08.842353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2938/5727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:07 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1679 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:09.092574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:09.095675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:09.106546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:09.107475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:09.108241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:09.108896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:09.110776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.112191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.112812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.113726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.114424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.115160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.202477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76ed44c1-70ff-490c-b4a5-76e19ed76951 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action" status: 200 len: 32642 microversion: 2.1 time: 0.116862 Oct 18 13:56:09.203934 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2790/5728] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:56:09 2022] POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action => generated 32642 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:56:09.357895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:09.360499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:09.369951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.370895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.371638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.372673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.373384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.374107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.687732 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea8691e1-3666-4d04-9def-b53284bbd4c6 tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1832 microversion: 2.1 time: 0.335661 Oct 18 13:56:09.688504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2939/5729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:09 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1832 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:09.727427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:09.729997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:09.759114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.761268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.762082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.766910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:09.768402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:09.770275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.825653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lazy-loading 'flavor' on Instance uuid 92dc0b63-9679-4bca-8968-941dc70c7923 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:56:09.847598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Going to try to live migrate instance to another host {{(pid=121009) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:56:17.217223 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86dacfeb-9fb6-467f-9053-0dad711111ae tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action" status: 202 len: 0 microversion: 2.1 time: 7.494991 Oct 18 13:56:17.218219 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2791/5730] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:56:09 2022] POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action => generated 0 bytes in 7497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:56:17.237118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:17.237920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:17.253936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:17.254508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:17.254964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:17.255708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:17.258576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:17.260020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:17.630085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:17.648543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f5fa7e5-b1c1-4c73-a3da-2bea6c7a4442 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.416389 Oct 18 13:56:17.649210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2940/5731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:17 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:18.310305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15d00505-9b6f-4cf1-92c5-35f2c2411f47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: .version_select at 0x7fb33526e820>, body: {"keypair": {"name": "tempest-keypair-379091121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlHObi81BTkBoMV7GfGcJRcWRvq2hhPbw5CqcHWaCJEH0Hfn2MP9d/PhA7krVFoKQmhilzX5wf1j7U74Hnf32czCxpg6TzQEHih0X+5j3Q6DboJ5wfAUB8MFnuodQhSrw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:18.383537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-15d00505-9b6f-4cf1-92c5-35f2c2411f47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:18.398986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-15d00505-9b6f-4cf1-92c5-35f2c2411f47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:18.523062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15d00505-9b6f-4cf1-92c5-35f2c2411f47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.055277 Oct 18 13:56:18.524109 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2792/5732] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:56:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:18.690947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:18.692300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:18.709188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:18.709764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:18.710250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:18.710987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:18.711454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:18.711921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:19.043503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:19.056503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-716f1b45-8f83-47ef-b560-4c07fb8e84d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.369446 Oct 18 13:56:19.062340 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2941/5733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:18 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:20.088998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:20.091954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:20.111947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.114927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.118317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.124052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.128487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.129324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.274038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "name": "network-vif-unplugged", "status": "completed", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:20.293188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.294111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.294802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.313575 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] Creating event network-vif-unplugged:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h1-858383-13 Oct 18 13:56:20.320731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7638f22e-d9b4-4341-b744-acbeecc644ea req-612cbd1a-0436-4b71-8934-193f4dc63374 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052428 Oct 18 13:56:20.328104 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2942/5734] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:21.075469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:21.106514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-157433ef-82b8-4446-9078-4fdf28aebf91 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 1.016768 Oct 18 13:56:21.106514 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2793/5735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:20 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:22.131802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:22.133483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:22.158401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:22.158919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:22.159375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:22.160110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:22.163615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:22.171934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:22.354734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:22.369059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:22.369848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:22.371334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:22.389072 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] Creating event network-changed:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h1-858383-13 Oct 18 13:56:22.398854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ec2bfd0d-879c-493a-abd5-aed0bb72762f req-df66662a-3252-4e01-9481-03954e2dcf16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058806 Oct 18 13:56:22.401353 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2794/5736] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:22.542254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:22.563569 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ac9c03b-38ae-4ca3-b056-2190e2a94bcd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.438909 Oct 18 13:56:22.610859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2943/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:22 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:23.625239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:23.629706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:23.670543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:23.672903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:23.677977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:23.680676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:23.683429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:23.686688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:24.076121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:24.095177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f967610-a8c1-4aa1-80be-e710abb7474b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.490546 Oct 18 13:56:24.097250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2795/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:23 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:24.323239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1554371685", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ec6368a-adbd-48ea-b80b-75176c1a2ea1"}], "security_groups": [{"name": "tempest-securitygroup--1250207371"}], "key_name": "tempest-keypair-379091121", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:24.520735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] validate_networks() for [('1ec6368a-adbd-48ea-b80b-75176c1a2ea1', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:56:25.116806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:56:25.117352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:25.117853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:56:25.118139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:25.118372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:56:25.118866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:56:25.119350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:56:25.131958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:25.134562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:25.135418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:25.136557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:25.137272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:25.137865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:25.138269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:25.145447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:25.145447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:25.147006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:25.147832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:25.154693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:25.163223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:25.171412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:25.187654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:56:25.191115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:56:25.364554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1c82aaa-7f71-4754-9f52-8064f94f304d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.045521 Oct 18 13:56:25.371179 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2944/5739] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:56:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:56:25.386776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4153fae-0cb7-4899-9b53-7d85e08a7478 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:25.386776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4153fae-0cb7-4899-9b53-7d85e08a7478 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:25.482696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4153fae-0cb7-4899-9b53-7d85e08a7478 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:25.484199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:25.495814 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac391f95-4d60-477d-a12f-b4d82ce8eb57 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.383420 Oct 18 13:56:25.496938 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2796/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:25 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:25.498046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4153fae-0cb7-4899-9b53-7d85e08a7478 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1238 microversion: 2.1 time: 0.120755 Oct 18 13:56:25.500813 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2945/5741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:25 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1238 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:26.525896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:26.529956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2841010d-de2f-4fba-b061-79f464ede6d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:26.530666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2841010d-de2f-4fba-b061-79f464ede6d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:26.534734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:26.570493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:26.571347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:26.571992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:26.572902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:26.573640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:26.574278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:26.676225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2841010d-de2f-4fba-b061-79f464ede6d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:26.685844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2841010d-de2f-4fba-b061-79f464ede6d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1238 microversion: 2.1 time: 0.164903 Oct 18 13:56:26.692525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2797/5742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:26 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1238 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:26.952822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:26.971072 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0612fa63-9196-47fd-86c4-c81ba729c096 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.439615 Oct 18 13:56:26.971072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2946/5743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:26 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:27.747051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:27.748300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:27.758312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:27.759318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:27.760038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:27.761098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:27.761898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:27.762771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:27.989251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:27.990040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:28.014516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:28.023379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:28.023901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:28.024365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:28.027296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd8ecddc-04f1-4db5-a922-c84a0e8dd617 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1234 microversion: 2.1 time: 0.296780 Oct 18 13:56:28.027710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:28.033845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:28.034001 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2798/5744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:27 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1234 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:28.034119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:28.292706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:28.308584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbef2b18-e9b6-41eb-899a-fc247c027e53 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.323906 Oct 18 13:56:28.309192 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2947/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:27 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:29.067894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:29.070529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:29.088082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:29.336668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:29.338479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:29.346640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:29.347467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:29.348337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:29.349302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:29.349994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:29.350791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:29.446166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:29.470621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac39b8f2-2f50-4628-9dca-00dbe310c20f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1290 microversion: 2.1 time: 0.419578 Oct 18 13:56:29.472430 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2799/5746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:29 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1290 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:29.934774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:29.946730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e397aea6-2e95-425d-8ccd-9493749117dd tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1689 microversion: 2.1 time: 0.614111 Oct 18 13:56:29.950753 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2948/5747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:29 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1689 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:30.507963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:30.508730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:30.520870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.521331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.522278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:30.522907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.523375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.523952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:30.649401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:30.660801 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-050b5e86-fba9-4046-b3d1-023fe0b3b6e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1296 microversion: 2.1 time: 0.156833 Oct 18 13:56:30.662985 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2800/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:30 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1296 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:30.973549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:30.974270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:30.984318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.988399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.989512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:30.993025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.993878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.995643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.357548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:31.378195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0075fa17-645a-41d2-b850-e536ba8fa4d7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1679 microversion: 2.1 time: 0.409338 Oct 18 13:56:31.417878 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2949/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:30 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1679 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:31.442942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:31.443813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:31.461436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.470597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.471492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.472444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.477443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.478813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.694671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:31.695310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:31.710762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.711682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.712657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.713590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.714269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.714861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.764562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49a4de97-68d2-4a44-a8a7-f6eeb294e77e tempest-TestNetworkAdvancedServerOps-477573433 tempest-TestNetworkAdvancedServerOps-477573433-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1832 microversion: 2.1 time: 0.325346 Oct 18 13:56:31.769260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2801/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:31 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1832 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:31.792004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:31.792566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:31.800052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.800646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.801318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:31.801941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:31.802619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:31.803080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:32.049762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:32.058200 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a57d9d82-ed76-439a-b923-857a686bbc89 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1679 microversion: 2.1 time: 0.270127 Oct 18 13:56:32.064421 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2802/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:31 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1679 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:32.241428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:32.250187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe3f3eca-ce7f-4d7e-9a70-46d3fcbaefd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.559670 Oct 18 13:56:32.251918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2950/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:31 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:33.276441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:33.277767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:33.286404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:33.286971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:33.287640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:33.289773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:33.289773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:33.289773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:33.444694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:33.473915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:33.474438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:33.474917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:33.496596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] Creating event network-changed:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:56:33.502616 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-133427ac-6d54-4536-90c5-fbdfc22e4b17 req-4833f60c-d3fe-42dc-9114-a46a84fee378 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065674 Oct 18 13:56:33.503765 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2951/5753] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:33.529011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:33.538226 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a41db51-4c72-4c74-8a21-f79cff6133a3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.266053 Oct 18 13:56:33.538900 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2803/5754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:33 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:34.221825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:34.224661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:34.243316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.246007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.246007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:34.246007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.246586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.250726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:34.346876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14993c33-c1e7-4d67-9640-97c46b5957a4 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action" status: 200 len: 38593 microversion: 2.1 time: 0.130818 Oct 18 13:56:34.355798 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2952/5755] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:56:34 2022] POST /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923/action => generated 38593 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:56:34.578022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:34.582296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:34.633320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.647963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.654675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:34.659298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.663759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.664529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:35.048711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:35.069037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-412ae95e-41d5-46a2-8cd9-513cf28bb9e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.508065 Oct 18 13:56:35.070007 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2804/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:34 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:36.093998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:36.095388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:36.098421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:36.099322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:36.104616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.105281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.105943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.106711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.107174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.107620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.361792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:36.364374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:36.370262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:36.381199 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f685526e-0fe2-4d2b-af11-a7e6ea2418d7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.293199 Oct 18 13:56:36.388167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.393179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.393179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.393753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.394347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.395017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.399375 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2953/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:36 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:36.422545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:36.435114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:56:36.444070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.444559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.445181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.476624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] Creating event network-changed:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h2-858383-13 Oct 18 13:56:36.493016 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d8226162-9c6b-468b-963c-98aa89e30361 req-b92d2c91-c1f5-4fb6-8f7d-5f4c6d6dd1b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092098 Oct 18 13:56:36.503378 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2954/5758] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:36.685706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:36.855313 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-729cbd9b-3230-46cf-9199-687709ac8a42 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 204 len: 0 microversion: 2.1 time: 0.490778 Oct 18 13:56:36.857931 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2805/5759] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:56:36 2022] DELETE /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:56:36.871559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:36.880272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:36.898007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.898954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.906921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.907744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.908228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.908673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:37.364700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:37.380036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-249501ff-2cf0-4eb5-bd66-c831d4639543 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1685 microversion: 2.1 time: 0.515573 Oct 18 13:56:37.384475 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2955/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:36 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1685 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:37.407026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:37.408551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:37.430612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:37.431490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:37.432264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:37.433732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:37.434587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:37.435366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:37.490358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:38.134214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:38.154597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11838ff9-2537-4cfe-a6fd-0771c0d9d2e3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.748331 Oct 18 13:56:38.168253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2806/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:37 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:38.430702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:38.444941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:38.480298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:38.481631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:38.487107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:38.488370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:38.494202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:38.497642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.194678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:39.201000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:39.202615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:39.254830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-941503e9-626b-48e6-be92-68c18a580f8c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1685 microversion: 2.1 time: 0.825898 Oct 18 13:56:39.258655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:39.259303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2956/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:38 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1685 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:39.267374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:39.268213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.269158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:39.269786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:39.270427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.529508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:39.538046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afaac607-e94e-4bc3-aaf8-7c1d600a8f8c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.360744 Oct 18 13:56:39.541634 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2807/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:39 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:39.635533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dc0b63-9679-4bca-8968-941dc70c7923", "name": "network-vif-deleted", "tag": "66e77715-4995-4eaa-8dbb-cbd91cbc98f3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:39.645569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:39.647852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:39.648717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:39.649336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.653647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=91 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:39.662098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] Creating event network-vif-deleted:66e77715-4995-4eaa-8dbb-cbd91cbc98f3 for instance 92dc0b63-9679-4bca-8968-941dc70c7923 on n-h2-858383-13 Oct 18 13:56:39.667446 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-71109edc-c36b-4ce1-85e8-792fe5076889 req-519d10ff-2f10-4849-adc4-11e415acdd48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Oct 18 13:56:39.668057 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2957/5764] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:40.281100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:40.283014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:40.292498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:40.298778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.299588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.300884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.301884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.302623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.304639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.355143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.356200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.356781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.357469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lazy-loading 'fault' on Instance uuid 92dc0b63-9679-4bca-8968-941dc70c7923 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:56:40.490535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:40.511617 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1cf8988-0583-4e41-8321-e72ca443abaf tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 200 len: 1354 microversion: 2.1 time: 0.233890 Oct 18 13:56:40.521655 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2808/5765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:40 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 1354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:40.562250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:40.562821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.591677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.795707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:40.816558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6bfe40c5-6aeb-4c51-ba3e-e5c020b69982 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.259132 Oct 18 13:56:40.833446 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2958/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:40 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:41.541642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:41.541642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: 92dc0b63-9679-4bca-8968-941dc70c7923] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:41.568322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:41.568834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:41.569373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:41.569997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:41.570497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:41.570936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:41.599841 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] HTTP exception thrown: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Request method failure captured: Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 HTTP/1.1 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7IGBlDKyARK9VA6W2bq45YJNmQP5lsBo3jK6nNFchQFCp7WqlbDx9FWzSYmi1RbzwwhLUSCg8_4yT2NzxnUBwLIYE1M-wa8UW8IDq3k-Ysb5tQcdQ0OSPZx8bR8xoXaXFiyazPea2eTVrjs1McVHg0DkpMgDyTtLesBx_HAIgMSq4 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 69a2792ee20e450e877d4f016c031768 Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '92dc0b63-9679-4bca-8968-941dc70c7923'} Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:56:41.601746 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Returning 404 to user: Instance 92dc0b63-9679-4bca-8968-941dc70c7923 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:56:41.606019 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d422e3c-641d-493d-8225-5540bf1f1130 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923" status: 404 len: 111 microversion: 2.1 time: 0.070804 Oct 18 13:56:41.607965 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2809/5767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:41 2022] GET /compute/v2.1/servers/92dc0b63-9679-4bca-8968-941dc70c7923 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:56:41.844482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:41.845311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:41.862528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:41.865915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:41.870695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:41.870695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:41.870695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:41.870695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:42.338335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-plugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:42.364838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:42.369577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:42.374978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:42.379056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:42.380408 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e82d96e-53bc-47be-b912-d2085ec8e2a8 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.543338 Oct 18 13:56:42.385570 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2959/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:41 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:42.413380 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] Creating event network-vif-plugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:56:42.432274 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-75ac02fc-cc96-4de4-8509-ae9e63110375 req-9a5860ac-e258-4c49-9ec6-bf6f001fe5b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358879 Oct 18 13:56:42.437545 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2810/5769] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:43.407012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:43.407755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:43.420806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:43.422548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:43.423727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:43.425602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:43.431063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:43.431848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:43.654829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:43.671289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cb5833d-c3c8-44db-82f7-1c4fec7f460c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1364 microversion: 2.1 time: 0.268069 Oct 18 13:56:43.675955 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2960/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:44.708343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:44.708343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:44.714814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:44.715328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:44.715778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:44.716497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:44.717188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:44.718079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:45.216449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:45.242988 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15e9f0e5-5159-477d-9973-f16bf3e0073b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1551 microversion: 2.1 time: 0.542122 Oct 18 13:56:45.270106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2811/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:44 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1551 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:45.280031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:45.280031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:45.313112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:45.316699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:45.317264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:45.318035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:45.318563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:45.322909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:45.544136 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-739608e1-91e8-4e27-b819-0ba089bf47b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277441 Oct 18 13:56:45.545261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2961/5772] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:56:45 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:50.072073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:50.104317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:50.112162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:50.115652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.161179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] Creating event network-changed:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:56:50.193017 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-de6ca606-95af-4698-9303-36fff6a9b3e0 req-8d746054-5410-42a3-878a-0e6f310f2d41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107794 Oct 18 13:56:50.196605 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2812/5773] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:50.660645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a36dc28b-1e32-4ef3-8229-beb74b030c21 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '.version_select at 0x7fb32ba5aca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:50.785940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a36dc28b-1e32-4ef3-8229-beb74b030c21 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-309171070" status: 202 len: 0 microversion: 2.1 time: 0.135834 Oct 18 13:56:50.789953 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2962/5774] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 13:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-309171070 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:56:50.822501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19cf190e-fe4f-4c67-ac8d-d28f75c3d1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: .version_select at 0x7fb32bebf040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-598382168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMR3BOtFQnzdPzV/Ou1Lu4v9/nQFvcKXiossMlLIjBpGbaLawQs8SOsQM6p8l2KxhiQObZPvUFJGFMM3pU4ZtyBM2aUgT4w1YGyiIRY7VjMC+X3VHDLTj8LmleHXq+kpQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:50.871999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19cf190e-fe4f-4c67-ac8d-d28f75c3d1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:50.887783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-19cf190e-fe4f-4c67-ac8d-d28f75c3d1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:51.052979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19cf190e-fe4f-4c67-ac8d-d28f75c3d1fb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.234439 Oct 18 13:56:51.053531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2813/5775] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 13:56:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:08.397112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1685026717", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "3f84dd6c-7f4a-4738-b09f-1b4cb57a99b8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-598382168", "security_groups": [{"name": "tempest-secgroup-smoke-199900940"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:08.466370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=23 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:08.467612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:08.792101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] validate_networks() for [('3f84dd6c-7f4a-4738-b09f-1b4cb57a99b8', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:57:10.003820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:57:10.004587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:57:10.005089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:57:10.005659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:57:10.006196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:57:10.037215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.037744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.042873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:10.047624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.052740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.052740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:10.080368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:57:10.085701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Getting quotas for user 69a2792ee20e450e877d4f016c031768 and project 9c7f9282abf546de97aeefc165b7073d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:57:10.115690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:57:10.118479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:57:10.474512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e891ffd-3e76-46f5-a0cc-1061c58ce5df tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.124702 Oct 18 13:57:10.475229 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2963/5776] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:57:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:57:10.494383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee3665ac-397e-4a20-bdac-26087b5cf0ae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:10.496239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee3665ac-397e-4a20-bdac-26087b5cf0ae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:10.522712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=30 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:10.524109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:10.525770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:10.673826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee3665ac-397e-4a20-bdac-26087b5cf0ae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:10.684828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee3665ac-397e-4a20-bdac-26087b5cf0ae tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1266 microversion: 2.1 time: 0.196525 Oct 18 13:57:10.686385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2814/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:10 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:11.712206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f6abcb9-20b7-4357-b842-e69c95b07135 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:11.712737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f6abcb9-20b7-4357-b842-e69c95b07135 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:11.933148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f6abcb9-20b7-4357-b842-e69c95b07135 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:11.946807 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f6abcb9-20b7-4357-b842-e69c95b07135 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1266 microversion: 2.1 time: 0.234031 Oct 18 13:57:11.947471 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2964/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:11 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:12.972722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:12.973988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:12.991178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.991675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.992121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:12.992872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.993470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.993784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:13.228911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:13.246979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-061035de-9c3d-4a9c-9358-ddd29e8a4009 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1318 microversion: 2.1 time: 0.278605 Oct 18 13:57:13.247279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2815/5779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:12 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:14.287161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:14.287831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:14.305666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:14.306477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:14.307094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:14.308146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:14.308789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:14.309393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:14.435170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:14.444740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c14e7fc5-61bc-4e3e-afbb-cf73e807f2a0 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1324 microversion: 2.1 time: 0.161428 Oct 18 13:57:14.445274 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2965/5780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:14 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:15.470436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:15.471725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:15.494991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:15.495496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:15.496082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:15.497170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:15.497808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:15.498295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:15.768225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:15.780790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6b90246-affe-4246-88da-361052db0e95 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.311680 Oct 18 13:57:15.803354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2816/5781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:15 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:16.804799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:16.806036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:16.820694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.821214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.821667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.822443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.822919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.823365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:17.400143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:17.427251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:17.428127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:17.428795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:17.463531 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] Creating event network-changed:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:57:17.489984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-dea29977-ae32-4cc8-8237-5845b102e3d7 req-445b3d07-c608-4cd3-9b98-80516952dd96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094823 Oct 18 13:57:17.492366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2817/5782] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:17.869045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:17.879412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc76f6ed-43b2-4776-914c-05b84577b0f7 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 1.078352 Oct 18 13:57:17.882367 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2966/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:16 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:18.912724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:18.913445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:18.932719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.933468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.940062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.943093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.943765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.945034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:19.209281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:19.221090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6dd5f60-d7a6-47ab-9c28-fb8ff708f3ec tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.315172 Oct 18 13:57:19.222697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2818/5784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:18 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:20.249091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:20.249665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:20.257550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:20.259767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:20.260283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:20.260737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:20.261460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:20.264967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:20.266307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:20.517168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:20.525959 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4f5608a-ef95-4ef4-ab4a-05d3dcd80c9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.280745 Oct 18 13:57:20.526886 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2967/5785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:20 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:21.551296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:21.552602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:21.576364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.578505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.578997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.579729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.580192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.580762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.857133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:21.869607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13f4ea68-09c2-4058-bb19-27cf224616c5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.323495 Oct 18 13:57:21.872377 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2819/5786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:21 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:22.899546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:22.899546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:22.906814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:22.919574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:22.920094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:22.921207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:22.927496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:22.927496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:22.927496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.271787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:23.288054 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-89323a14-7c7c-46c3-8a65-639da39767bb tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.396886 Oct 18 13:57:23.289243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2968/5787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:22 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:23.521372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "name": "network-vif-plugged", "status": "completed", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:23.527471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:23.535987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.536472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.537094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.550498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] Creating event network-vif-plugged:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:57:23.556919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2e5e42ff-4c32-4347-bb9e-237448385170 req-5f2fb34e-c6e3-4c99-bbbf-113b5a4463a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039606 Oct 18 13:57:23.567209 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2820/5788] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:23.699635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:23.700933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:23.708720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.709174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.709835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.710753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.711391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.712159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.926968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:23.939632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a238400-3d4b-4483-a6ed-e96aa732bce9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.243758 Oct 18 13:57:23.941247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2969/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:23 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:23.963388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:23.964461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:23.972271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.973116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.973787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.974756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.975452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.976131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.186231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:24.204375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc795147-e087-43d6-8e5c-c1a4ae3e5498 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.243599 Oct 18 13:57:24.206900 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2821/5790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:23 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:24.232613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:24.232613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:24.242946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.243834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.244490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.245442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.263632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.264499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.312882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:24.313662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:24.320687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.321197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.321650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.322392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.326306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.326984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.563922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:24.578661 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a041a301-9ca7-46b9-b20d-d21c7408a55b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.349792 Oct 18 13:57:24.579279 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2970/5791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:24 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:24.607233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-262320955"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:24.609814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:24.617381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.618320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.618944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.619871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.620513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.621137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.786784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:24.798323 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6081a136-b66c-4f10-9928-2142cb314653 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1391 microversion: 2.1 time: 0.490157 Oct 18 13:57:24.802358 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2822/5792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:24 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:25.362808 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6642b7ee-82ba-4209-a74e-14fb04df3bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.762927 Oct 18 13:57:25.365576 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2971/5793] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:24 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:57:25.824485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:25.825115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:25.855667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:25.857160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:25.857738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:25.858543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:25.859655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:25.860426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.259124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:26.277762 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb4e1923-95c0-41a1-9454-949e732b513f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1562 microversion: 2.1 time: 0.457304 Oct 18 13:57:26.283500 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2823/5794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:25 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1562 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:26.305397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:26.306260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:26.322499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.323067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.326996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.334593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.335282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.335908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.746204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:26.763275 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1445b7f4-aaf4-49b9-89e4-bf9040c23231 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1562 microversion: 2.1 time: 0.457134 Oct 18 13:57:26.763275 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2972/5795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:26 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1562 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:32.695679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:32.697005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:32.730730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:32.776621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.787710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.791694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.792708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.801534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.802197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.802674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.810325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.813896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.854447 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] Creating event network-changed:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:57:32.882715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-05eb4358-fcdc-4fd4-8b94-e51721175958 req-41a1f683-7fee-47f7-a2fe-18786e9296e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156092 Oct 18 13:57:32.884313 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2973/5796] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:57:33.351860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:33.361046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2da206a-8e0c-40e0-b020-285424c2f9c8 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1562 microversion: 2.1 time: 0.669693 Oct 18 13:57:33.361633 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2824/5797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:32 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1562 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:34.185624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-plugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:34.224825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:34.225058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:34.225390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:34.266399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] Creating event network-vif-plugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:57:34.294501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f8b589e5-5910-4cd8-8466-73d3c3e0a607 req-b5459d16-1d55-4258-806e-1ba3a4e7a550 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122545 Oct 18 13:57:34.301401 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2974/5798] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:52.479450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:52.481829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:52.498566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=24 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:52.530676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=52 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:52.544721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:52.549650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:52.568049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:52.569335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:52.571017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:52.572548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:52.731169 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1373433-7dd1-424a-89c0-2616d828deda tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action" status: 200 len: 24565 microversion: 2.1 time: 0.258871 Oct 18 13:57:52.732302 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2825/5799] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:52 2022] POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action => generated 24565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:57:53.953555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:53.966894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:53.969650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:53.970549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:53.976114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:53.976610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:53.977058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:53.977903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:53.978274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:53.978740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:54.214820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:54.234676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7a8a88f-5588-4cd3-bc9e-bac9559b30f0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.284050 Oct 18 13:57:54.236926 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2975/5800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:53 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:55.270163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:55.271435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:55.283670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.286767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.287422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.290426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.291103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.292206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.538871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:55.549891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ab14267c-c7d6-4d2e-9dad-435574c4285f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.285046 Oct 18 13:57:55.550520 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2826/5801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:55 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:55.574328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-55380799"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:55.583395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:55.585309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.585815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.586289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.587011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.587504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.587946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:56.477413 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e084ed03-f8d4-4f2f-8fb3-f14ffe76e367 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.907404 Oct 18 13:57:56.479947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2976/5802] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:55 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:57:58.144669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-unplugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:58.168367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:58.168740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:58.169178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:58.253748 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] Creating event network-vif-unplugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:57:58.278122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-27ce48c5-190f-4cdd-b6bd-327567902c0d req-5cb52ed1-1746-4a57-a838-b744410cc8f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136252 Oct 18 13:57:58.281951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2827/5803] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:02.215170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-plugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:02.252529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:02.255830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:02.257582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:02.312366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] Creating event network-vif-plugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:58:02.331649 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b36cb90e-517d-4b93-863a-abd4b206f1a4 req-4d1345ca-fff6-49e3-8132-c3aed9a32852 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120981 Oct 18 13:58:02.342439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2977/5804] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:03.914271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:03.919023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:03.981061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:03.983868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:03.984475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:03.992034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:03.992804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:03.993376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:04.220319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:58:04.220766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:58:04.223330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:58:04.223796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:58:04.224178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:58:04.621933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:04.651099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:04.651099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:04.651099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:04.651921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:04.652624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:04.653853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:04.721943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2ff72f6-9103-4743-96f2-4f5fe4d313ee tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action" status: 202 len: 1137 microversion: 2.1 time: 0.811988 Oct 18 13:58:04.723082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2828/5805] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:58:03 2022] POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action => generated 1137 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:58:04.747400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:04.748211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:04.784389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:04.788726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:04.789960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:04.791562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:04.793626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:04.794211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:05.174407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:05.227442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b2be042-245d-477c-a1fd-f1e513233a58 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.486535 Oct 18 13:58:05.228722 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2978/5806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:04 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:06.259049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:06.259806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:06.290650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:06.291455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:06.293049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:06.298980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:06.301787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:06.302738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:06.887925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:06.898442 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f755fc2e-21dd-4e5f-a34b-08be157c3f9f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.644914 Oct 18 13:58:06.899853 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2829/5807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:06 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:07.925530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:07.926092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:07.958119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:07.958563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:07.959030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:07.965229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:07.965748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:07.966236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:08.447229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:08.457191 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f58a555f-1ea4-40f1-bde6-23975616c37f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.535206 Oct 18 13:58:08.458263 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2979/5808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:07 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:09.533983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:09.725688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:09.742659 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3487bf2-2931-45d7-9109-f15f0682c34f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.255137 Oct 18 13:58:09.743038 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2830/5809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:09 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:10.782354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:10.783399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:10.799232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:10.817925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:10.819083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:10.821326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:10.824713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:10.829276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:11.399781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:11.408621 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2d0a521-bf71-4bde-80be-fb32282f639c tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.631494 Oct 18 13:58:11.409230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2980/5810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:10 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:12.443872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:12.445246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:12.474421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:12.477914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:12.478822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:12.479824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:12.501796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:12.537759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:12.952660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:12.962910 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee56f403-1dee-4bc8-8099-611ed18d327e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.526385 Oct 18 13:58:12.963496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2831/5811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:12 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:13.988744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:13.989486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:13.997788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:13.998971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:13.999523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:14.000659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:14.001441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:14.002379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:14.436627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:14.447301 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d1e7937-4f75-4de8-9dbe-b7ee246da852 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.462032 Oct 18 13:58:14.448352 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2981/5812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:13 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:15.473669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:15.474336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:15.484941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:15.491077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:15.492520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:15.493452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:15.494105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:15.494705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:15.938253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:15.947839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0281afe9-bf63-45a6-b5ae-e8b7b045dcf9 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.478102 Oct 18 13:58:15.968871 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2832/5813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:15 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:16.979075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:16.980411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:16.997189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:16.998296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:16.999657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:17.000822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:17.003422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:17.004380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:17.341496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:17.365949 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f852289-4bad-4d46-b939-f670ef91045b tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.385766 Oct 18 13:58:17.366830 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2982/5814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:16 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:18.399906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:18.401196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:18.417293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:18.440948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:18.442745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:18.455186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:18.455958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:18.456676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:18.831840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:18.852105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bc4dceb-f636-49d6-938d-87808241954e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.456306 Oct 18 13:58:18.866474 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2833/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:18 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:19.897100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:19.898480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:19.918857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:19.929703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:19.931885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:19.933613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:19.934025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:19.937870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:20.392782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:20.421303 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e49d8dd-6d0f-4311-af64-0a52932ba054 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.532082 Oct 18 13:58:20.434149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2983/5816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:19 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:21.464285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:21.465576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:21.487613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:21.491769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:21.492599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:21.493577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:21.495124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:21.497263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:21.897661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:21.914228 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9ee323b-d11b-469e-905d-d3a936e04834 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.456639 Oct 18 13:58:21.914962 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2834/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:21 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:22.944839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:22.946627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:22.957739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:22.958468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:22.959045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:22.960292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:22.960881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:22.967399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:23.361889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:23.408292 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-588da032-7d04-4098-8576-6df424be70e5 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1690 microversion: 2.1 time: 0.467701 Oct 18 13:58:23.409143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2984/5818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:22 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1690 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:24.438288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:24.439623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:24.449052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=25 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:24.451578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:24.454190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:24.454966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:24.456834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:24.457567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:24.458351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:24.536406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:24.781107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:24.790456 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fade61e0-d318-4e7e-bd59-d4d63760e90e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1696 microversion: 2.1 time: 0.359236 Oct 18 13:58:24.791059 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2835/5819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:24 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1696 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:25.827321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:25.834905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:25.842596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:25.856812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:25.862273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:25.863377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:25.864211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:25.864765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:26.190095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:26.202105 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22673ce2-31d1-4192-b10f-9d4d9ab4d52e tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1696 microversion: 2.1 time: 0.382760 Oct 18 13:58:26.216474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2985/5820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:25 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1696 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:27.112390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:27.112390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:27.129964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.130499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.134647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.135552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.136177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.139862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.233331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:27.233966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:27.242925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:27.246950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.247457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.247907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.249771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.252381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.258778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.386511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:27.395298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d31a7aba-fa36-41bc-a995-0e9a15c793f7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.295700 Oct 18 13:58:27.396562 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2836/5821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:27 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:27.423065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1809699002"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:27.426216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:27.440023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.441558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.442123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.443063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:27.443695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:27.444342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:27.562394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:27.578689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d910fec-727b-42e3-aa44-73aefdd12a09 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1681 microversion: 2.1 time: 0.344790 Oct 18 13:58:27.585219 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2986/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:27 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:58:28.161232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca3ab2f3-03cd-47d6-9d38-88f954860a6a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.743679 Oct 18 13:58:28.166220 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2837/5823] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:58:27 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:58:28.177965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:28.178742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:28.200500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:28.203869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:28.205450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:28.206732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:28.207996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:28.208924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:28.440740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:28.453376 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8427b896-3844-4652-a704-fdd8e09cd54b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.286457 Oct 18 13:58:28.454602 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2987/5824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:28 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:29.480290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:29.481008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:29.488492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:29.488996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:29.489672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:29.490599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:29.491239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:29.491855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:29.746163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:29.758028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0641bf7f-04d8-4c0e-b120-0efbce47459f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.282730 Oct 18 13:58:29.759402 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2838/5825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:29 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:29.925997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "name": "network-vif-plugged", "status": "completed", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:29.945416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:29.945416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:29.945416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:29.981301 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] Creating event network-vif-plugged:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:58:29.991360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-940f325e-b286-48b5-a265-a08eb4e774a2 req-c44a62d7-36e1-44d8-a5b8-cd9ccefa7389 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069824 Oct 18 13:58:29.991980 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2988/5826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:30.786805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:30.787422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:30.802568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:30.803081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:30.805011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:30.807369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:30.808133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:30.814336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:31.151947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:31.164731 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa31f296-49a6-45eb-b25f-6df84898b72d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1687 microversion: 2.1 time: 0.381546 Oct 18 13:58:31.167606 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2839/5827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:30 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1687 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:32.050329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-unplugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:32.082963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:32.092261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:32.092896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:32.117281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] Creating event network-vif-unplugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:58:32.157356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3e15498a-83e0-480f-baa5-8ea34c885e88 req-af0f425e-5e79-4e53-b637-909f96e483c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124864 Oct 18 13:58:32.157356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2989/5828] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:32.195192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:32.196478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:32.214410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:32.215213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:32.215861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:32.216799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:32.217625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:32.218357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:33.051767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:33.065194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea87d504-af01-4115-afab-928e8c3676a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.873931 Oct 18 13:58:33.068932 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2840/5829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:32 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:34.094582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:34.095312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:34.112938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:34.113341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:34.113741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:34.129556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:34.129556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:34.129556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:34.642433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:34.653836 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24f3da92-8195-47ff-81b5-f9c82d6c3b24 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.564234 Oct 18 13:58:34.671245 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2990/5830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:34 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:35.687477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:35.688296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:35.713232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:36.166709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:36.180616 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-903b16d4-2564-43a5-a6bb-cefd8f63c00d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.492624 Oct 18 13:58:36.193835 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2841/5831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:35 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:37.204074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:37.204918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:37.246444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:37.250235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:37.250706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:37.251462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:37.251947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:37.252622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:37.272802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:37.617011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:37.627571 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-772897d0-9e34-44db-b041-cb23d9a6baea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.427176 Oct 18 13:58:37.652635 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2991/5832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:37 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:37.925161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-plugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:37.956641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:37.957692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:37.958202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:37.971705 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] Creating event network-vif-plugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:58:37.995604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-595918be-f0f5-47be-961f-6c8b150e0a90 req-cbfe2c28-195f-46c7-be95-17ac095eaee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071778 Oct 18 13:58:37.995604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2842/5833] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:38.657178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:38.658442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:38.697530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:38.697530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:38.697815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:38.698420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:38.698886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:38.699323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:39.199336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:39.216119 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ecd6bba-b6c3-4964-9012-202628b2f8c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.563867 Oct 18 13:58:39.222808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2992/5834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:38 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:40.252645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:40.253144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:40.260264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:40.261036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:40.261499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:40.262320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:40.262790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:40.263904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:40.460093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:40.477584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9d2447a-d168-412c-ada3-f3cfcadaac25 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.231001 Oct 18 13:58:40.493174 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2843/5835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:40 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:41.503639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:41.504401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:41.531799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:41.533858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:41.534576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:41.535565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:41.537094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:41.538601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:41.940105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:41.953059 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7c4f073-c39e-45c9-8ea0-aac28ba1727b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.453793 Oct 18 13:58:41.953643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2993/5836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:41 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:42.979188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:42.980444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:42.993672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:42.993672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:42.993672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:42.994139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:42.994636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:42.995230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:43.237178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:43.250429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ae0a3b0-552f-48e7-94c2-ad613a413d03 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.274652 Oct 18 13:58:43.267656 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2844/5837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:42 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:44.276378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:44.277565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:44.293254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:44.293697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:44.294195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:44.301490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:44.303229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:44.304266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:44.551428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:44.561325 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33e8fdce-8a63-487e-bdd5-f2008c59bfd0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.291012 Oct 18 13:58:44.583631 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2994/5838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:44 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:45.614113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:45.614907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:45.623843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:45.629790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:45.631846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:45.636487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:45.637092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:45.642756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:45.851995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:45.871116 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6a3982a-6fb0-4e0d-a48d-b464f2b23600 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.284800 Oct 18 13:58:45.871951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2845/5839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:45 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:58:46.896801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:46.897815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:46.915658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:46.928068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:46.928699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:46.929578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:46.930245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:46.931055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:47.507913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:47.530195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-215da83e-b400-4a7c-84cb-dc7a6f2b25fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.629928 Oct 18 13:58:47.530195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2995/5840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:46 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:48.556830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:48.557418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:48.571188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:48.571763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:48.572173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:48.572908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:48.573376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:48.573818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:49.482022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:49.493896 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9fbc2c65-3293-4ffc-847c-87346351d794 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.941113 Oct 18 13:58:49.508138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2846/5841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:48 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:50.542723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:50.547245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:50.573449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:50.577684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:50.578884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:50.579643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:50.580338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:50.580962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:51.042095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:51.058337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8fc60da2-f742-4dd1-a02d-8f599385eddb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.525934 Oct 18 13:58:51.090185 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2996/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:50 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:52.082971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:52.084343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:52.095634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:52.104872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:52.104872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:52.104872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:52.104872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:52.104872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:52.577962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:52.588742 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a034f871-6ae1-407e-8f90-ced6809ce75a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.507086 Oct 18 13:58:52.590207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2847/5843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:52 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:53.613427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:53.614163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:53.630700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.635061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.635061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:53.635061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.635532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.635976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:53.925658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:53.925658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:53.944847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.945350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.946346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:53.947269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.947756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.948184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:54.045543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:54.050265 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d230265-e79e-4933-9e9a-fa85ae30e257 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action" status: 200 len: 24572 microversion: 2.1 time: 0.134598 Oct 18 13:58:54.051779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2848/5844] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:58:53 2022] POST /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e/action => generated 24572 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:58:54.054777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-255fd65f-000e-45a6-a493-7d6fee600b06 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.448086 Oct 18 13:58:54.055376 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2997/5845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:53 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:55.153133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:55.154520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:55.168885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=28 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:55.170577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:55.171083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:55.171529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:55.172244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:55.173008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:55.173120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:55.223899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:55.550290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:55.560485 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cda19d3e-1832-4498-964e-2ad5a76c1369 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1682 microversion: 2.1 time: 0.413399 Oct 18 13:58:55.561414 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2849/5846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:55 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:56.589688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:56.590167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:56.607251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:56.607251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:56.607251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:56.607251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:56.609580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:56.609580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:56.828063 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:58:56.828519 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 13:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 (ip 10.222.0.27) !!! Oct 18 13:58:57.495904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:57.507750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed876a49-e8f8-4228-b8be-e5961199e962 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.922597 Oct 18 13:58:57.509471 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2998/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:56 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:57.712713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:57.713390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:57.733499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:57.735513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:57.735513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:57.735513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:57.735939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:57.736384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:58.176388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:58.185977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd729c5b-e5a4-45d3-824b-535ba5e05314 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.478035 Oct 18 13:58:58.187116 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2850/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:57 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:58.442729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-unplugged", "status": "completed", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:58.453459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=26 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:58.455568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:58.456229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:58.456891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:58.511207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] Creating event network-vif-unplugged:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 13:58:58.516782 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a7bddd43-04ef-4dfd-846c-77d87eb87854 req-8ebbbbb6-4000-4d2a-b91a-68aa430012ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078935 Oct 18 13:58:58.518002 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2999/5849] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:01.990636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:01.991408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:02.011419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.018615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.018615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.018615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.018615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.018615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.262400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:02.273485 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d36d0df5-e4ab-47b3-b931-cdf8d502d1da tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.286684 Oct 18 13:59:02.274443 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2851/5850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:01 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:02.305719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:02.306513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:02.314023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.319314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.319314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.319314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.319314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.319314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.601595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:02.610999 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09f91f19-d486-4c82-a7a0-f2e5ae325a89 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.309516 Oct 18 13:59:02.627779 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3000/5851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:02 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:02.639857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:02.640668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:02.648293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.649077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.649762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.651010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.651699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.652379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.273405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:03.290289 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2b13d07-04b1-404d-830f-784d7d73149b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.656127 Oct 18 13:59:03.293134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2852/5852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:02 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:03.317307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:03.321117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:03.335193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.338719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.339570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.342403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.346489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.346489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.676985 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88f3da0f-afa7-452c-80cf-689fed2b7bab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.363277 Oct 18 13:59:03.682301 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3001/5853] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:03 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:59:03.688354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:03.688988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:03.703342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.706462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.713366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.716838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.719847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.721993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:04.169856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:04.181716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3317ef0-9add-48df-9ab5-7a19858be9fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1671 microversion: 2.1 time: 0.499236 Oct 18 13:59:04.183276 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2853/5854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:03 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1671 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:05.211976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:05.212779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:05.229578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:05.230167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:05.230631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:05.232001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:05.232475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:05.238122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:05.715747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:05.728813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f85f196-c82a-44f6-80c7-b269a89a144a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1671 microversion: 2.1 time: 0.522061 Oct 18 13:59:05.729685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3002/5855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:05 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1671 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:06.755524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:06.756342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:06.779051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.780239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.780906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.781841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.782501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.783267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.816164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:06.816787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:06.828864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.829388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.829844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.831970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.833433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.834078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.867090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:59:07.241560 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61c9e149-015b-43aa-b7fe-75ece29ae363 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 204 len: 0 microversion: 2.1 time: 0.429392 Oct 18 13:59:07.244026 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3003/5856] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:59:06 2022] DELETE /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:59:07.266989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:07.305485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.307390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.308788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.336095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] Creating event network-changed:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:59:07.362833 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-070d2530-4f2e-4b00-8a37-63e734dc6fc4 req-80af971d-fd3b-4b93-9f31-751ce75a15bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118347 Oct 18 13:59:07.364898 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3004/5857] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:07.394841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:07.395770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:07.405218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.406008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.407348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.409083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.410461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.411107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.434844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:07.443536 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df86cb4f-178b-4381-a22e-581331c4b991 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.693720 Oct 18 13:59:07.471071 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2854/5858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:06 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:07.476124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:07.494172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:07.529030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.529558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.530009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.530760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.531234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.531655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.639429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a112eff-1546-4efe-95bc-8964a1ef5d2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 200 len: 322 microversion: 2.1 time: 0.166956 Oct 18 13:59:07.644682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2855/5859] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:07 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:07.661310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:07.671964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:07.681278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.686799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.688193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.688478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:07.689106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:07.689811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:07.923688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:07.936071 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01fc4e35-a31d-45c7-b231-1f90776e4970 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1687 microversion: 2.1 time: 0.568567 Oct 18 13:59:07.937209 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3005/5860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:07 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1687 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:08.049301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:08.060366 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f64f80a-fdcb-47f9-928f-46ca271f97a6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.413794 Oct 18 13:59:08.061198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2856/5861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:07 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:08.088915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:08.089802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:08.098926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.099661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.100295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:08.101282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.101936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.102994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:08.124089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:08.418589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:08.431562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f68e4a8a-22e1-4613-b6d5-141960053b59 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.346377 Oct 18 13:59:08.432167 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3006/5862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:08 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:08.467292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:08.468281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:08.478248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.479005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.480256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:08.481206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.482418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.483032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:08.961029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:08.962612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:08.970335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.971236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.971925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:08.972934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:08.973657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:08.974359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:09.357464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:09.370874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-694e572e-f962-4f0f-87ca-f3fbc8151e5f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1687 microversion: 2.1 time: 0.410148 Oct 18 13:59:09.371684 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3007/5863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:08 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1687 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:09.770718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:09.784843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3c9fdaf-1d7a-4cdc-9195-ce8b36369258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 1.324524 Oct 18 13:59:09.789107 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2857/5864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:08 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:09.813982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:09.814677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:09.823674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:09.824192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:09.824650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:09.826033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:09.831619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:09.832381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:10.039251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:10.047465 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccf93ebf-2132-460a-965a-c2490ffb1ee2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.237886 Oct 18 13:59:10.048384 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3008/5865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:09 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:10.216480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1605567383", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1ec6368a-adbd-48ea-b80b-75176c1a2ea1"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:10.317094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] validate_networks() for [('1ec6368a-adbd-48ea-b80b-75176c1a2ea1', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:59:10.400812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:10.401436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:10.409260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:10.413122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:10.414091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:10.415014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:10.416080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:10.417012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:10.699695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:10.708845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc224ead-54e1-4ae0-a7a9-e608874685fc tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1687 microversion: 2.1 time: 0.311872 Oct 18 13:59:10.712219 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3009/5866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:10 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1687 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:11.736224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:11.736952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:11.750571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:11.750571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:11.750571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:11.750571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:11.751451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:11.751958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:11.834635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:11.848541 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f740f7a-e7ec-45e4-8954-cd225294d08f tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1501 microversion: 2.1 time: 0.115462 Oct 18 13:59:11.850006 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3010/5867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:11 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1501 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:11.910600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9a1929-abac-4842-9560-48a3c9c0599e", "name": "network-vif-deleted", "tag": "cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:11.924285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:11.924787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:11.925234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:11.940965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] Creating event network-vif-deleted:cdb81b1c-9a49-4a45-b7a5-f4cf56ca8768 for instance fd9a1929-abac-4842-9560-48a3c9c0599e on n-h1-858383-13 Oct 18 13:59:11.946430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cd8dd05c-5373-40de-9aba-e2cac9372dbc req-4dff5139-29e5-40df-8e66-a59ddde2fa97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039405 Oct 18 13:59:11.947575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3011/5868] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:59:12.217215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:59:12.218523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:59:12.219189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:59:12.219779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:59:12.220368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:59:12.231180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.231920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.232536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.233491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.234176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.234978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.256949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:59:12.278876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:59:12.305431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:59:12.308137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:59:12.461704 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f13d6713-4add-4553-bc41-5e9a91920122 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.253878 Oct 18 13:59:12.468747 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2858/5869] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:59:12.477552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49bfd5e9-d756-4073-ad54-c5de72287b10 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:12.480112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49bfd5e9-d756-4073-ad54-c5de72287b10 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:12.561213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49bfd5e9-d756-4073-ad54-c5de72287b10 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:12.569287 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49bfd5e9-d756-4073-ad54-c5de72287b10 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1215 microversion: 2.1 time: 0.098806 Oct 18 13:59:12.569879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3012/5870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:12 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:12.874094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:12.876312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:12.901974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.908106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.910680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.910680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.910680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.910680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.960142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.960640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.961087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.961551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lazy-loading 'fault' on Instance uuid fd9a1929-abac-4842-9560-48a3c9c0599e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:59:13.008991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69a2792ee20e450e877d4f016c031768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7f9282abf546de97aeefc165b7073d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:13.019556 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db6ab00b-e548-4f4b-a089-afb7e9e1ac88 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 200 len: 1356 microversion: 2.1 time: 0.150507 Oct 18 13:59:13.020338 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2859/5871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:12 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:13.594099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c86590f8-3a49-45ba-bf93-eb8567547cef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:13.595637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c86590f8-3a49-45ba-bf93-eb8567547cef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:13.733606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c86590f8-3a49-45ba-bf93-eb8567547cef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:13.744927 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c86590f8-3a49-45ba-bf93-eb8567547cef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1215 microversion: 2.1 time: 0.156654 Oct 18 13:59:13.750143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3013/5872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:13 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:14.043795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:14.044441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [instance: fd9a1929-abac-4842-9560-48a3c9c0599e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:14.057353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.070807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.071281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:14.072046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.073021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.073467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:14.093361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] HTTP exception thrown: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Request method failure captured: Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e HTTP/1.1 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTq7IGBlDKyARK9VA6W2bq45YJNmQP5lsBo3jK6nNFchQFCp7WqlbDx9FWzSYmi1RbzwwhLUSCg8_4yT2NzxnUBwLIYE1M-wa8UW8IDq3k-Ysb5tQcdQ0OSPZx8bR8xoXaXFiyazPea2eTVrjs1McVHg0DkpMgDyTtLesBx_HAIgMSq4 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c7f9282abf546de97aeefc165b7073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 9c7f9282abf546de97aeefc165b7073d Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-91384113 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 69a2792ee20e450e877d4f016c031768 Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkAdvancedServerOps-91384113-project Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'fd9a1929-abac-4842-9560-48a3c9c0599e'} Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:59:14.109983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Returning 404 to user: Instance fd9a1929-abac-4842-9560-48a3c9c0599e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:59:14.116598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-856c3ff0-4f48-40cf-bf13-b837d4204d29 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e" status: 404 len: 111 microversion: 2.1 time: 0.072135 Oct 18 13:59:14.117817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2860/5873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:14 2022] GET /compute/v2.1/servers/fd9a1929-abac-4842-9560-48a3c9c0599e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:59:14.769655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:14.770471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:14.780181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.782931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.783775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:14.784834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.785542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.787264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:14.942208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:14.952006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6a8e1f6-d4b5-4214-8c40-415861adb78e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1211 microversion: 2.1 time: 0.186556 Oct 18 13:59:14.952618 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3014/5874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:14 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1211 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:15.994344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:15.996053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:16.008077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:16.008999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:16.009626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:16.010704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:16.011258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:16.011769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:16.435408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:16.460601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9dfb1400-1924-4875-94e3-2718e479b3c3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1285 microversion: 2.1 time: 0.474483 Oct 18 13:59:16.466466 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2861/5875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:15 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1285 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:17.489193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:17.489824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:17.502709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:17.504216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:17.504966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:17.505934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:17.506672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:17.507279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:17.609594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:17.623327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-435a6215-0121-416c-bb2e-7616dac373e0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1273 microversion: 2.1 time: 0.138093 Oct 18 13:59:17.624505 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3015/5876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:17 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:18.650725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:18.651476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:18.672085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:18.672594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:18.673057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:18.673760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:18.674274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:18.674712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:18.917904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:18.927165 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-592c24e8-04b3-4e9c-9398-91c5741bb726 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1273 microversion: 2.1 time: 0.280236 Oct 18 13:59:18.945725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2862/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:18 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:19.951175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:19.952446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:19.975561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:19.976386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:19.976856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:19.983282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:19.987351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:19.989740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:20.997218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:21.006007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9a815bd-aa17-4343-824d-06738d406fe2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 1.059397 Oct 18 13:59:21.011084 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3016/5878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:19 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:22.197381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:22.246230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:22.300922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:22.879752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:22.896436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da96d0c8-17b9-4520-905f-7057f0d22299 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.865696 Oct 18 13:59:22.898822 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2863/5879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:22 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:23.066842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4598eb6-98e5-45ec-bfba-8035e128f483", "tag": "385cfae4-f877-436b-b3ec-fbb69358f6f1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:23.092331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.094424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.094424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.130329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] Creating event network-changed:385cfae4-f877-436b-b3ec-fbb69358f6f1 for instance e4598eb6-98e5-45ec-bfba-8035e128f483 on n-h1-858383-13 Oct 18 13:59:23.159094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9ecbfda1-62fe-4094-b4b7-6e2518088769 req-207b2fdb-aac5-4649-828c-244e5bd24497 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100490 Oct 18 13:59:23.159094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3017/5880] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:23.921259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.922042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.933483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.937041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.937715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.939411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.941455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.943206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:24.263787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:24.276945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10600851-94a0-4d87-b77a-2120835538a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.355520 Oct 18 13:59:24.285279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2864/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:23 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:25.311496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:25.313301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:25.340741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:25.357434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:25.359971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:25.360712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:25.362772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:25.363982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:25.366002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:25.912809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:25.926442 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73bd97e1-d9ea-4a9e-8071-635f6483e501 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.620689 Oct 18 13:59:25.927679 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3018/5882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:25 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:26.871652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd08d5ec-56c9-4e93-8de0-2f8679c87ee3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] Calling method '.version_select at 0x7fb32bd28c10>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:26.880675 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd08d5ec-56c9-4e93-8de0-2f8679c87ee3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [0598c815-ea50-4c78-85fc-969d50894498] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:59:26.962572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:26.962572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:26.975633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:26.976305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:26.977744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:26.979458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:26.979952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:26.980405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:27.237786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:27.249545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c83e26f-83cb-4597-928b-aaf9e7b011fb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.294697 Oct 18 13:59:27.250159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3019/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:26 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:27.891125 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd08d5ec-56c9-4e93-8de0-2f8679c87ee3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] [0598c815-ea50-4c78-85fc-969d50894498] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44706. Oct 18 13:59:27.906513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:28.055702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd08d5ec-56c9-4e93-8de0-2f8679c87ee3 tempest-TestNetworkAdvancedServerOps-91384113 tempest-TestNetworkAdvancedServerOps-91384113-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-598382168" status: 202 len: 0 microversion: 2.1 time: 1.183228 Oct 18 13:59:28.086277 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2865/5884] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 13:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-598382168 => generated 0 bytes in 1219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:59:28.277963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:28.284208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:28.298396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:28.303561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:28.303561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:28.303561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:28.303561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:28.303561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:28.510219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:28.521222 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3f488a1-20b0-4792-b803-c59cf7731258 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.249380 Oct 18 13:59:28.522747 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3020/5885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:28 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:29.549344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:29.550023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:29.568667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:29.570227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:29.571416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:29.572142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:29.580384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:29.580384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:29.592288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=88 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:29.954894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:29.968081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86ba1708-f557-4ce7-b38b-de54e368cf1a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.424932 Oct 18 13:59:29.968670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2866/5886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:29 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:30.268518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4598eb6-98e5-45ec-bfba-8035e128f483", "name": "network-vif-plugged", "status": "completed", "tag": "385cfae4-f877-436b-b3ec-fbb69358f6f1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:30.281815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:30.282706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:30.283244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:30.301149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] Creating event network-vif-plugged:385cfae4-f877-436b-b3ec-fbb69358f6f1 for instance e4598eb6-98e5-45ec-bfba-8035e128f483 on n-h1-858383-13 Oct 18 13:59:30.306990 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-777debdb-699c-480b-9cbe-6fc6073c9052 req-37cf9c16-49b4-4dde-857b-e24da20b1ab6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043529 Oct 18 13:59:30.311404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3021/5887] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:30.995612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:30.997458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:31.008679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:31.010195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:31.014659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:31.015773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:31.016457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:31.017136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:31.343397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:31.359833 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a004a7a7-3b55-4b56-82db-795fc776b61c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1315 microversion: 2.1 time: 0.368375 Oct 18 13:59:31.362146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2867/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:30 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:32.388835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:32.390502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:32.403179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:32.406853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.407647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.409339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.409339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.409900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.410627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.919571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:32.932360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8126476d-608f-49d4-b8bf-056bc81de6db tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1503 microversion: 2.1 time: 0.551190 Oct 18 13:59:32.935803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3022/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:32 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1503 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:32.959762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:32.968570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.969195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.969821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.994308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Going to try to stop instance {{(pid=121009) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:59:33.231724 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-688a0e12-18c1-4020-94e6-47e14d15c1b5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483/action" status: 202 len: 0 microversion: 2.1 time: 0.274817 Oct 18 13:59:33.233253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2868/5890] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:32 2022] POST /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:59:33.242145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:33.242982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:33.257660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:33.259438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:33.261240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:33.263786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:33.265887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:33.266747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:33.681686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:33.693025 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5720beb0-ac82-443e-a77c-71677dc0eefd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.455321 Oct 18 13:59:33.693907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3023/5891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:33 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:34.727505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:34.728315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:34.740167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.740773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.741735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.742842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.743697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.757057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.024759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:35.024759 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d578f3d3-2441-4ef5-89f8-90ea48a125b7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.304657 Oct 18 13:59:35.025385 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2869/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:34 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:36.048487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:36.049114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:36.057501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:36.059961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:36.061810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:36.061810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:36.062268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:36.063260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:36.257632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:36.267535 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc796480-b57b-430d-aba3-4f13d12a2fa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.223053 Oct 18 13:59:36.268817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3024/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:36 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:37.292126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:37.292747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:37.304622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:37.305133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:37.305580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:37.312866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:37.313430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:37.313889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:37.706505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:37.716515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-984301b1-3629-45fc-83ae-4325e0f47851 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.429036 Oct 18 13:59:37.717842 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2870/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:37 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:38.748285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:38.750610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:38.813043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:38.814476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:38.815621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:38.818303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:38.822314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:38.824432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:38.890367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=88 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:39.181200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:39.223493 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85049040-e2ec-4d6f-a0fd-6e7891070481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.484679 Oct 18 13:59:39.224091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3025/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:38 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:40.251603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:40.256153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:40.293882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:40.295620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:40.296959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:40.299208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:40.301455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:40.302107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:40.654482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:40.699571 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-255a3669-0a40-4ea8-8553-f2a895db248a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.453622 Oct 18 13:59:40.700975 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2871/5896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:40 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:41.735007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:41.740421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:41.782213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:41.793554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:41.794359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:41.795275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:41.803120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:41.804248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:42.142221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:42.161095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-860546b4-2f90-4503-8e78-2e3f8e50293b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.436633 Oct 18 13:59:42.161707 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3026/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:41 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:43.185596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:43.187018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:43.208905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:43.211205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:43.212517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:43.214978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:43.216918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:43.217775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:43.371245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1598245938", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "10c6a87e-7cfd-475d-9053-0b02d916416b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:43.466258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] validate_networks() for [('10c6a87e-7cfd-475d-9053-0b02d916416b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:59:43.560544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:43.567283 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ea593fd-94c0-417c-b5f8-9a81c89b7245 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.385661 Oct 18 13:59:43.598531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2872/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:43 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:44.431882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:59:44.433011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:59:44.433676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:59:44.434274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:59:44.434847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:59:44.449082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.453555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.456732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:44.462388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.462388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.462388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:44.532057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Getting quotas for project 480e0bfa755e4b99bb01ea3084d7c214. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:59:44.544745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Getting quotas for user b28a5b73e4fa4ce0aadd144e09a6f977 and project 480e0bfa755e4b99bb01ea3084d7c214. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:59:44.578216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:59:44.581570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:59:44.593193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:44.594549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:44.605621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.607450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.608455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:44.612619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.613345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.613983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:44.754625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e78acdc-4748-4893-acb7-a8ba59cf9bd8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387072 Oct 18 13:59:44.755937 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3027/5899] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:59:44.780409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c63493e-e915-4145-8477-a229a881a3bf tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:44.781358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c63493e-e915-4145-8477-a229a881a3bf tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:44.929161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c63493e-e915-4145-8477-a229a881a3bf tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:44.942767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c63493e-e915-4145-8477-a229a881a3bf tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1219 microversion: 2.1 time: 0.177421 Oct 18 13:59:44.947588 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3028/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:44 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:45.593031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:45.607510 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-896fbf28-f9b3-41d0-a46a-40fd42fe4030 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 1.020235 Oct 18 13:59:45.610995 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2873/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:44 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:45.974407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b48576f-a3a1-49eb-a46b-853ff5049d71 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:45.974964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b48576f-a3a1-49eb-a46b-853ff5049d71 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:46.255754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b48576f-a3a1-49eb-a46b-853ff5049d71 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:46.270929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b48576f-a3a1-49eb-a46b-853ff5049d71 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1219 microversion: 2.1 time: 0.300648 Oct 18 13:59:46.272406 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3029/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:45 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:46.635622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:46.636258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:46.648273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:46.652842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:46.652842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:46.652842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:46.652842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:46.652842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:46.916075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:46.925811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ce58d55-8dc2-41e2-828f-b58543ae84d5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.295144 Oct 18 13:59:46.939095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2874/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:46 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:47.300364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:47.301745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:47.314181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.316183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.317045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:47.318183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.318882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.319705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:47.470547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:47.482557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4de5db55-5da3-4d91-8282-03b1674c58a5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1271 microversion: 2.1 time: 0.191465 Oct 18 13:59:47.496386 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3030/5904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:47 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:47.954384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:47.956082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:47.967390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.968434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.969115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:47.970109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.970769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.971856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:48.387894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:48.400220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21108bc7-1adc-4553-ac5b-cc92c2aee1ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.452168 Oct 18 13:59:48.400833 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2875/5905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:47 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:48.512246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:48.512926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:48.521129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:48.521637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:48.522114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:48.524503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:48.525146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:48.526006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:48.681517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:48.695973 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f51ecb2d-4c3b-434b-aa91-91fccc56a012 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1279 microversion: 2.1 time: 0.189901 Oct 18 13:59:48.698369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3031/5906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:48 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:49.424816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:49.426047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:49.443793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.444533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.445163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:49.446038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.446755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.447357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:49.688575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:49.701353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-242f4ebe-0ea8-4d13-a0a7-ce3fe4cb662b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.280695 Oct 18 13:59:49.710423 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2876/5907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:49 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:49.726744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:49.727367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:49.741856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.742405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.742879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:49.743586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.744228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.745473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:50.262020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:50.282995 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-81ed247e-5e6b-48e5-ac6f-c8ceee83c9b2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1277 microversion: 2.1 time: 0.560028 Oct 18 13:59:50.284430 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3032/5908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:49 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1277 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:50.727379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:50.728062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:50.743118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:50.743990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:50.744592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:50.746300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:50.746918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:50.747515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:51.314787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:51.315513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:51.326466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:51.327491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:51.328122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:51.329302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:51.329963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:51.330639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:51.403867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:51.416696 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e43b1eff-91cf-4c54-ba26-dfa15dfc294d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.693275 Oct 18 13:59:51.417899 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2877/5909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:50 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:51.597115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:51.606358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d72540d-0119-4666-9f37-6a63a7f4aab5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.299464 Oct 18 13:59:51.610682 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3033/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:51 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:52.449189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:52.451088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:52.471181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:52.471816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:52.481807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:52.483946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:52.484935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:52.485717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:53.023447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f5d781-f84a-42f6-b118-51199828dffd", "tag": "34136cb3-c3da-442d-a324-20b47a95e19f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:53.076236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:53.077302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:53.079866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:53.109129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] Creating event network-changed:34136cb3-c3da-442d-a324-20b47a95e19f for instance 93f5d781-f84a-42f6-b118-51199828dffd on n-h2-858383-13 Oct 18 13:59:53.119933 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-22195896-d7a9-453b-b074-cef1bb975b38 req-0fa4bf57-d051-4f31-b273-27f49471b864 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490830 Oct 18 13:59:53.121885 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3034/5911] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:53.134708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:53.146306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:53.153261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:53.159468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:53.159468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:53.159468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:53.159468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:53.159468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:53.194735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:53.200754 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bce65510-6242-43dd-92fb-d051a487233c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.755665 Oct 18 13:59:53.205084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2878/5912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:52 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:53.577219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:53.587976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69681dba-1fd1-41f8-8603-5d1cc1dee732 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.461452 Oct 18 13:59:53.589123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3035/5913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:53 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:54.227889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:54.229140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:54.237230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.238164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.238957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.240118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.240800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.242259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.614267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:54.615016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:54.621642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:54.623073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:54.631527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.631527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.633521 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d0c58a2-a5b6-493e-9b34-4624b067e2a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.410259 Oct 18 13:59:54.634479 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2879/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:54 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:54.636485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.637325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.637818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.638355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.936685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:54.945021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51bae547-c258-43ea-a07a-8f75d36e553a tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.336376 Oct 18 13:59:54.963825 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3036/5915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:54 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:55.665404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:55.665404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:55.670017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:55.675695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:55.676273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:55.677901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:55.678660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:55.680079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:55.978126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:55.978696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:56.001952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:56.008754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:56.028328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f360a08-fbf5-4255-ae02-010ee4321ba6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.374749 Oct 18 13:59:56.043517 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2880/5916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:55 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:56.271048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:56.632799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:56.658918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-526e33d5-d9f0-4a0b-b59d-4b8d5cf2138c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.681758 Oct 18 13:59:56.658918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3037/5917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:55 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:57.070561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:57.071869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:57.094589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.097367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.099569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.100570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.105235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.105883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.502861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:57.510846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:57.518142 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f940053-dec8-4b5d-b810-b5ef9c2f9638 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.451515 Oct 18 13:59:57.522095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2881/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:57 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:57.684096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:57.685014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:57.710911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.714727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.715388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.718700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.719247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.723346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:58.548010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:58.549378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:58.566292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:58.570946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:58.571699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:58.572642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:58.575410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:58.576090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:58.738972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:58.756258 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd207b8e-53a8-4946-b2de-2e901a799cc3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 1.076789 Oct 18 13:59:58.791188 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3038/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:57 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:58.889040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:58.897595 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2854f8f6-f33b-4d47-b669-8dd03daa7e49 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1513 microversion: 2.1 time: 0.353848 Oct 18 13:59:58.898233 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2882/5920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:58 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:59.790596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:59.791226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:59.804762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.805849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.806336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.809316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.809795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.811661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.923771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:59.924975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:59.949676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:59.955212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.956186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.957845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.969186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.969186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.969186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.314207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:00.348333 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1df77ed2-68cb-4883-855a-3713ea68c7dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.545758 Oct 18 14:00:00.349294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3039/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:59 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:00.467777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:00.477248 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3643339b-5468-4968-8d1a-956c9d4c4d50 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1490 microversion: 2.1 time: 0.557788 Oct 18 14:00:00.477839 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2883/5922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:59 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1490 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:00.506451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:00.509611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:00.520738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.521256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.521725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.522490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.522966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.523473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.602009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b62106a-6731-413b-8d08-b2442eb6f966 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 200 len: 157 microversion: 2.1 time: 0.097086 Oct 18 14:00:00.602009 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3040/5923] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:00 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 157 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:00.611301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:00.612159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:00.619570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.620286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.621278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.624863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.624863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.624863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.152574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f5d781-f84a-42f6-b118-51199828dffd", "name": "network-vif-plugged", "status": "completed", "tag": "34136cb3-c3da-442d-a324-20b47a95e19f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:01.181600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.184262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.184910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.227410 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] Creating event network-vif-plugged:34136cb3-c3da-442d-a324-20b47a95e19f for instance 93f5d781-f84a-42f6-b118-51199828dffd on n-h2-858383-13 Oct 18 14:00:01.249948 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6e3b1009-df54-48ce-9205-e93ff1d13e0b req-2d9055b5-f53d-42a9-b765-6fa8a6b92072 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091478 Oct 18 14:00:01.265480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3041/5924] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:01.379754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:01.380485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:01.398504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.399022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.399490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.400223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.400699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.408338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.667095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:01.677396 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcc2bea7-b266-48b7-b944-d8417de4a6ec tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1319 microversion: 2.1 time: 0.302870 Oct 18 14:00:01.678740 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3042/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:01 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:01.766031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:01.780875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b55cef74-1275-4a33-b12e-c287eae88135 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 1.174024 Oct 18 14:00:01.782121 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2884/5926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:00 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:01.812915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:01.814566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:01.831335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.832617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.847927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.863862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.867218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.867831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.065516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:02.080701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64736c2d-1141-4f7a-8d62-12cf4850b743 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.271915 Oct 18 14:00:02.081796 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3043/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:01 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:02.107577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:02.107577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:02.119932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.120376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.120828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.121551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.122023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.122484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.549624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:02.573299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8856f10d-298e-4c89-a980-a75951b46a83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.471544 Oct 18 14:00:02.574789 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2885/5928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:02 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:02.599367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-549433860", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5b9deadb-5815-4bb3-8a79-321ca4b278fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:02.612761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:02.615675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:02.642119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.642583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.643621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.648435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.651466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.652534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.688800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:00:03.142583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:03.155322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc84a084-3d94-4ae1-b1b4-4d49a80a7635 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.551988 Oct 18 14:00:03.156461 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2886/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:02 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:03.174328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:03.174328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:03.192175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:03.192686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:03.193311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:03.197215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:03.197215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:03.197215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:03.432438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:00:03.432641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:00:03.434245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:00:03.434744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:00:03.435195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:00:03.437604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:03.454723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:03.455502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:03.456120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:03.457219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:03.460067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:03.460760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:03.563701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:03.591461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:03.768244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:00:03.771046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b9deadb-5815-4bb3-8a79-321ca4b278fb',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:00:04.038486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:04.046545 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb21c423-dbd0-417a-95d0-b13092d5901f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1508 microversion: 2.1 time: 0.888832 Oct 18 14:00:04.049160 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2887/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:03 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1508 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:04.076802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1187945533", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1ec6368a-adbd-48ea-b80b-75176c1a2ea1"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:04.229638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] validate_networks() for [('1ec6368a-adbd-48ea-b80b-75176c1a2ea1', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:00:04.419231 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8575634e-e976-483f-9054-44ca366a104f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824619 Oct 18 14:00:04.420824 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3044/5931] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:00:04.480802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba41692b-d728-43ca-9da8-139b6273f205 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:04.486285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba41692b-d728-43ca-9da8-139b6273f205 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:04.662995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba41692b-d728-43ca-9da8-139b6273f205 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:04.674278 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba41692b-d728-43ca-9da8-139b6273f205 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1056 microversion: 2.1 time: 0.239902 Oct 18 14:00:04.675480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3045/5932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:04 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1056 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:05.546043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:00:05.547080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:00:05.547733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:00:05.548493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:00:05.549135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:00:05.564054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:05.568407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:05.569063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:05.571513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:05.572159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:05.572742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:05.612694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:05.622371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:05.653456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:00:05.660576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:00:05.702797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77c1d31f-6137-4d6d-a9df-fbf0c5d63d04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:05.703482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77c1d31f-6137-4d6d-a9df-fbf0c5d63d04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:05.787666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-77c1d31f-6137-4d6d-a9df-fbf0c5d63d04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:05.802601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77c1d31f-6137-4d6d-a9df-fbf0c5d63d04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1056 microversion: 2.1 time: 0.105412 Oct 18 14:00:05.803748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3046/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:05 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1056 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:06.219803 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69ce47c7-7ea6-4550-9184-c14b0a628281 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168619 Oct 18 14:00:06.225607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2888/5934] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:00:06.239990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da91cc67-a5da-4817-8d54-76f8c5649ab4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:06.244854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da91cc67-a5da-4817-8d54-76f8c5649ab4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:06.567734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da91cc67-a5da-4817-8d54-76f8c5649ab4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:06.576377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da91cc67-a5da-4817-8d54-76f8c5649ab4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1215 microversion: 2.1 time: 0.344000 Oct 18 14:00:06.579736 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3047/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:06 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:06.828160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:06.829530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:06.843064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:06.843064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:06.848272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:06.849349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:06.849982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:06.850599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:07.220169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:07.232039 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0c165021-aedf-4039-a8b8-5ecb6294de82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1098 microversion: 2.1 time: 0.408145 Oct 18 14:00:07.247498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2889/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:06 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1098 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:07.610821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2eb8e7c8-5970-416a-9d43-1b999f2e0b63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:07.612126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2eb8e7c8-5970-416a-9d43-1b999f2e0b63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:07.753736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2eb8e7c8-5970-416a-9d43-1b999f2e0b63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:07.766924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2eb8e7c8-5970-416a-9d43-1b999f2e0b63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1215 microversion: 2.1 time: 0.160483 Oct 18 14:00:07.771807 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3048/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:07 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:08.258402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:08.259725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:08.274174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.274898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.275556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:08.276887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.277728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.279141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:08.547153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:08.587395 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-959a31c1-bff4-413a-8033-090ceb1deeac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1154 microversion: 2.1 time: 0.319306 Oct 18 14:00:08.587395 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2890/5938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:08 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1154 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:08.806487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:08.806487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:08.844654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.845760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.846258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:08.847264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.847735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.848476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.117375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:09.117375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c221410a-c016-4037-9537-a8a1f7dd5fc9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1211 microversion: 2.1 time: 0.238100 Oct 18 14:00:09.117375 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3049/5939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:08 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1211 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:09.603225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:09.603932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:09.617562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.619582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.621500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.622801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.624714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.625929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:10.148861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:10.149503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:10.213646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:10.214278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:10.214748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:10.215513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:10.224431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:10.225027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:10.406036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:10.408337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:10.422620 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1911b1c8-50e7-41c1-876f-e3333104dae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1267 microversion: 2.1 time: 0.275502 Oct 18 14:00:10.423807 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3050/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:10 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:10.624044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:10.646462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ead86dfd-6c73-4c20-aa59-b2464907d97c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1172 microversion: 2.1 time: 1.049264 Oct 18 14:00:10.646959 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2891/5941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:09 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1172 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:11.450844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:11.452446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:11.498430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.501327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.503212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.508299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.508299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.508299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.670957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:11.671773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:11.699562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.700680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.703150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.708031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.709428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.710081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.716097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:11.735753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6153c0c7-862b-4e9f-9f19-f444dcdd4aa9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1273 microversion: 2.1 time: 0.292234 Oct 18 14:00:11.749641 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3051/5942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:11 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:11.917302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:11.936347 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-72ba639c-3761-4305-be10-38948cacdca7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1172 microversion: 2.1 time: 0.271332 Oct 18 14:00:11.940950 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2892/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:11 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1172 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:12.772960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:12.773748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:12.803913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.804713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.805283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.806310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.811582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.812866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.954212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:12.966335 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5350967b-c958-4496-88af-f2704728702c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1273 microversion: 2.1 time: 0.197224 Oct 18 14:00:12.969992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:12.970676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:12.985786 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3052/5944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:12 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:12.991870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.992439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.995376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.996182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:13.002019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:13.002327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:13.703937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:13.712306 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4cd63e04-7489-4913-93e8-b1db0e8aed4a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1214 microversion: 2.1 time: 0.749099 Oct 18 14:00:13.730531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2893/5945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:12 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1214 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:13.997941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:13.998601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:14.001493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:14.011185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.017311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.018080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:14.019265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.020138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.020617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:14.502484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:14.520003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6dba8f33-39de-4168-91c9-280c705acacb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.526448 Oct 18 14:00:14.520910 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3053/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:13 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:14.744886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:14.747465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:14.759738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.762247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.767973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:14.769684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.778619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.781695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:15.176539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:15.193669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-482ccb7b-d785-419e-9ed9-aa539bf35a6d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1214 microversion: 2.1 time: 0.452537 Oct 18 14:00:15.198217 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2894/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:14 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1214 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:15.546806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:15.547445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:15.557027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:15.567047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:15.567699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:15.572072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:15.576550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:15.577415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:15.918110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:15.931537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3ccd697-a991-4ed4-9a95-af64b474adc6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.389177 Oct 18 14:00:15.942571 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3054/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:15 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:16.198524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158403f6-90c2-4d25-8380-ef0c4bc91ad9", "tag": "57856cd3-ad45-4e5c-9664-f091666550a1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:16.208870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:16.210357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:16.221446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:16.222638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:16.237366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:16.242848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:16.247570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:16.248375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:16.248870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:16.249324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:16.261334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:16.263220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:16.265392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:16.305654 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] Creating event network-changed:57856cd3-ad45-4e5c-9664-f091666550a1 for instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 on n-h1-858383-13 Oct 18 14:00:16.322292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a7c6c7c5-8a8a-40df-907f-b82caf08b8ff req-b65b5e06-8905-4a9a-ac9e-6e3f02c7e8c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129332 Oct 18 14:00:16.325633 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2895/5949] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:00:16.972177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:16.972920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:17.008246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:17.008754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:17.009295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:17.014986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:17.015756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:17.017396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:17.765267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:17.888947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:17.923749 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-483625de-f4ea-460d-a0dc-9125b317323f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.963306 Oct 18 14:00:17.927131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2896/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:16 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:18.190370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:18.199614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b89cf122-b069-4a74-887c-f262a7f581c7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1214 microversion: 2.1 time: 1.983452 Oct 18 14:00:18.207181 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3055/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:16 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1214 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:18.396735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3097a00f-9b3c-49d6-b062-2d2cb70aa34e", "tag": "d898cdd0-2ab1-41d3-9de6-da39da54466a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:18.417018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:18.419003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:18.420454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:18.461791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] Creating event network-changed:d898cdd0-2ab1-41d3-9de6-da39da54466a for instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e on n-h1-858383-13 Oct 18 14:00:18.471980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3b769c02-2af9-497b-b311-bb16043e9d29 req-7db24011-0d79-4067-af77-cf64a7d95238 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084239 Oct 18 14:00:18.478174 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2897/5952] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:00:18.960834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:18.962264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:18.985288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:18.987540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:18.988840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:18.991688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:18.992578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:18.993417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.233357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:19.236496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:19.253873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:19.254430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:19.255080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.255972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:19.256596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:19.257191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.619414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:19.632285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-106eb299-e5b2-402b-9dd6-3ebbad2e6f52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1214 microversion: 2.1 time: 0.403183 Oct 18 14:00:19.634921 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2898/5953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:19 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1214 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:19.744480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:19.756840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c4ce583-9845-49b5-a06f-d736e9759a08 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.799436 Oct 18 14:00:19.768298 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3056/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:18 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:20.662708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:20.663512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:20.675228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.686560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.689700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:20.692083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.692862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.693885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:20.785128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:20.786386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:20.809906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.812593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.813090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:20.822547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.826711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.827322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:21.603072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:21.615786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:21.622137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71f2a9b5-6a08-4ec0-96ca-e694fb4abf2c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1214 microversion: 2.1 time: 0.965476 Oct 18 14:00:21.626518 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2899/5955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:20 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1214 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:21.646463 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc5d89f4-4a8b-4da6-b9f3-2e67d001fb47 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.868570 Oct 18 14:00:21.651734 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3057/5956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:20 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:22.652991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:22.654342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:22.668007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.668533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.668993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.669734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.670240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.670690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.681840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:22.683814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:22.699589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.701054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:22.702094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.706220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.710426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.711112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.711790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:23.132942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:23.154281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d796dd5-b58f-439b-963f-06d2e2c58ff3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.478101 Oct 18 14:00:23.167760 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3058/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:22 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:24.180699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:24.183337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:24.201808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:24.202277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:24.202741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:24.203476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:24.203952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:24.204412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:24.511027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:24.525040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd3d6153-053c-4a24-9049-305c1778ddc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 1.874407 Oct 18 14:00:24.540668 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2900/5958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:22 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:24.741729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:24.762203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0acb98bf-ee24-445c-9277-9b5837cf5775 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.584163 Oct 18 14:00:24.764472 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3059/5959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:24 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:25.556919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:25.559164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:25.574339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.575091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.575722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:25.577110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.577737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.578576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:25.787995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:25.789225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:25.806907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.812966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.814232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:25.817641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.819053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.824743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:26.358192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:26.378035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7068814f-c1a7-4719-938f-1628f114948f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.824728 Oct 18 14:00:26.400046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2901/5960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:25 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:27.105079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:27.121678 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc77710f-3f0b-4365-9102-08f85cc6455a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 1.336450 Oct 18 14:00:27.125314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3060/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:25 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:27.404759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:27.405386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:27.417444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:27.418475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:27.421222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:27.423443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:27.424092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:27.425713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:27.780839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3097a00f-9b3c-49d6-b062-2d2cb70aa34e", "name": "network-vif-plugged", "status": "completed", "tag": "d898cdd0-2ab1-41d3-9de6-da39da54466a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:27.814430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:27.815087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:27.815778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:27.844901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] Creating event network-vif-plugged:d898cdd0-2ab1-41d3-9de6-da39da54466a for instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e on n-h1-858383-13 Oct 18 14:00:27.863833 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c5074e1b-fc9c-498f-a29a-82bd7169758d req-b9a38703-e07f-4a6d-b0c3-f994a0540fde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100277 Oct 18 14:00:27.865492 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3061/5962] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:27.987993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:28.003396 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43d90849-7733-4d20-a382-d9a80359fd44 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.602267 Oct 18 14:00:28.004004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2902/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:27 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:28.156771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:28.156771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:28.196737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.196737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.199010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.199716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.200220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.200955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.589870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:28.605534 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ce07f3a3-5aac-44a4-8090-793e45ec03c4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.456072 Oct 18 14:00:28.606685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3062/5964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:28 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:29.036851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:29.039951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:29.083021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.084063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.084910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.086666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.087727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.089351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.500586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:29.529502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c3bd6af-cefc-41c1-a334-a76f477e0f0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.499747 Oct 18 14:00:29.530626 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2903/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:29 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:29.631766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:29.632603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:29.642277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.642277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.642877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.643905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.643989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.644602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.822468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:29.833488 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95b27fbe-20a3-47f5-81b4-f24a98266fbb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1315 microversion: 2.1 time: 0.206403 Oct 18 14:00:29.834157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3063/5966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:29 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:30.554872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:30.556289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:30.581644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:30.582525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:30.585439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:30.588105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:30.595857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:30.599774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:30.858544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:30.859185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:30.873176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:30.876281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:30.877064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:30.881028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:30.881969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:30.882713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:31.279073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:31.287111 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfe6eded-3746-479a-81d2-b2f1ad534247 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.738016 Oct 18 14:00:31.287715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2904/5967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:30 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:31.517637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:31.530137 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-204c4ea3-af48-4bac-b34c-3ff3de9faa9a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1502 microversion: 2.1 time: 0.676829 Oct 18 14:00:31.534334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3064/5968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:30 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1502 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:31.560723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:31.563622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:31.576509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:31.583088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:31.583828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:31.590465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:31.593048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:31.597653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:31.597653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:31.664491 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3768f9c-6ab1-4d11-b340-ca25cca509fc tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.108667 Oct 18 14:00:31.669453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2905/5969] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:31 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:32.328240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:32.330903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:32.349291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.351075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.352693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.354869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.356610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.358759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.681233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:32.685794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:32.708722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.709725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.711777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.714225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.714919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.717415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.759682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:32.771598 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be45c773-158d-4124-8856-1ded5561f92e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.454022 Oct 18 14:00:32.777353 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3065/5970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:32 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:32.805470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd487225-6a3c-4654-9a17-4b94ece5d2cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.130662 Oct 18 14:00:32.809220 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2906/5971] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:32 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:33.803968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:33.804718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:33.815868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:33.818015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:33.819218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.819872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.821228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:33.821873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.823270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.835996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.838161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.839588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.842937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.843778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.845179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.847493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.848257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.953290 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36eef9e1-b633-415f-b862-054a778228af tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.138214 Oct 18 14:00:33.955660 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2907/5972] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:33 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:34.296368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:34.348322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb27289f-8276-4de6-a470-35cb39bb6c62 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.548424 Oct 18 14:00:34.350188 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3066/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:33 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:34.963692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:34.965988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:34.985128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:34.985917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:34.986580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:34.987469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:34.991034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:34.995193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:35.067201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45120693-7bb6-47d2-8c95-88a91acae35d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.107588 Oct 18 14:00:35.073541 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2908/5974] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:34 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:35.161051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158403f6-90c2-4d25-8380-ef0c4bc91ad9", "name": "network-vif-plugged", "status": "completed", "tag": "57856cd3-ad45-4e5c-9664-f091666550a1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:35.180421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:35.180932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:35.181386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:35.219898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] Creating event network-vif-plugged:57856cd3-ad45-4e5c-9664-f091666550a1 for instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 on n-h1-858383-13 Oct 18 14:00:35.225198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a6ec4241-f1aa-4b6c-9e45-bae6d03872f6 req-d5eb2eed-c0c0-4a3a-a813-87e6b967cb09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067647 Oct 18 14:00:35.226364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3067/5975] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:35.383101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:35.384004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:35.395317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:35.398777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:35.407313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:35.408318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:35.408969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:35.409573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:36.078910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:36.081550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:36.107420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:36.107946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:36.108405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:36.109145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:36.109620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:36.121483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:36.189587 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0afad8e-08ad-4269-9f8e-73dcb3ef2c4d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.114873 Oct 18 14:00:36.193438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3068/5976] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:36 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:36.317688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:36.328533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-713d3db0-7406-4134-a977-afae7c4961be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1202 microversion: 2.1 time: 0.949918 Oct 18 14:00:36.336880 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2909/5977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:35 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1202 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:37.202133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:37.205080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:37.228319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.230409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.234305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.254189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.254189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.254189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.254189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:37.309926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-41d9d62b-7070-420b-b12e-ebe7984883a4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.112548 Oct 18 14:00:37.314415 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3069/5978] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:37 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:37.363608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:37.364342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:37.380674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.381171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.387331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.387331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.387331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.387331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.903727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:37.912347 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c561e392-7e04-4af3-8fb2-24000416e434 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1389 microversion: 2.1 time: 0.552585 Oct 18 14:00:37.917340 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2910/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:37 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1389 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:37.937787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:37.938799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:37.959038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.959822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.960434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.961432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.962075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.962692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.321605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:38.324030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:38.330351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:38.338882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99c9f1f3-fb8f-40f5-8ad0-2c082b0066c3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1389 microversion: 2.1 time: 0.406624 Oct 18 14:00:38.341068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.341867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.343303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3070/5980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:37 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1389 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:38.344169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.345849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.347576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.349337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.369379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:38.371348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:38.379828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.380572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.381364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.382586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.383223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.383817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.476034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-421988f3-d3f4-480c-ae3b-5fdbccc9be05 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.158180 Oct 18 14:00:38.481576 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2911/5981] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:38 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 14:00:38.737571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:38.742737 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5aab4c7-35cb-47a0-90ce-0723aaae52be tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1389 microversion: 2.1 time: 0.377687 Oct 18 14:00:38.743959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3071/5982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:38 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1389 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:38.767352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:38.768230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:38.777178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.777985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.778607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.779855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:38.780511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:38.781498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.810071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:00:39.287549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e5d0f6d9-beb3-4fe8-9aea-3405f903eb36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 204 len: 0 microversion: 2.1 time: 0.523957 Oct 18 14:00:39.291942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2912/5983] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:00:38 2022] DELETE /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:00:39.304122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:39.304986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:39.326296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.328822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.329365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.336061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.339651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.341044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.490288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:39.498794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:39.519116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.522103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.524202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.529009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.529763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.530503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.703765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:39.717695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9eb75085-6015-43f4-8dba-6686bf42a0c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1395 microversion: 2.1 time: 0.415264 Oct 18 14:00:39.722646 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3072/5984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:39 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1395 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:40.255736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51594b57-2386-458c-9bed-6ff8f3a8441a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.770069 Oct 18 14:00:40.256688 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2913/5985] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:39 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:00:40.755483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:40.756915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:40.778118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:40.779723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:40.782476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:40.783729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:40.784553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:40.795388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:41.274000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:41.281986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:41.298298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:41.299566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:41.301313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:41.302620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:41.303633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:41.304298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:41.388780 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4bc4487-0dcc-4124-8b8a-c44bbf164c9e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 14 microversion: 2.1 time: 0.125127 Oct 18 14:00:41.390289 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2914/5986] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:41 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 14:00:41.427423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:41.437598 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57387cfc-d217-430d-a1e0-497f15a527ea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1395 microversion: 2.1 time: 0.699960 Oct 18 14:00:41.438995 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3073/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:40 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1395 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:41.987805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158403f6-90c2-4d25-8380-ef0c4bc91ad9", "name": "network-vif-deleted", "tag": "57856cd3-ad45-4e5c-9664-f091666550a1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:42.015905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.018992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.018992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.031353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] Creating event network-vif-deleted:57856cd3-ad45-4e5c-9664-f091666550a1 for instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 on n-h1-858383-13 Oct 18 14:00:42.036333 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2f5dba1b-8bc0-437c-923f-a6a22dcd5a3e req-704ff14c-8e3f-4144-a20a-dbcb33d72a23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310653 Oct 18 14:00:42.042549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2915/5988] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:42.402958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:42.406241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:42.424019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.424665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.425251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.426129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.426718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.427272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.465836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:42.468918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:42.483123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.483628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.484080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.484808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.485271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.485706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.512860 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eadee5e1-9b57-4890-ad0e-970f3abe004d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action" status: 200 len: 8208 microversion: 2.1 time: 0.114486 Oct 18 14:00:42.514235 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3074/5989] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:42 2022] POST /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e/action => generated 8208 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:42.527601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:42.528455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:42.540920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.540920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.540920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.540920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.543666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.544442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.616326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:42.626480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7eb19b5f-5112-447a-b1bb-2b82d7afcff3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.165085 Oct 18 14:00:42.627079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2916/5990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:42 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:43.168985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:43.188723 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-773165df-1c1c-4537-b516-58124be8528e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.667904 Oct 18 14:00:43.189344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3075/5991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:42 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:43.225083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:43.226142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:43.237893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.241046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.241745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.242781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.243414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.244082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.489877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:43.523426 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49847324-5702-49d6-af20-a62c4b452353 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.297972 Oct 18 14:00:43.537327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2917/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:43.552473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:43.553757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:43.572797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.573317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.573782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.574564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.575040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.575595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.651215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:43.651869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:43.688560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.738296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:43.822971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:43.833745 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af79d411-f308-4e74-b518-d4b3ac973bcc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.186902 Oct 18 14:00:43.834382 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2918/5993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:43 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:44.135823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:44.145266 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-deb8ec92-fbef-4d18-8877-8dd9cedd764f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.597205 Oct 18 14:00:44.152093 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3076/5994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:44.178122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:44.178756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:44.188810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.191112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.191730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.196353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.197042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.198226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.427622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:44.447843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58b96ece-f091-4222-a643-3c6923158e84 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.273472 Oct 18 14:00:44.454564 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2919/5995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:44 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:44.473640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:44.474262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:44.482856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.483365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.483818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.484534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.485186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.485626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.787152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Locking {{(pid=121010) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 18 14:00:44.862155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:44.863386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:44.876678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.883725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.885969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.886975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.889259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.893599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.027164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:45.041235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fbe0104-3c01-4d64-969a-e527736467ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.183972 Oct 18 14:00:45.042651 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2920/5996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:44 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:45.256500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c353d7d-ea70-43ee-bc5e-897a9c4c7d76 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.787542 Oct 18 14:00:45.257918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3077/5997] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:44 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:00:45.266871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:45.267737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:45.283712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.284452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.285049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.285946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.286616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.287221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.661503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:45.672923 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-caa0ac19-f852-488d-8898-56036d253257 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.409938 Oct 18 14:00:45.691835 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2921/5998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:45 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:45.698407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:45.723903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.727815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.731051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.818727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action HTTP/1.1 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 15 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: {"os-stop": {}} Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0e0d3798-4fd3-4937-87ce-907a8b190d90', 'body': {'os-stop': {}}} Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked Oct 18 14:00:45.826937 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:45.838206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 409 to user: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 is locked {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:00:45.839107 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13493360-1995-4a02-863a-d9fdcf163d8a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 409 len: 107 microversion: 2.1 time: 0.146071 Oct 18 14:00:45.839708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3078/5999] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:45 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 107 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 14:00:45.852821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:45.853393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:45.882175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.882879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.883115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.891306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.892302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.895740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.075099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:46.077934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:46.094734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:46.097709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:46.101428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.103207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:46.127399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:46.132208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.251468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:46.263671 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9180a1b3-ba87-4a85-a0e5-c7a866609f85 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.198014 Oct 18 14:00:46.268632 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3079/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:46 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:46.290298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Unlocking {{(pid=121009) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 14:00:46.628310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd9fa8e8-9a03-43d4-84ff-2e648d8502d0 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.780488 Oct 18 14:00:46.628966 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2922/6001] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:45 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:00:46.641192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:46.661701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:46.661701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:46.661701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.720477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:00:47.072638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26026125-e37f-4bda-83e5-9ac5112628c6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.438784 Oct 18 14:00:47.082123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:47.085522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:47.087975 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3080/6002] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:46 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:00:47.096420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.098830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.100406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:47.104644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.105520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.109810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:47.295439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:47.296444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:47.305192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.305995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.306712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:47.308415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.309271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.309877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:47.517672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:47.530946 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6aaafb92-ac0f-4503-b9b3-e73769e91bcd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.451135 Oct 18 14:00:47.534021 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2923/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:47 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:47.561333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:47.572775 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-222638aa-ab4e-49a9-846d-050a91dde481 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.282994 Oct 18 14:00:47.573649 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3081/6004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:47 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:48.559878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:48.564648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:48.596105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:48.597728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:48.598384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.600790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:48.603173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:48.606771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:48.606921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:48.608396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.626433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:48.628498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:48.630582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.632881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:48.633633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:48.638549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.777046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:48.787374 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9be8a7bb-662f-4d85-b53b-f7e893477108 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1187 microversion: 2.1 time: 0.194744 Oct 18 14:00:48.810239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3082/6005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:48 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1187 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:48.846800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:48.859061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24e8ba1f-eac4-4d72-b478-a0aae5b915f2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.304081 Oct 18 14:00:48.897133 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2924/6006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:48 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:49.824663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:49.826026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:49.833664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.836246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.836913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.838411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.839118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.839858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.878794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:49.898157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.898840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.900939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.901603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid 158403f6-90c2-4d25-8380-ef0c4bc91ad9 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:00:49.908135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:49.908781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:49.925926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.926485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.926953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.927749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.928165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.928613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:50.029308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:50.045062 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cee67bd0-db2f-4be9-babf-647c00b40482 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 200 len: 1192 microversion: 2.1 time: 0.232387 Oct 18 14:00:50.061819 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3083/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:49 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 1192 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:50.509326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:50.509326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37b355b8-4e81-40b3-96c8-50029a557d1e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.610397 Oct 18 14:00:50.509326 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2925/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:49 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:51.081130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:51.082111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 158403f6-90c2-4d25-8380-ef0c4bc91ad9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:51.098886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:51.099639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:51.100810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:51.101876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:51.102541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:51.104749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:51.123471 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 HTTP/1.1 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '158403f6-90c2-4d25-8380-ef0c4bc91ad9'} Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:51.140684 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. Oct 18 14:00:51.145453 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:00:51.148359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 158403f6-90c2-4d25-8380-ef0c4bc91ad9 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:00:51.149504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c246b3c-afd3-4b9d-8fbe-49bac685063b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9" status: 404 len: 111 microversion: 2.1 time: 0.074765 Oct 18 14:00:51.154417 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3084/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:51 2022] GET /compute/v2.1/servers/158403f6-90c2-4d25-8380-ef0c4bc91ad9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:00:51.535651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:51.536273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:51.546048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:51.546587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:51.549816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:51.561631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:51.562660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:51.563293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:51.916934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:51.935890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-081dea7b-311f-4d64-ae46-cfda6dc8a20c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.402966 Oct 18 14:00:51.953408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2926/6010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:51 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:52.813897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d63d1af-b808-431b-9234-4e9075acd44a", "device": "/dev/sdb"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:52.820610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:52.846590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:52.847834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:52.848331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:52.849216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:52.849832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:52.850682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:52.977106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:52.979263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:52.989807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:52.992413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:52.992877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:52.993661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:52.994939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:52.996175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:53.215129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:53.223240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-094c4008-0877-4926-a1af-d1e29ca2e938 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.250355 Oct 18 14:00:53.223822 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2927/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:52 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:53.837922 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a85c420-6b26-4de3-b46e-b8294743a587 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "POST /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.031207 Oct 18 14:00:53.844577 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3085/6012] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:00:52 2022] POST /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:54.251781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:54.252623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:54.276834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:54.277364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:54.285862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:54.286834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:54.287425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:54.289645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:54.621912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:54.633360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-360cb437-5568-4dd9-b426-35ccb37fc4eb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.390774 Oct 18 14:00:54.636628 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2928/6013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:54 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:55.666906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:55.667736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:55.694568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.694568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.694568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.694568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.695182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.695355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.984084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:55.997768 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ce24731-2f4e-4845-931c-f921a8a20a21 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.342313 Oct 18 14:00:55.999981 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3086/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:55 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:57.020935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:57.021478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:57.028865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.037216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.041716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.041716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.041716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.041716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.461377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:57.473587 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12435dfe-84aa-4a54-897f-e37c0b7523f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.453862 Oct 18 14:00:57.474267 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2929/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:57 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:58.502101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:58.503794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:58.513559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.514529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.520526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.520526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.520526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.520526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.785811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:58.799270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1527030-14e7-4d00-b418-a31b3211a49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1656 microversion: 2.1 time: 0.303123 Oct 18 14:00:58.801673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3087/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:58 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1656 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:58.833493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:58.844776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.845986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.849033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.952171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:00:59.249253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54987668-c2c9-46c0-8c15-946ad85783a7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.419731 Oct 18 14:00:59.250325 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2930/6017] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:58 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:00:59.267474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:59.269189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:59.299923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.301632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.308133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:59.308133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.308133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.308133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:00.281554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:00.294830 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a2bbcdd-3fc9-494a-b30a-ff615132a27f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1665 microversion: 2.1 time: 1.038313 Oct 18 14:01:00.295831 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3088/6018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:59 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1665 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:01.325943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:01.330146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:01.344488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:01.345217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:01.346738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:01.347945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:01.351114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:01.351806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:01.427684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:01.904790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:01.923418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c4795fa-10ef-4955-b6bf-7306295ac3a2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1665 microversion: 2.1 time: 0.605029 Oct 18 14:01:01.925312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2931/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:01 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1665 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:02.085173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1506154319", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a488dd19-9f08-4137-bc71-077b28f0b7f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:02.252218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:01:02.951809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:02.952480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:02.957481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:02.967794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.969641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.971855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:02.972778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.975522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.976202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.250283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:03.258622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88bc1a02-15a9-464c-973e-ca1465cd3e4f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.313134 Oct 18 14:01:03.259236 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2932/6020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:02 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:03.290266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:03.290968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:03.304483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.305024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.310790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.311568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.320909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.326654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.571792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:01:03.572858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:01:03.573745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:01:03.574416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:01:03.575092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:01:03.591979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.592791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.594316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.595122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.595614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.596070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.619447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:01:03.626983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:01:03.726619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:01:03.729511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a488dd19-9f08-4137-bc71-077b28f0b7f4',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:01:03.787430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:03.807650 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d001b06-bff0-46b3-bc0a-fdb728cca970 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.519131 Oct 18 14:01:03.810342 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2933/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:03 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:03.840003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:03.840563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:03.848018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.848900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.849756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.851539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.852426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.859224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:04.170665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Unlocking {{(pid=121009) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 14:01:04.231008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=60 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:04.352008 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f054c6d1-af7d-4eeb-85f2-5d10ad9d2ea9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.288200 Oct 18 14:01:04.364053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3089/6022] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:01:04.370410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1df9630-6d4c-4235-a68f-fc78e706c414 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:04.370718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1026b2b2-5cae-41f7-9528-53fa82058933 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.536406 Oct 18 14:01:04.374225 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2934/6023] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:01:03 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:04.374843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1df9630-6d4c-4235-a68f-fc78e706c414 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:04.398445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:04.399388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:04.418281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.419118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.419816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:04.422549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.423354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.425276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:04.558667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1df9630-6d4c-4235-a68f-fc78e706c414 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:04.570752 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1df9630-6d4c-4235-a68f-fc78e706c414 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1057 microversion: 2.1 time: 0.203060 Oct 18 14:01:04.573292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3090/6024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:04 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1057 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:04.855725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:04.864556 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37ca42f0-07f9-4edb-a25c-b84665126ede tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.472003 Oct 18 14:01:04.872310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2935/6025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:04 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:04.898912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:04.899552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:04.910540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.911045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.911495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:04.912276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.912672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.913114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.184570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:05.197202 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3bd39b2-d7fe-4c9b-ad6b-ba6a24bf26c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.301458 Oct 18 14:01:05.220267 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3091/6026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:04 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:05.226026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:05.226691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.237157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.459228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:05.481657 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b3d9d0c-61b6-4003-8274-f9f680a0df46 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.259572 Oct 18 14:01:05.483661 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2936/6027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:05 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:05.523857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:05.523857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:05.564021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.564923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.565450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.566373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.567048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.567986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.597154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-85652f6f-7c78-4c7a-aacc-ea50da7ad980 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:05.597786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-85652f6f-7c78-4c7a-aacc-ea50da7ad980 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:05.727734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-85652f6f-7c78-4c7a-aacc-ea50da7ad980 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:05.737528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-85652f6f-7c78-4c7a-aacc-ea50da7ad980 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1057 microversion: 2.1 time: 0.145598 Oct 18 14:01:05.774474 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2937/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:05 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1057 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:05.864829 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8787bd83-1ec0-430b-a528-d005f6383d78 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.350949 Oct 18 14:01:05.865838 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3092/6029] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:01:05 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:05.876170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:05.876810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:05.885677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.886225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.893048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.893858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:05.894390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:05.896841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:06.121926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:06.136504 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e0a04915-cee1-4ccb-a58a-baca04bb9c9b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1674 microversion: 2.1 time: 0.264926 Oct 18 14:01:06.155673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2938/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:05 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:06.768660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:06.769714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:06.801733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:06.823221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:06.823734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:06.824510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:06.824995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:06.825439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.047738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:07.058344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e0044d4-afbb-4912-987f-7cae2fc2c365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1099 microversion: 2.1 time: 0.295038 Oct 18 14:01:07.059579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3093/6031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:06 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1099 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:07.166438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:07.170036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:07.194296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.198750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.202879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.202879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.205369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.206223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.436687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:07.460162 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4236ca9d-2fa9-45d3-844b-6d6cafd543fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1654 microversion: 2.1 time: 0.301189 Oct 18 14:01:07.469221 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2939/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:07 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1654 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:07.484729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:07.485670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:07.492308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.493157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.494044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.495225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.495926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.496586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.776616 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d0ffaba-4232-41b7-b944-8f8035ae89b2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.295791 Oct 18 14:01:07.786109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3094/6033] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:01:07 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:07.787328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:07.788179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:07.799246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.799761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.800223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.806398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.807114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.811245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:08.089287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:08.103413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:08.142040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:08.146376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:08.146376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:08.146376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:08.146376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:08.146799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:08.193443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:08.226540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2185e81e-bb1f-4971-9dd6-b4db1d048c34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1661 microversion: 2.1 time: 0.443604 Oct 18 14:01:08.254453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2940/6034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:07 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1661 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:08.354674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:08.367806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1774e69c-a1ab-4f69-b399-73ecedbfc7a9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1163 microversion: 2.1 time: 0.282073 Oct 18 14:01:08.386875 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3095/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:08 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1163 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:09.252314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:09.253803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:09.269666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.270495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.271111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:09.272015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.272662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.273264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:09.397877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:09.399161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:09.410458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.413365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.414089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:09.415029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.417046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.417664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.045410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:10.063269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02f9edba-ceaa-4c14-b068-99266245b3e5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.669152 Oct 18 14:01:10.065181 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3096/6036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:09 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:10.092826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:10.103261 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7bfda252-a876-4ead-961b-9317aa22e0ff tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.852744 Oct 18 14:01:10.110499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2941/6037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:09 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:10.132248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:10.132248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:10.137902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.138485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.138947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.139645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.140287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.140885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.453781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:10.461808 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7326a059-96c1-4416-95e3-9b71caa61308 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.337286 Oct 18 14:01:10.465591 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3097/6038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:10 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:10.500720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:10.501482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:10.509657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.510192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.510652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.511378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.511851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.512299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.812063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:10.834905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7781aec4-7029-47f1-be96-6ca31bae541a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.338077 Oct 18 14:01:10.838648 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2942/6039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:10 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:10.864534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:10.865521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:10.875222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.878750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.879453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.880391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:10.885280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:10.885960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:10.976165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:11.088774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:11.091058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:11.101921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.104575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.105041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.105776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.106289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.106731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.204250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:11.213674 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-baeb9939-ade5-4e5b-97f8-fefb96f1cbcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.353426 Oct 18 14:01:11.220314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3098/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:10 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:11.243089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:11.244297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:11.250711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.251484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.252100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.253232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.254696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.255445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.271016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:11.279857 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fb76bc8-56ac-4b73-ba81-04a2cda88de5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.195403 Oct 18 14:01:11.281312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2943/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:11 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:11.480192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4981d9-6100-4ec0-8c15-3840fd5cfb09", "tag": "367c602a-111e-490b-9abe-7c28080e774d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:11.498506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.499012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.501187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.531071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] Creating event network-changed:367c602a-111e-490b-9abe-7c28080e774d for instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 on n-h2-858383-13 Oct 18 14:01:11.544781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-69fc0de1-a353-4a8b-a08b-3b884f699427 req-2d4fdc78-a7c8-487d-870c-b5c81825b3cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068492 Oct 18 14:01:11.545469 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2944/6042] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:01:11.610972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:11.623714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1c19ded-5fc8-4626-b169-344b9930a3a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.384459 Oct 18 14:01:11.625427 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3099/6043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:11 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:11.657290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:11.657290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:11.670351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.670860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.671899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.672021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.672478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.672924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:12.260766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:12.273460 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-393c7c4a-3ce7-4156-b187-1a13fcb670ae tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.623233 Oct 18 14:01:12.280593 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2945/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:11 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:12.305666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:12.306514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:12.322861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:12.323600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:12.324204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:12.325115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:12.325729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:12.326338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:12.667910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:12.679181 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54c45422-1811-49a4-b2fa-e27c85391418 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.376562 Oct 18 14:01:12.682274 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3100/6045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:12 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:13.708051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:13.709278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:13.737822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.738834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.740754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:13.743075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.743744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.744906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:13.938115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:13.947497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06e91667-9140-496b-ba25-1a957acaa8b6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.243860 Oct 18 14:01:13.960858 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2946/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:13 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:14.971669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.972293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.975197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:14.979514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:14.991249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.995251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.996230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.998143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.999094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:15.002653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:15.283631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:15.292422 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1aa0f92-6667-4708-bc7b-1836d8607fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.324498 Oct 18 14:01:15.293417 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3101/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:14 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:16.320891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:16.323171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:16.333940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.360606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:16.361131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:16.361590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:16.362420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:16.363285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:16.363908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:16.396142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.684999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:16.697862 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ecefb99-3ce7-4725-a540-77ee37c483f6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.383159 Oct 18 14:01:16.700712 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2947/6048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:16 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:17.727820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:17.728460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:17.742502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:17.744747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:17.745540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:17.749258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:17.750099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:17.750708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:18.081439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:18.093425 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca993aed-09ad-4c2f-a678-f1e67cea8a82 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.373119 Oct 18 14:01:18.096560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3102/6049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:17 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:19.121013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:19.122309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:19.135340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.135853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.136330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.155100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.155725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.156191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.442254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:19.452309 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c1aec59-a26f-457c-ae1b-465bda709365 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.335937 Oct 18 14:01:19.453542 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2948/6050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:19 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:20.476920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:20.478274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:20.493650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.494198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.500529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.501420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.501921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.502429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.763339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:20.776751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fab561c-de66-462f-ae08-df08532f5cf8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1215 microversion: 2.1 time: 0.303649 Oct 18 14:01:20.777973 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3103/6051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:20 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:21.811037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:21.812380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:21.865116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:21.865669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:21.866439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:21.867882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:21.869531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:21.869985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:22.052747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:22.062879 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d27985a4-7400-49b1-8771-319f0585f553 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.266416 Oct 18 14:01:22.064588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2949/6052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:21 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:23.091184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:23.092217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:23.099199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:23.108412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:23.108412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.108412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:23.108412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:23.108412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.301613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:23.311899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-210548c7-9794-46bd-94c8-b1b4930f6da9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.224963 Oct 18 14:01:23.312507 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3104/6053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:23 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:24.339974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:24.341328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:24.352654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:24.353168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:24.353639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:24.354416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:24.354890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:24.355331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:24.523061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:24.536252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-471d2d20-8f04-4ecf-9b87-2f3b7a582760 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.200570 Oct 18 14:01:24.536252 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2950/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:24 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:25.556878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:25.557587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:25.565326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:25.566075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:25.570354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:25.570354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:25.570354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:25.570354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:25.733879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:25.742636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ef82353-cd69-40b7-b718-9935d4d91bd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.189809 Oct 18 14:01:25.743570 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3105/6055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:25 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:26.766621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:26.767585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:26.778487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.780197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.780944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:26.781777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.782380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.782955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:26.971349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:26.980207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c1ecfe9-ce81-4104-8ffc-10b4d471e157 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.217680 Oct 18 14:01:26.980795 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2951/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:26 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:28.004086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:28.004707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:28.012471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:28.016851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:28.016851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:28.016851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:28.016851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:28.016851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:28.150958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:28.159359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d445335-fc94-43d8-9ff5-7f3e03b0aa41 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.159599 Oct 18 14:01:28.159969 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3106/6057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:27 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:29.184161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:29.184786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:29.191757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.192251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.192699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.193388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.193917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.194421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.324814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:29.332784 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb7d48b8-a329-41b1-a368-526349edf96b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.153274 Oct 18 14:01:29.333352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2952/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:29 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:30.357007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:30.358876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:30.380231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:30.380839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:30.381359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:30.382183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:30.382721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:30.383233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:30.558399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:30.567010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fa3b717-0799-46a2-a529-af9b8aca2e04 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.214812 Oct 18 14:01:30.586803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3107/6059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:30 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:31.297907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4981d9-6100-4ec0-8c15-3840fd5cfb09", "name": "network-vif-plugged", "status": "completed", "tag": "367c602a-111e-490b-9abe-7c28080e774d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:31.317926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.319030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.319816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.337907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] Creating event network-vif-plugged:367c602a-111e-490b-9abe-7c28080e774d for instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 on n-h2-858383-13 Oct 18 14:01:31.345514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1fcf9de2-cf8a-4a45-8172-42533c485a22 req-ab94161f-c8cb-4fb5-957a-ee936b0cd0e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052644 Oct 18 14:01:31.352589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2953/6060] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:31.594288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:31.595502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:31.605153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.605650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.606347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.606856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.607301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.607779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.757720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:31.768966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1a9d795-b597-4cf1-907b-fb14a64d787c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.178495 Oct 18 14:01:31.782640 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3108/6061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:31 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:32.255349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:32.255946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:32.263180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.266823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.266823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.266823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.266823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.266823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.372428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lazy-loading 'services' on Instance uuid 93f5d781-f84a-42f6-b118-51199828dffd {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:01:32.638774 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f60f308-a6a8-44d4-bd3e-62366824b988 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd/os-volume_attachments/2d63d1af-b808-431b-9234-4e9075acd44a" status: 202 len: 0 microversion: 2.1 time: 0.388200 Oct 18 14:01:32.640319 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2954/6062] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:01:32 2022] DELETE /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd/os-volume_attachments/2d63d1af-b808-431b-9234-4e9075acd44a => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:32.794325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:32.794948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:32.801788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.802323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.802778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.803470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.803940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.804379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.987538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:32.996412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b738221-0ca0-4206-aa2a-0c4c0eeb5032 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1203 microversion: 2.1 time: 0.206601 Oct 18 14:01:32.997002 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3109/6063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:32 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.022502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.023499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.029710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=48 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:34.031891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.032399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.032854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.033573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.034045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.034517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.195315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:34.204124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29219e40-b10a-4254-9aab-8264a128f676 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1389 microversion: 2.1 time: 0.188140 Oct 18 14:01:34.208897 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2955/6064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:34 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1389 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.227361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.230876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.249455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.249987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.250608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.251511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.252020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.253026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.463617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:34.474006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80a43229-99c0-405b-b92c-0bea8229d18b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1389 microversion: 2.1 time: 0.249486 Oct 18 14:01:34.475014 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3110/6065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:34 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1389 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.499250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.500692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.507462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.508135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.508698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.509513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.511193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.511861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.709697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:34.718746 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81a07c12-2823-4d67-9881-06ab8bc5e261 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1389 microversion: 2.1 time: 0.224666 Oct 18 14:01:34.719344 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2956/6066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:34 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1389 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.742273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.743217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.746393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=45 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:34.750090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.750598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.751053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.751768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.752244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.752721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.778173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:01:35.099283 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47022b63-d4d7-46c0-988b-922f24b7f2ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 204 len: 0 microversion: 2.1 time: 0.360570 Oct 18 14:01:35.099916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3111/6067] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:01:34 2022] DELETE /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:01:35.109162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:35.109895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:35.117339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:35.117968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:35.118455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:35.119928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:35.120485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:35.120990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:35.277764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:35.291723 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45bf07a9-958d-458c-8ef2-dd7d4e40671b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1395 microversion: 2.1 time: 0.185903 Oct 18 14:01:35.292310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2957/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:35 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1395 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:36.315653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:36.317175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:36.326207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.326915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.330773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.330773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.330773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.330773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.539425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:36.562486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e8630ec-97cc-4701-a251-4403537a8d0e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1395 microversion: 2.1 time: 0.244591 Oct 18 14:01:36.563134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3112/6069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:36 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1395 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:37.414674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4981d9-6100-4ec0-8c15-3840fd5cfb09", "name": "network-vif-deleted", "tag": "367c602a-111e-490b-9abe-7c28080e774d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:37.428048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:37.428900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:37.429645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:37.448764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] Creating event network-vif-deleted:367c602a-111e-490b-9abe-7c28080e774d for instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 on n-h2-858383-13 Oct 18 14:01:37.461135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-532d2fe4-cba5-41a3-a55d-17c95c4d8879 req-1ac0f344-354c-4fe3-a226-93aa90763678 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050981 Oct 18 14:01:37.469310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2958/6070] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:37.584487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:37.585278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:37.607244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:37.608069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:37.608752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:37.609716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:37.610430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:37.611150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:37.657744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:37.761248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:37.773432 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98fa3c24-15ef-45d0-96bc-eda9b0bb107e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.194308 Oct 18 14:01:37.786598 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3113/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:37 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:38.690776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:38.691434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:38.698115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.698698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.699155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.699956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.700631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.701274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.731736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:01:38.807233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:38.807233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:38.809044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.809627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.810178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.811685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.812222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.813189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.898038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:38.908747 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b305c92-2bdb-439b-979f-e1d1b45c13f4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.113295 Oct 18 14:01:38.909297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3114/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:38 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:39.067262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f7fcdb4-e716-407a-b8f4-4d63852e10e2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 204 len: 0 microversion: 2.1 time: 0.381480 Oct 18 14:01:39.067861 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2959/6073] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:01:38 2022] DELETE /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:01:39.079369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:39.080005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:39.086847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.087353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.088363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.089102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.089576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.090016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.271615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:39.281595 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26485ed7-3fb9-45b0-ad03-c3d41c5dfd49 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1514 microversion: 2.1 time: 0.204271 Oct 18 14:01:39.282511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3115/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:39 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:39.813803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:39.818190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:39.828112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.828900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.830149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.839031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.841066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.843612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.932017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.942472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.018100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:40.028916 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11fcbc81-10d9-4e99-8242-e06395b1d359 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.100286 Oct 18 14:01:40.030066 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3116/6075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:39 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:40.120260 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9460e6b0-00ef-4944-bb12-acecc23931cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.570649 Oct 18 14:01:40.121667 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2960/6076] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:01:39 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:40.130387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:40.131160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:40.138999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.139716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.140175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.140886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.141354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.141916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.301568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:40.309174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:40.310630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:40.318394 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0c0380d-82df-4010-8ed2-93ce1f954c83 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1671 microversion: 2.1 time: 0.192708 Oct 18 14:01:40.324458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.325220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.327702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.328761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.330891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3117/6077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:40 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:40.341933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.341933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.520693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:40.535951 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5828ae56-ca98-412f-a45e-7518cfc58c6c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1514 microversion: 2.1 time: 0.234038 Oct 18 14:01:40.536549 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2961/6078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:40 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:41.052651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:41.054039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:41.066126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.066886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.069738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.070549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.071218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.071851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.243077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:41.255042 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a9e7b21-fd8f-480f-b53d-812da12bbf0b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.206199 Oct 18 14:01:41.256232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3118/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:41 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:41.344088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:41.345461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:41.353387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.355203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.356187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.357446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.358261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.358872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.397677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:41.561677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:41.562466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:41.576724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.579037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.579536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.581519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:41.582339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:41.583126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.667292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:41.685674 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63ae991b-a412-4d7c-86b6-48cc8eedb36a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1671 microversion: 2.1 time: 0.345623 Oct 18 14:01:41.686715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2962/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:41 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1671 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:41.876670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:41.885267 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc97cf60-8f94-4282-bf59-f771d41869b7 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1514 microversion: 2.1 time: 0.329314 Oct 18 14:01:41.886085 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3119/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:41 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:42.067501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f5d781-f84a-42f6-b118-51199828dffd", "name": "network-vif-deleted", "tag": "34136cb3-c3da-442d-a324-20b47a95e19f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:42.082948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.083690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.085981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.115292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] Creating event network-vif-deleted:34136cb3-c3da-442d-a324-20b47a95e19f for instance 93f5d781-f84a-42f6-b118-51199828dffd on n-h2-858383-13 Oct 18 14:01:42.130702 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c07370f2-fe77-4b68-a41e-fbcb20c349e2 req-cc359c98-73b3-48da-979c-a9892291a273 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068292 Oct 18 14:01:42.130702 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2963/6082] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:42.280497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:42.281781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:42.299801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.301981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.302703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.306414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.309040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.312386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.393882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:42.404268 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-603839d7-c142-48bc-8215-6a290f1a4f98 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.128872 Oct 18 14:01:42.423459 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3120/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:42 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:42.713842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:42.715182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:42.725220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.731971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.732482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.733537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.734030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.734869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.910808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:42.911458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:42.929733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.930274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.930937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.931845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.932465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.933079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.008175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:43.021103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:43.021103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.021103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lazy-loading 'fault' on Instance uuid 93f5d781-f84a-42f6-b118-51199828dffd {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:01:43.089693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:43.102234 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4379c85-2cc4-40db-b60d-fb74b002926d tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 200 len: 1309 microversion: 2.1 time: 0.195065 Oct 18 14:01:43.102849 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3121/6084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:42 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:43.133195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:43.142551 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88ee791e-1cb6-4060-a8f4-5aec7032d176 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.433512 Oct 18 14:01:43.143329 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2964/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:42 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:43.436851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:43.438275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:43.463472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:43.464315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:43.473333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.479312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:43.480132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:43.480809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.579936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:43.612892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4acc020d-52eb-4756-80ce-ea38f83f3b7a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1188 microversion: 2.1 time: 0.177023 Oct 18 14:01:43.615737 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3122/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:43 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:44.132208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:44.132846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 93f5d781-f84a-42f6-b118-51199828dffd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:44.140425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.140928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.141382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.142118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.142587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.143028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.158341 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] HTTP exception thrown: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Request method failure captured: Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd HTTP/1.1 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrDMy8Dj4iC1vesYtCGeJjypK_jIz0yRoNXIvrfQOeKcv9TM1JU7_zvqwMCo4mVUyOIgpeXam0kqsX-sve-JteHa7kCqv3atnEj4ITD_jpWYJV3hdX9GXDSYeVd4GHRb88EAiFLVEJeB_vatvTaEg6rviuxklxj7cAxw0ry_P4r_naM Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 480e0bfa755e4b99bb01ea3084d7c214 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 480e0bfa755e4b99bb01ea3084d7c214 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesSnapshotTestJSON-1994933526-project Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b28a5b73e4fa4ce0aadd144e09a6f977 Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesSnapshotTestJSON-1994933526-project Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93f5d781-f84a-42f6-b118-51199828dffd'} Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:44.160355 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. Oct 18 14:01:44.165153 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:44.167127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Returning 404 to user: Instance 93f5d781-f84a-42f6-b118-51199828dffd could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:01:44.168538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14081a39-f3ef-432f-a4aa-6b0c803b13ca tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd" status: 404 len: 111 microversion: 2.1 time: 0.044162 Oct 18 14:01:44.169136 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2965/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:44 2022] GET /compute/v2.1/servers/93f5d781-f84a-42f6-b118-51199828dffd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:01:44.638146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:44.638774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:44.645966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.646497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.646944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.647826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.648295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.648730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.719944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.720450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.720903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.721371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid cc4981d9-6100-4ec0-8c15-3840fd5cfb09 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:01:44.797928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:44.832159 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4447f5b-e8ea-4108-b2b2-70b65da4b79c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 200 len: 1193 microversion: 2.1 time: 0.198826 Oct 18 14:01:44.833100 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3123/6088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:44 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 1193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:45.860621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:45.861782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: cc4981d9-6100-4ec0-8c15-3840fd5cfb09] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:45.883425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:45.884391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:45.885072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:45.886035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:45.886806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:45.887571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:45.928156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 HTTP/1.1 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'cc4981d9-6100-4ec0-8c15-3840fd5cfb09'} Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:45.933816 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:01:45.938647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance cc4981d9-6100-4ec0-8c15-3840fd5cfb09 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:01:45.943375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18569738-6544-4e6e-94e2-23c34b584ab2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09" status: 404 len: 111 microversion: 2.1 time: 0.081897 Oct 18 14:01:45.944234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2966/6089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:45 2022] GET /compute/v2.1/servers/cc4981d9-6100-4ec0-8c15-3840fd5cfb09 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:01:55.987398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1868985973", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "10c6a87e-7cfd-475d-9053-0b02d916416b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:56.010199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:56.010959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=66 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:56.063468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] validate_networks() for [('10c6a87e-7cfd-475d-9053-0b02d916416b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:01:56.762742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:01:56.763177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:01:56.763667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:01:56.764359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:01:56.764999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:01:56.786166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:56.786762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:56.787232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:56.788219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:56.789726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:56.792773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:56.835682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Getting quotas for project 480e0bfa755e4b99bb01ea3084d7c214. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:01:56.850776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Getting quotas for user b28a5b73e4fa4ce0aadd144e09a6f977 and project 480e0bfa755e4b99bb01ea3084d7c214. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:01:56.883208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:01:56.890177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:01:57.090962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da43ec9a-9412-4ff7-88cb-3f778052be8f tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107625 Oct 18 14:01:57.092708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3124/6090] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:01:57.104718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fcc598e-f145-4e7a-8325-b209274214dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:57.105365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fcc598e-f145-4e7a-8325-b209274214dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:57.121746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:57.128902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=17 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:57.247399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fcc598e-f145-4e7a-8325-b209274214dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:57.263072 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fcc598e-f145-4e7a-8325-b209274214dc tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1219 microversion: 2.1 time: 0.159509 Oct 18 14:01:57.263072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2967/6091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:57 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:58.285139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:58.285718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:58.294538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:58.295410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:58.296033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:58.296760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:58.297228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:58.297668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:58.479241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:58.523698 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-667bfae3-5630-46ef-bfb1-7befe465eb83 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1223 microversion: 2.1 time: 0.239421 Oct 18 14:01:58.524397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3125/6092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:58 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1223 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:59.551558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:59.552198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:59.565764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:59.577004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:59.577744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:59.579942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:59.581051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:59.582772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:59.795129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:59.816021 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-66416a51-73e4-42a3-82c3-f1f53f26774e tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1271 microversion: 2.1 time: 0.268465 Oct 18 14:01:59.826459 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2968/6093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:59 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:00.856823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:00.857410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:00.868966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:00.872951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:00.873739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:00.875818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:00.877966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:00.879729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:01.114748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:01.123482 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91f075aa-06d7-44f1-907d-681d9523f0af tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1277 microversion: 2.1 time: 0.271707 Oct 18 14:02:01.135203 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3126/6094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:00 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:02.157200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:02.158588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:02.177189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:02.177960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:02.178632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:02.179725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:02.184800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:02.184800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:02.693401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:02.721129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2dc177e6-48bc-42cb-8b00-7d2dd3d9d415 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.567510 Oct 18 14:02:02.722315 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2969/6095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:02 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:03.365233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067b4b58-17b0-41ce-bc4c-4d801e3d60b9", "tag": "06c9cb43-cc30-42a0-b94c-6af886a4edf6"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:03.392855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:03.400968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:03.401802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:03.448998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] Creating event network-changed:06c9cb43-cc30-42a0-b94c-6af886a4edf6 for instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 on n-h2-858383-13 Oct 18 14:02:03.458906 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ab16d8d0-461e-4754-8cd4-ad95ff0b6e72 req-bcd52952-9cb3-4cd0-b729-b67574e554eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097463 Oct 18 14:02:03.459874 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3127/6096] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:03.763715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:03.765553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:03.780749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:03.782718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:03.783593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:03.791153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:03.792987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:03.793693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:04.153648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:04.175709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a4b608f-3fd7-40a6-b60d-0d9956dde837 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.424546 Oct 18 14:02:04.176361 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2970/6097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:03 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:05.206801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:05.209074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:05.254409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:05.256727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:05.257933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:05.260002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:05.262044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:05.264014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:06.084948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:06.101487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a59d045e-8903-42bb-b358-9ebb42e2acd9 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.905060 Oct 18 14:02:06.106819 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3128/6098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:05 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:07.133232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:07.134815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:07.144429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:07.146336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:07.149940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:07.149940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:07.149940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:07.149940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:07.251374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:07.855770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:07.864689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8e334a6-a6e1-4a5e-8303-b33d68ac34d5 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.735505 Oct 18 14:02:07.866213 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2971/6099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:07 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:08.891477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:08.895824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:08.898769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:08.899724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:08.901738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:08.902536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:08.903220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:08.904119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:08.904745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:08.905614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:09.378636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:09.395559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e43f0553-da55-40ac-9b8c-997cbcf5eac3 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.508205 Oct 18 14:02:09.396741 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3129/6100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:08 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:10.357817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b4b58-17b0-41ce-bc4c-4d801e3d60b9", "name": "network-vif-plugged", "status": "completed", "tag": "06c9cb43-cc30-42a0-b94c-6af886a4edf6"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:10.374371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:10.378886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:10.379874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:10.412929 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] Creating event network-vif-plugged:06c9cb43-cc30-42a0-b94c-6af886a4edf6 for instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 on n-h2-858383-13 Oct 18 14:02:10.421359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:10.422366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:10.431669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bf9746a3-21e4-4946-b6d3-2d0e074e346b req-44f94712-c092-44aa-84bd-559eb8e73bd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382207 Oct 18 14:02:10.433409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:10.434130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:10.434811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2972/6101] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:10.435268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:10.437882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:10.438476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:10.438999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:10.764857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:10.773265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-795fc623-ad5b-4f96-8275-ac5e9e21d808 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.355656 Oct 18 14:02:10.775701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3130/6102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:10 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:11.800557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:11.802767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:11.811866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:11.812637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:11.813093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:11.814108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:11.814873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:11.815475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:12.044888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:12.053112 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58a41bb2-f4ad-460f-a9b4-e52c6f5d56d6 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1319 microversion: 2.1 time: 0.259448 Oct 18 14:02:12.055709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2973/6103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:11 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:13.077324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:13.078454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:13.107222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:13.109105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:13.110424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:13.115314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:13.116208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:13.116957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:13.292997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:13.301515 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c470ea49-b58a-41a5-ac47-2ad425db51f2 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1508 microversion: 2.1 time: 0.228371 Oct 18 14:02:13.302124 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3131/6104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:13 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:13.325413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a8ce583-afcd-4c8c-abec-c7b9ebec1084", "device": "/dev/sdb"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:13.328256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:13.336204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:13.336774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:13.337392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:13.338146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:13.338887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:13.339500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:14.398857 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2303a0fd-c8d8-49d4-849f-f0c151099475 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "POST /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053301 Oct 18 14:02:14.398857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2974/6105] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:02:13 2022] POST /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9/os-volume_attachments => generated 194 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:16.111099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:16.112379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:16.127594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.131001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.132296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:16.135812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.137161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.138469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:16.416162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:16.430203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f7fe50f-628c-405f-80c4-d149b5c362ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.322719 Oct 18 14:02:16.432907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3132/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:16 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:16.461619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:16.463715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:16.471934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.472812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.473497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:16.474476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.475166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.475825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:16.730307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:16.747674 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71c082c2-ca0d-47e2-9086-95ec322b1b18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.288103 Oct 18 14:02:16.752482 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2975/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:16 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:16.776501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:16.777142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:16.783425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.785426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.786229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:16.787399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:16.788027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:16.788896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:17.070421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:17.085715 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be23721f-b596-4d94-ba23-5a128330b676 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.310995 Oct 18 14:02:17.088221 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3133/6108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:16 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:17.116612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:17.117363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:17.127776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:17.128278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:17.134628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:17.139588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:17.139588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:17.139588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:17.418273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:17.434588 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec0fcb4a-a5a1-45e8-acb9-f02e1b557008 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.321577 Oct 18 14:02:17.447542 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2976/6109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:17 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:17.648889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1223126716", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1ec6368a-adbd-48ea-b80b-75176c1a2ea1"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:17.675645 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:02:17.675836 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:02:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 18 14:02:17.802803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] validate_networks() for [('1ec6368a-adbd-48ea-b80b-75176c1a2ea1', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:02:19.103722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:02:19.104802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:02:19.106483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:02:19.110658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:02:19.114786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:02:19.134112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:19.134886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:19.135724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:19.136668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:19.137155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:19.137655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:19.171853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:02:19.189988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:02:19.221864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:02:19.224821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:02:19.367732 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e645e821-78ec-414d-b6fc-499f0242d0c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723536 Oct 18 14:02:19.368671 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3134/6110] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:02:19.382027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b54992a8-ed71-4782-b662-e90102b2497e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:19.382700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b54992a8-ed71-4782-b662-e90102b2497e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:19.539570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b54992a8-ed71-4782-b662-e90102b2497e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:19.547924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b54992a8-ed71-4782-b662-e90102b2497e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1215 microversion: 2.1 time: 0.171573 Oct 18 14:02:19.551291 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2977/6111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:19 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:20.575050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7d999b2-1adc-4132-ae46-7063ba091a5e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:20.575050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f7d999b2-1adc-4132-ae46-7063ba091a5e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:20.648719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f7d999b2-1adc-4132-ae46-7063ba091a5e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:20.664888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7d999b2-1adc-4132-ae46-7063ba091a5e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1215 microversion: 2.1 time: 0.095703 Oct 18 14:02:20.665940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3135/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:20 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:21.692100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:21.692861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:21.704288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:21.705401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:21.706329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:21.708215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:21.708886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:21.709545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:21.804895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:21.816365 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2108e5de-4c28-4579-8e9b-1ea2d7090977 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1211 microversion: 2.1 time: 0.130495 Oct 18 14:02:21.832707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2978/6113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:21 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1211 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:22.848896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:22.850409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:22.872277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:22.874332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:22.874962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:22.879053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:22.879053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:22.879053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:22.982958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:22.993647 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e09bd00-0afd-4f3c-a5ac-d3c3fabafeb3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1267 microversion: 2.1 time: 0.152325 Oct 18 14:02:22.998874 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3136/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:22 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:24.020337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:24.021524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:24.046082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:24.201682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:24.211672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7887593e-48ab-4ee2-a008-f5213c469356 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1273 microversion: 2.1 time: 0.195663 Oct 18 14:02:24.213311 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2979/6115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:24 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:25.240789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:25.242166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:25.251909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:25.252796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:25.255243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:25.256565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:25.257215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:25.257809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:25.419278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:25.428848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7c3b1e2-c307-4f1b-a55e-e70740349187 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.192146 Oct 18 14:02:25.429995 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3137/6116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:25 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:26.012894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff5bc04-7e59-4422-8828-74a938f53d92", "tag": "6bd02a18-4984-4eea-ab72-dc57a74eb3e9"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:26.023872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:26.024653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:26.025265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:26.046716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] Creating event network-changed:6bd02a18-4984-4eea-ab72-dc57a74eb3e9 for instance 5ff5bc04-7e59-4422-8828-74a938f53d92 on n-h1-858383-13 Oct 18 14:02:26.046716 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4befef77-d0bb-4582-ba2f-50a861eb2cde req-2a239ab8-4c2d-4974-b9cf-cb0002a9f524 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036620 Oct 18 14:02:26.046716 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2980/6117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:26.453474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:26.454553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:26.457958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:26.463944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:26.464984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:26.465642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:26.466549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:26.467892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:26.468486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:26.471967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=67 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:26.631389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:26.641451 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b63c600c-f1a5-42b3-a3be-0eb0dc23fad9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.193337 Oct 18 14:02:26.643063 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3138/6118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:26 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:27.667317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:27.668201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:27.674706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:27.675221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:27.675949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:27.676671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:27.677148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:27.677591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:27.683455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:27.826835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:27.836099 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0428b62f-1a1f-4b62-b359-a019a2bc50fa tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.174697 Oct 18 14:02:27.839006 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2981/6119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:27 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:28.865890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:28.865890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:28.872948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:28.873540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:28.873931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:28.875006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:28.875515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:28.876314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:29.085673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:29.099360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-189a1cce-832f-4717-9bc1-12512fb06f3a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.243830 Oct 18 14:02:29.100494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3139/6120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:28 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:30.124757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:30.125996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:30.129644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:30.130364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=35 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:30.136102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:30.141138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:30.141138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:30.141138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:30.141138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:30.141138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:30.313889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:30.324712 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-235c7c78-c31f-4c05-bff8-e343cac91951 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.203738 Oct 18 14:02:30.325322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2982/6121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:30 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:31.353292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:31.353923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:31.362353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:31.364259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:31.365930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.367701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.370927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.372845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.373670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.374135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.618394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:31.627955 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8e0e1f4-6c81-419e-bcca-d25042e8430e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.279069 Oct 18 14:02:31.629318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3140/6122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:31 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:32.653780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:32.654447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:32.676521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.676995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.677557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.678208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.687146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.687725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.888740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff5bc04-7e59-4422-8828-74a938f53d92", "name": "network-vif-plugged", "status": "completed", "tag": "6bd02a18-4984-4eea-ab72-dc57a74eb3e9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:32.903663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.904158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.904659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.920993 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] Creating event network-vif-plugged:6bd02a18-4984-4eea-ab72-dc57a74eb3e9 for instance 5ff5bc04-7e59-4422-8828-74a938f53d92 on n-h1-858383-13 Oct 18 14:02:32.931012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b760866d-e8e1-43bd-9666-3f29c1983ba3 req-9245c3fa-4428-4e5c-b2df-61658ac9cd3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045846 Oct 18 14:02:32.932258 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3141/6123] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:02:32.963572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:32.973697 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9a1e2b0-ca6b-4862-8691-4b47aa7418b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.324533 Oct 18 14:02:32.974924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2983/6124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:32 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:34.005295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:34.005854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:34.013354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:34.013979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:34.014589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:34.015558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:34.016097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:34.016635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:34.261616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:34.271306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52013329-5b14-4287-b0b6-7ef0752998e9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1315 microversion: 2.1 time: 0.274125 Oct 18 14:02:34.277119 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3142/6125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:33 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:35.300390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:35.300997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:35.309128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.309969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.310687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.311644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.312390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.313052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.486018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:35.505325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba500b16-cfd1-47d5-81b2-55084b177aa7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1502 microversion: 2.1 time: 0.208597 Oct 18 14:02:35.505758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2984/6126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:35 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:35.532716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:35.533281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:35.544190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.544704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.545581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.546529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.546998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.552018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.762353 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Removing security group ae00385f-7c87-4cab-92aa-8ff15f890861 from port 6bd02a18-4984-4eea-ab72-dc57a74eb3e9 Oct 18 14:02:36.359006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eae65eaa-3e32-4f5a-bbd3-aa9cd70f7481 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92/action" status: 202 len: 0 microversion: 2.1 time: 0.830504 Oct 18 14:02:36.360974 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3143/6127] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:35 2022] POST /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:02:36.371869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:36.371869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:36.377225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff5bc04-7e59-4422-8828-74a938f53d92", "tag": "6bd02a18-4984-4eea-ab72-dc57a74eb3e9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:36.382716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.388043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.388792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.391286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.392039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.395941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.402328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.405518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.406260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.435289 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] Creating event network-changed:6bd02a18-4984-4eea-ab72-dc57a74eb3e9 for instance 5ff5bc04-7e59-4422-8828-74a938f53d92 on n-h1-858383-13 Oct 18 14:02:36.448749 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8f21d58f-887b-4e0d-b03d-1226236b80a3 req-cbcfc642-01cf-4a6b-8beb-f5ec1e166d20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077393 Oct 18 14:02:36.459144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3144/6128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:02:36.617496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:36.638902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc4f08ce-1731-484b-923f-64dd2430e9bb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1460 microversion: 2.1 time: 0.273046 Oct 18 14:02:36.639811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2985/6129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:36 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1460 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:36.665292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:36.666007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:36.675357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.675858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.676301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.678304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.678958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.679551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.944907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:36.966766 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56a71132-260a-4ff9-85e1-eeafb03b3202 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.302836 Oct 18 14:02:36.972123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3145/6130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:36 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:36.997227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:36.997860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:37.008653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.014689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.019779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.020148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.021462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.025191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.314886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:37.326894 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-989e984b-d139-4d67-9a3a-f5c4ea519d26 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.334498 Oct 18 14:02:37.328500 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2986/6131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:36 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:37.353322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:37.353913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:37.367399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.367663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.368337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.369205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.369821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.370452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.673278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:37.690132 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0732df61-08f0-4c44-a542-3a7e58c7ff3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.337520 Oct 18 14:02:37.691087 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3146/6132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:37 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:37.713460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:37.714141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:37.725108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.741255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.741255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.741255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.741255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.741255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.923569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:37.935544 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f24ca86e-ff75-443f-863a-1c4e2683dd18 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.226585 Oct 18 14:02:37.941920 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2987/6133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:37 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:38.253827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-724076387", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "1ec6368a-adbd-48ea-b80b-75176c1a2ea1"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:38.342021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] validate_networks() for [('1ec6368a-adbd-48ea-b80b-75176c1a2ea1', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:02:39.104147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:02:39.104784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:02:39.106016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:02:39.106016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:02:39.106016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:02:39.121566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:39.122670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:39.123490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:39.124542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:39.125177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:39.125785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:39.161029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:02:39.168176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Getting quotas for user 7963aa7a74c147cdab99b56131a66842 and project 4474d29a061642a2820fab69697ea4fe. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:02:39.195049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:02:39.198343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:02:39.381606 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b875f719-d6e3-4c3d-8025-df6d122c3fc7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131818 Oct 18 14:02:39.383624 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3147/6134] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:02:39.394283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1fb3f48a-2381-472b-aea6-c8ea1850e270 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:39.395308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1fb3f48a-2381-472b-aea6-c8ea1850e270 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:39.459616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1fb3f48a-2381-472b-aea6-c8ea1850e270 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:39.469968 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1fb3f48a-2381-472b-aea6-c8ea1850e270 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1214 microversion: 2.1 time: 0.079079 Oct 18 14:02:39.485726 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2988/6135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:39 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:40.492958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:40.493593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:40.506940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.507421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.508227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:40.510885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.513265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.517368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:40.645496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:40.664778 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7eff7a1-aa1a-45a2-80ed-7cc67a8a2899 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1218 microversion: 2.1 time: 0.175369 Oct 18 14:02:40.667101 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3148/6136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:40 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:41.232610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-356268970", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "70cdee87-eb9d-47be-837a-1c6df4dc3ff5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:41.374573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:02:41.690583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:41.691332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:41.715907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.716988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.719143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.722615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.724028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.724959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.804979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:41.814184 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-710d1022-be76-449c-a482-38ac838908a9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1266 microversion: 2.1 time: 0.128306 Oct 18 14:02:41.814984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3149/6137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:41 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:41.962694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:02:41.963332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:02:41.963598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:02:41.964189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:02:41.964756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:02:41.973870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.974405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.974853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.975585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.976044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.976486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.003061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:02:42.010230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:02:42.024663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:02:42.027588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='70cdee87-eb9d-47be-837a-1c6df4dc3ff5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:02:42.287185 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5e67b6b-0eda-4d67-a354-3a5c75b27463 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059102 Oct 18 14:02:42.287825 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2989/6138] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:02:42.299428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0881eaef-8ca1-436f-8bf8-99424e405e00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:42.300051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0881eaef-8ca1-436f-8bf8-99424e405e00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:42.377950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0881eaef-8ca1-436f-8bf8-99424e405e00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:42.385673 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0881eaef-8ca1-436f-8bf8-99424e405e00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1056 microversion: 2.1 time: 0.090287 Oct 18 14:02:42.386297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3150/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:42 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1056 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:42.849515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:42.857426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:42.866252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.867355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.868125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.869931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.870699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.871900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.959872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:42.970364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-145cb003-ef88-4865-a8cb-13483d90dcc1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1284 microversion: 2.1 time: 0.135080 Oct 18 14:02:42.971198 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2990/6140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:42 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:43.410783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-afa49cb4-0359-44d3-8aa2-9ad0e455abee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:43.410783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-afa49cb4-0359-44d3-8aa2-9ad0e455abee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:43.539355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-afa49cb4-0359-44d3-8aa2-9ad0e455abee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:43.547323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-afa49cb4-0359-44d3-8aa2-9ad0e455abee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1056 microversion: 2.1 time: 0.141518 Oct 18 14:02:43.548444 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3151/6141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:43 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1056 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:43.996294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:43.998839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:44.009273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.010001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.011743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.012938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.013669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.014308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.244633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:44.255573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5705ec0-9a90-4312-906e-001bf458da15 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.264157 Oct 18 14:02:44.256772 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2991/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:43 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:44.573620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:44.573620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:44.584673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.585180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.585826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.599151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.599669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.600131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.775431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:44.799853 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cd04b77-53b3-421a-89b1-4693e91d397c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1108 microversion: 2.1 time: 0.231202 Oct 18 14:02:44.801752 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3152/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:44 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1108 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:44.982856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961de213-c6bf-4673-931d-450a4fac84cd", "tag": "d1e1c0b6-af57-490c-82f3-743177ffd89b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:44.995419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.996286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.996948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.037868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] Creating event network-changed:d1e1c0b6-af57-490c-82f3-743177ffd89b for instance 961de213-c6bf-4673-931d-450a4fac84cd on n-h2-858383-13 Oct 18 14:02:45.060427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-559192ee-6c2a-4cf9-b967-66635062e079 req-880ebeaf-6d65-4348-919a-db99c069156f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081060 Oct 18 14:02:45.061799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2992/6144] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:45.290237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:45.291535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:45.298672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.299342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.299799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.300544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.301014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.301483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.829272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:45.832045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:45.841173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.842289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.842931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.844078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.844899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.845817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.970600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:45.985885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7697de7e-683b-4024-af4f-44bdcb5cde4c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1126 microversion: 2.1 time: 0.162027 Oct 18 14:02:46.005946 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2993/6145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:45 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1126 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:46.023023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:46.038483 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16c14a0b-41de-4e58-bb4c-035816793bef tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.752914 Oct 18 14:02:46.039079 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3153/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:45 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:47.012644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:47.013284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:47.020859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.021522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.021968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.022796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.023280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.023731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.065304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:47.065924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:47.079069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.079872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.080448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.081166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.081820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.082295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.457977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:47.467930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:47.480376 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba0ef4d2-8ef6-4823-af8b-b42f563b8df1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.418516 Oct 18 14:02:47.481497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3154/6147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:47 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:47.483620 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb340efb-9a9c-41ed-bf59-7a8fad1a4116 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.474970 Oct 18 14:02:47.499081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2994/6148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:47 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:48.512153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:48.514047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:48.515235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:48.517257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:48.533738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.536745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.538220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.538507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.539159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.540574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.541854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.543005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.543685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.544901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.545252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.549103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.878031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:48.891376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82ae9ae6-0311-4c97-a457-69c05bc31018 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.388057 Oct 18 14:02:48.908262 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2995/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:48 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:48.921886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:48.932456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6726c792-f2c3-4c93-9eb3-f6eb2ab3a511 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.428607 Oct 18 14:02:48.937590 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3155/6150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:48 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:49.029086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b99074-c015-4aa0-9e48-1abf4508ea30", "tag": "2bd13ae8-0282-4f40-8633-8c5d01f393cc"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:49.041100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.042738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.043364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.069775 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] Creating event network-changed:2bd13ae8-0282-4f40-8633-8c5d01f393cc for instance 17b99074-c015-4aa0-9e48-1abf4508ea30 on n-h1-858383-13 Oct 18 14:02:49.083406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-07826e99-78b9-42e9-8cca-b3c8a12c29af req-b4241ab0-2eb5-4984-b24c-9882fd7b76a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065854 Oct 18 14:02:49.084665 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2996/6151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:49.932515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:49.935019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:49.956088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:49.960637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.963427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.965492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.966003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:49.967540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.968305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:49.969042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.969632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.998145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.002127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.002717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.007400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.009873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.010378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.235479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:50.259200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-940ff2c6-d99f-4308-a2b4-cf4f37bb9631 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.340307 Oct 18 14:02:50.260237 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3156/6152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:49 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:50.424884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:50.425466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:50.464066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.465425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.475845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.476713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.478718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.479168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.517403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:50.547676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f2b9926-16ef-4d6f-8648-b1e3c6b8a37e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.587142 Oct 18 14:02:50.549374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2997/6153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:49 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:50.711106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lazy-loading 'services' on Instance uuid 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:02:51.000305 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa912e86-3da9-4da2-8695-1f601079f8c8 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "DELETE /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9/os-volume_attachments/8a8ce583-afcd-4c8c-abec-c7b9ebec1084" status: 202 len: 0 microversion: 2.1 time: 0.579613 Oct 18 14:02:51.018216 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3157/6154] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:02:50 2022] DELETE /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9/os-volume_attachments/8a8ce583-afcd-4c8c-abec-c7b9ebec1084 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:02:51.292606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.293357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.300881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.301697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.302380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.303541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.304208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.304850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.542981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.542981 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c831d51-69a9-43e1-883d-876d2ad048fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.222049 Oct 18 14:02:51.542981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2998/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:51.572774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.573761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.588732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.589275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.589737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.591295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.593418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.597444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.629571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:51.799481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.818350 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5fa2fca-f207-45ae-82e7-de6238a95ea9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.240135 Oct 18 14:02:51.818350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3158/6156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:52.319658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961de213-c6bf-4673-931d-450a4fac84cd", "name": "network-vif-plugged", "status": "completed", "tag": "d1e1c0b6-af57-490c-82f3-743177ffd89b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:52.329649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:52.331137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:52.342776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.346000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.347296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.364606 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] Creating event network-vif-plugged:d1e1c0b6-af57-490c-82f3-743177ffd89b for instance 961de213-c6bf-4673-931d-450a4fac84cd on n-h2-858383-13 Oct 18 14:02:52.377198 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1cf3cabb-c89f-42d8-8cdb-2d442e01538f req-d3d22038-e6cb-445a-a422-aa3186db2435 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061203 Oct 18 14:02:52.377913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 2999/6157] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:52.567079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:52.571159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:52.589363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.590125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.593863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.593863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.593863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.593863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.805864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:52.810664 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6dcaca0d-0071-4766-8219-36d1025c5375 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.250006 Oct 18 14:02:52.811508 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3159/6158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:52 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:52.840140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:52.840818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:52.850750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.851838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.854040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.857116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.860620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.861244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.024080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:53.034028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d3516c6-78c8-4779-9e83-9af3d2b92bd6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1314 microversion: 2.1 time: 0.203544 Oct 18 14:02:53.035424 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3000/6159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:52 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:53.846521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:53.847768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:53.849883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:53.862945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.863734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.864188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.865081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.866027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.866651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.062342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:54.063739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.079177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.119047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:54.127285 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e801a569-6267-4f68-aa59-91d3a18350c1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.284833 Oct 18 14:02:54.128015 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3160/6160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:53 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:54.140420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:54.322664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:54.331335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff8aa39b-9a72-4175-89f8-b25b311da052 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1502 microversion: 2.1 time: 0.273834 Oct 18 14:02:54.331927 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3001/6161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:54 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:54.397515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:54.398097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:54.406921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.407447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.407879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.409472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.410017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.410529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.712941 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c72d7c6c-07ff-4ad9-acd6-12812141a889 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd/action" status: 202 len: 0 microversion: 2.1 time: 0.323968 Oct 18 14:02:54.714707 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3161/6162] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:54 2022] POST /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:02:54.723409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:54.724046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:54.732525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.733047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.734191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.739925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.739925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.739925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.924209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:54.935427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e237e85a-f10d-4e6d-a77c-715956a33dcf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1507 microversion: 2.1 time: 0.216103 Oct 18 14:02:54.941736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3002/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:54 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:55.159491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:55.160862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:55.171553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:55.172084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:55.172543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:55.173259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:55.173722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:55.174309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:55.398126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:55.414534 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f07aedda-ddfd-4135-849e-c02c0a7f18bc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.259608 Oct 18 14:02:55.416298 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3162/6164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:55 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:55.959469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:55.960229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:55.970551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:55.972023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:55.973322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:55.974813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:55.977952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:55.980251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.199186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:56.211187 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8473a19-4c03-442d-b54f-a37f7c232129 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1487 microversion: 2.1 time: 0.255699 Oct 18 14:02:56.213374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3003/6165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:55 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:56.243215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:56.243898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:56.254623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.255209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.255766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.256588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.258749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.259293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.288946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lazy-loading 'flavor' on Instance uuid 961de213-c6bf-4673-931d-450a4fac84cd {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:02:56.440400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:56.442135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:56.475609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.478787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.479547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.480306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.480782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.481533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.654796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:56.664925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7000d512-d5d3-4fac-89a5-14778d1b9815 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.230629 Oct 18 14:02:56.666303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3004/6166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:56 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:56.940646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-975f0eae-f479-44ba-b622-46fd1db1740e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd/action" status: 202 len: 0 microversion: 2.1 time: 0.699659 Oct 18 14:02:56.941572 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3163/6167] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:56 2022] POST /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:02:56.964516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:56.965163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:56.972676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.973173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.973995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.975049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.975877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.976480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.162394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:57.175983 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75b3f30b-129b-4a03-95db-00a2c0a9e877 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1493 microversion: 2.1 time: 0.222282 Oct 18 14:02:57.177433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3005/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:56 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1493 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:57.694264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:57.696390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:57.704641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.705147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.705594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.706331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.706798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.707300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.890430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:57.899683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9de9168-5e7d-4110-a489-2035d07600c8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.213050 Oct 18 14:02:57.902132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3164/6169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:57 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:58.209449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:58.213450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:58.224251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.224917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.225657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.226410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.227749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.228636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.463127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:58.473187 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fb25ae52-9e72-4060-a266-c5e184ae571a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1514 microversion: 2.1 time: 0.268201 Oct 18 14:02:58.474243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3006/6170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:58 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:58.932508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:58.938792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:58.945812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:58.947828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.948333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.948784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.949501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.950143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.950577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.136683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:59.145450 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc794a79-e107-4fe0-8c02-32276dbfeacc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.223144 Oct 18 14:02:59.161529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3165/6171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:58 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:59.499609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:59.499609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:59.527886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:59.528541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:59.532402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.536694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.536694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.536694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.536694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.536694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.538203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.538825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.540079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.540975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.541547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.542445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.667347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:02:59.907377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:59.917051 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25ee6819-805f-4da2-9171-00495df7120c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.423705 Oct 18 14:02:59.931165 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3007/6172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:59 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:00.091524 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f82d3da2-47bd-4a80-8533-1385601f381c tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "DELETE /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 204 len: 0 microversion: 2.1 time: 0.569554 Oct 18 14:03:00.092417 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3166/6173] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:02:59 2022] DELETE /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:03:00.101119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:00.102228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:00.108975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.109779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.110536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.111468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.112146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.113105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.174608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:00.175630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:00.197104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.197788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.198331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.199262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.204404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.204404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.416784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:00.425847 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-284c6583-bb55-407d-ba46-ddb1a28e6b58 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1514 microversion: 2.1 time: 0.329288 Oct 18 14:03:00.431969 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3008/6174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:00 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:00.607260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:00.631195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23cddf84-2007-4b4d-8866-587b17b17d1a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.451850 Oct 18 14:03:00.631195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3167/6175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:00 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:00.943330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:00.943964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:00.955092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.956538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.957292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.958306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.958949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.959571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.309868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:01.321897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cf26265-75ea-4f2c-a79b-a58edbb75acf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.380783 Oct 18 14:03:01.339269 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3009/6176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:00 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:01.461697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:01.462822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:01.497639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.499597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.500269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.501028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.501501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.501939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.659743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:01.659743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:01.661493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.662023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.666287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.671667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.672306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.672306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.940688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:01.965291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:01.971011 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd890420-6186-43cf-abc8-da9e59cd2472 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1514 microversion: 2.1 time: 0.517368 Oct 18 14:03:01.975695 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3168/6177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:01 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1514 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:01.989872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e577a5c-0f33-4850-a003-cb6384a6c8ec tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.342527 Oct 18 14:03:02.006670 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3010/6178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:01 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:02.167399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961de213-c6bf-4673-931d-450a4fac84cd", "name": "network-vif-plugged", "status": "completed", "tag": "d1e1c0b6-af57-490c-82f3-743177ffd89b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:02.188863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:02.189675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:02.191191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:02.209554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] Creating event network-vif-plugged:d1e1c0b6-af57-490c-82f3-743177ffd89b for instance 961de213-c6bf-4673-931d-450a4fac84cd on n-h2-858383-13 Oct 18 14:03:02.218930 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a9da0264-6fc2-4423-9f52-2e401cbb1fd6 req-9d625c9e-3f72-4b22-b85f-1f3af13859ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057459 Oct 18 14:03:02.220576 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3169/6179] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:02.350539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:02.351341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:02.372642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:02.373305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:02.374021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:02.375250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:02.377421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:02.378995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:02.604900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:02.648241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa0962d2-3056-45c5-bcd2-bce1a3af91cf tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.302925 Oct 18 14:03:02.649069 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3011/6180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:02 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:02.948755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b4b58-17b0-41ce-bc4c-4d801e3d60b9", "name": "network-vif-deleted", "tag": "06c9cb43-cc30-42a0-b94c-6af886a4edf6"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:02.998540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.026706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.026706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.026947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:03.026947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:03.027487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] Creating event network-vif-deleted:06c9cb43-cc30-42a0-b94c-6af886a4edf6 for instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 on n-h2-858383-13 Oct 18 14:03:03.027588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:03.027687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-39e7fe12-d92f-4c9b-81cf-19ecf2f40468 req-4b71158a-f96e-47e2-b388-d3e62bc8fe58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083189 Oct 18 14:03:03.027978 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3170/6181] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:03.036535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.040926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.051020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.051232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:03.052067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:03.055654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.062408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.064803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.066975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.072655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.072655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.072655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.072655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.072655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.244048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:03.252603 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2e8c179f-85c1-4605-a8f2-1c6567334a13 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1472 microversion: 2.1 time: 0.252834 Oct 18 14:03:03.277847 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3012/6182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:02 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:03.435329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:03.488499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:03.495718 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b174fa6-a329-4713-a7a6-200343c15532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.465889 Oct 18 14:03:03.498311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3171/6183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:03 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:03.678572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:03.681027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:03.687506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.688206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.688836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:03.689725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:03.690398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:03.691024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.085064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:04.094152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8416fcc7-1953-43fe-b54a-01d1468f8057 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.420880 Oct 18 14:03:04.114411 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3013/6184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:03 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:04.297050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:04.297724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:04.334662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.335260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.345267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.350042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.350825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.356482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.528949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:04.529929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:04.544099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.550815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.551540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.552239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.556531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.558846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.559505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.560220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lazy-loading 'fault' on Instance uuid 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:03:04.560960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.567625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.728081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28a5b73e4fa4ce0aadd144e09a6f977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480e0bfa755e4b99bb01ea3084d7c214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:04.750730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59715099-73cb-4dce-94f9-e95d016a4405 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 200 len: 1309 microversion: 2.1 time: 0.469362 Oct 18 14:03:04.780929 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3172/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:04 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 1309 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:04.871845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:04.881743 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-987fbe8a-1629-4955-8bd8-31d09b9ae732 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.356646 Oct 18 14:03:04.882220 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3014/6186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:04 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:05.137513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:05.138230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:05.150631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.151151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.151618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:05.152330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.152814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.153250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:05.371764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:05.387444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91106d64-564e-4d69-9f24-01e9302a00ea tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.260104 Oct 18 14:03:05.391208 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3173/6187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:05 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:05.782362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:05.783878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] [instance: 067b4b58-17b0-41ce-bc4c-4d801e3d60b9] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:05.801240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.801685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.802173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:05.802912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.803386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.803830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:05.848627 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] HTTP exception thrown: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Request method failure captured: Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 HTTP/1.1 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrDMy8Dj4iC1vesYtCGeJjypK_jIz0yRoNXIvrfQOeKcv9TM1JU7_zvqwMCo4mVUyOIgpeXam0kqsX-sve-JteHa7kCqv3atnEj4ITD_jpWYJV3hdX9GXDSYeVd4GHRb88EAiFLVEJeB_vatvTaEg6rviuxklxj7cAxw0ry_P4r_naM Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 480e0bfa755e4b99bb01ea3084d7c214 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_480e0bfa755e4b99bb01ea3084d7c214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 480e0bfa755e4b99bb01ea3084d7c214 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1994933526 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesSnapshotTestJSON-1994933526-project Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: b28a5b73e4fa4ce0aadd144e09a6f977 Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesSnapshotTestJSON-1994933526-project Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '067b4b58-17b0-41ce-bc4c-4d801e3d60b9'} Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:05.852458 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] Returning 404 to user: Instance 067b4b58-17b0-41ce-bc4c-4d801e3d60b9 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:05.857255 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6b5c3892-c487-4665-a0d9-2e4064130663 tempest-VolumesSnapshotTestJSON-1994933526 tempest-VolumesSnapshotTestJSON-1994933526-project] 10.222.0.27 "GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9" status: 404 len: 111 microversion: 2.1 time: 0.078853 Oct 18 14:03:05.879379 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3015/6188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:05 2022] GET /compute/v2.1/servers/067b4b58-17b0-41ce-bc4c-4d801e3d60b9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:05.913869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:05.915113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:05.936770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:06.272784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:06.281180 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc780e9f-09cd-40df-838e-7024afa8a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.378073 Oct 18 14:03:06.281772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3174/6189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:05 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:06.417127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:06.418374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:06.437920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:06.439300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:06.440224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:06.443682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:06.444175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:06.445676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:06.642672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:06.665093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e3ac801-b75c-444f-9d2e-8eb39793593e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.243717 Oct 18 14:03:06.665768 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3016/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:06 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:07.307617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:07.313946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:07.320006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:07.322243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:07.323297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:07.325250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:07.326091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:07.330359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:07.599923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:07.609581 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0fb4bd9-f028-4c54-b614-49ff048cdc32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.306844 Oct 18 14:03:07.618163 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3175/6191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:07 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:07.697524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:07.698982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:07.714011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:07.720779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:07.723274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:07.725051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:07.728636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:07.729361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:07.947043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:07.956646 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc86d035-2fa6-4230-b933-5e2d7b8dc286 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.265893 Oct 18 14:03:07.978080 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3017/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:07 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:08.633466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:08.635104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:08.644658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:08.645415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:08.646097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:08.649486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:08.651900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:08.652597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:08.964847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:08.973824 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa8dc1b2-897e-4fc0-89dc-aec3bcc31456 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.344217 Oct 18 14:03:08.974449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3176/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:08 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:09.001544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:09.002771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:09.015860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:09.027196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:09.032153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:09.038720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:09.042452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:09.042452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:09.343339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:09.345575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:09.366516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c98d5dbe-6eca-42c7-a0b4-e9c6b370ffe7 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.370749 Oct 18 14:03:09.390341 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3018/6194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:08 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:09.997395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:09.998152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:10.017183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:10.017972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:10.018590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:10.019376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:10.019941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:10.020439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:10.317830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:10.329099 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ff132d06-69fa-4a1b-8fc2-cdc48ff6807e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.335294 Oct 18 14:03:10.330356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3177/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:09 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:10.400206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:10.402124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:10.418309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:10.423509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:10.424290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:10.425250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:10.425966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:10.426706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:10.686532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:10.698034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c36439a6-0af2-456d-b950-ecb2ce1d323b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.302932 Oct 18 14:03:10.714705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3019/6196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:10 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:11.364745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:11.365821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:11.381349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:11.382258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:11.382912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:11.383838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:11.384317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:11.384761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:11.727117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:11.728658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:11.767141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:11.768755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:11.781453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:11.784954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:11.785910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:11.790205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:11.848278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:11.859159 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b82bd74-4314-4482-8fb2-ed773fb1b2bb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.499824 Oct 18 14:03:11.877611 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3178/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:11 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:12.400026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:12.415550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24b75912-14df-45e8-ad93-2cd7851caadb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.693242 Oct 18 14:03:12.416477 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3020/6198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:11 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:12.906351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:12.906351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:12.934339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:12.940357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:12.940357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:12.942289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:12.947018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:12.947812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:13.255090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:13.265689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c9056ff-55b8-4603-8324-6ab82b00bc7e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.371482 Oct 18 14:03:13.266575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3179/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:12 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:13.442626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:13.443443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:13.451513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:13.452220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:13.452838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:13.453590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:13.454076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:13.454578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:13.656487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:13.667369 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25a1f00a-1536-48d7-9b13-54d1f4c14990 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.228634 Oct 18 14:03:13.667976 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3021/6200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:13 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:14.293222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:14.293907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:14.305264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:14.305779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:14.306268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:14.307214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:14.307859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:14.308471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:14.628107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:14.649520 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc57570c-377c-47ab-b4c3-8ce19c9f4b46 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.360581 Oct 18 14:03:14.652514 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3180/6201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:14 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:14.699761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:14.701271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:14.726817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:14.739216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:14.739816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:14.740880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:14.741627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:14.742830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:15.138193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:15.146962 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b8d807a-6815-408a-9175-5edf53d597ed tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.452498 Oct 18 14:03:15.167599 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3022/6202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:14 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:15.674378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:15.675416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:15.699984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:15.699984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:15.702962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:15.703998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:15.704699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:15.705398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:16.097894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:16.108041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd7302bc-82ef-4fab-9c1e-a725f2088e93 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.438897 Oct 18 14:03:16.132097 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3181/6203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:15 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:16.174953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:16.176421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:16.184577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:16.185341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:16.185985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:16.186902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:16.187531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:16.188127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:16.433667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:16.464241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1775b4ea-68d9-4c00-897f-54c0fc808bfe tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.289746 Oct 18 14:03:16.465115 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3023/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:16 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:17.145139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:17.145782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:17.154628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:17.155252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:17.155588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:17.156333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:17.156809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:17.157263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:17.446041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:17.454928 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7e38425-b405-4343-8698-a1afa5f8958a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.314443 Oct 18 14:03:17.455515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3182/6205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:17 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:17.496661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:17.497302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:17.524093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:17.524812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:17.525285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:17.526041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:17.535340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:17.535783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:17.860053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:17.874667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-52be0396-acd9-44ad-9e32-13cf2a42ff34 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.384219 Oct 18 14:03:17.892517 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3024/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:17 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:18.480512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:18.481818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:18.489929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:18.491226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:18.491896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:18.492903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:18.493466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:18.493937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:18.760216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:18.769932 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e0faa64-d279-469f-865f-6720f765b49d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.295089 Oct 18 14:03:18.772210 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3183/6207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:18 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:18.900999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:18.901645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:18.915317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:18.915826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:18.920795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:18.921581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:18.922099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:18.926313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:19.248514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:19.273571 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ccb972fe-33fc-47fd-bfba-c0572f0736b6 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.376323 Oct 18 14:03:19.280328 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3025/6208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:18 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:19.799372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:19.801573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:19.813675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:19.814540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:19.815193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:19.817133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:19.817984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:19.821028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:20.054129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:20.063954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd2cf32e-b97e-4a51-aa17-373f3e628696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.268462 Oct 18 14:03:20.064777 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3184/6209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:19 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:20.309373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:20.310213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:20.334028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:20.334633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:20.335082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:20.335810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:20.336276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:20.336718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:20.680684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:20.691942 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29c7e384-2fa8-4b49-ae78-59be625260c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.386426 Oct 18 14:03:20.709172 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3026/6210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:20 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:21.091190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:21.092344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:21.130317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:21.130317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:21.130317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:21.130317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:21.133202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:21.135833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:21.423765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:21.436672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18b1fcbd-2021-45b4-8be8-e15e0f7812f7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.351548 Oct 18 14:03:21.437270 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3185/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:21 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:21.723763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:21.723763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:21.730214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:21.731077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:21.731830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:21.732873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:21.735653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:21.737082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:21.940275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:21.950822 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5060c3b5-2b93-473e-a17d-583e36b3d876 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.238447 Oct 18 14:03:21.952070 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3027/6212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:21 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:22.462552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:22.463201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:22.475461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:22.477335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:22.477966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:22.478944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:22.479573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:22.480350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:22.788469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:22.797252 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b6c9999-5879-4d11-a7ec-91689e07ecdd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.339978 Oct 18 14:03:22.814601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3186/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:22 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:22.979589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:22.980763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:22.987952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:22.988756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:22.989467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:22.990486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:22.991113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:22.992234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:23.151069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:23.159736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2d5f1a96-330e-418b-a070-fe9450aff388 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.184618 Oct 18 14:03:23.160315 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3028/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:22 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:23.821358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:23.822690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:23.830659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:23.831271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:23.831822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:23.832658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:23.833219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:23.833852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:24.051845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:24.067077 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d24f440a-6798-4beb-968e-c7f71b3df04d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.244083 Oct 18 14:03:24.067766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3187/6215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:23 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:24.185588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:24.186415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:24.207008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:24.208882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:24.208882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:24.209863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:24.209863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:24.210495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:24.384493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:24.397331 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4da831a-099c-4c46-88d1-5a9c4858aae9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1506 microversion: 2.1 time: 0.216406 Oct 18 14:03:24.399146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3029/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:24 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:25.094923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:25.096891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:25.111144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.112141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.112847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:25.113860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.114680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.115454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:25.120433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:25.306002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:25.315112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61e12f8b-f75a-4e0f-8f8e-f9f0863a79a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1168 microversion: 2.1 time: 0.224989 Oct 18 14:03:25.317525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3188/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:25 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:25.421537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:25.422422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:25.430992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.431935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.432631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:25.438756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.439654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.440335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:25.665349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:25.687799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-92a1cd47-cea7-48fb-a7ab-27837ce0e7b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1506 microversion: 2.1 time: 0.269942 Oct 18 14:03:25.699834 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3030/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:25 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:26.045499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961de213-c6bf-4673-931d-450a4fac84cd", "name": "network-vif-unplugged", "status": "completed", "tag": "d1e1c0b6-af57-490c-82f3-743177ffd89b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:26.083423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:26.084204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:26.084760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:26.109957 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] Creating event network-vif-unplugged:d1e1c0b6-af57-490c-82f3-743177ffd89b for instance 961de213-c6bf-4673-931d-450a4fac84cd on n-h2-858383-13 Oct 18 14:03:26.117010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-52f8465d-1c79-416a-991e-6e1eae58f6f0 req-d2797158-8489-4fec-8edd-d65f84998091 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076723 Oct 18 14:03:26.123170 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3189/6219] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:03:26.342309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:26.343348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:26.352008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:26.356268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:26.356745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:26.360650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:26.369297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:26.373434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:26.615499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:26.631677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59856554-b505-44dd-b47c-7ee8d83a3fea tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1214 microversion: 2.1 time: 0.294585 Oct 18 14:03:26.633531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3031/6220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:26 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:26.713678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:26.724814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:26.764129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:26.765069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:26.766880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:26.776915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:26.779935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:26.780362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.087771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:27.105485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb47539d-e961-496c-aea3-4470de94cbdd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 200 len: 1509 microversion: 2.1 time: 0.397083 Oct 18 14:03:27.107186 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3190/6221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:26 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:27.130765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:27.131636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:27.143594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.144482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.145230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.146186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.146803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.147439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.375460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:27.386137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15119598-9c29-4a6d-8a7b-8add44ae5955 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.260853 Oct 18 14:03:27.404865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3032/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:27 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:27.425973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:27.427910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:27.434754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.435516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.436165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.437043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.437680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.440878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.653630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:27.663806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:27.665903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:27.678878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6e3095e-435a-4bd9-92c7-e0e09445d4f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.256655 Oct 18 14:03:27.682372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.698479 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3191/6223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:27 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:27.699509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.700148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.701085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.704454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.709931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.727819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:27.734629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:27.751826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.752617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.753289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.758148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.759446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.760507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.934070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:27.957736 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1111a16d-a88d-4aee-b5ac-c3cd3631be73 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.292649 Oct 18 14:03:27.957736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3033/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:27 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:28.014347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:28.024401 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b02d7146-737a-4109-8528-70e73dc5f6ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.312804 Oct 18 14:03:28.026272 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3192/6225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:27 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:28.048300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:28.050152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:28.058780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.059393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.059856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.060587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.061065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.061515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.229915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:28.239075 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77c5a0ab-b027-4b98-a31a-b51dd0d09c68 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.195308 Oct 18 14:03:28.239867 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3034/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:28 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:28.263355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:28.269583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.270427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.271117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.294886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:03:28.594899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70842c2a-79d2-4eb6-b292-0090cc85c80b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.335471 Oct 18 14:03:28.595529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3193/6227] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:28 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:03:28.611206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:28.611828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:28.622386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.624601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.624601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.624601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.625724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.626210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.643396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:28.796979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:28.812352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8ee4712-8a7c-4cd0-9c29-c6fa6c34f20e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.212177 Oct 18 14:03:28.813826 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3035/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:28 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:28.980641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:28.982253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:28.989969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.990651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.991168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.992454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.993478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.994189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:29.148581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:29.157460 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd37c241-4758-4232-9943-26f320db48d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.181747 Oct 18 14:03:29.158085 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3194/6229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:28 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:29.837542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:29.838869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:29.853256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:29.854346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:29.854737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:29.855520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:29.856152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:29.862390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:30.145554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:30.162872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8cc13c0a-a49b-4b41-ad96-98ee15a06432 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.327484 Oct 18 14:03:30.162872 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3036/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:29 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:30.185696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:30.187115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:30.190358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:30.204216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:30.205183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:30.205577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:30.210453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:30.210994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:30.221567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:30.574640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:30.590377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5cc73c62-9148-456b-ad47-1c0ffcbd9b54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.408593 Oct 18 14:03:30.590959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3195/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:30 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:31.188483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:31.190018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:31.212212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.212997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.213633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:31.214554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.216232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.217281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:31.396676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:31.406030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9ab7c1e-8499-49f5-8e61-d6fd4701c136 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.221802 Oct 18 14:03:31.406649 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3037/6232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:31 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:31.616469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:31.618081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:31.626146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.626903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.627527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:31.628693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.629884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.630565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:31.868923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:31.877897 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ecea85f-f3cc-43d9-a7b1-db3bec1ccc17 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.267353 Oct 18 14:03:31.878771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3196/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:31 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:32.435665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:32.436918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:32.443812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:32.444308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:32.444785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:32.445483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:32.445940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:32.446409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:32.658437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:32.672705 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d682577a-c55f-423f-8af4-f5d57fbb94fd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.242336 Oct 18 14:03:32.673956 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3038/6234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:32 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:32.902199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:32.903726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:32.912185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:32.912988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:32.914096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:32.915147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:32.915820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:32.918548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.102412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:33.111119 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8410b1e-c356-4b66-b1fc-fe7157586343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.213490 Oct 18 14:03:33.111971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3197/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:32 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:33.701172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:33.701855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:33.710503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=54 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:33.710503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.710503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.710777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.711285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.711756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.712923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.878120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:33.886788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f69a0b22-2323-4361-803d-45a862b1b49d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.193855 Oct 18 14:03:33.889471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3039/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:33 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:34.140402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:34.141230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:34.149208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.149639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.150850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:34.151588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.152218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.152657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:34.322704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:34.328887 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4119ef84-3916-4c6c-8453-96e811fe1b48 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.192721 Oct 18 14:03:34.329904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3198/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:34 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:34.912503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:34.914554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:34.923571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.924421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.924985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:34.926889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.928620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.929160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:35.075931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:35.084988 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3e89139-ad52-4dea-9a29-8a498d3137b3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.178567 Oct 18 14:03:35.087008 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3040/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:34 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:35.365430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:35.367481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:35.386857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:35.387373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:35.388236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:35.389065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:35.389541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:35.389987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:35.586098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:35.612346 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4b68538-8f06-4b92-b5ce-54dfb0f62596 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.250553 Oct 18 14:03:35.621735 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3199/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:35 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:36.112386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:36.113030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:36.121639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.122827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.123596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.124542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.125394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.126048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.304445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:36.314584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91f9076d-fc21-4074-be00-b73582ef30ce tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.206102 Oct 18 14:03:36.315587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3041/6240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:36 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:36.640364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:36.641017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:36.662697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.664385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.664976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.673195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.674919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.675844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.837349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:36.846298 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e18be33-d493-4c81-87b4-362decc06bc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.209841 Oct 18 14:03:36.847140 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3200/6241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:36 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:37.338701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:37.339865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:37.356292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.357121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.357749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:37.361593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.361593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.361593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:37.618408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:37.636777 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97784ffc-62c7-4433-aa1b-2a6df77abe6e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.302179 Oct 18 14:03:37.637381 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3042/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:37 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:37.870965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:37.871588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:37.888793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.889163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.889611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:37.890348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.890908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.891345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:38.065770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:38.076264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0fbac8c-0c66-4b3c-8172-282f97ab40d3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.209556 Oct 18 14:03:38.076871 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3201/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:37 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:38.661150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:38.663953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:38.677722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:38.679596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:38.681482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:38.684321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:38.685767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:38.686625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:38.904799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:38.913558 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9db72346-d25a-4fc8-91aa-ab9a7f147368 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1679 microversion: 2.1 time: 0.256561 Oct 18 14:03:38.914714 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3043/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:38 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:39.103545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:39.104180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:39.123155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.123825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.124290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.125156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.126329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.126329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.333874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b99074-c015-4aa0-9e48-1abf4508ea30", "name": "network-vif-plugged", "status": "completed", "tag": "2bd13ae8-0282-4f40-8633-8c5d01f393cc"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:39.343900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:39.353814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4de6f024-b412-4bec-a891-889706468796 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.257534 Oct 18 14:03:39.362986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3202/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:39 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:39.379494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.380586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.388957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.403887 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] Creating event network-vif-plugged:2bd13ae8-0282-4f40-8633-8c5d01f393cc for instance 17b99074-c015-4aa0-9e48-1abf4508ea30 on n-h1-858383-13 Oct 18 14:03:39.411765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-92d0f674-db9a-45bc-ba95-d2fe0cba8f89 req-760bdfd4-0051-439f-bdbe-5ce1e1d720b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083131 Oct 18 14:03:39.417539 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3044/6246] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:03:39.943602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:39.944361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:39.953213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.953818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.957830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.957830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.957830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.957830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.114939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:40.127192 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec6db921-476d-469c-badf-50df7deeffd5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1656 microversion: 2.1 time: 0.194019 Oct 18 14:03:40.127969 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3203/6247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:39 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1656 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:40.156398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:40.167012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.168339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.169063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.197014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:03:40.398954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:40.400555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:40.415143 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d12b93d-97ba-4487-a1d9-c87769630335 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.263680 Oct 18 14:03:40.419599 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3045/6248] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:40 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:03:40.425772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.426474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.427662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.428373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.428879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.431521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:40.432013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.433137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:40.443977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.445236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.445970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.447035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.447755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.448423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.485977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:40.733401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:40.753809 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e38f27eb-4b41-45a0-bc54-1c1071403f4a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1665 microversion: 2.1 time: 0.326342 Oct 18 14:03:40.762150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3046/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:40 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1665 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:40.792458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:40.800864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22b4e4da-9fc1-4b83-bd14-4410ce3105a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1202 microversion: 2.1 time: 0.407432 Oct 18 14:03:40.814316 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3204/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:40 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:41.782259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:41.783676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:41.792174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.792997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.793785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:41.794689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.795314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.795908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:41.829664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:41.830933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:41.840979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.844157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.845355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:41.847445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.849615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.850263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.067391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.080430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4418a85-5846-41f3-893f-251b4e4a4350 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1389 microversion: 2.1 time: 0.254369 Oct 18 14:03:42.081905 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3205/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:41 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:42.104900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:42.105128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.106088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:42.114117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.114695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.115525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.116083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-16ad5f3a-d074-40bd-a1a7-cffe332c7bac tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1665 microversion: 2.1 time: 0.336297 Oct 18 14:03:42.118684 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3047/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:41 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1665 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:42.119485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.120006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.134590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.276976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.289263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b1a4930-cddf-49eb-871e-e403c589691c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1389 microversion: 2.1 time: 0.189172 Oct 18 14:03:42.290643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3206/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:42 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:42.317246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:42.318785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:42.357249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.358099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.358769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.361342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.361859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.362344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.693446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.698964 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-086a72b7-d1c7-4781-b423-4f4485ac1fc0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1389 microversion: 2.1 time: 0.386456 Oct 18 14:03:42.700265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3048/6254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:42 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1389 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:42.801156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:42.801796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:42.811361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.816429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.816429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.816429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.816429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.816429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.847668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:03:43.152171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:43.153564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.162014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.162841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.163515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.164543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.165219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.165802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.189978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49e5e82e-dcef-45b1-a357-7897ab2d27f8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 204 len: 0 microversion: 2.1 time: 0.392022 Oct 18 14:03:43.191410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3207/6255] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:42 2022] DELETE /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:03:43.227220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:43.266404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.285400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.285924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.287642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.287642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.287642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.292200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.363337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:43.373517 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-438ec945-3344-4cf2-8c6e-b1b0c2ad7d0f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.225897 Oct 18 14:03:43.374745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3049/6256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:43.399390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:43.400312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.407456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.408223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.408879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.409836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.410531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.411173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.513084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:43.525121 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3a27632-120f-42a0-83ea-484638afc1ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1395 microversion: 2.1 time: 0.315437 Oct 18 14:03:43.526374 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3208/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:43 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1395 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:43.639583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:43.646361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-106f0fa9-6c2a-4b94-943f-f0b6f9588177 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.250932 Oct 18 14:03:43.650589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3050/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:43.675700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:43.676496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.683704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.684359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.685019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.685845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.686564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.687078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.830557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:43.840250 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-96db7709-1aa8-4023-8cd6-25885654918b tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.168611 Oct 18 14:03:43.859043 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3209/6259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:43.863475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:43.864385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.871316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.872037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.872673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.873816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.874524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.875162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.040006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:44.042657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:44.051386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-787db190-b61b-4579-98cb-c41bc4d8e4ab tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.191825 Oct 18 14:03:44.052137 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3051/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:43 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:44.075275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:44.075822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:44.082628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.083112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.086961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.086961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.086961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.086961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.220261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:44.228683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcda49cf-74c8-4c74-a72b-4d09ff4381f3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.157171 Oct 18 14:03:44.229606 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3210/6261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:44 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:44.252997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:44.253621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:44.265897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.266955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.267572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.268422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.269307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.270048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.326846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lazy-loading 'flavor' on Instance uuid 0e0d3798-4fd3-4937-87ce-907a8b190d90 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:03:44.551739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:44.555401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:44.570522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.572333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.572893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.573700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.574283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.575940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.713484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb0d8c08-2941-4432-bb88-a422671eccdb tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.464838 Oct 18 14:03:44.714739 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3052/6262] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:44 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:03:44.725079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:44.731624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:44.749415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.750528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.751534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.752433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:44.752920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:44.753378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:44.802194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:44.811002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c0d69b5-1a35-4dbb-b5ae-1af9eed5a61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1395 microversion: 2.1 time: 0.265587 Oct 18 14:03:44.811949 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3211/6263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:44 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1395 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:44.984635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:44.998739 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db38dc21-f102-4511-976d-c07261e38fb5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1677 microversion: 2.1 time: 0.278616 Oct 18 14:03:44.999373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3053/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:44 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:45.693401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b99074-c015-4aa0-9e48-1abf4508ea30", "name": "network-vif-deleted", "tag": "2bd13ae8-0282-4f40-8633-8c5d01f393cc"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:45.705242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:45.705997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:45.706807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:45.720886 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] Creating event network-vif-deleted:2bd13ae8-0282-4f40-8633-8c5d01f393cc for instance 17b99074-c015-4aa0-9e48-1abf4508ea30 on n-h1-858383-13 Oct 18 14:03:45.728307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a072f235-3e78-4bcd-ac49-fd8cb0f246e8 req-15d2b2b3-caa1-4fbf-bbfa-7d1cd2eccd3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039755 Oct 18 14:03:45.734447 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3212/6265] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:45.845569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:45.846311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:45.860585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:45.861430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:45.868271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:45.868271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:45.868271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:45.868271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:45.968222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:45.980319 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8613e787-220e-41a3-bf04-a8d9304e0211 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.146323 Oct 18 14:03:45.998270 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3054/6266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:45 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:46.025197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:46.026025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:46.035847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.036360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.037026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:46.038459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.041764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.044677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:46.356838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:46.383630 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bd95c3b-67f1-4afb-bc17-31e7e961aa1d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1660 microversion: 2.1 time: 0.363009 Oct 18 14:03:46.386836 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3213/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:46 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1660 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:46.417048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:46.417600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:46.424086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.424649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.425103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:46.425816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.426320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.426764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:46.769430 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75d80ebb-ff5f-4d9f-af41-1223e2e84cd1 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action" status: 202 len: 0 microversion: 2.1 time: 0.358444 Oct 18 14:03:46.770372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3055/6268] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:46 2022] POST /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:03:46.780644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:46.782598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:46.794641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.795152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.796895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:46.799420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:46.800145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:46.802210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:47.006629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:47.007944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:47.023768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:47.024195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:47.026628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:47.026628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:47.026628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:47.026628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:47.153073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:47.161636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-011a9b83-e8d1-4129-8eeb-4e6d12036b30 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.160353 Oct 18 14:03:47.167102 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3056/6269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:46 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:47.226920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:47.236470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2114d2af-0d70-46f7-8abe-6c59ef00d8c5 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1666 microversion: 2.1 time: 0.459667 Oct 18 14:03:47.237346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3214/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:46 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1666 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:48.187334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:48.191743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:48.197515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.198599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.199173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.200609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.201268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.201821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.262338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:48.262958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:48.279991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.280781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.281388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.282308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.282929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.283573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.284901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:48.295297 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1b391c0-6a35-4376-9607-e91c37eb513b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.113565 Oct 18 14:03:48.318253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3057/6271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:48 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:48.590418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:48.607108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-294be797-8061-457c-b68b-0593c94bd18f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1666 microversion: 2.1 time: 0.349427 Oct 18 14:03:48.612211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3215/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:48 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1666 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:49.322513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:49.323965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:49.337328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.351265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.351922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.359796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.359796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.359796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.476629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:49.515263 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-69e99f48-a774-48d3-9539-335037358a31 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.196852 Oct 18 14:03:49.530081 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3058/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:49 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:49.633813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:49.634631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:49.646560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.647317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.651944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.655343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.659766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.660526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.929426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:49.953240 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-376cdd04-440f-4ea9-92d4-2a628bacd90e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.324418 Oct 18 14:03:49.955029 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3216/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:49 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:49.989301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:49.989920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:50.007933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.009093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.009804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.010917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.011616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.012464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.308342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:50.390413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e78cd5f-5669-4d9c-84c1-fd7bbb2ec8b4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1669 microversion: 2.1 time: 0.404145 Oct 18 14:03:50.391887 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3059/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:49 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:50.420168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:50.427343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:50.439612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.441634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.451424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.453314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.466783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.469195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.517451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:03:50.528311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Working on deleting snapshot 6030a55d-e331-48a8-9b9d-adc33172030f from shelved instance... Oct 18 14:03:50.538483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:50.539606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:50.549880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.550707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.551646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.552645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.553537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.554456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.628666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:50.638514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-45027af2-621d-4d98-93e4-d24ae2f1e1b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.103857 Oct 18 14:03:50.639369 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3060/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:50 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:51.670423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:51.672167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:51.680673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:51.681405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:51.686773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:51.686773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:51.686773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:51.686773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:51.826513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:51.836761 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bbf4dff7-6519-436b-a112-ace6064723ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.171026 Oct 18 14:03:51.837344 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3061/6277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:51 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:52.861816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:52.863346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:52.870792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.871617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.872241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.873292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.874123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.874725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.965889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:52.976605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ddfbde9-38b7-40d0-a468-8a3235bead26 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1187 microversion: 2.1 time: 0.119449 Oct 18 14:03:52.977657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3062/6278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:52 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:53.396868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Doing local delete in cell 589719e2-761e-418b-aee5-8deaa2841263(cell1) {{(pid=121010) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 14:03:53.398819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:53.399487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:53.400122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:53.400719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 14:03:53.408820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] deallocate_for_instance() {{(pid=121010) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 14:03:54.008585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:54.009907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:54.029507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.031692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.038741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.040013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.041793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.043268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.128297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.134553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.135185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.135775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid 17b99074-c015-4aa0-9e48-1abf4508ea30 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:03:54.211586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:54.226533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1e43bf1-6a9a-4529-b2c0-35b67b840444 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 200 len: 1192 microversion: 2.1 time: 0.229649 Oct 18 14:03:54.238086 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3063/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:53 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 1192 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:54.832287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961de213-c6bf-4673-931d-450a4fac84cd", "name": "network-vif-deleted", "tag": "d1e1c0b6-af57-490c-82f3-743177ffd89b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:54.883774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.884528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.891214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.917256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_external_events [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] Unable to find a host for instance 961de213-c6bf-4673-931d-450a4fac84cd. Dropping event network-vif-deleted {{(pid=121009) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 14:03:54.917256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2cc76bd4-ede8-425e-ac65-8a237a378344 req-aba14ec2-d074-440b-acc4-7669767cc092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.087942 Oct 18 14:03:54.917256 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3064/6280] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 14:03:54.951390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Updating instance_info_cache with network_info: [] {{(pid=121010) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 14:03:54.968655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:55.265218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:55.269899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:55.302874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.308877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.314514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.315589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.316220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.316808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.348960 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 HTTP/1.1 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '17b99074-c015-4aa0-9e48-1abf4508ea30'} Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:55.350763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:55.354971 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:55.356133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:55.357959 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-026ec4f1-e9fa-42ae-9c69-952690bf0178 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 404 len: 111 microversion: 2.1 time: 0.099072 Oct 18 14:03:55.364303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3065/6281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:55 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:56.120940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20240898-7f22-42ba-9c4a-2de402f475ec tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 204 len: 0 microversion: 2.1 time: 5.708140 Oct 18 14:03:56.121452 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3217/6282] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:50 2022] DELETE /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 0 bytes in 5711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:03:56.129571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:56.130466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 961de213-c6bf-4673-931d-450a4fac84cd] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:56.141051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.144857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.145487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.146548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.147210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.147798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.177340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd HTTP/1.1 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '961de213-c6bf-4673-931d-450a4fac84cd'} Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:56.181765 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. Oct 18 14:03:56.185872 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.187136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 404 to user: Instance 961de213-c6bf-4673-931d-450a4fac84cd could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:56.189071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eca6b5fd-6fd1-415f-a495-9390ffe2dd3e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd" status: 404 len: 111 microversion: 2.1 time: 0.063918 Oct 18 14:03:56.190838 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3066/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:56 2022] GET /compute/v2.1/servers/961de213-c6bf-4673-931d-450a4fac84cd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:56.200674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:56.201435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:56.210107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.214857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.215480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.216370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.218571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.218571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.296699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:03:56.941347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b54d04ed-34da-4274-a266-53db979c10dd tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 204 len: 0 microversion: 2.1 time: 0.744941 Oct 18 14:03:56.941913 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3218/6284] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:56 2022] DELETE /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:03:56.951325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:56.952842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:56.977256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.978035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.978662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.979582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.980213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.980811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:57.061805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:57.175822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:57.184648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3abfecf6-7af5-4070-a767-c4c22e667832 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1466 microversion: 2.1 time: 0.237248 Oct 18 14:03:57.200732 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3067/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:56 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:58.210162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:58.216091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:58.237236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.237767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.242612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.243213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.246210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.247034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.500853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:58.516547 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-86a472ea-5093-421b-bf91-7e2bf6f9a302 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1466 microversion: 2.1 time: 0.311888 Oct 18 14:03:58.517644 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3219/6286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:58 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1466 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:58.780649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:58.781754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:58.795970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.796839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.797507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.798468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.799184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.799799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.838975 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 HTTP/1.1 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '17b99074-c015-4aa0-9e48-1abf4508ea30'} Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:58.841252 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.845854 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.847710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:58.848756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e930cfd9-d49c-4df0-9d48-7e90c8d25bb5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 404 len: 111 microversion: 2.1 time: 0.073991 Oct 18 14:03:58.849477 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3068/6287] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:58 2022] DELETE /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:03:58.858641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:58.863583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 17b99074-c015-4aa0-9e48-1abf4508ea30] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:58.869893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.870565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.877442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.878387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.878972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.879779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.934542 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 HTTP/1.1 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '17b99074-c015-4aa0-9e48-1abf4508ea30'} Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:58.942603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 17b99074-c015-4aa0-9e48-1abf4508ea30 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2b4e5ca-445e-4bd0-bb3f-32ebde85f1a6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30" status: 404 len: 111 microversion: 2.1 time: 0.089593 Oct 18 14:03:58.947340 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3220/6288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:58 2022] GET /compute/v2.1/servers/17b99074-c015-4aa0-9e48-1abf4508ea30 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:03:59.546916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:59.547548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:59.560764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:59.582987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff5bc04-7e59-4422-8828-74a938f53d92", "name": "network-vif-deleted", "tag": "6bd02a18-4984-4eea-ab72-dc57a74eb3e9"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:59.605933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:59.609726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:59.610422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:59.611445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:59.619285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:59.643248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:59.648401 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:59.649265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:59.690150 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] Creating event network-vif-deleted:6bd02a18-4984-4eea-ab72-dc57a74eb3e9 for instance 5ff5bc04-7e59-4422-8828-74a938f53d92 on n-h1-858383-13 Oct 18 14:03:59.741508 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4a00838d-6a6f-4c20-b846-b98962da9a68 req-3f811030-3dd0-44a2-a2f2-b9c4a1f51ad3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165642 Oct 18 14:03:59.761499 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3221/6289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:04:00.404897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:00.435005 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86015cb0-285b-4132-b599-39c5c95127ee tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 200 len: 1466 microversion: 2.1 time: 0.894428 Oct 18 14:04:00.435963 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3069/6290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:59 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 1466 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:01.507190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:01.508031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 5ff5bc04-7e59-4422-8828-74a938f53d92] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:01.511734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:01.516902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.517653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.518300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.519204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.519843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.520446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.550082 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 HTTP/1.1 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '5ff5bc04-7e59-4422-8828-74a938f53d92'} Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:01.552846 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. Oct 18 14:04:01.558512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:01.562388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 404 to user: Instance 5ff5bc04-7e59-4422-8828-74a938f53d92 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:01.563731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a25bd7b-6c8d-4171-8abe-363355076e92 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92" status: 404 len: 111 microversion: 2.1 time: 0.106344 Oct 18 14:04:01.567727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3222/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:01 2022] GET /compute/v2.1/servers/5ff5bc04-7e59-4422-8828-74a938f53d92 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:01.574253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:01.574253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:01.585102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.585619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.588134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.588922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.589415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.589874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.650905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:01.988221 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b22f86ea-edb8-4319-b2c9-56e75f2c9865 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 204 len: 0 microversion: 2.1 time: 0.418224 Oct 18 14:04:01.990138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3070/6292] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:01 2022] DELETE /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:04:02.002040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:02.003264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:02.042000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:02.046799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:02.048753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:02.054605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:02.055398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:02.056880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:02.376554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:02.388604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2dd6f181-0787-4987-b0f8-b32953332a3d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1508 microversion: 2.1 time: 0.393610 Oct 18 14:04:02.390988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3223/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:01 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:03.415437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:03.418120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:03.454426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:03.460171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:03.460171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:03.460171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:03.460171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:03.460171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:04.440875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:04.492294 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8aad207a-25b6-474f-81ce-d3aa997111d2 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1508 microversion: 2.1 time: 1.082413 Oct 18 14:04:04.493363 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3071/6294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:03 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1508 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:05.358725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3097a00f-9b3c-49d6-b062-2d2cb70aa34e", "name": "network-vif-deleted", "tag": "d898cdd0-2ab1-41d3-9de6-da39da54466a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:05.385278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:05.396039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:05.399691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:05.447356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] Creating event network-vif-deleted:d898cdd0-2ab1-41d3-9de6-da39da54466a for instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e on n-h1-858383-13 Oct 18 14:04:05.485867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-65f1ab0f-03e4-497b-8f1f-bb9e40a5887f req-de7e044d-3774-4612-a4f9-28eca178ae3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130828 Oct 18 14:04:05.490496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3224/6295] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:05.517874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:05.517874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:05.532505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:05.542321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:05.544605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:05.549250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:05.559019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:05.559019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:05.559019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:05.735297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:05.746241 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6c6afef-ffa5-4562-81f4-cb6f3fa9b10e tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1466 microversion: 2.1 time: 0.233983 Oct 18 14:04:05.750924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3072/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:05 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1466 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:06.795012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:06.795810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:06.825981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:06.826726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:06.827194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:06.828156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:06.828517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:06.828957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:06.922263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:06.922779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:06.923253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:06.923710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lazy-loading 'fault' on Instance uuid 3097a00f-9b3c-49d6-b062-2d2cb70aa34e {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:04:07.276297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:07.285910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b2ed152-9ed4-4034-9508-f9ef7b46e727 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 200 len: 1305 microversion: 2.1 time: 0.502361 Oct 18 14:04:07.286593 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3225/6297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:06 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 1305 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:08.319870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:08.328166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 3097a00f-9b3c-49d6-b062-2d2cb70aa34e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:08.335903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.337165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.338765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.340049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.344516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.347545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.390266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e HTTP/1.1 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3097a00f-9b3c-49d6-b062-2d2cb70aa34e'} Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:08.392088 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:08.397601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 404 to user: Instance 3097a00f-9b3c-49d6-b062-2d2cb70aa34e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:08.398972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-489cfc67-c625-4983-8031-d99212648fd3 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e" status: 404 len: 111 microversion: 2.1 time: 0.086882 Oct 18 14:04:08.402540 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3073/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:08 2022] GET /compute/v2.1/servers/3097a00f-9b3c-49d6-b062-2d2cb70aa34e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:08.410940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:08.411532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:08.423008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.426246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.426799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.427619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.432095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.432660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.512014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:08.955976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-561524cf-6b00-4edf-a820-ae58d8325b71 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 204 len: 0 microversion: 2.1 time: 0.548755 Oct 18 14:04:08.957369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3226/6299] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:08 2022] DELETE /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:04:08.965845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:08.966779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:08.981826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.982872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.983502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.984400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.985028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.986577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:09.367090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:09.390151 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-822db293-828a-48ff-9c60-5703377449f9 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1496 microversion: 2.1 time: 0.427000 Oct 18 14:04:09.393420 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3074/6300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:08 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:10.422293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:10.422943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:10.439395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.439923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.440392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:10.444425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.444931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.457909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:11.132963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:11.145712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c6d6aaf-a5f5-4e47-97da-f9ba71430e63 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1496 microversion: 2.1 time: 0.727434 Oct 18 14:04:11.146950 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3227/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:10 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1496 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:12.191221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:12.192505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:12.215921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.216799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.219515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.231295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.236333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.236796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.278202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4598eb6-98e5-45ec-bfba-8035e128f483", "name": "network-vif-deleted", "tag": "385cfae4-f877-436b-b3ec-fbb69358f6f1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:12.326026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.327493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.327952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.389926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] Creating event network-vif-deleted:385cfae4-f877-436b-b3ec-fbb69358f6f1 for instance e4598eb6-98e5-45ec-bfba-8035e128f483 on n-h1-858383-13 Oct 18 14:04:12.399267 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d08513bf-8777-4957-84a1-c993e05a0b26 req-31909c06-66e6-4e86-869b-75a283d193ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153574 Oct 18 14:04:12.405265 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3228/6302] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:12.411649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:12.458232 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1d29b12-6e05-4c1e-835b-0bad3534715f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1454 microversion: 2.1 time: 0.263095 Oct 18 14:04:12.464489 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3075/6303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:12 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:13.491202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:13.491938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:13.515448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.515448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.519300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.520082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.520574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.535239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.652654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.653221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.654118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.654768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lazy-loading 'fault' on Instance uuid e4598eb6-98e5-45ec-bfba-8035e128f483 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:04:13.782466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:13.785498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=15,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:13.796672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2452b46-aefb-4878-ae69-b02a6b44956d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 200 len: 1305 microversion: 2.1 time: 0.314235 Oct 18 14:04:13.797282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3229/6304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:13 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 1305 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:14.825814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:14.826895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: e4598eb6-98e5-45ec-bfba-8035e128f483] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:14.849514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:14.855273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:14.855273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:14.855273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:14.855273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:14.855273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:14.958599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 HTTP/1.1 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e4598eb6-98e5-45ec-bfba-8035e128f483'} Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:14.961790 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. Oct 18 14:04:14.968114 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:04:14.991383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 404 to user: Instance e4598eb6-98e5-45ec-bfba-8035e128f483 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:14.992804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-781c8676-7eaa-466d-aca3-b33d23c5487c tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483" status: 404 len: 111 microversion: 2.1 time: 0.171251 Oct 18 14:04:15.000671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3076/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:14 2022] GET /compute/v2.1/servers/e4598eb6-98e5-45ec-bfba-8035e128f483 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:15.010431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:15.010995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:15.036605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.037883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.038416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.041618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.042802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.043265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.138462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:15.636503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6e1fa0b-a413-4359-b732-51c72e0cd62d tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 204 len: 0 microversion: 2.1 time: 0.627190 Oct 18 14:04:15.636503 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3230/6306] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:15 2022] DELETE /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:04:15.644521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:15.644988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:15.672727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.675417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.675878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.681301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.688591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.688591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.066657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:16.083397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11e2e425-a350-43b4-bd0e-b7146a1b7354 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1675 microversion: 2.1 time: 0.444929 Oct 18 14:04:16.086984 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3077/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:15 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:16.547205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-995e6802-d696-45b1-9355-2fb6aa10bc84 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: .version_select at 0x7fb331aa2e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-20049699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSITGLe83KRWp9+nd+Kgz/g343hoxnCjEc8l9kixEhaWyBo1kOEIi13+CtjlUqQy5F4KGAvM/wmpUuhQzs3+eJMaafig90yA7uOBQnEvuHwH8QEvwY8y98ZBWM+we/qwA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:16.596376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-995e6802-d696-45b1-9355-2fb6aa10bc84 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:16.612684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-995e6802-d696-45b1-9355-2fb6aa10bc84 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:16.724842 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-995e6802-d696-45b1-9355-2fb6aa10bc84 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.189432 Oct 18 14:04:16.725812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3231/6308] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:04:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:17.114580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:17.115447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:17.147295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:17.148593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:17.150523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:17.151321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:17.155548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:17.159621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:17.478085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:17.487710 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-613e57a7-ef01-4938-bcf3-aa36c07acc5f tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1675 microversion: 2.1 time: 0.381606 Oct 18 14:04:17.502831 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3078/6309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:17 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1675 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:18.522358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:18.523154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:18.530585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.531089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.531547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.532273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.532744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.533186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.138605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:19.159111 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-402b81ce-d958-48dc-a386-da5b5ee6d4ca tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1675 microversion: 2.1 time: 0.641057 Oct 18 14:04:19.171269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3232/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:18 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1675 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:20.215696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:20.217052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:20.244272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.244808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.245271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.251306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.251306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.251306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.277456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0d3798-4fd3-4937-87ce-907a8b190d90", "name": "network-vif-deleted", "tag": "21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:20.294564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.295453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.296191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.337112 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] Creating event network-vif-deleted:21b8fcff-31ce-4c51-b5ca-ae6fe0e15e6c for instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 on n-h2-858383-13 Oct 18 14:04:20.359984 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-09963a58-cb25-4042-ae24-3d74e7372c33 req-6785420f-f59d-4928-b94a-0bf401737e7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089411 Oct 18 14:04:20.370797 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3233/6311] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:20.529871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:20.553645 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a89b7ac-2019-48ca-83c8-310127f3cff4 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1607 microversion: 2.1 time: 0.345243 Oct 18 14:04:20.555372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3079/6312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:20 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1607 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:21.589458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:21.590356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:21.602396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:21.602958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:21.604183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.605077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:21.605708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:21.606403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.668835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:21.669506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:21.670025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.671076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lazy-loading 'fault' on Instance uuid 0e0d3798-4fd3-4937-87ce-907a8b190d90 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:04:21.784820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7963aa7a74c147cdab99b56131a66842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4474d29a061642a2820fab69697ea4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:21.816391 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bbbc8a0d-ba13-4b75-93a6-557f8bcdcc95 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 200 len: 1328 microversion: 2.1 time: 0.231557 Oct 18 14:04:21.830230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3234/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:21 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:22.312051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1058822941", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "c916bf4e-478b-4c44-927c-8cd257f8e31d"}], "key_name": "tempest-TestNetworkBasicOps-20049699", "security_groups": [{"name": "tempest-secgroup-smoke-1388628187"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:22.603970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] validate_networks() for [('c916bf4e-478b-4c44-927c-8cd257f8e31d', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:04:22.842688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:22.843333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] [instance: 0e0d3798-4fd3-4937-87ce-907a8b190d90] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:22.858730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:22.859561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:22.861818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:22.861818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:22.861818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:22.862510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:22.887573 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] HTTP exception thrown: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Request method failure captured: Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 HTTP/1.1 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrCB9L30_b0k-ofjoKUEdbRSt7ZKP59WChklV4j_Jyj-eHtGBolI96GY3jIA1Lk47h3fREa2yTEiWZnPZl9Qir_rlQnq6FH7JMgeQGPeCMohkXPW4UHKzvhs7ZuUf0EXzVc30moQR5NxYlkV4oAV9-wxPrth0P2fPlCF4vbztfcPyr0 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4474d29a061642a2820fab69697ea4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4474d29a061642a2820fab69697ea4fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4474d29a061642a2820fab69697ea4fe Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-2128230300 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7963aa7a74c147cdab99b56131a66842 Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-2128230300-project Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0e0d3798-4fd3-4937-87ce-907a8b190d90'} Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:22.889541 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Returning 404 to user: Instance 0e0d3798-4fd3-4937-87ce-907a8b190d90 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:22.893738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2487b2cb-a86b-4da5-ade1-da4e648e0f2a tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90" status: 404 len: 111 microversion: 2.1 time: 0.053256 Oct 18 14:04:22.898211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3235/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:22 2022] GET /compute/v2.1/servers/0e0d3798-4fd3-4937-87ce-907a8b190d90 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:04:22.904062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c9dc293-beea-4606-b45b-37a1800dd649 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] Calling method '.version_select at 0x7fb33535e8b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:23.011244 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c9dc293-beea-4606-b45b-37a1800dd649 tempest-ServerActionsTestJSON-2128230300 tempest-ServerActionsTestJSON-2128230300-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379091121" status: 202 len: 0 microversion: 2.1 time: 0.111687 Oct 18 14:04:23.012080 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3236/6315] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 14:04:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379091121 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:04:23.575931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:04:23.575931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:04:23.575931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:04:23.575931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:04:23.575931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:04:23.589847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:23.590632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:23.591132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.594524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:23.595668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:23.596351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.668250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:23.684803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:23.713965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:04:23.720646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:04:24.691297 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc42459e-2a35-4f53-a7bb-0b2641272a59 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.384150 Oct 18 14:04:24.691992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3080/6316] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:04:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:04:24.705621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a132374-9293-4ca6-a726-c20df491a6d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:24.708075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a132374-9293-4ca6-a726-c20df491a6d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:24.875182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a132374-9293-4ca6-a726-c20df491a6d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:24.884080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a132374-9293-4ca6-a726-c20df491a6d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1247 microversion: 2.1 time: 0.184336 Oct 18 14:04:24.884661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3237/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:24 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1247 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:25.913887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5ad0611-3ce6-46e6-acf4-9a3b040393c0 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:25.914918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5ad0611-3ce6-46e6-acf4-9a3b040393c0 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:26.009350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5ad0611-3ce6-46e6-acf4-9a3b040393c0 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:26.017640 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5ad0611-3ce6-46e6-acf4-9a3b040393c0 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1247 microversion: 2.1 time: 0.109883 Oct 18 14:04:26.021506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3081/6318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:25 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1247 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:27.045638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:27.046318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:27.055292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:27.055994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:27.057232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:27.057712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:27.058366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:27.058977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:27.164840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:27.181861 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78cc509a-4de1-43b6-94a3-474b2082726c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1251 microversion: 2.1 time: 0.140442 Oct 18 14:04:27.182833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3238/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:27 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1251 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:28.209755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:28.210445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:28.241609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:28.242905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:28.248239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:28.250782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:28.250782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:28.250782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:29.216722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:29.233956 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f85c0b37-2987-48db-bcaf-3beaafb9bd2e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1299 microversion: 2.1 time: 1.031718 Oct 18 14:04:29.237658 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3082/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:28 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1299 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:30.270433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:30.272850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:30.304005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.305776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.308725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:30.314594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.314594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.314594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:30.502749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:30.516312 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6cc4d25-d866-4133-800c-6ef6aa2c964d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1305 microversion: 2.1 time: 0.248176 Oct 18 14:04:30.516942 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3239/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:30 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:31.545526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:31.546131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:31.581057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:31.587440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:31.589371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:31.590958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:31.598757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:31.600389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:31.619259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:32.035649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:32.045644 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89b40d7c-ded4-4dce-a22a-685980e821a5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.506569 Oct 18 14:04:32.046548 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3083/6322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:31 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:33.076487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:33.076487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:33.076487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:33.103823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:33.104863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:33.105637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.106677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:33.109843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:33.110623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.432948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:33.445835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5becd59-fbc9-4ffa-9603-54972ab2497e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.379071 Oct 18 14:04:33.449661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3240/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:33 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:33.943092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f45b48-8a87-44fa-aa81-bc4c223f4f49", "tag": "5d5419ff-6642-4385-875e-54f6fd192c9d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:33.952222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:33.968171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:33.968671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:33.969111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.984150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] Creating event network-changed:5d5419ff-6642-4385-875e-54f6fd192c9d for instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 on n-h1-858383-13 Oct 18 14:04:33.991620 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a0ad0927-fd8c-4de6-af29-ed692b290d52 req-af86962a-e349-4554-b03c-0706adadc727 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050658 Oct 18 14:04:33.993037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3084/6324] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:34.478436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:34.479695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:34.497853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:34.498502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:34.499027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:34.499816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:34.500363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:34.500857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:34.852841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:34.863911 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2db3b0dd-6e02-4575-9dc7-954f5603780f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.391845 Oct 18 14:04:34.870466 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3241/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:34 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:35.884903 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:04:35.885504 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 (ip 10.222.0.27) !!! Oct 18 14:04:35.892746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:35.897966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:35.905090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:35.905909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:35.906602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:35.907543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:35.908241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:35.908885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:36.015541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:36.092861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:36.104915 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2591d370-a907-4e21-9e4f-1d78e61c788f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.220861 Oct 18 14:04:36.106010 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3085/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:35 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:36.654717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:36.798914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1373390392", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:36.892240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:04:36.892739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:04:36.898227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:04:36.898227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:04:36.898227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:04:36.922205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:36.926799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:36.926799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:36.926799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:36.926799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:36.926799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:36.946526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Getting quotas for project 0ecce2c06c92430c960a30e339c67657. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:36.952182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Getting quotas for user a30abc68bfe54b08bec23485ea413465 and project 0ecce2c06c92430c960a30e339c67657. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:36.965876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:04:36.969095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:04:37.108640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-557e6d38-6fd7-4381-aa53-20073f15c0c2 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.459328 Oct 18 14:04:37.109690 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3242/6327] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 14:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 14:04:37.122097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:37.123569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:37.151335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:37.151985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:37.162921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:37.163699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:37.164599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:37.169710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:37.169710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:37.169710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:37.248757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:37.257624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:37.259213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:37.260469 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ad436c9-db3f-4db9-a48d-b8d0cdd384bb tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1281 microversion: 2.47 time: 0.142799 Oct 18 14:04:37.262976 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3086/6328] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:37 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:37.366764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:37.375613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4f5e4e5-d9a4-433a-a551-e8b117c2e4a1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.240217 Oct 18 14:04:37.386292 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3243/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:37 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:38.298944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:38.299582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:38.403658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:38.404253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:38.419567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:38.423902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:38.424776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:38.425312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:38.426319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:38.426951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:38.427579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:38.432894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:38.437062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:38.439797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97c1bc72-4eb7-4b87-9082-cad8ad6ebcfc tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1281 microversion: 2.47 time: 0.143768 Oct 18 14:04:38.477060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3087/6330] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:38 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:38.704505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:38.713596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83366399-41d9-4c3c-bd86-f9baba9058b6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.314191 Oct 18 14:04:38.714761 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3244/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:38 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:39.479619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:39.480250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:39.487065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:39.511077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:39.511965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:39.512651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:39.518530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:39.520049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:39.523735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:39.699612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:39.720179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:39.724347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:39.728139 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4d91a62-377e-4605-9168-059ac56d202f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1333 microversion: 2.47 time: 0.255615 Oct 18 14:04:39.742098 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3088/6332] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:39 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1333 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:39.742330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:39.742861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:39.762634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:39.763297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:39.772273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:39.773173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:39.774848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:39.775376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:40.173509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:40.181909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2738bbe0-b347-4f50-8f19-54da1d577f5b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.444908 Oct 18 14:04:40.182544 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3245/6333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:39 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:40.764376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:40.765224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:40.775772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:40.778902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:40.783565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:40.786641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:40.787337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:40.787988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:40.888006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:40.899767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:40.901192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:40.902429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53495311-7bad-4c23-84a4-aa809b216e5e tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1351 microversion: 2.47 time: 0.144003 Oct 18 14:04:40.903062 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3089/6334] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:40 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:04:41.205233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:41.206576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:41.214722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.215305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.227046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.227046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.227046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.227046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.399350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:41.411741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb896006-8a4c-402a-bae2-4defdcfc4105 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.208305 Oct 18 14:04:41.432226 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3246/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:41 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:41.565014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f45b48-8a87-44fa-aa81-bc4c223f4f49", "name": "network-vif-plugged", "status": "completed", "tag": "5d5419ff-6642-4385-875e-54f6fd192c9d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:41.580131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.580131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.580131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.592285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] Creating event network-vif-plugged:5d5419ff-6642-4385-875e-54f6fd192c9d for instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 on n-h1-858383-13 Oct 18 14:04:41.597697 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0e09f063-1102-43b5-b40e-b376bc4d1b46 req-80470da0-1e4b-4922-9de2-f1191b48331a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036305 Oct 18 14:04:41.598481 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3090/6336] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:41.935632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:41.936259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:41.943901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.945088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.946417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.947235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.947799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.948303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:42.074336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:42.083517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:42.085051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:42.086401 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa0c6a0c-1436-4ccd-b5a9-350e47070d62 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1339 microversion: 2.47 time: 0.154653 Oct 18 14:04:42.087045 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3247/6337] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:41 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1339 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:42.441313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:42.442034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:42.451738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:42.452183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:42.452693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:42.453410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:42.453929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:42.454350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:42.625243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:42.634514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ccbced7e-c8a0-4a38-ba44-0f6c87888847 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1373 microversion: 2.1 time: 0.203597 Oct 18 14:04:42.635097 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3091/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:42 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:43.113267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:43.115140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:43.122553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.123058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.123505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.124229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.124695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.125130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.200813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:43.209978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:43.211492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:43.212761 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31e9b311-68fb-4a5c-a105-9ee4348bf064 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1339 microversion: 2.47 time: 0.103689 Oct 18 14:04:43.213409 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3248/6339] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:43 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:43.657911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:43.658743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:43.666543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.667046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.667501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.668298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.668801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.669249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.817997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:43.827147 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ceb10811-2a16-4dc3-82db-70411a3c8db4 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1546 microversion: 2.1 time: 0.173056 Oct 18 14:04:43.828403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3092/6340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:43 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:43.853900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:43.854568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:43.860766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.861265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.861860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.862789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:43.863767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:43.865007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:43.880769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:44.026967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:44.035220 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0dbf8c7f-ed09-41f4-ae19-f11d0f9feac9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1546 microversion: 2.1 time: 0.186101 Oct 18 14:04:44.035889 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3249/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:43 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:44.238961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:44.240095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:44.246502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.247004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.247462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.248179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.248655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.249099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.320302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:44.328846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:44.330383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:44.332025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8d880f8-cbf1-44e0-a9ac-c42c650d59a3 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1360 microversion: 2.47 time: 0.096965 Oct 18 14:04:44.332947 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3093/6342] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:44 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1360 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:44.366651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-810009542"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:44.369302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:44.378510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.389545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.389545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.389545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.389545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.389545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.931950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7afc95b-a2cc-4b7d-8766-c99dc4edd198 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "POST /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349/action" status: 202 len: 52 microversion: 2.47 time: 0.569972 Oct 18 14:04:44.932939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3250/6343] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 14:04:44 2022] POST /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349/action => generated 52 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 18 14:04:44.945797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:44.947121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:44.955173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.955935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.956684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.957566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:44.958752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:44.959641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:44.990772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:45.527034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bcb70311-1d69-40ac-897f-90a91a4d826c tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 204 len: 0 microversion: 2.47 time: 0.586252 Oct 18 14:04:45.531255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3094/6344] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:04:44 2022] DELETE /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 14:04:45.541473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:45.543099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:45.549673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:45.550375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:45.550940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:45.552688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:45.565576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:45.566077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:45.660063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:45.663403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:45.664865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:45.666072 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58d80baf-cdfc-4595-a186-d1d705377c11 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1366 microversion: 2.47 time: 0.133285 Oct 18 14:04:45.666646 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3251/6345] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:45 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:04:46.694034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:46.694730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:46.701667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:46.702193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:46.702639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:46.709010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:46.709010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:46.709010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:46.780214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:46.789742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:46.791460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:46.792662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c22c223-44f5-4f67-93e5-6e1d94ab1932 tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1366 microversion: 2.47 time: 0.103606 Oct 18 14:04:46.793465 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3095/6346] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:46 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:46.966531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f45b48-8a87-44fa-aa81-bc4c223f4f49", "tag": "5d5419ff-6642-4385-875e-54f6fd192c9d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:46.974373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:46.975585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:46.982793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:46.983703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:46.984416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:46.999547 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] Creating event network-changed:5d5419ff-6642-4385-875e-54f6fd192c9d for instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 on n-h1-858383-13 Oct 18 14:04:47.007322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-503cb479-2132-4272-af0f-084f9fa65625 req-96fcd109-6eed-4ba4-8ffb-20d9e372f95f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044519 Oct 18 14:04:47.008728 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3252/6347] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:47.819498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:47.820460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:47.830040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:47.830572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:47.831026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:47.831756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:47.832218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:47.832660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:47.909394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:47.919668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:47.921182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a30abc68bfe54b08bec23485ea413465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecce2c06c92430c960a30e339c67657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:47.922406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aed04a6b-1f70-497e-ad41-a78a450c67fd tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 200 len: 1366 microversion: 2.47 time: 0.107633 Oct 18 14:04:47.922984 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3096/6348] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:47 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:04:48.951640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:48.952357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] [instance: 570a3681-103e-43b0-964b-ca4c36ac0349] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:48.963890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:48.968538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:48.969039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:48.969782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:48.973569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:48.974169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:48.994247 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] HTTP exception thrown: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Request method failure captured: Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 HTTP/1.1 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrJ009px-wgKNABLz8iTvdbAG8W_uG7F6aYM49oGwvk3EzANuEUoSPA8UxgdZr7hD4q1eakpzROa69JOLuHl7DIvCxOzvRBkGNSxCPKaWz2RObpB-i52hsvjE1eytcbxPQmGv-rrm3viO3I2uVcSNpEYaarjsgVsYR1CFHv3XgL4TU4 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0ecce2c06c92430c960a30e339c67657 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAaction247Test-245432984 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ecce2c06c92430c960a30e339c67657"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ecce2c06c92430c960a30e339c67657"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ecce2c06c92430c960a30e339c67657"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ecce2c06c92430c960a30e339c67657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAaction247Test-245432984 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0ecce2c06c92430c960a30e339c67657 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAaction247Test-245432984 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAaction247Test-245432984-project Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a30abc68bfe54b08bec23485ea413465 Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAaction247Test-245432984-project Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '570a3681-103e-43b0-964b-ca4c36ac0349'} Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:48.996063 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. Oct 18 14:04:49.001047 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:04:49.003046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] Returning 404 to user: Instance 570a3681-103e-43b0-964b-ca4c36ac0349 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:49.004793 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01c98bc4-507c-4533-b237-b003bec3996f tempest-ServersAaction247Test-245432984 tempest-ServersAaction247Test-245432984-project] 10.222.0.27 "GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349" status: 404 len: 111 microversion: 2.47 time: 0.058943 Oct 18 14:04:49.006126 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3253/6349] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:04:48 2022] GET /compute/v2.1/servers/570a3681-103e-43b0-964b-ca4c36ac0349 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:04:53.859428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1834218992", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4b8eb39d-52e3-404c-812b-447508a34270", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:53.874897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:53.942258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:04:54.405599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:04:54.406026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:04:54.406706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:04:54.407314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:04:54.407737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:04:54.427208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:54.427939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:54.428543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:54.429471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:54.430588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:54.431020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:54.463741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:54.470306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:54.543681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:04:54.546136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b8eb39d-52e3-404c-812b-447508a34270',volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:04:55.085383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d9d2798-f99b-40eb-bc6e-13f93788871b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229860 Oct 18 14:04:55.087075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3097/6350] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:04:55.099851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-143f1a8c-3ee9-45c9-aad2-c3f8370fbfa8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:55.100501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-143f1a8c-3ee9-45c9-aad2-c3f8370fbfa8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:55.180172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-143f1a8c-3ee9-45c9-aad2-c3f8370fbfa8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:55.193875 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-143f1a8c-3ee9-45c9-aad2-c3f8370fbfa8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1071 microversion: 2.1 time: 0.098684 Oct 18 14:04:55.207067 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3254/6351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:55 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1071 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:56.221098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:56.222689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:56.234779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:56.235583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:56.237171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:56.239913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:56.240948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:56.241591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:56.327039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:56.335851 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ae875e97-c22c-4bfa-9999-27c366244360 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1121 microversion: 2.1 time: 0.120443 Oct 18 14:04:56.336443 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3098/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:56 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1121 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:57.370507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:57.372128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:57.391297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:57.393717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:57.396713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:57.400096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:57.402799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:57.403758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:57.494926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:57.503388 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-036b0478-bf43-407d-bffb-d3364701d493 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1169 microversion: 2.1 time: 0.147844 Oct 18 14:04:57.505333 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3255/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:57 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1169 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:58.533387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:58.534192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:58.565239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:58.565770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:58.566253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:58.566987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:58.574158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:58.574585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:58.757296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:58.770633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a296e694-eeca-416f-b436-fc517fa418f9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1187 microversion: 2.1 time: 0.236740 Oct 18 14:04:58.783309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3099/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:58 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1187 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:59.846527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-533617637", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:59.885516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:59.886279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:59.898385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:59.901445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:59.903605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:59.904819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:59.906798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:59.908364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:59.990181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] validate_networks() for [('1e9f1925-ab60-4668-b7cd-4fcd49ebdafa', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:05:00.220421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:00.230595 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90df0e8d-0547-49c5-89b7-04f51c80d369 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.435326 Oct 18 14:05:00.231177 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3100/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:59 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:01.117316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:01.117782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:01.118278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:01.118693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:01.119108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:01.136152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:01.136648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:01.137096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.137828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:01.138329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:01.138763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.163726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Getting quotas for project d997272634b942cea71aa0192c8fd6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:01.171273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Getting quotas for user 9dad180b505844d3b17d811bc071e3e8 and project d997272634b942cea71aa0192c8fd6a3. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:01.190550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:01.193424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:01.254238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:01.255863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:01.263993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:01.264770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:01.265392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.266359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:01.267003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:01.267594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.402695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c46ce69b-4e65-4310-abde-ced6c7c3503f tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.881111 Oct 18 14:05:01.408000 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3256/6356] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:05:01.608213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c8bb0-a510-4597-aa5a-72895dd03710", "tag": "213d1c4f-0e99-4b2d-81d9-2477a7b3b571"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:01.611704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:01.626104 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c483823f-c0a3-4df1-886f-115012caf5e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.371402 Oct 18 14:05:01.626104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3101/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:01 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:01.641779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-55dd3c85-2705-44ea-abee-4eb764288cfb tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:01.642657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-55dd3c85-2705-44ea-abee-4eb764288cfb tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:01.647565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:01.648065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:01.648546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.686845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] Creating event network-changed:213d1c4f-0e99-4b2d-81d9-2477a7b3b571 for instance 310c8bb0-a510-4597-aa5a-72895dd03710 on n-h2-858383-13 Oct 18 14:05:01.700593 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7f97113e-2ad3-4b26-8609-3b3fd2e4bb99 req-3b33443d-fdd8-4556-99be-505215baa9e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291143 Oct 18 14:05:01.701846 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3257/6358] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:01.753834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55dd3c85-2705-44ea-abee-4eb764288cfb tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:01.762828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-55dd3c85-2705-44ea-abee-4eb764288cfb tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1223 microversion: 2.1 time: 0.138526 Oct 18 14:05:01.764292 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3102/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:01 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:02.650084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:02.650843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:02.683120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:02.683627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:02.684077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:02.685002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:02.685543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:02.685943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:02.791220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c332ddaf-f597-41d4-811e-4f67a5f88edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:02.792593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c332ddaf-f597-41d4-811e-4f67a5f88edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:02.899309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c332ddaf-f597-41d4-811e-4f67a5f88edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:02.906450 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c332ddaf-f597-41d4-811e-4f67a5f88edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1223 microversion: 2.1 time: 0.121721 Oct 18 14:05:02.912002 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3103/6360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:02 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:03.037298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:03.045835 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-982c9c0a-a61a-48e1-be4b-5515cbd665aa tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.400585 Oct 18 14:05:03.046969 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3258/6361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:02 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.012356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:04.033267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:04.046089 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f3bfe05-9c0a-434f-8df9-7be790cfb474 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1275 microversion: 2.1 time: 0.114743 Oct 18 14:05:04.046934 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3104/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:03 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:04.071720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:04.072849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:04.079855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.080254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.080706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.081415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.081865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.082520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.289509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:04.300748 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c16afc01-f93c-45cc-81a4-b9774870e2af tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.232843 Oct 18 14:05:04.301646 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3259/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:04 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:05.077622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:05.087024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:05.087659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:05.094049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.095629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.095629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.096293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.096765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.097206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.168461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:05.179028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-579f93a1-464a-4728-8575-ffe10e123342 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1275 microversion: 2.1 time: 0.103633 Oct 18 14:05:05.180496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3105/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:05 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:05.324714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:05.325358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:05.346209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.346798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.347276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.348090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.348604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.349052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.542561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:05.554238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3acaab28-e124-498f-98bd-f2a9f5db05e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.233723 Oct 18 14:05:05.555107 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3260/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:05 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:06.203426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:06.204798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:06.213462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.214090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.214660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:06.215480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.216051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.216588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:06.417994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:06.428465 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a1a9b65-0dc2-41e5-9cbd-2780d28de6b4 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.227491 Oct 18 14:05:06.429078 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3106/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:06 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:06.588329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:06.589300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:06.615119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.617849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.620660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:06.621714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.622445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.631007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:06.914153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:06.925241 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4657949d-b568-4669-91fc-9bb993341c87 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.345349 Oct 18 14:05:06.926014 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3261/6367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:06 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:07.459004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:07.459693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:07.468390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:07.469181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:07.469797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:07.470873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:07.471511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:07.471997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:07.527097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5e377-c04d-492e-8b8d-adcc8da55783", "tag": "4b156f72-eaa6-431a-a649-c0ebdb8bae91"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:07.538508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:07.540846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:07.541502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:07.542260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:07.555076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] Creating event network-changed:4b156f72-eaa6-431a-a649-c0ebdb8bae91 for instance d4c5e377-c04d-492e-8b8d-adcc8da55783 on n-h1-858383-13 Oct 18 14:05:07.565971 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f3ad9f21-2b9b-4fda-a745-ecfa8e3f7b3f req-b201faac-69eb-4464-9ed6-5a88e52241c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042553 Oct 18 14:05:07.566589 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3262/6368] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:07.747107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:07.760881 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71203258-0e22-4623-8f3e-c03f7e71df60 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.307346 Oct 18 14:05:07.763179 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3107/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:07 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:07.961768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:07.961768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:07.968425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:07.968872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:07.969324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:07.970036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:07.971075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:07.971075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:08.169884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:08.179122 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11700f3e-1eb9-4a73-9057-4623b3aca010 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1229 microversion: 2.1 time: 0.227930 Oct 18 14:05:08.181349 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3263/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:07 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1229 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:08.787960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:08.788689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:08.796184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:08.796748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:08.797262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:08.798117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:08.798576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:08.799048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:08.968758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:08.977683 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93d6a916-a877-4aa5-bfd7-591ccd1f5e93 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.194392 Oct 18 14:05:08.978380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3108/6371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:08 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:09.205129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:09.205777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:09.212786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.213283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.213728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.214451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.214910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.215342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.340264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:09.342912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:09.350159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.350637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.351125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.351854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.352320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.352767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.361996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:09.371427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-339ebb64-5265-4509-864b-4217968f4fda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.170263 Oct 18 14:05:09.372453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3264/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:09 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:09.481540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e11b4cfa-25fb-43b1-9d59-ff7e7819eefc tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49/action" status: 200 len: 24576 microversion: 2.1 time: 0.145009 Oct 18 14:05:09.482499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3109/6373] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:05:09 2022] POST /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49/action => generated 24576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:05:10.001878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:10.002595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:10.009169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.009741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.010273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.010982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.011444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.011880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.163176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:10.171262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66363548-8892-4ae5-aec6-661b46b94713 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.173324 Oct 18 14:05:10.171861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3265/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:09 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:10.396033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:10.396807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:10.404684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.405232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.405680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.406419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.406979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.407384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.587544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:10.595895 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42b40127-bfcc-4b54-9dfd-0a998ed341d7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.204700 Oct 18 14:05:10.596480 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3110/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:10 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:11.195559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:11.196256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:11.203738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.204644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.206263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.206880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.207970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:11.208773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.209333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.209863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:11.375998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:11.385318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f63b1419-5e91-4068-bd6a-8b394e0939aa tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.194808 Oct 18 14:05:11.386999 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3266/6376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:11 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:11.621184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:11.621875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:11.625113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.631498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.632099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.632649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:11.633451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.634264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.634900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:12.068309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:12.079674 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54a5e50a-1752-4b88-b4bc-d3179d208882 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.463504 Oct 18 14:05:12.080409 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3111/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:11 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:12.409488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:12.410123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:12.418970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:12.418970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:12.419645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:12.420410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:12.420973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:12.421397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:12.575817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:12.584417 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39280dda-2020-4d1e-ac72-4368edd4d0b9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.178872 Oct 18 14:05:12.585006 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3267/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:12 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:13.103318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:13.103946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:13.106680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=10 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:13.111710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:13.112233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:13.112682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:13.113385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:13.114495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:13.114985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:13.253258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:13.262727 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9623d920-1b68-47ce-911b-37ad1734ebd3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.163367 Oct 18 14:05:13.263791 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3112/6379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:13 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:13.500989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c5e377-c04d-492e-8b8d-adcc8da55783", "name": "network-vif-plugged", "status": "completed", "tag": "4b156f72-eaa6-431a-a649-c0ebdb8bae91"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:13.513824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:13.514927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:13.515384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:13.527708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] Creating event network-vif-plugged:4b156f72-eaa6-431a-a649-c0ebdb8bae91 for instance d4c5e377-c04d-492e-8b8d-adcc8da55783 on n-h1-858383-13 Oct 18 14:05:13.532946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-863364f7-b8c7-4c3a-afb8-9b23eb60b734 req-b77ef08a-a830-47fa-a638-4b01811b904b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036176 Oct 18 14:05:13.533554 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3268/6380] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:13.608668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:13.609380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:13.615970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:13.616476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:13.616934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:13.617922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:13.618759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:13.619213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:13.814272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:13.823453 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b047496a-ea63-4a49-a57f-bc4c9b5f7351 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.219144 Oct 18 14:05:13.824037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3113/6381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:13 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:14.288779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:14.289583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:14.296347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.296851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.297298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:14.298005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.298500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.299117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:14.513349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:14.513349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:14.513349 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57206ca1-7c0d-411f-850c-e7f664e0c13f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.200175 Oct 18 14:05:14.513349 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3269/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:14 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.903876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.016354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:15.024422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-feffb35a-6d11-42cd-b3b4-1d24cd829c7b tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1323 microversion: 2.1 time: 0.181319 Oct 18 14:05:15.024888 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3114/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:14 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:15.512863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:15.513489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:15.520436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:15.520930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:15.521378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.522095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:15.522563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:15.522999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.669038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:15.677531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9efee375-f0ae-4c60-8dd5-32da06773c36 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.169666 Oct 18 14:05:15.678128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3270/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:15 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:16.052306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.052944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.063319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.074121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.077746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.077746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.077746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.077746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.212960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:16.225424 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a9eef746-eba7-4640-970a-0e5fb6af655e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1520 microversion: 2.1 time: 0.181644 Oct 18 14:05:16.226234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3115/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:16.293001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc8edd81-f69b-4ba5-8d33-01d47672005e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-319416024", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc8edd81-f69b-4ba5-8d33-01d47672005e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 242 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-319416024", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-319416024', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1e9f1925-ab60-4668-b7cd-4fcd49ebdafa'}]}}} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:05:16.302927 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc8edd81-f69b-4ba5-8d33-01d47672005e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc8edd81-f69b-4ba5-8d33-01d47672005e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016154 Oct 18 14:05:16.308123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3271/6386] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:16 2022] POST /compute/v2.1/servers => generated 175 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:05:16.317044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.317644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: 5d528d17-18ef-40d6-8129-323db7f470cf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.324217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] HTTP exception thrown: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5d528d17-18ef-40d6-8129-323db7f470cf/metadata HTTP/1.1 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': '5d528d17-18ef-40d6-8129-323db7f470cf'} Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.334573 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 404 to user: Instance 5d528d17-18ef-40d6-8129-323db7f470cf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f685e6a7-27e6-427b-9baf-7bc284e81e09 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/5d528d17-18ef-40d6-8129-323db7f470cf/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024594 Oct 18 14:05:16.346176 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3116/6387] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/5d528d17-18ef-40d6-8129-323db7f470cf/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:05:16.398697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e337a1b8-d7ca-47da-8036-8c94feb9d36e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-914877538", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e337a1b8-d7ca-47da-8036-8c94feb9d36e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 498 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-914877538", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-914877538', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1e9f1925-ab60-4668-b7cd-4fcd49ebdafa'}]}}} Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 14:05:16.403189 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.406303 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.411695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e337a1b8-d7ca-47da-8036-8c94feb9d36e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.412640 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e337a1b8-d7ca-47da-8036-8c94feb9d36e tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018352 Oct 18 14:05:16.413757 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3272/6388] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:16 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:05:16.491458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c6953e7-a83d-4d45-9989-31b854951052 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1168690750", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c6953e7-a83d-4d45-9989-31b854951052 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 500 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1168690750", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1168690750', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1e9f1925-ab60-4668-b7cd-4fcd49ebdafa'}]}}} Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 14:05:16.496126 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c6953e7-a83d-4d45-9989-31b854951052 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c6953e7-a83d-4d45-9989-31b854951052 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010524 Oct 18 14:05:16.499365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3117/6389] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:16 2022] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:05:16.556649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a32769ce-6bbd-4888-9639-046f822ab430 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1875574973", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a32769ce-6bbd-4888-9639-046f822ab430 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 754 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1875574973", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1875574973', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1e9f1925-ab60-4668-b7cd-4fcd49ebdafa'}]}}} Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:05:16.560886 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:05:16.563561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:05:16.566109 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.566109 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.566109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a32769ce-6bbd-4888-9639-046f822ab430 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.566109 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a32769ce-6bbd-4888-9639-046f822ab430 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010660 Oct 18 14:05:16.566109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3273/6390] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:16 2022] POST /compute/v2.1/servers => generated 1197 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 14:05:16.612332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eec80641-2df6-44f6-bae0-8f6efb940edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1851694402", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eec80641-2df6-44f6-bae0-8f6efb940edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 1266 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1851694402", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1e9f1925-ab60-4668-b7cd-4fcd49ebdafa"}]}} Oct 18 14:05:16.616843 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1851694402', 'imageRef': '8cd3436a-01fb-4325-a6ee-cd057c374be6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1e9f1925-ab60-4668-b7cd-4fcd49ebdafa'}]}}} Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.619276 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:05:16.620451 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:05:16.622161 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 14:05:16.622161 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.622161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eec80641-2df6-44f6-bae0-8f6efb940edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.622161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eec80641-2df6-44f6-bae0-8f6efb940edf tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011597 Oct 18 14:05:16.622161 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3118/6391] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Oct 18 14:05:16 2022] POST /compute/v2.1/servers => generated 2221 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 14:05:16.628570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.629079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: 762995c5-2ede-4600-afac-075bf3f71247] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.635946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] HTTP exception thrown: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/762995c5-2ede-4600-afac-075bf3f71247/metadata/test2 HTTP/1.1 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '762995c5-2ede-4600-afac-075bf3f71247', 'id': 'test2'} Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:16.637628 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 404 to user: Instance 762995c5-2ede-4600-afac-075bf3f71247 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98dd42e6-a390-4fda-9335-cc9cf3136860 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/762995c5-2ede-4600-afac-075bf3f71247/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014637 Oct 18 14:05:16.642242 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3274/6392] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/762995c5-2ede-4600-afac-075bf3f71247/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:05:16.653240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.653781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.659831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.660318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.660762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.661454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.661922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.662382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.696036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:05:16.726505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.727136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.733558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.734111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.734537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.735291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.735756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.736371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.884632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:16.894464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-778411bd-6696-46bf-95ee-81615cfd246c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.181388 Oct 18 14:05:16.895563 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3275/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:17.085552 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68a55af9-b8ab-43d4-9bae-c4660991f6f9 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 204 len: 0 microversion: 2.1 time: 0.432204 Oct 18 14:05:17.085552 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3119/6394] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:05:16 2022] DELETE /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:05:17.106122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:17.107109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:17.114672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:17.115211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:17.115681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:17.116428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:17.116910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:17.117265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:17.256029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:17.263878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f62d0da-325e-4aa4-8cd0-04482303d775 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1526 microversion: 2.1 time: 0.176134 Oct 18 14:05:17.264444 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3276/6395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:17 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:17.919024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:17.919743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:17.927802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:17.927802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:17.927802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:17.928409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:17.928880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:17.929315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:18.081552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:18.089449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3fa580c-6f0c-454a-9b0b-9e8711103e54 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.174731 Oct 18 14:05:18.090019 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3120/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:17 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:18.297753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:18.298453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:18.306018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:18.306537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:18.306980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:18.307670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:18.308131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:18.308562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:18.451601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:18.460366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e6c5028-ede8-4ede-90f4-8c1520c810be tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1526 microversion: 2.1 time: 0.172891 Oct 18 14:05:18.460951 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3277/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:18 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:18.673367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c8bb0-a510-4597-aa5a-72895dd03710", "name": "network-vif-plugged", "status": "completed", "tag": "213d1c4f-0e99-4b2d-81d9-2477a7b3b571"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:18.684427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:18.685385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:18.686023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:18.699916 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] Creating event network-vif-plugged:213d1c4f-0e99-4b2d-81d9-2477a7b3b571 for instance 310c8bb0-a510-4597-aa5a-72895dd03710 on n-h2-858383-13 Oct 18 14:05:18.705259 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9d07542c-2a03-42c4-b125-3e0ec99a7c4b req-ae2027ee-3209-4351-90b8-557cc51ebb6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035734 Oct 18 14:05:18.705868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3121/6398] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:19.052630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c5e377-c04d-492e-8b8d-adcc8da55783", "name": "network-vif-deleted", "tag": "4b156f72-eaa6-431a-a649-c0ebdb8bae91"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:19.065104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.065612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.066088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.093745 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] Creating event network-vif-deleted:4b156f72-eaa6-431a-a649-c0ebdb8bae91 for instance d4c5e377-c04d-492e-8b8d-adcc8da55783 on n-h1-858383-13 Oct 18 14:05:19.101329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-421f4aa8-6dbe-420e-9039-45a95e284707 req-4bc0ccbe-6c0e-454b-b276-a88c81336670 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052404 Oct 18 14:05:19.114441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:19.115949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:19.120895 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3278/6399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:19.153514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.154124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.154786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.155715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.156788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.157407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.347296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:19.357101 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bb7cbb9-5cec-485f-8765-b7ce8e6a5ab6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1217 microversion: 2.1 time: 0.247778 Oct 18 14:05:19.358049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3122/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:19 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:19.485102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:19.486168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:19.494577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.496418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.496418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.496418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.496842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.497223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.543165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:19.543660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:19.544105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:19.544566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lazy-loading 'fault' on Instance uuid d4c5e377-c04d-492e-8b8d-adcc8da55783 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:05:19.589247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad180b505844d3b17d811bc071e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd997272634b942cea71aa0192c8fd6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:19.599670 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-690fb9ff-d6fe-410b-b76c-dbd6aa405ef8 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 200 len: 1313 microversion: 2.1 time: 0.118991 Oct 18 14:05:19.603089 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3279/6401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:19 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 1313 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:20.383193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:20.384456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:20.392627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.393378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.399135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.401279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.402497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.402948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.406159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:20.623682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:20.625136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] [instance: d4c5e377-c04d-492e-8b8d-adcc8da55783] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:20.642873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.643650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.644193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.644431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:20.645561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.646302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.646959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.652993 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3a6831e-a361-4072-aa0e-dd10a7902539 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1404 microversion: 2.1 time: 0.274951 Oct 18 14:05:20.653829 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3123/6402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:20 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:20.664212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] HTTP exception thrown: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Request method failure captured: Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 HTTP/1.1 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrKLsvy0TnBuuSt53_bQ3ah1NYwa2p8eKID6qp7lfTsAM5oU7SctxBucHac2RwNDRJ8Sy9hc9T3P-tT_tc-q2D7jDh0m2Xp8jrWrgyx5Dj2_5l9MIZYzs2djC_gFVVUKa2ebhkfCXoVIh2QaPR1DJUW4zrsvcESVxpQYe8xuZaPfgJg Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d997272634b942cea71aa0192c8fd6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d997272634b942cea71aa0192c8fd6a3 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-446157097 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 9dad180b505844d3b17d811bc071e3e8 Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-446157097-project Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'd4c5e377-c04d-492e-8b8d-adcc8da55783'} Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:20.665875 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] Returning 404 to user: Instance d4c5e377-c04d-492e-8b8d-adcc8da55783 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c911c3ea-ef26-4231-8333-df78a0e2c312 tempest-ServerMetadataNegativeTestJSON-446157097 tempest-ServerMetadataNegativeTestJSON-446157097-project] 10.222.0.27 "GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783" status: 404 len: 111 microversion: 2.1 time: 0.047968 Oct 18 14:05:20.669851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3280/6403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:20 2022] GET /compute/v2.1/servers/d4c5e377-c04d-492e-8b8d-adcc8da55783 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:05:20.695574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:20.696438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:20.704261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.705270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.706489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.708285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.712329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.712329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.903415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:20.914334 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c28042c0-080e-4e76-bda2-c27ec203b5b0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1404 microversion: 2.1 time: 0.224107 Oct 18 14:05:20.915466 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3124/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:20 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1404 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:20.938479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-270594221"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:20.940856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:20.947889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.948650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.949110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:20.949838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:20.950507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:20.950820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:21.081731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Attempting to quiesce instance before volume snapshot. Oct 18 14:05:21.148784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 18 14:05:21.439717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Creating snapshot from volume 4b8eb39d-52e3-404c-812b-447508a34270. {{(pid=121010) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 18 14:05:24.123898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c539be4-5d01-4cb0-8213-4d8a09b745b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710/action" status: 202 len: 0 microversion: 2.1 time: 3.183570 Oct 18 14:05:24.130207 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3281/6405] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:05:20 2022] POST /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710/action => generated 0 bytes in 3191 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 14:05:26.417693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-289548396", "imageRef": "ebae022d-e32c-4075-b287-272a8c56591c", "flavorRef": "452", "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:26.537588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:05:26.928597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6fd0a354-cbac-468f-ba3b-6e3271489b01 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: .version_select at 0x7fb3311901f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-973467565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMd4EB2zPGvtHHcFomLEoqeuCeUFE9t04LwbQmHTn80/9JI1OXCdIy7BoZrN7EDRsfDuhkzQOxmOvxv35vG43xCuJTa5JkUtl6GrhitLcRe9oqCax1mDkbntSwTq5Q981w=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:26.978860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6fd0a354-cbac-468f-ba3b-6e3271489b01 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:26.992283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-6fd0a354-cbac-468f-ba3b-6e3271489b01 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:27.118107 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6fd0a354-cbac-468f-ba3b-6e3271489b01 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.195304 Oct 18 14:05:27.119194 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3282/6406] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:05:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:27.144854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:27.145305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:27.145783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:27.146230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:27.146644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:27.156647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:27.157122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:27.157757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:27.158753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:27.159215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:27.159726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:27.179386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:27.185214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:27.200168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:27.202855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a1645982-2449-41da-b390-9a192b6d974b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:27.460887 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8173bc75-c879-4c38-94f1-433588aeecbc tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048116 Oct 18 14:05:27.462931 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3125/6407] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:05:27.475046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af089fe1-c1be-469d-b989-f44bcf09002a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:27.475880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af089fe1-c1be-469d-b989-f44bcf09002a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:27.776909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af089fe1-c1be-469d-b989-f44bcf09002a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:27.786411 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af089fe1-c1be-469d-b989-f44bcf09002a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1229 microversion: 2.1 time: 0.315094 Oct 18 14:05:27.810232 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3283/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:27 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1229 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:28.824767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2c6b3066-0a88-460c-aebb-d8f9caf10d9d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:28.825426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2c6b3066-0a88-460c-aebb-d8f9caf10d9d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:28.970102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2c6b3066-0a88-460c-aebb-d8f9caf10d9d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:28.979283 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2c6b3066-0a88-460c-aebb-d8f9caf10d9d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1229 microversion: 2.1 time: 0.165575 Oct 18 14:05:28.979970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3126/6409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:28 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:30.005083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:30.005083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:30.018734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.026900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.027379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.028153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.028655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.029177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.212367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:30.221088 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6430335b-5944-440e-8182-a3fcb929cd51 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1281 microversion: 2.1 time: 0.222626 Oct 18 14:05:30.221695 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3284/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:29 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:30.870596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1264162809", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": "none"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:30.948138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:30.948286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:30.948979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:30.949390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:30.949805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:30.959918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.960409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.960877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.962408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.962877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.963342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.991282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Getting quotas for project a79d8bf690d04c18b05c645663c4b164. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:30.997822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Getting quotas for user 68bd78c89d374f0da78cd4bd72048cfd and project a79d8bf690d04c18b05c645663c4b164. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:31.016469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:31.018908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:31.245800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:31.248611 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:31.255428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:31.256093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:31.256683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:31.257568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:31.258221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:31.258774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:31.283173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b4ab74f-d8cf-423f-8f6b-942ab51f882d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.589363 Oct 18 14:05:31.284759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3127/6411] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 14:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 14:05:31.299585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:31.301470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:31.346785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:31.358262 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-80daa07b-f047-4641-a39b-a9e0c31f1335 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1299 microversion: 2.1 time: 0.116555 Oct 18 14:05:31.362211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3285/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:31 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:31.446984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:31.468878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:31.475051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:31.476937 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-860413b5-fc23-461d-b93a-9bc5c29b66b5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1278 microversion: 2.57 time: 0.184005 Oct 18 14:05:31.478168 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3128/6413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:31 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:31.860166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2093162442", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "f92108d1-69e9-445b-9475-4c3377409410"}], "key_name": "tempest-TestNetworkBasicOps-973467565", "security_groups": [{"name": "tempest-secgroup-smoke-1360582980"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:32.082686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] validate_networks() for [('f92108d1-69e9-445b-9475-4c3377409410', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:05:32.388904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:32.390323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:32.414335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:32.415034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:32.415569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:32.416523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:32.417319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:32.418142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:32.731951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:32.746380 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-385c5fa5-3475-495c-b50f-22ad9648f14d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.361701 Oct 18 14:05:32.749779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3129/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:32 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:32.759399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:32.762952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:32.979024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:32.979529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:32.980071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:32.980686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:32.981296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:32.993814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:32.994546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.001141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.001141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.001141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.001141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.017048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:33.031217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:33.034401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:33.039268 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-998b1fdf-9af1-4851-b701-4e3881015344 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1278 microversion: 2.57 time: 0.288295 Oct 18 14:05:33.041522 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3130/6415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:32 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:33.046305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:33.054376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:33.110745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:33.114206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:33.364727 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77088f7e-857c-4091-9457-c382f458a1eb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.507546 Oct 18 14:05:33.367159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3286/6416] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:05:33.401915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a52abae0-0005-482c-ae3c-8dce581a59af tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:33.410445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a52abae0-0005-482c-ae3c-8dce581a59af tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:33.781203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:33.782312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:33.791529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.792540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.793922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.794506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.795209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.795859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.994947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.010622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6bd40ef-36c8-4c60-a38e-3434ca2ec42c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.238528 Oct 18 14:05:34.021147 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3287/6417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:33 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:34.061126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a52abae0-0005-482c-ae3c-8dce581a59af tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.106297 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a52abae0-0005-482c-ae3c-8dce581a59af tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1248 microversion: 2.1 time: 0.724665 Oct 18 14:05:34.117230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:34.117841 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3131/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:33 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1248 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:34.131961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:34.146034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:34.146823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:34.147444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:34.148366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:34.149035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:34.150336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:34.280795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.290476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.291973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.293327 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2a3ab7f-90e5-44de-a47f-bb9a047e59aa tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1330 microversion: 2.57 time: 0.194868 Oct 18 14:05:34.293824 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3288/6419] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:34 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1330 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:34.403760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4a9b60-1c29-476d-ab7e-016320f5167e", "tag": "59c40a55-3d35-425b-ba7c-9c731a8660d6"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:34.414666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:34.415158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:34.415603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:34.428585 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] Creating event network-changed:59c40a55-3d35-425b-ba7c-9c731a8660d6 for instance dd4a9b60-1c29-476d-ab7e-016320f5167e on n-h1-858383-13 Oct 18 14:05:34.437371 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e8b4d5d5-e444-4060-b087-3c2bfb6cef95 req-d5434d19-c368-4291-a614-6ae9fda2c6fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 Oct 18 14:05:34.437371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3132/6420] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:05:35.050559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:35.052159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:35.075278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.075778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.076240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.076972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.077446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.077942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.150242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:35.151366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:35.164715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.165293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.165811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.166624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.172347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.174299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.308632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.319769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.321031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-147d9e5c-7df7-4284-9aa4-f14a325aa54b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.281075 Oct 18 14:05:35.322159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3289/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:35 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:35.328305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:35.329135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:35.339309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.340513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.341438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.342515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.343160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.344094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.351834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d427f98-6fc3-43ad-9638-16ba17bce99b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1252 microversion: 2.1 time: 0.208076 Oct 18 14:05:35.353327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3133/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:35 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1252 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:35.425100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.436500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.438234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.441013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35e78eb1-c303-49ef-a0e4-7b0039b7015e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1336 microversion: 2.57 time: 0.117629 Oct 18 14:05:35.442511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3290/6423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:35 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:36.344824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:36.345450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:36.352297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.352785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.353230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.353915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.354405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.354840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.376157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:36.376801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:36.384471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.384984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.385450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.386205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.386689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.388075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.508154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.511998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:36.518493 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ae312ec-67a7-4f1d-acf4-bc3e3c0b7435 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1244 microversion: 2.1 time: 0.146168 Oct 18 14:05:36.519250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3291/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:36 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:36.527273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:36.527273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:36.532558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.533255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.533901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.534848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.535461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.535885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.547801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.556769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-17600e7b-56b5-427d-b22f-fe1ef3a67fd8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.215899 Oct 18 14:05:36.559873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3134/6425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:36 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:36.607515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.616975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.618891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.620295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d17faf94-1d3b-43d2-bc59-15c6c994fe28 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1336 microversion: 2.57 time: 0.099850 Oct 18 14:05:36.621294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3292/6426] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:36 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:37.551696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:37.552451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:37.559459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.559964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.560596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.561361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.561827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.562289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.595077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:37.595077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:37.595077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.595842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.596168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.597162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.597726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.598277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.631849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.639977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-460ed78a-2153-4017-95b8-cd9242b876c3 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1300 microversion: 2.1 time: 0.101907 Oct 18 14:05:37.641713 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3135/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:37 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:37.651801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:37.653048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:37.659763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.665106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.665106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.665106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.665106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.665106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.733119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.748687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.750577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.751932 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-795589dd-b148-4f5a-8066-f2dd876bd619 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1357 microversion: 2.57 time: 0.104894 Oct 18 14:05:37.753004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3136/6428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:37 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:37.779712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:37.783041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:37.790118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.790718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.792573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.794024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.794757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.796325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.847539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.860959 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3b6e997-4b27-4df8-b129-2a051234fbd6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.283715 Oct 18 14:05:37.872755 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3293/6429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:37 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:37.912400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:37.912894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:37.913378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:37.913797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:37.917540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:38.272145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:38.278256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.278753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.279207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.279920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.280386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.280825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.315441 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94245244-16db-4acc-95b9-ae0b4fcc30b4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "POST /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d/action" status: 202 len: 1138 microversion: 2.57 time: 0.539798 Oct 18 14:05:38.315987 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3137/6430] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Oct 18 14:05:37 2022] POST /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d/action => generated 1138 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 14:05:38.337353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:38.337995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:38.342258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:38.346839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.347342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.348340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.349827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.350321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.350766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.439416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:38.456084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:38.458208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:38.459699 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37e2e659-9e36-4c91-a252-412cfd402ecc tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.126362 Oct 18 14:05:38.488318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3294/6431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:38 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:38.664951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:38.668556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:38.672586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.673084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.673536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.674293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.674757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.675432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.760637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:38.768538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e22342c-2feb-4b12-8430-9afc9f51d401 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1306 microversion: 2.1 time: 0.108224 Oct 18 14:05:38.769122 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3138/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:38 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:38.889728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:38.897258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:38.914376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.915724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.916373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.917684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.918356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.918975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:39.123973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:39.147408 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfed5744-312d-4e4b-bfe5-aeb8e18e8b4f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.256078 Oct 18 14:05:39.148644 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3295/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:38 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:39.493873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:39.494767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:39.501285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.501899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.502460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:39.503245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.503895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.504489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:39.579571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:39.589269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:39.591026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:39.592046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95bef608-696b-4a83-9f30-d3a8337144ad tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.103885 Oct 18 14:05:39.592616 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3139/6434] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:39 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:39.795327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:39.798808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:39.806233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.806773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.808653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:39.808653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.809678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.809810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.029275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.048332 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a05c01ce-f6b2-4de7-bac3-5fd56bc020cd tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.254842 Oct 18 14:05:40.050392 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3296/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:39 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:40.172327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:40.173086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:40.180326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:40.182213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.182916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.183721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.184835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.185358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.185838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.309593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc101acf-f75b-4616-a536-0a140e0fcbfc", "tag": "ea403f90-7205-45ec-987a-a59440736909"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:40.321306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.322482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.322963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.335061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] Creating event network-changed:ea403f90-7205-45ec-987a-a59440736909 for instance fc101acf-f75b-4616-a536-0a140e0fcbfc on n-h2-858383-13 Oct 18 14:05:40.359260 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-69ac95d4-6d29-476d-a630-0d0b78eaa68c req-ace962b4-350e-430c-9f42-33b594c184b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Oct 18 14:05:40.360062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3297/6436] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:05:40.378323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.390108 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b350e03c-6af1-48a5-8aa2-2fc44c84b2e1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.221850 Oct 18 14:05:40.395419 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3140/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:40 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:40.619728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:40.620850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:40.634364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.635575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.636697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.638185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.638858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.639582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.727799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.732002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.733508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.734734 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-295b8399-357a-4159-b5a5-b025988b08c9 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.119501 Oct 18 14:05:40.735297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3298/6438] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:40 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:41.072999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:41.073650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:41.076257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:41.083865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.085117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.085117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.085572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.086039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.086501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.271306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:41.281630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a95c57b-c660-4d88-9e41-1c401545c395 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.212612 Oct 18 14:05:41.282352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3141/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:41 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:41.420828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:41.421347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:41.430270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.430785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.431275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.431998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.432476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.433059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.591323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:41.600340 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11d5b4c3-722e-423a-ba60-7454bb87204e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.183802 Oct 18 14:05:41.602239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3299/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:41 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:41.763078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:41.763732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:41.770004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.770534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.771019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.771712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:41.772159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:41.772599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:41.858287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:41.867339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:41.869262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:41.870538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eaa06dec-78dd-481f-b92d-f091653fc31e tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.111595 Oct 18 14:05:41.871345 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3142/6441] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:41 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:42.308330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:42.309013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:42.315101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.315604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.316064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.316759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.317229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.317706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.459985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.467872 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ba3b260-f983-48b8-add0-ae75c9174767 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.163408 Oct 18 14:05:42.468672 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3300/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:42 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:42.626830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:42.627450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:42.636032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.636660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.637115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.638106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.638740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.639164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.796559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.799611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:42.806376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d04f3d7e-3cad-4cdf-aa73-9268bd2318e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.183427 Oct 18 14:05:42.807147 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3143/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:42 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:42.904190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:42.904838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:42.911084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.911584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.912038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.912741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.913210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.913649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.982016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.993049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.995139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.996437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50e0a5f9-f865-4990-bd3a-fd9a2ebc28d6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.097899 Oct 18 14:05:42.997033 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3301/6444] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:42 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:43.498484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:43.498484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:43.500929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.502271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.502871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.504554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.506952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.507828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.662762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:43.675125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf8848b3-fb25-43e8-968a-dafa536ebcbe tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.187178 Oct 18 14:05:43.675807 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3144/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:43 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:43.836131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:43.836131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:43.838727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:43.839619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:43.842374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.842880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.843343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.844117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.844602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.845053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.990360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:43.998908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8bad4868-8d44-49b1-9ad2-fbedff7c095e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.169952 Oct 18 14:05:43.999548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3302/6446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:43 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:44.025497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:44.026158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:44.032491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.032984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.033437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.034184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.034651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.035697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.090728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=20 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:44.104779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:44.116408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:44.117978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:44.119246 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-356ce55f-977c-489e-a054-0b837ccd8a2a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.097988 Oct 18 14:05:44.119814 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3145/6447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:44 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:44.700414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:44.701305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:44.708369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.708876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.709328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.710040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.710534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.710979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.857467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:44.865389 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6dbbef8-41e0-4a8a-a823-36823de4f72e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.169348 Oct 18 14:05:44.865964 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3303/6448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:44 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:45.024494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:45.025132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:45.031956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.032464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.032890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:45.033582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.034146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.034518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:45.148412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:45.149234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:45.155761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.156555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.157529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:45.158592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.160604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.161893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:45.184897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:45.194275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fefd2aa8-fdee-4b3c-ac08-22867fdedb3d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.174656 Oct 18 14:05:45.195100 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3146/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:45 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:45.252528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:45.261527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:45.263114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:45.264333 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2abd540-8726-4b86-a5bc-fc6561febfe4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.120727 Oct 18 14:05:45.264910 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3304/6450] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:45 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:45.890921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:45.891550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:45.897723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.898255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.898703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:45.899403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:45.899887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:45.900325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:46.055349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:46.063371 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99366b15-fafd-4d1a-bc53-2db96e41f113 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.176352 Oct 18 14:05:46.064073 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3147/6451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:45 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:46.219214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:46.219845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:46.227682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:46.228150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:46.228616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:46.229333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:46.229880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:46.230355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:46.293462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:46.294102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:46.300671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:46.301176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:46.301914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:46.302665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:46.303136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:46.303572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:46.389489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:46.400048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:46.401776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:46.403957 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a39f431a-1d6a-432d-af4b-f5669381c265 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.114523 Oct 18 14:05:46.404738 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3148/6452] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:46 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:46.465835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:46.475136 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d31a5a7-7535-41e6-a1a5-9208c2272ac5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.259678 Oct 18 14:05:46.475841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3305/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:46 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:46.992233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc101acf-f75b-4616-a536-0a140e0fcbfc", "name": "network-vif-plugged", "status": "completed", "tag": "ea403f90-7205-45ec-987a-a59440736909"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:47.008450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.009164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.009674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.021871 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] Creating event network-vif-plugged:ea403f90-7205-45ec-987a-a59440736909 for instance fc101acf-f75b-4616-a536-0a140e0fcbfc on n-h2-858383-13 Oct 18 14:05:47.027433 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5179c41e-2489-453f-a04f-d776cb65b807 req-f0d85dd9-9b61-4f87-9f9d-831cb6f884f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038894 Oct 18 14:05:47.034547 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3149/6454] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:47.087620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:47.088398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:47.094821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.095326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.096120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.102780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.102780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.102780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.291470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:47.300544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb11d0b8-4f47-41bf-b855-557b51a51beb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.217508 Oct 18 14:05:47.301228 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3306/6455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:47 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:47.443348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:47.444317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:47.459368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.459875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.460325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.461037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.461500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.461937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.500928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:47.502212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:47.510660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.511725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.512533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.513598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:47.514316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:47.514995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:47.559430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:47.573087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:47.576400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:47.576876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06140afa-a715-43b2-9373-75e2bddf66f5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.139528 Oct 18 14:05:47.577790 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3150/6456] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:47 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:47.705795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:47.714145 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65c1861f-e42d-4706-b035-f3dbfb8303b4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.218677 Oct 18 14:05:47.714833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3307/6457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:47 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:48.325943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:48.326839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:48.333898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.334496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.335012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.335786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.336388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.336892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.490206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:48.498463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-44ef2258-57c7-4406-946b-140958d6782c tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1374 microversion: 2.1 time: 0.176511 Oct 18 14:05:48.499040 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3151/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:48 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:48.605198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:48.606452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:48.617367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.618484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.618607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.619293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.619775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.620218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.705847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:48.714403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:48.716112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:48.717311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d192cbe-7b19-4fa2-857d-f25bd797f28a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.116125 Oct 18 14:05:48.717912 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3308/6459] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:48 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:48.742256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:48.743260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:48.750100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.750935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.751606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.752588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:48.754024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:48.754358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:48.919589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:48.929843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11d665ce-c819-49e7-8dee-f3a45ad02e6f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.194130 Oct 18 14:05:48.930706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3152/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:48 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:49.523560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:49.524540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:49.531428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.532007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.532443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.533181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.533691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.542222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.542222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:49.698546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:49.707564 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c8a3343-043c-44a2-8fc9-72388785c27b tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1547 microversion: 2.1 time: 0.188342 Oct 18 14:05:49.718437 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3309/6461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:49 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:49.734251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:49.735061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:49.749228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.751410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.751866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.753635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:49.754296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:49.754989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.756909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.757372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.769591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.770252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.770816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.771715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.772625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.773118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.853145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:49.862771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:49.864389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:49.865955 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15a2ec84-fd15-4a17-9a09-3b5586d8832a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.122764 Oct 18 14:05:49.888533 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3310/6462] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:49 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:49.926535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:49.935418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ed9ea514-9a06-495f-83cc-8ec6adf813d9 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1547 microversion: 2.1 time: 0.205259 Oct 18 14:05:49.937625 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3153/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:49 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:49.958327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:49.959196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:49.965778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.966445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.967041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:49.967895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:49.968524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:49.969037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:50.120298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:50.129107 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d9f97c4e-c89f-4944-bc3b-fd0a5975c629 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.175037 Oct 18 14:05:50.129967 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3311/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:49 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:50.897640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:50.898468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:50.905368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:50.905858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:50.906407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:50.907029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:50.907489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:50.907945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:50.983883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:50.992540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:50.994008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:50.995275 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9229d633-78ed-4cf4-8bb8-763c5529f296 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.102108 Oct 18 14:05:50.996374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3154/6465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:50 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:51.153863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:51.154917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:51.162763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:51.163367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:51.163901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:51.164730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:51.165399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:51.165909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:51.321510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:51.331132 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8b73f6e4-d0ca-4515-9942-aa9e02cc6d5f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.181099 Oct 18 14:05:51.341836 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3312/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:51 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:52.022374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:52.022909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:52.029985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:52.030537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:52.030986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:52.031698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:52.032519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:52.033837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:52.106394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:52.116331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:52.124539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:52.128962 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1bb394b-fb0c-41fd-96a1-d83572d0a018 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.107938 Oct 18 14:05:52.128962 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3155/6467] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:52 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:52.355512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:52.356162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:52.363562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:52.364092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:52.364596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:52.365271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:52.365741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:52.366213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:52.606831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:52.619934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9fd7f8f-9c4d-4310-b75a-3defb76e035d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.268217 Oct 18 14:05:52.623916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3313/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:52 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:52.778513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f37909b-752f-4cd0-8241-d6714f0e955d tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Action: 'create', calling method: .version_select at 0x7fb331432790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1241537019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGLXEEEI6qjpSJRVsoQjpgurUBXr6+jvFfW1LQtphdPxm2ZsttYK8eF48kzLfBMSOL4BpNM2gP7nOs3VAAMU7VRnfWUNZ2EhhC3bJvbjuPTn3FLWAzB5z30KSY6efXJqg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:52.795835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9f37909b-752f-4cd0-8241-d6714f0e955d tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Getting quotas for project 0109abe8e76e4e5e9f622e401f9921b0. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:52.800730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9f37909b-752f-4cd0-8241-d6714f0e955d tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Getting quotas for user 0b5c1ca9fe7c4461a07baa70d73f04e7 and project 0109abe8e76e4e5e9f622e401f9921b0. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:52.973167 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f37909b-752f-4cd0-8241-d6714f0e955d tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.193940 Oct 18 14:05:52.973167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3156/6469] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:05:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:53.154150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:53.154807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:53.170453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:53.171425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:53.172139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:53.173162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:53.173814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:53.174497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:53.287478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:53.296717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:53.298703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:53.299956 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-183feba5-99e0-4888-a983-661934ffdf1d tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.150795 Oct 18 14:05:53.301021 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3314/6470] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:53 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:53.648858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:53.649465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:53.663014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:53.667281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:53.667281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:53.667281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:53.667281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:53.667281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:53.837109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:53.851285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f285c7df-c7ec-4f81-ae8c-f4278bb9423d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.207988 Oct 18 14:05:53.852075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3157/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:53 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:54.327841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:54.329246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:54.337104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:54.337975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:54.338705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:54.340504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:54.341111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:54.341645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:54.413450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:54.422912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:54.428892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:54.428892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f1e8463-0c0b-4b2d-b7af-6b67a9687ba6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.101705 Oct 18 14:05:54.428892 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3315/6472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:54 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:54.884154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:54.884154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:54.889636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:54.890192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:54.890656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:54.891614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:54.892089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:54.892532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:55.055626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:55.063943 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21963abc-1bde-4dea-9773-a168afa65d6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.187991 Oct 18 14:05:55.064529 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3158/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:54 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:55.453650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:55.455052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:55.468093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:55.470277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:55.470941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:55.472072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:55.472722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:55.473346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:55.557531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:55.565254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:55.567001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:55.568935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04f235b7-c35d-4233-b2fd-593dc33f2bd4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.119653 Oct 18 14:05:55.569700 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3316/6474] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:55 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:56.091512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:56.092143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:56.100660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.101200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.101664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.102488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.103080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.103524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.259887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:56.268402 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-94bc57ad-7418-4f2b-89f2-2defd8123e78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.183812 Oct 18 14:05:56.268986 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3159/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:56 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:56.403894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1527389289", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0e247234-b879-478b-9b4e-daa524bd4dca", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1241537019", "security_groups": [{"name": "tempest-secgroup-smoke-671404802"}], "networks": [{"uuid": "4967ff05-ba1e-497b-bd46-bc9cb1f3a413"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:56.548311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] validate_networks() for [('4967ff05-ba1e-497b-bd46-bc9cb1f3a413', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:05:56.601921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:56.604207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:56.612887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.613821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.617847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.619408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.619773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.620209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.733614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:56.745807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:56.750708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:56.754561 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e77266a6-d151-418d-ad9a-6cb523904d1a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.155893 Oct 18 14:05:56.756884 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3160/6476] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:56 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:05:57.071909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:57.071909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:57.071909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:57.071909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:57.071909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:57.086170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.086170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.086170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.086695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.087177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.087678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.107720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Getting quotas for project 0109abe8e76e4e5e9f622e401f9921b0. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:57.114798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Getting quotas for user 0b5c1ca9fe7c4461a07baa70d73f04e7 and project 0109abe8e76e4e5e9f622e401f9921b0. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:57.175189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:57.180546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e247234-b879-478b-9b4e-daa524bd4dca',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:57.292083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:57.292707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:57.299543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.300042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.300489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.301192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.301660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.302127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.438494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.447095 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64013a7f-8484-4b57-a816-87de9034750c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.158905 Oct 18 14:05:57.447666 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3161/6477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:57 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:57.631193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c77b511c-4335-48d7-8690-b896fa604d33 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.231156 Oct 18 14:05:57.636912 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3317/6478] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:05:57.643062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6150995-1cde-476c-8f2e-89b0e394737a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:57.643818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6150995-1cde-476c-8f2e-89b0e394737a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:57.702884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a6150995-1cde-476c-8f2e-89b0e394737a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.709835 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6150995-1cde-476c-8f2e-89b0e394737a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1099 microversion: 2.1 time: 0.070653 Oct 18 14:05:57.710448 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3162/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:57 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1099 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:57.790025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:57.791216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:57.797478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.798233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.798694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.799417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.799886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.800446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.869382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.878248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.880049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.881242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d05d357-f3c9-4bca-8e3e-4611101c37d7 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.095719 Oct 18 14:05:57.881804 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3318/6480] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:57 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:58.473318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:58.474886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:58.483430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.483929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.484379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.485130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.485756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.486400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.491443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:58.636083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:58.648684 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-801d5943-d038-4f2a-b44e-0e5138c7021b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.179511 Oct 18 14:05:58.661739 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3163/6481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:58 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:58.732997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51cedc01-0f13-402b-a2bd-1b6512415781 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:58.733549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51cedc01-0f13-402b-a2bd-1b6512415781 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:58.801583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-51cedc01-0f13-402b-a2bd-1b6512415781 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:58.811641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51cedc01-0f13-402b-a2bd-1b6512415781 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1099 microversion: 2.1 time: 0.082426 Oct 18 14:05:58.820745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3319/6482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:58 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1099 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:58.908677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:58.909301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:58.915397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.915898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.916348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.917041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.917502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.918319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.994145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.003032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.004507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.007138 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97d48c51-8217-4eb3-90a5-8de6038d6f91 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.102636 Oct 18 14:05:59.007587 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3164/6483] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:05:58 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:05:59.671928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:59.672560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:59.679363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:59.679870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:59.680331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:59.681175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:59.681663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:59.682112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:59.838550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:59.839441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:59.853110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:59.853578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.854099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:59.856810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:59.857538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:59.860118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:59.860711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:59.865422 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2413822-9654-4165-93cf-f4c731f17a77 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.196883 Oct 18 14:05:59.867221 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3320/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:59 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:59.938301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.947171 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-19b146aa-e451-42b0-b4a3-bc3adf4fcd43 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1197 microversion: 2.1 time: 0.114964 Oct 18 14:05:59.947991 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3165/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:59 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:00.034133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:00.040373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:00.041973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.042555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.043082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.043875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.044358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.044847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.115982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:00.125451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:00.127375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:00.130274 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf0426d7-fcf8-447f-a348-5ba0fd4f573f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.099892 Oct 18 14:06:00.140962 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3321/6486] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:00 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:00.891709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:00.892524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:00.899612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.900114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.900567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.901278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.901744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.902405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.972166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:00.972968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:00.981708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.982506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.982965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.983689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.984160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.984603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:01.058822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.068281 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdabe1ba-eb31-46e9-84ed-0648a6d1168b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1215 microversion: 2.1 time: 0.100630 Oct 18 14:06:01.070177 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3322/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:00 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:01.137780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.149849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ee8051e-62d4-499c-89f2-83fca4b1f883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.263029 Oct 18 14:06:01.151032 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3166/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:00 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:01.177967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:01.178936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:01.185390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:01.186174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:01.186788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:01.188457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:01.189956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:01.190749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:01.365898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.376698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.380780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.382198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1b82eab-86ee-4e8e-a58f-7cb5232fdc25 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.222883 Oct 18 14:06:01.383282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3323/6489] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:01 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:02.102614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:02.103243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:02.111082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.112524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.113238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.114319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.114789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.115230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.181111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:02.182878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:02.191710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.193902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.194604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.198700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.198700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.198700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.366154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.376423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec335def-3a01-48b6-a4d1-51264cb58cb1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1282 microversion: 2.1 time: 0.278384 Oct 18 14:06:02.385936 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3167/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:02 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:02.411238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:02.414177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:02.418256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.419808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.420516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.421132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.422024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.422688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.423285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.426552 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3bb105b-ff6c-4226-907c-a5d6a4c7fb22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.250503 Oct 18 14:06:02.427126 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3324/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:02 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:02.501232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.511155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.512670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.513924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-590381e3-48a1-42d7-8252-9923eb046696 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.109572 Oct 18 14:06:02.514775 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3168/6492] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:02 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:06:02.882075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:02.892687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.893492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.894197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.908743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] Creating event network-changed:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:06:02.914942 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cb0f923c-3fe8-4fdb-954e-f057a13f8d85 req-4a377c79-7542-4fc1-b8bb-d5739d99eeb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156498 Oct 18 14:06:02.915748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3325/6493] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:03.403897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:03.405304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:03.412902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.413418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.413898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.414712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.415183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.415624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.456291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:03.458288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:03.466119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.466636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.467125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.467937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.468411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.469026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.649863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.673511 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-74637207-da8c-4f07-b04b-7683aa8f6181 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.225096 Oct 18 14:06:03.677514 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3326/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:03 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:03.682823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:03.683637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:03.691915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.692823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.693525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.694539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.695236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.695897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.708436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.719759 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-52bc4a0f-8262-4a96-95b5-fc05558be41a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1282 microversion: 2.1 time: 0.321482 Oct 18 14:06:03.720647 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3169/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:03 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:03.800199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.827164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.841161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.843496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df2c1ab4-885f-4237-889c-ee0a78392a34 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.164505 Oct 18 14:06:03.844628 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3327/6496] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:03 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:04.700913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:04.701600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:04.709090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.709614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.710249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.711108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.711581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.712033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.747649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:04.749232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:04.762916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.763808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.764629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.765807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.766541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.767393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.794540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:04.897872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:04.906878 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3fb16ad1-e350-431b-8971-d6dc1f496a61 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.209700 Oct 18 14:06:04.907825 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3170/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:04 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:04.915614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:04.916491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:04.922846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.923684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.924303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.935821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.935821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.935821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.956802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:04.967374 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a5ee446-fba4-4bef-8a18-0f63b5b7c864 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1282 microversion: 2.1 time: 0.224881 Oct 18 14:06:04.969093 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3328/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:04 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:05.007033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:05.020748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:05.022452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:05.023652 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-010aad41-7e04-4693-a63a-5b99a2c5160a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.114658 Oct 18 14:06:05.024241 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3171/6499] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:04 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:05.933465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:05.934116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:05.941183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:05.941699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:05.942843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:05.943571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:05.944047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:05.944519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:05.996601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:05.998095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:06.009400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.017004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.017004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.017004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.017004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.017004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.137067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.146168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-92c7f338-3eee-4a48-b252-1aecba7352a4 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.216375 Oct 18 14:06:06.157070 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3329/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:05 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:06.168893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.182808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:06.183442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:06.186022 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96ca07c1-5236-4996-85e7-725cd1ef766a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1282 microversion: 2.1 time: 0.189545 Oct 18 14:06:06.190106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3172/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:05 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:06.194608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.195340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.195981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.196896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.197579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.198491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.276833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.286864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.288331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.289513 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b658fbd7-402e-4252-978f-f4553428c31a tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.131322 Oct 18 14:06:06.290117 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3330/6502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:06 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:07.172868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:07.173525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:07.181321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.181816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.182302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.182990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.183560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.183998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.216767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:07.217424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:07.223736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:07.225690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.226244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.226708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.227430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.227956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.228393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.347319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.355455 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-73dc8cae-330b-4932-b8aa-5d405005fbcd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.186532 Oct 18 14:06:07.356036 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3173/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:07 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:07.360741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:07.361681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:07.368509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.369076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.369536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.370284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.370749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.371193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.410815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.421902 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f00207ee-fc27-4d39-9655-f9cbe67ad8d1 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1282 microversion: 2.1 time: 0.208907 Oct 18 14:06:07.437800 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3331/6504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:07 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:07.444934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.453531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.455062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.456252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e51ff2a-7187-4825-98f3-ba730dd7a26b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.099093 Oct 18 14:06:07.456817 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3174/6505] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:07 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:08.379399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:08.380351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:08.387823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.388339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.388802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.389523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.389997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.390469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.447806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:08.449656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:08.456521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:08.473123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.474639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.475508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.476598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.477299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.479708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.580113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:08.590734 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e71b52a-a0d1-4035-8bed-0437ae0f1506 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.215200 Oct 18 14:06:08.591320 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3332/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:08 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:08.599369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:08.600114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:08.615660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.617455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.617455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.617455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:08.617859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:08.618309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:08.661043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:08.668939 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a05f68d-4dab-4caa-9825-884c280c6995 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.225250 Oct 18 14:06:08.669525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3175/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:08 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:08.687948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:08.696655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:08.698129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:08.699307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bcc8df1-e04b-446b-86c2-1bf306de579b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.106360 Oct 18 14:06:08.699859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3333/6508] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:08 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:09.614279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:09.615737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:09.623145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.623641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.624094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.624846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.625306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.625794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.692035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:09.694511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:09.695729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:09.701580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.702120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.702583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.703302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.703779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.704257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.771356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.778284 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06681a99-b1b6-44bd-bc01-2f36f9a50639 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.168013 Oct 18 14:06:09.779056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3176/6509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:09 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:09.783398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:09.784025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:09.789797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.790330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.790776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.791477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.791934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.792379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.859427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.862580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.871072 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33447b2d-9ad8-4294-9b5d-9ab187359c46 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.182503 Oct 18 14:06:09.871670 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3334/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:09 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:09.879179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.880972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.882197 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9d58b52-4f8a-42b0-b2b1-c921b51a55a5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.102376 Oct 18 14:06:09.882954 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3177/6511] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:09 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:10.802931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:10.803565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:10.806254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:10.811094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.811603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.812064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:10.812771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.813250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.813698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:10.894142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:10.895002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:10.902142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.902645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.903097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:10.903803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.904270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.904710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:10.956600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:10.964404 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95119242-0257-4a40-a011-696e4f6e7d0f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.165626 Oct 18 14:06:10.969366 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3335/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:10 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:10.970040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:10.970705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:10.976768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.977284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.977748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:10.978501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:10.978984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:10.979497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:11.056340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:11.073384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:11.078191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:11.079747 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72c789ce-c810-4349-83ef-450f7def2c3f tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1366 microversion: 2.57 time: 0.113814 Oct 18 14:06:11.080545 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3336/6513] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:10 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:11.321717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:11.329544 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25101cba-78d4-43e1-8e7b-8a6d95eff276 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.439373 Oct 18 14:06:11.330134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3178/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:10 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:11.988563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:11.989351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:11.997168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:11.997678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:11.998155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:11.998868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:11.999465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:11.999917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:12.108568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:12.109317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:12.113391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:12.119448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:12.120113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:12.120639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:12.121429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:12.122080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:12.122533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:12.134799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:12.142608 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe96c74c-dc69-4bed-921d-16818821bc2d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.158029 Oct 18 14:06:12.147133 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3337/6515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:11 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:12.205502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:12.205502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:12.215676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:12.217160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:12.218413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4510dc5b-9e92-48f5-89b8-d1975d5e40c5 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1372 microversion: 2.57 time: 0.114587 Oct 18 14:06:12.218978 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3179/6516] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:12 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:06:12.352930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:12.353990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:12.363005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:12.363692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:12.364241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:12.365428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:12.365912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:12.366394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:12.526747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:12.535483 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98bcb788-380b-4e5c-a7f9-9ecfb96e8f86 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.186522 Oct 18 14:06:12.542199 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3338/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:12 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:13.167313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:13.168148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:13.176266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.177626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.178349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.179168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.179749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.180448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.247620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:13.249360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:13.259407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.260227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.260878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.261632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.262624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.262720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.329613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:13.338936 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e176d267-60ac-4f18-9824-554c5ed2af52 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.175874 Oct 18 14:06:13.346860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:13.347056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3180/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:13 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:13.348491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:13.350813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:13.352012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-93ff4965-98cd-4c05-a1a4-a888bb1a369b tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1372 microversion: 2.57 time: 0.110105 Oct 18 14:06:13.352570 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3339/6519] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:13 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:06:13.561329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:13.562011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:13.569046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.569548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.569993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.570721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:13.571188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:13.571620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:13.755927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:13.765356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36446403-93e4-4865-b84b-99d7bb817a2f tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.207834 Oct 18 14:06:13.766350 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3181/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:13 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:14.368731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:14.369496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:14.376810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.377406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.377943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.378783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.379792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.379792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.390218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:14.393339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:14.398779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.399341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.399957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.400662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.401126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.401551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.491610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:14.502264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:14.504191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:14.506327 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-66e4d2f8-e998-465a-bdfc-86c2eb7af5ab tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1357 microversion: 2.57 time: 0.130306 Oct 18 14:06:14.507086 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3182/6521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:14 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1357 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:06:14.539848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:14.544805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:14.550580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.551117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.553529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.554365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.554852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.555357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.573133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:14.574265 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42372a61-4ab0-407c-956e-0aa6e92de496 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.209247 Oct 18 14:06:14.575315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3340/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:14 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:14.591215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:06:14.788848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:14.789486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:14.795775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.796249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.796733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.797520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.797994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.798465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.914766 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f6577c4-4540-4161-bb97-d67547df6193 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 204 len: 0 microversion: 2.57 time: 0.379060 Oct 18 14:06:14.915865 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3183/6523] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:06:14 2022] DELETE /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 14:06:14.924592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:14.925460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:14.934912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.935513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.936027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:14.936810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:14.937330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:14.937764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:15.046816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:15.054745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:15.055122 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-399a3249-3f84-4235-8649-c9408c0783ff tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.270198 Oct 18 14:06:15.064720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:15.066407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3341/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:14 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:15.066895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:15.068624 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-79555157-b372-4726-812d-b4e08ff10f69 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1363 microversion: 2.57 time: 0.148474 Oct 18 14:06:15.069455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3184/6525] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:14 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:06:15.603245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:15.604170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:15.610948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:15.611546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:15.612243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:15.613210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:15.613904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:15.615262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:15.772036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:15.781345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-943fc459-68e1-4d04-855c-47d87055e782 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.182496 Oct 18 14:06:15.790549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3342/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:15 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:16.088477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:16.089245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:16.097491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.098255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.098618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.100304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.100698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.101367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.105579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:16.113758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:16.129163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.132775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.134384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.141172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.141172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.141172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.228409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:16.237295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:16.239860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:16.242253 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b87c59a6-25d1-4a9a-89c6-84093c569ce6 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1363 microversion: 2.57 time: 0.144307 Oct 18 14:06:16.243806 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3343/6527] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:16 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:16.310509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:16.320568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-018d5cd2-3010-409b-ae51-cc7a9d849a42 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.236502 Oct 18 14:06:16.321723 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3185/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:16 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:16.806074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:16.806847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:16.814274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.814935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.815680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.816495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:16.817040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:16.817610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:16.958694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:16.962198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:16.967236 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdf5c14f-05f4-4050-9d0d-5a73c6d14f00 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1341 microversion: 2.1 time: 0.166185 Oct 18 14:06:16.968062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3344/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:16 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:17.273895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:17.274660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:17.285785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.287654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.289273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:17.290029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.290555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.291007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:17.338307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.338307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.338307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:17.339673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lazy-loading 'fault' on Instance uuid d3344910-3900-49ba-a391-117480958f9d {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:06:17.346825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:17.347620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:17.359976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.366313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.366313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:17.366313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.367281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.368023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:17.434043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:17.449668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:17.451582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68bd78c89d374f0da78cd4bd72048cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79d8bf690d04c18b05c645663c4b164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:17.453299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a9702da-c2ea-413c-a230-1b8a2221c208 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 200 len: 1368 microversion: 2.57 time: 0.184187 Oct 18 14:06:17.453870 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3186/6530] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:17 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:17.635227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:17.645195 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8561992-ac0a-4c4c-9632-493be76c3377 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.304157 Oct 18 14:06:17.646882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3345/6531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:17 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:17.976993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "name": "network-vif-plugged", "status": "completed", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:17.991493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:17.992402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:17.994586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:17.995076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:17.995509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.012112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.015926 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] Creating event network-vif-plugged:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:06:18.016618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.017316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.022477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-63a8933e-f7bd-4cea-ac49-34f48928d5ef req-e08582e5-e4f8-4323-80d8-9f68aa821c00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050112 Oct 18 14:06:18.023333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.023471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3187/6532] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:18.024166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.025092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.481437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:18.482261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] [instance: d3344910-3900-49ba-a391-117480958f9d] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:18.489481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.490017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.490497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.491445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.491978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.492597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.511927 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] HTTP exception thrown: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Request method failure captured: Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d HTTP/1.1 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrKqlGludR-bJ0xdkHpiL-Eu5WYdxLNP3Dq7sWgwjT4WSTNJRU9-LGdWCpExPITsXmifJE52Z3tjBKTHQ5zW7STRjP4RBIS5CYqQHPkJqc2_Wxq_dHtcI-0gwJc-0wf97sbHPI9unGqqJfaIhimb0Edswv2XkOcT5kW_w4LhqO50Kh4 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.57 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a79d8bf690d04c18b05c645663c4b164 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerShowV257Test-1236989091 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a79d8bf690d04c18b05c645663c4b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a79d8bf690d04c18b05c645663c4b164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a79d8bf690d04c18b05c645663c4b164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a79d8bf690d04c18b05c645663c4b164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerShowV257Test-1236989091 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a79d8bf690d04c18b05c645663c4b164 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerShowV257Test-1236989091 Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerShowV257Test-1236989091-project Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 68bd78c89d374f0da78cd4bd72048cfd Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerShowV257Test-1236989091-project Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd3344910-3900-49ba-a391-117480958f9d'} Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:18.514258 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] Returning 404 to user: Instance d3344910-3900-49ba-a391-117480958f9d could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0d8b2bd3-db9d-4030-bbbe-a50004f496a4 tempest-ServerShowV257Test-1236989091 tempest-ServerShowV257Test-1236989091-project] 10.222.0.27 "GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d" status: 404 len: 111 microversion: 2.57 time: 0.038752 Oct 18 14:06:18.526029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3188/6533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:18 2022] GET /compute/v2.1/servers/d3344910-3900-49ba-a391-117480958f9d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 14:06:18.531163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:18.547461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b96f9edb-368c-485f-9e0a-7beac174f3f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1387 microversion: 2.1 time: 0.561517 Oct 18 14:06:18.553460 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3346/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:17 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1387 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:18.670308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:18.671484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:18.689419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:18.825190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:18.834931 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-915e9f8c-ce6a-4e81-a641-9b092a852dc8 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1270 microversion: 2.1 time: 0.170251 Oct 18 14:06:18.835819 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3189/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:18 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:19.588989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:19.589600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:19.590357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:19.601709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:19.606721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.607700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.609918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:19.609918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.609918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.609918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:19.622093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.622622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.623089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:19.623836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.624320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.624775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:19.646729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:06:19.873673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:19.883694 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9db3aee7-9fa7-4dc7-8742-ffdae67ab73e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.308046 Oct 18 14:06:19.884898 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3347/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:19 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:19.890182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:19.891106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:19.904988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.906015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.906730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:19.907670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:19.908478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:19.910529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.088473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1865737-95c9-4cf3-b260-415830dfebe1 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 204 len: 0 microversion: 2.1 time: 0.498168 Oct 18 14:06:20.088473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3190/6537] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:06:19 2022] DELETE /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:06:20.094867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:20.095586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:20.103667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.104227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.104684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.105529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.105994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.106517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.151395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:20.161203 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-559964cd-9846-416f-a201-3fff5dbdf33b tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1460 microversion: 2.1 time: 0.274807 Oct 18 14:06:20.165729 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3348/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:19 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1460 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:20.185732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:20.186361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:20.193362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.193933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.194420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.195448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.196197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.196822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.327848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:20.338354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-165e3195-3de6-433f-9a56-cc79ec70a6e6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1553 microversion: 2.1 time: 0.249225 Oct 18 14:06:20.350087 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3191/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:20 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:20.388560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:20.397464 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-da3b3d5e-0fe3-45d9-80aa-026c4f693608 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1460 microversion: 2.1 time: 0.215935 Oct 18 14:06:20.403774 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3349/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:20 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1460 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:20.916076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:20.916708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:20.923977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.924479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.924924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:20.925617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:20.926278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:20.927381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:21.072512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:21.081639 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c30efb3-f05e-45bf-813f-87fa36f25c19 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.169368 Oct 18 14:06:21.082554 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3192/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:20 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:21.365950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:21.366633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:21.373495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:21.374018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:21.379624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:21.379624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:21.379624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:21.379624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:21.617601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:21.628908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-406b2616-8189-4011-8716-9fe52fe0ee73 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1553 microversion: 2.1 time: 0.266679 Oct 18 14:06:21.637528 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3350/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:21 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:22.105491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:22.106446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:22.115471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:22.116299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:22.117022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:22.118028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:22.118765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:22.119450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:22.312474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:22.325852 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0da8e3a5-be20-40bf-b26c-155b585fcad5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.224591 Oct 18 14:06:22.327531 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3193/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:22 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:22.654882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:22.656490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:22.663930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:22.664586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:22.665147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:22.666162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:22.666855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:22.667547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:22.964868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:22.976676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-835c83bf-fca1-4de2-8c67-770c304fe20d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1553 microversion: 2.1 time: 0.326312 Oct 18 14:06:22.978123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3351/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:22 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:23.223926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc101acf-f75b-4616-a536-0a140e0fcbfc", "name": "network-vif-deleted", "tag": "ea403f90-7205-45ec-987a-a59440736909"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:23.235764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:23.236593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:23.237245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:23.242417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:23.251307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] Creating event network-vif-deleted:ea403f90-7205-45ec-987a-a59440736909 for instance fc101acf-f75b-4616-a536-0a140e0fcbfc on n-h2-858383-13 Oct 18 14:06:23.257672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e9635bf4-a19b-45df-a66c-6f55a0f3cbc9 req-778f5fe3-a580-4ea7-b829-dcd08ee2ba05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Oct 18 14:06:23.258926 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3194/6545] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:23.351558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:23.352237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:23.359758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:23.365652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:23.366184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:23.368576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:23.369297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:23.369926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:23.828163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:23.846747 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-924fa8e9-8d88-41d5-b398-bf546f5e0d45 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.499785 Oct 18 14:06:23.866650 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3352/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:23 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:24.006609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:24.007908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:24.018084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:24.018911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:24.019695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:24.020817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:24.021387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:24.022088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:24.083237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:24.084160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:24.084781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:24.085434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lazy-loading 'fault' on Instance uuid fc101acf-f75b-4616-a536-0a140e0fcbfc {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:06:24.181064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:24.194498 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-26093ac1-6bc6-4def-85e4-10fd7e236f41 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 200 len: 1338 microversion: 2.1 time: 0.194790 Oct 18 14:06:24.195799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3195/6547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:23 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:24.876372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:24.877618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:24.886270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:24.886984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:24.887657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:24.889829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:24.890545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:24.896174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:25.112732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:25.121710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b32c12f-40bd-4b3e-a761-4480ba65ed3b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.248988 Oct 18 14:06:25.138010 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3353/6548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:24 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:25.221571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:25.222962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: fc101acf-f75b-4616-a536-0a140e0fcbfc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:25.230411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:25.231177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:25.231705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:25.232853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:25.232967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:25.233363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:25.257497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] HTTP exception thrown: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Request method failure captured: Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc HTTP/1.1 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrJR6k1ATdORqtHnni3iVH-mCMwgTrWrazzHKGaEHG-0MqP3ZxCP4uR8NYPzn6FOcUtEx0NAN4-H6apKd_fIbCGY_nD0SzyM-msRjKY8Q8o_fjcOI6JXofTSkisVMYkxPYAJGujJrpmK6p-WgnHhYRSfikuxEKz_g5z0pvMuePMQbEI Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 8e66870b1baa4c3aaebe72cf76b25453 Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'fc101acf-f75b-4616-a536-0a140e0fcbfc'} Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:25.259034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. Oct 18 14:06:25.264112 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:25.265481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Returning 404 to user: Instance fc101acf-f75b-4616-a536-0a140e0fcbfc could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:06:25.266559 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be90d218-0507-4d03-896b-7748cfa4a13f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc" status: 404 len: 111 microversion: 2.1 time: 0.050433 Oct 18 14:06:25.271060 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3196/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:25 2022] GET /compute/v2.1/servers/fc101acf-f75b-4616-a536-0a140e0fcbfc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:06:25.298269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:25.313730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:25.314292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:25.314763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:25.337056 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] Creating event network-changed:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:06:25.348323 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-48d73fd8-b66f-4f39-bdba-dd52030fe46a req-c3f95ea7-c101-4ac7-b927-69b43612fdcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063001 Oct 18 14:06:25.350609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3354/6550] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:25.610907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-73fc1a02-705f-4a2c-b3a6-a33319efc610 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '.version_select at 0x7fb32bea5af0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:25.722546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-73fc1a02-705f-4a2c-b3a6-a33319efc610 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-973467565" status: 202 len: 0 microversion: 2.1 time: 0.115592 Oct 18 14:06:25.736764 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3197/6551] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 14:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-973467565 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:06:26.147449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:26.148808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:26.161298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:26.162102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:26.163766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:26.168928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:26.168928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:26.168928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:26.384570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:26.396392 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2494e4c2-9d13-494d-91cc-04ae870d53a3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.254549 Oct 18 14:06:26.398862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3355/6552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:26 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:27.432592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:27.432592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:27.443990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:27.444522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:27.444995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:27.445700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:27.446194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:27.446637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:27.718915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:27.747660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:27.748615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:27.749795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:27.767009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] Creating event network-changed:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:06:27.792307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-15546eb5-3ebf-401b-b914-a8f40a96471d req-8f0dbe52-4a74-46b7-9fc7-4b43517a469e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080314 Oct 18 14:06:27.805047 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3356/6553] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:06:27.888075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:27.909257 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-111d578a-3da2-4e4e-bcc0-48d33edc07e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.483622 Oct 18 14:06:27.913076 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3198/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:27 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:28.946724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:28.947396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:28.958912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:28.959433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:28.959900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:28.960653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:28.961536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:28.961536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:29.709069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:29.709572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:29.721781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:29.729579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:29.730110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:29.730902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:29.731374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:29.731807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:29.748669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:29.759147 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d50df116-6a61-4d62-bd94-68fe694c8883 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.818219 Oct 18 14:06:29.774090 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3357/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:28 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:29.781732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f45b48-8a87-44fa-aa81-bc4c223f4f49", "tag": "5d5419ff-6642-4385-875e-54f6fd192c9d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:29.793901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:06:29.807022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:29.807918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:29.808546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:29.828942 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] Creating event network-changed:5d5419ff-6642-4385-875e-54f6fd192c9d for instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 on n-h1-858383-13 Oct 18 14:06:29.843539 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8e37f0f0-de8e-43b6-89d4-667997dff994 req-0dedf23f-708b-4724-be05-9ad724c465d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074290 Oct 18 14:06:29.844719 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3358/6556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:29.854476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:29.868913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:29.869826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:29.870627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:29.890478 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] Creating event network-changed:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:06:29.893205 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-107b786d-7bf8-4e23-8a6d-e2e74f0d446a req-f91bed88-d0de-4f43-b5b0-437c871a18e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046481 Oct 18 14:06:29.895696 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3359/6557] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:30.233971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d5079d7-63ed-46fd-a324-52e5ff0775c5 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 204 len: 0 microversion: 2.1 time: 0.529762 Oct 18 14:06:30.237913 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3199/6558] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:06:29 2022] DELETE /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:06:30.245170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:30.245900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:30.252345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:30.252865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:30.253328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:30.254046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:30.272946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:30.273359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:30.591948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:30.603077 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71237a78-d2cf-4f45-a73f-cc71e13be8ec tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1670 microversion: 2.1 time: 0.361864 Oct 18 14:06:30.603526 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3360/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:30 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1670 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:30.785450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:30.786378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:30.795037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:30.797098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:30.797098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:30.797098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:30.798205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:30.798755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:31.096925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:31.106346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22ee6114-01a0-4968-811c-e33484240ca8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.325485 Oct 18 14:06:31.107017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3200/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:30 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:31.630924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:31.631618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:31.646937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:31.647462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:31.647993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:31.659290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:31.659947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:31.660427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:31.887075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:31.896925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-662c3f1d-f6bd-4693-a9e8-113229650b65 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1670 microversion: 2.1 time: 0.269485 Oct 18 14:06:31.897988 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3361/6561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:31 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1670 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:32.022734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4a9b60-1c29-476d-ab7e-016320f5167e", "name": "network-vif-plugged", "status": "completed", "tag": "59c40a55-3d35-425b-ba7c-9c731a8660d6"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:32.034831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:32.035732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:32.036950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:32.051381 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] Creating event network-vif-plugged:59c40a55-3d35-425b-ba7c-9c731a8660d6 for instance dd4a9b60-1c29-476d-ab7e-016320f5167e on n-h1-858383-13 Oct 18 14:06:32.057070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3f095962-e59b-4ec1-a550-a0e277ab6c43 req-d4b6ced5-e212-44b4-aa16-b744ee03b0d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038990 Oct 18 14:06:32.063054 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3201/6562] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:32.137801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:32.139295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:32.152746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:32.153670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:32.154491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:32.155408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:32.156199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:32.157951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:32.391260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:32.410343 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab9f9a54-796f-46c5-a811-665cf34e7233 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.282289 Oct 18 14:06:32.412603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3362/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:32 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:32.702676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b43d8803-bbac-424f-84ba-9c7aebc3026f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: .version_select at 0x7fb3352d6280>, body: {"keypair": {"name": "tempest-keypair-1431787794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHf9JqTV/BzPuX8yfWi0p5zQb60xlSIINkKdK3jLE7OnQVh/pVuXzkqenqW9JqbTUm8GJgtK5snGq/3+L44w0VVSn8KLMZtSG2SabDnzblpY1plhBJf2RbvDn2qcQQw1A=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:32.719818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b43d8803-bbac-424f-84ba-9c7aebc3026f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for project 1858431337674b66a5b20c21bea03164. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:06:32.726514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b43d8803-bbac-424f-84ba-9c7aebc3026f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for user 59e8ec11269d4e2f9e78e95950642232 and project 1858431337674b66a5b20c21bea03164. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:06:32.813095 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b43d8803-bbac-424f-84ba-9c7aebc3026f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.293579 Oct 18 14:06:32.813644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3202/6564] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 14:06:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 295 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 14:06:32.923296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:32.923930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:32.937647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:32.938191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:32.938656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:32.939391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:32.939853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:32.940338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:33.080594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f45b48-8a87-44fa-aa81-bc4c223f4f49", "name": "network-vif-deleted", "tag": "5d5419ff-6642-4385-875e-54f6fd192c9d"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:33.093341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:33.094640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:33.101421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:33.104869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:33.109226 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] Creating event network-vif-deleted:5d5419ff-6642-4385-875e-54f6fd192c9d for instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 on n-h1-858383-13 Oct 18 14:06:33.113796 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c333b30a-caff-4bd1-a872-a96aa1601eeb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1602 microversion: 2.1 time: 0.194239 Oct 18 14:06:33.115105 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3363/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:32 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1602 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:33.115464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e5008bfc-7b1f-4482-82ec-921da18bbea1 req-82eaaf97-c68d-42c2-aa2f-a2963be66c35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041313 Oct 18 14:06:33.116049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3203/6566] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:33.438931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:33.439575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:33.450241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:33.454954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:33.455995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:33.463707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:33.463707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:33.463707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:33.465800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:33.648993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:33.657817 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2989c944-2257-411d-bf9e-88327c9f475d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1375 microversion: 2.1 time: 0.222610 Oct 18 14:06:33.658484 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3364/6567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:33 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:34.148374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:34.149181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:34.155760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.156387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.156937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.157886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.158450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.158969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.205515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.206093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.208340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.208340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lazy-loading 'fault' on Instance uuid 94f45b48-8a87-44fa-aa81-bc4c223f4f49 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:06:34.272770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:34.298762 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a05e6b4-81f3-4d0e-a727-eb07c013ce74 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 200 len: 1337 microversion: 2.1 time: 0.155629 Oct 18 14:06:34.310148 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3204/6568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:34 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 1337 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:34.694436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:34.702046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:34.716518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.717050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.717516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.718424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.718918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.719429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.936637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:34.947439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50bb0fd3-b90d-4584-9a16-8bcd84628579 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1562 microversion: 2.1 time: 0.266262 Oct 18 14:06:34.964515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3365/6569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:34 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:34.972470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:34.973392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:34.980953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.981460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.982202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:34.982660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:34.983129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:34.983570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:35.325450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:35.326339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 94f45b48-8a87-44fa-aa81-bc4c223f4f49] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:35.335933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:35.336628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:35.337150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:35.339255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:35.340046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:35.340826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:35.359188 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] HTTP exception thrown: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Request method failure captured: Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 HTTP/1.1 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrJR6k1ATdORqtHnni3iVH-mCMwgTrWrazzHKGaEHG-0MqP3ZxCP4uR8NYPzn6FOcUtEx0NAN4-H6apKd_fIbCGY_nD0SzyM-msRjKY8Q8o_fjcOI6JXofTSkisVMYkxPYAJGujJrpmK6p-WgnHhYRSfikuxEKz_g5z0pvMuePMQbEI Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8e66870b1baa4c3aaebe72cf76b25453 Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '94f45b48-8a87-44fa-aa81-bc4c223f4f49'} Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:35.361755 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. Oct 18 14:06:35.367389 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:06:35.369317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Returning 404 to user: Instance 94f45b48-8a87-44fa-aa81-bc4c223f4f49 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:06:35.370945 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6486e385-d53a-41d8-93b8-6ae93fb4dabb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49" status: 404 len: 111 microversion: 2.1 time: 0.049547 Oct 18 14:06:35.372076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3366/6570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:35 2022] GET /compute/v2.1/servers/94f45b48-8a87-44fa-aa81-bc4c223f4f49 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:06:35.532220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:35.543401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58ee3d65-15b3-4905-b736-ed534e688c90 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1562 microversion: 2.1 time: 0.574942 Oct 18 14:06:35.565967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3205/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:34 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1562 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:35.673155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:35.673701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:35.679156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5fafca0b-ddbb-459e-a50a-cad6c0fb6701 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '.version_select at 0x7fb330cf8940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:35.691316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:35.696107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:35.696758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:35.697504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:35.697963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:35.709068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:35.737581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:06:35.808980 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5fafca0b-ddbb-459e-a50a-cad6c0fb6701 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-20049699" status: 202 len: 0 microversion: 2.1 time: 0.139718 Oct 18 14:06:35.809774 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3206/6572] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 14:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-20049699 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:06:36.058005 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-465a9e09-8904-4f1f-8f0d-6f46635f7af6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 204 len: 0 microversion: 2.1 time: 0.389778 Oct 18 14:06:36.058900 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3367/6573] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:06:35 2022] DELETE /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:06:36.068576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:36.069479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:36.076021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:36.076584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:36.077251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:36.078467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:36.078933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:36.079554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:36.240146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:36.251010 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa39b654-750e-4004-b022-a8582f008c71 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1568 microversion: 2.1 time: 0.187597 Oct 18 14:06:36.265041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3207/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:36 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:36.361489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-651750366", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f2a4e5-7315-4cd6-9cfb-e500b1385b93"}], "security_groups": [{"name": "tempest-securitygroup--210292443"}], "key_name": "tempest-keypair-1431787794", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:36.532177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] validate_networks() for [('43f2a4e5-7315-4cd6-9cfb-e500b1385b93', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:06:37.173634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:06:37.175087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:06:37.175087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:06:37.175464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:06:37.176025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:06:37.186830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:37.187343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:37.187809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:37.188567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:37.189048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:37.189501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:37.207425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for project 1858431337674b66a5b20c21bea03164. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:06:37.212830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for user 59e8ec11269d4e2f9e78e95950642232 and project 1858431337674b66a5b20c21bea03164. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:06:37.225721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:06:37.228178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:06:37.278248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:37.278652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:37.290631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:37.291142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:37.291600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:37.292329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:37.292798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:37.293438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:37.358168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1c8ead1-8e23-4fff-a0af-6371e9705b92 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.009736 Oct 18 14:06:37.366075 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3368/6575] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 14:06:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 14:06:37.373249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:37.374247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:37.493626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:37.503153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:37.505442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:37.506693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71a2be7a-067d-4816-8765-cb2665413594 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1281 microversion: 2.20 time: 0.138606 Oct 18 14:06:37.507271 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3369/6576] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:37 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:37.528606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:37.540322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28640b60-538e-4472-98d6-34f0c51831ab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1568 microversion: 2.1 time: 0.265896 Oct 18 14:06:37.540322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3208/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:37 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:38.533680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:38.534936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:38.562946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:38.564207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:38.580670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:38.585970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:38.589427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:38.590639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:38.592859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:38.594598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:38.766745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:38.784364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63b4ede9-56ba-4073-9791-2ec6f845ef78 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1526 microversion: 2.1 time: 0.225478 Oct 18 14:06:38.785031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3209/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:38 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1526 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:38.803158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:38.804593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4a9b60-1c29-476d-ab7e-016320f5167e", "name": "network-vif-deleted", "tag": "59c40a55-3d35-425b-ba7c-9c731a8660d6"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:38.809664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:38.820027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:38.824865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:38.829421 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a7e6b1e-02d0-4db5-8bbd-2f7b2e380aab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1281 microversion: 2.20 time: 0.300156 Oct 18 14:06:38.838890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:38.841735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:38.842349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:38.849372 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3370/6579] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:38 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:38.875391 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] Creating event network-vif-deleted:59c40a55-3d35-425b-ba7c-9c731a8660d6 for instance dd4a9b60-1c29-476d-ab7e-016320f5167e on n-h1-858383-13 Oct 18 14:06:38.881577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f03811dc-9dcb-4d2a-9ac2-d05f3f6a4bff req-23e2a4d8-1074-4763-abfe-dbdf1a5c9ba4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095108 Oct 18 14:06:38.882393 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3210/6580] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:39.808902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:39.816144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:39.824993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:39.825616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:39.826113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:39.835338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:39.839496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:39.840066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:39.864076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:39.864798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:39.885249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:39.885249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:39.888009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:39.888799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:39.889286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:39.889731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:39.996975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:40.006633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:40.008494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:40.009888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e02d37a8-19c6-4095-b415-dcc59389adcb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1285 microversion: 2.20 time: 0.150253 Oct 18 14:06:40.011094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3211/6581] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:39 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:40.128339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:40.154439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c004e5d-4d35-462d-8b70-69a73f7d30ad tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1360 microversion: 2.1 time: 0.349179 Oct 18 14:06:40.155037 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3371/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:39 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1360 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:41.043996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:41.045145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:41.058680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:41.059946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:41.063706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:41.065721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:41.066410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:41.066883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:41.152964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:41.171912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:41.171912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:41.171912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-256c8404-6745-4409-b69b-4052325c0ba6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1341 microversion: 2.20 time: 0.137604 Oct 18 14:06:41.171912 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3212/6583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:41 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1341 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:41.182658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:41.183403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:41.191585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:41.194448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:41.196872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:41.196872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:41.196872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:41.197704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:41.198384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:41.353495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:41.363133 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d41a47e2-aa05-4948-956a-ef552285f4b8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1360 microversion: 2.1 time: 0.184639 Oct 18 14:06:41.383829 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3372/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:41 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:42.217262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:42.218364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:42.233450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:42.233956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:42.234422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:42.235326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:42.235960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:42.236557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:42.411690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:42.413361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:42.425101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:42.427044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:42.427593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:42.437314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:42.437949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:42.438485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:42.552265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:42.562079 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c9e0a93-5fa1-42d7-ba49-33b83951603f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1360 microversion: 2.1 time: 0.155529 Oct 18 14:06:42.563416 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3373/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:42 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:42.734734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:42.810982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:42.829981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:42.839312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:42.845251 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4f75f8e1-914e-4da7-afce-5ea0b3d09f10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.627132 Oct 18 14:06:42.856703 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3213/6586] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:42 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:43.519423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:43.543332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.544759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.547271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.570131 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] Creating event network-changed:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h2-858383-13 Oct 18 14:06:43.576634 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8edf3e4b-9583-4f2f-a1f4-98943eb2eef8 req-8fe633d5-b2fc-44b9-97cd-71529f72668d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065439 Oct 18 14:06:43.577772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3374/6587] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:43.591134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:43.591771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:43.606661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.607174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.607643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.610726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.611213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.611666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.760095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:43.765272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:43.776787 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-23e074a0-156f-47e9-9419-0da535108dee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1360 microversion: 2.1 time: 0.193369 Oct 18 14:06:43.790077 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3214/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:43 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1360 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:43.887713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:43.888534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:43.901333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.902046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.902640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.903556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.904103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.914662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:44.191177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:44.202642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:44.204352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:44.205863 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e97bf49-ec6f-43d5-8ad0-519be2c7c016 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.322742 Oct 18 14:06:44.206520 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3375/6589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:43 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:44.804483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:44.805733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:44.828280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:44.829020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:44.829654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:44.830574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:44.831319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:44.831961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:44.930015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:44.940142 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1f4b6379-ca9b-457b-abe3-a4f9e204699e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 200 len: 1360 microversion: 2.1 time: 0.139579 Oct 18 14:06:44.942491 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3215/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:44 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 1360 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:45.231869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:45.232507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:45.239342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:45.239953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:45.240493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:45.241281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:45.241833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:45.242437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:45.644049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:45.661850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:45.672426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:45.675461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5003d43-9b0f-4882-9d8b-dde8350e9fb0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.447615 Oct 18 14:06:45.677574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3376/6591] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:45 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:45.978087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:45.979962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:46.010801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:46.014705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:46.014705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:46.017504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:46.020639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:46.022716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:46.047998 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e HTTP/1.1 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'dd4a9b60-1c29-476d-ab7e-016320f5167e'} Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:06:46.050125 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:06:46.055312 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:06:46.058958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:06:46.059938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74d3a6d0-4d98-4ddd-8a6a-fdb1c804c53a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 404 len: 111 microversion: 2.1 time: 0.095635 Oct 18 14:06:46.060736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3216/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:45 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:06:46.705281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:46.707104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:46.718018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:46.727283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:46.727283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:46.727283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:46.727283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:46.727283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:47.021122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:47.038981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:47.042649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:47.044104 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a126a72c-06ef-4058-b323-8e80f70d1b6b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.343577 Oct 18 14:06:47.046673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3377/6593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:46 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:48.076781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:48.077975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:48.085986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:48.088314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:48.117259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:48.118580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:48.119182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:48.121515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:48.500674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:48.509407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:48.510865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:48.512026 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d564d7df-e127-4abe-8531-ae3bfdc261a2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.440970 Oct 18 14:06:48.512594 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3217/6594] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:48 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:49.401536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "name": "network-vif-plugged", "status": "completed", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:49.415367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:49.430230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:49.443911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:49.446620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:49.447149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:49.482735 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] Creating event network-vif-plugged:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h2-858383-13 Oct 18 14:06:49.495774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-febdf4a5-bbea-4cdf-b127-7883848c3601 req-cfac7192-021f-4265-8943-53c22aa16c94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100064 Oct 18 14:06:49.499665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3378/6595] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:49.540402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:49.541652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:49.560981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:49.561796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:49.562454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:49.563363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:49.563997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:49.564604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:49.978366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:50.006952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:50.020530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:50.023388 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e06d1246-a436-45ce-b1de-e1f361ca901c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.486970 Oct 18 14:06:50.029947 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3218/6596] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:49 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:51.049950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:51.051964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:51.072471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:51.073323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:51.074685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:51.081257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:51.082824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:51.083561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:51.378737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:51.399103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:51.399103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:51.400500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8158abb4-6a53-414a-88e0-7937a609b8f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1406 microversion: 2.20 time: 0.355185 Oct 18 14:06:51.401953 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3379/6597] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:51 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:51.676776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2e05608-98ea-4d3f-b90a-a47e1a82e5b7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: .version_select at 0x7fb3304bd550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-509586092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlrrspszSQkJU1youPtsEk3VUkrttgm97lHcES+/xrGRU2xe1BISuMdmix5v2V4IzDk78Hd5JmrMMpRDSWe+qQUBUn/uwvQdgiowRcEAY6R2XVoSnjYKW+PssMJSJPg0Q=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:51.701451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c2e05608-98ea-4d3f-b90a-a47e1a82e5b7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:06:51.708044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c2e05608-98ea-4d3f-b90a-a47e1a82e5b7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:06:51.812060 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2e05608-98ea-4d3f-b90a-a47e1a82e5b7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.140348 Oct 18 14:06:51.813153 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3219/6598] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:06:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:52.429072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:52.430420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:52.437983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.438891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.439514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.440416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.441066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.441815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.608766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:52.617466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:52.620771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:52.626227 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2543f1da-860d-42b3-81fc-119e6104f1b5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1598 microversion: 2.20 time: 0.201133 Oct 18 14:06:52.627204 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3380/6599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:06:52 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1598 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:06:52.654633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:52.655150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:52.662383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.662884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.663332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.664042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.664508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.664946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.799668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f015bed-0b76-44df-ae2c-9c7efc1fde83 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146932 Oct 18 14:06:52.814760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3220/6600] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 14:06:52 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:06:52.857432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:52.858247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:52.867489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.867489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.875559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.875559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:52.875559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:52.875559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:52.907516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:06:53.250906 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa3972ac-342c-4d3b-af03-4a277018ad67 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 204 len: 0 microversion: 2.1 time: 0.398477 Oct 18 14:06:53.256508 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3381/6601] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:06:52 2022] DELETE /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:06:53.261543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:53.262210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:53.269139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:53.270751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:53.271346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:53.272000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:53.272562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:53.273136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:53.589736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:53.603604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff4d1ee9-a27f-40ec-a928-ec921195c709 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1410 microversion: 2.1 time: 0.346118 Oct 18 14:06:53.605692 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3221/6602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:53 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1410 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:54.255475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:54.270369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:54.271111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:54.271857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:54.290102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:54.290358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] Creating event network-changed:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h2-858383-13 Oct 18 14:06:54.295588 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-41866f61-f812-4dd5-aaf8-474660058541 req-f13ca7d9-3458-4e1b-876d-a2d86ddcc263 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045951 Oct 18 14:06:54.296402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3382/6603] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:54.633668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:54.634337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:54.651356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:54.652196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:54.653018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:54.655772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:54.656450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:54.659718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:54.845297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:54.856601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3858b12-ecf1-4289-a72b-faf9dc09acda tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1410 microversion: 2.1 time: 0.228753 Oct 18 14:06:54.858030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3222/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:54 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1410 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:55.386135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2005694806", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9025be8a-0260-4c8a-b84c-490e2f6c9d5d"}], "key_name": "tempest-TestNetworkBasicOps-509586092", "security_groups": [{"name": "tempest-secgroup-smoke-628559614"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:55.675679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] validate_networks() for [('9025be8a-0260-4c8a-b84c-490e2f6c9d5d', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:06:55.881794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:55.882481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:55.890458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:55.891259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:55.891713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:55.892437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:55.892908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:55.893543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:55.983428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:56.004796 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6654137a-ddc2-4b7c-9ad2-61b3f837b5ac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1368 microversion: 2.1 time: 0.119797 Oct 18 14:06:56.006084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3223/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:55 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:56.228675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:06:56.229436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:06:56.230207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:06:56.230899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:06:56.231603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:06:56.243356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:56.243928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:56.244850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:56.245851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:56.246632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:56.247707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:56.284767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:06:56.291336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Getting quotas for user 8e66870b1baa4c3aaebe72cf76b25453 and project ccbc15ce8ee64fa1b767c3bfb5926fee. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:06:56.307163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:06:56.311120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:06:56.313477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c8bb0-a510-4597-aa5a-72895dd03710", "name": "network-vif-deleted", "tag": "213d1c4f-0e99-4b2d-81d9-2477a7b3b571"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:56.325657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:56.327004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:56.327004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:56.341040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] Creating event network-vif-deleted:213d1c4f-0e99-4b2d-81d9-2477a7b3b571 for instance 310c8bb0-a510-4597-aa5a-72895dd03710 on n-h2-858383-13 Oct 18 14:06:56.348335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d9501000-059b-4e36-adbd-d3e882255495 req-d06ae7d3-3d45-416d-9215-5e293597be8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037017 Oct 18 14:06:56.350722 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3224/6606] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:06:56.410626 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1186da92-3c58-4f23-88c8-3a4a427f6d4f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.034755 Oct 18 14:06:56.412127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3383/6607] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:06:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:06:56.424144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-409d5156-99b1-46f8-9a59-1158dd864996 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:56.424901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-409d5156-99b1-46f8-9a59-1158dd864996 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:56.497415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-409d5156-99b1-46f8-9a59-1158dd864996 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:56.506613 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-409d5156-99b1-46f8-9a59-1158dd864996 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1248 microversion: 2.1 time: 0.085695 Oct 18 14:06:56.521471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3225/6608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:56 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:57.032544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:57.033367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:57.040978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:57.041992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:57.042283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:57.043045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:57.043748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:57.044373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:57.109981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:57.119510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0adb48c6-4e20-4dc5-9369-acc3520a6437 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1202 microversion: 2.1 time: 0.090972 Oct 18 14:06:57.120033 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3384/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:57 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:57.534010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:57.534698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:57.543045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:57.543566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:57.544018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:57.544727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:57.545288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:57.545730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:57.632489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:57.643061 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bf7f43f8-80a3-4d0a-898e-711f5a585b9d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1252 microversion: 2.1 time: 0.113100 Oct 18 14:06:57.645344 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3226/6610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:57 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1252 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:58.142491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:58.143286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:58.149967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:58.151264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:58.151264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:58.151660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:58.152142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:58.152593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:58.219536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:58.228257 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39556251-9c6d-40b6-866f-dc452e287b40 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1202 microversion: 2.1 time: 0.089599 Oct 18 14:06:58.244034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3385/6611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:58 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:58.667849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:58.668705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:58.677245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:58.678122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:58.684173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:58.684173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:58.684173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:58.684173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:58.747092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:58.755887 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42c56900-a007-481b-be91-19874a991fff tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1300 microversion: 2.1 time: 0.092167 Oct 18 14:06:58.756507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3227/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:58 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:59.256944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:59.257597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:59.265472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:59.266897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:59.267578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:59.268556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:59.270157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:59.270814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:59.775373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:59.781070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:59.782539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:59.787568 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a76406c2-1e34-4c4d-8e82-93c9df34d89a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1202 microversion: 2.1 time: 0.537696 Oct 18 14:06:59.801993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3386/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:59 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1202 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:59.809898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:59.810433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:59.811344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:59.812222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:59.813148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:59.817143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:59.921569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:59.932741 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ef1bf1d-1830-4891-bacc-d197b86de146 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1306 microversion: 2.1 time: 0.156305 Oct 18 14:06:59.942419 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3228/6614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:59 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:00.815542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:00.818719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:00.823987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:00.824509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:00.825001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:00.825702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:00.826219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:00.826676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:00.891979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:00.901010 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e784b7b-597e-4070-8290-bb50b85e71ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1202 microversion: 2.1 time: 0.089910 Oct 18 14:07:00.901579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3387/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:00 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:00.965007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:00.966905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:00.979889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:00.980391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:00.980840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:00.981552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:00.982010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:00.982508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:01.249328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:01.258356 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06c9b6a8-b080-45b3-a8ca-4e0b1bac54d7 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.297719 Oct 18 14:07:01.259313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3229/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:00 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:01.420335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e4b8c8-131b-4e73-9721-e9bd66ac3750", "tag": "53f99dca-696d-4b0b-984c-6ea1780ac3e5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:01.431289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:01.431901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:01.432466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:01.444318 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] Creating event network-changed:53f99dca-696d-4b0b-984c-6ea1780ac3e5 for instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 on n-h1-858383-13 Oct 18 14:07:01.457677 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e7bed6a5-9b21-4308-b98e-7cfce6aeb886 req-0d7db738-879c-44f8-9342-4d1fabc5a49d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039334 Oct 18 14:07:01.457677 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3388/6617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:01.923473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:01.924275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:01.932109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:01.932651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:01.933116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:01.933833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:01.934333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:01.934806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:02.021975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:02.035577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-626335b5-53f7-4d99-866d-2362fe0d0769 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 200 len: 1202 microversion: 2.1 time: 0.115469 Oct 18 14:07:02.036543 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3230/6618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:01 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 1202 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:02.283755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:02.284679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:02.292615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:02.294958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:02.294958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:02.294958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:02.295277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:02.295573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:02.445207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:02.455084 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-012649c9-a229-4227-a639-26d643e1414f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.176481 Oct 18 14:07:02.457004 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3389/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:02 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:03.060545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:03.061199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:03.069094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:03.069622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:03.070181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:03.070896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:03.071359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:03.071796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:03.086733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 HTTP/1.1 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '310c8bb0-a510-4597-aa5a-72895dd03710'} Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:03.088597 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98d4b69a-a0c2-4acd-9218-fc897519005c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 404 len: 111 microversion: 2.1 time: 0.033611 Oct 18 14:07:03.098213 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3231/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:03 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:07:03.477952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:03.478670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:03.486223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:03.486741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:03.487338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:03.488620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:03.489118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:03.489587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:03.637639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:03.646508 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bab5cbb-05cb-407f-9a90-b293fbf8fc3e tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.172441 Oct 18 14:07:03.647132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3390/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:03 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:04.670457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:04.671414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:04.679247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:04.679751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:04.680253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:04.680962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:04.681429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:04.681866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:04.826490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:04.835675 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b522b27e-a874-43a4-85fa-32c8dfd2c133 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.169306 Oct 18 14:07:04.836252 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3232/6622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:04 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:05.244159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:05.247423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:05.251679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.252187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.252650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:05.253366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.253963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.254523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:05.269291 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e HTTP/1.1 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'dd4a9b60-1c29-476d-ab7e-016320f5167e'} Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:05.271031 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d6c502e-27e7-4737-baee-89bc7a6cf099 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 404 len: 111 microversion: 2.1 time: 0.033043 Oct 18 14:07:05.275546 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3391/6623] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:07:05 2022] DELETE /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:05.281185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:05.281805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: dd4a9b60-1c29-476d-ab7e-016320f5167e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:05.288480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.289072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.289678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:05.290191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.290833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.291210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:05.306032 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e HTTP/1.1 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'dd4a9b60-1c29-476d-ab7e-016320f5167e'} Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:05.313122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance dd4a9b60-1c29-476d-ab7e-016320f5167e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-30c68834-ae4c-48d7-a79b-e682a09f8125 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e" status: 404 len: 111 microversion: 2.1 time: 0.032017 Oct 18 14:07:05.317921 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3233/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:05 2022] GET /compute/v2.1/servers/dd4a9b60-1c29-476d-ab7e-016320f5167e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:05.860627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:05.861271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:05.872885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:06.041060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:06.050490 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-36951fbd-735a-438e-b617-bef26587ed39 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.193716 Oct 18 14:07:06.051316 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3392/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:05 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:06.615207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:06.615802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:06.618899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:06.626156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:06.626715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:06.627516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:06.628185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:06.629415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:06.629864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:06.644897 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 HTTP/1.1 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '310c8bb0-a510-4597-aa5a-72895dd03710'} Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:06.646490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53b8bcd2-8d40-44f6-abd8-8e6546c4243d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 404 len: 111 microversion: 2.1 time: 0.037541 Oct 18 14:07:06.651178 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3234/6626] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:07:06 2022] DELETE /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:06.657079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:06.657709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 310c8bb0-a510-4597-aa5a-72895dd03710] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:06.660555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:06.661255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:06.666106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:06.666616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:06.667076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:06.667789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:06.668263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:06.668775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:06.683023 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 HTTP/1.1 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '310c8bb0-a510-4597-aa5a-72895dd03710'} Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:06.684590 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 310c8bb0-a510-4597-aa5a-72895dd03710 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21a03aa6-df91-4fd4-b4a7-33141286ef1d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710" status: 404 len: 111 microversion: 2.1 time: 0.032899 Oct 18 14:07:06.689525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3393/6627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:06 2022] GET /compute/v2.1/servers/310c8bb0-a510-4597-aa5a-72895dd03710 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:06.774859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eca335ac-1f11-487b-a2b1-47fe1ca778e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: .version_select at 0x7fb3314799d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1315374410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbuof5P+5h723Cc6TVbUPMXQoeXlbhwF9X28jLErRCoXx+6deXdhg5kSZp7PAr9HIENgwvfwI+6jDpMiRX5qEJF/ldakqyN8+0Gf2HgYc1Fr9Ct5AO3dFHpQsYt3M5GcQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:06.791429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-eca335ac-1f11-487b-a2b1-47fe1ca778e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:07:06.796703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-eca335ac-1f11-487b-a2b1-47fe1ca778e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:07:06.886299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eca335ac-1f11-487b-a2b1-47fe1ca778e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.115309 Oct 18 14:07:06.888446 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3235/6628] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:07:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:07.074931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:07.075674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:07.083967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:07.084492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:07.084961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:07.085700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:07.086220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:07.087160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:07.230798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:07.240787 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-528c3a9d-27cf-457b-b80f-a61c6bf8e603 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.169923 Oct 18 14:07:07.241529 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3394/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:07 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:08.091430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e4b8c8-131b-4e73-9721-e9bd66ac3750", "name": "network-vif-plugged", "status": "completed", "tag": "53f99dca-696d-4b0b-984c-6ea1780ac3e5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:08.104453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:08.105054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:08.105504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:08.116815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] Creating event network-vif-plugged:53f99dca-696d-4b0b-984c-6ea1780ac3e5 for instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 on n-h1-858383-13 Oct 18 14:07:08.122152 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-86ab5e39-ea95-4f30-b298-a127a67904a0 req-6ab03c61-4a3f-4aa5-8745-a2f08b68c634 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Oct 18 14:07:08.122783 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3236/6630] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:08.273027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:08.275316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:08.282553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:08.283362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:08.284069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:08.285819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:08.286447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:08.286999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:08.435581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:08.443428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03b41c4d-936f-4d86-91ae-2f3be8a33ff6 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.182536 Oct 18 14:07:08.443994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3395/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:08 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:09.467451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:09.468239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:09.475727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:09.476341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:09.476804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:09.477520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:09.477995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:09.478541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:09.664059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:09.672929 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c003b19-e856-4af3-b9cf-eeead87f6d4d tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1373 microversion: 2.1 time: 0.211073 Oct 18 14:07:09.673506 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3237/6632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:09 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:10.695721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:10.701674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:10.703295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:10.703804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:10.704267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:10.704979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:10.705460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:10.705906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:10.846426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:10.854307 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-039e42bb-d086-4360-bca1-78c25ee41c77 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1545 microversion: 2.1 time: 0.163041 Oct 18 14:07:10.854882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3396/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:10 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1545 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:10.876960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:10.877590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:10.885315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:10.887161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:10.887161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:10.887161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:10.887526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:10.887857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:11.037576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:11.039924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:11.046625 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98780875-0263-4a9d-9b2f-0e4ee4d9b1bb tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1545 microversion: 2.1 time: 0.173601 Oct 18 14:07:11.047525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3238/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:10 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1545 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:13.541229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e4b8c8-131b-4e73-9721-e9bd66ac3750", "tag": "53f99dca-696d-4b0b-984c-6ea1780ac3e5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:13.547265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:13.562205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:13.562720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:13.563179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:13.586624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] Creating event network-changed:53f99dca-696d-4b0b-984c-6ea1780ac3e5 for instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 on n-h1-858383-13 Oct 18 14:07:13.592334 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0a170598-9b0c-4c24-83b9-4514d39bac95 req-fb568237-0d22-4e3b-b16b-4b63247ace2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054889 Oct 18 14:07:13.593806 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3397/6635] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:31.087731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:31.088346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:31.090380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:31.091071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:31.096593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:31.097095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:31.098211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:31.098998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:31.104542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:31.104542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:31.125393 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e833363-871b-425c-9e23-40f1c7cc253a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/ips" status: 200 len: 152 microversion: 2.20 time: 0.043323 Oct 18 14:07:31.125988 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3239/6636] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 18 14:07:31 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:07:34.657251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=70 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:34.662260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:34.663116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:34.670795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:34.671449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:34.671853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:34.672608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:34.673112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:34.673570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:34.699650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lazy-loading 'flavor' on Instance uuid 0275ae28-fb08-43ea-a192-df0b7a7649a3 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:07:35.372339 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f2e4ce4-9fe5-4f56-9e60-e1869e4e067c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/action" status: 202 len: 0 microversion: 2.20 time: 0.717572 Oct 18 14:07:35.373035 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3398/6637] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 14:07:34 2022] POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:07:35.381539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:35.382276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:35.392394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.392900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.393549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.394560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.395327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.395777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.544640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:35.560974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:35.562731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:35.563954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8bc0490-ab8e-429b-b7ad-e11b419c8b39 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.186687 Oct 18 14:07:35.564532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3240/6638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:35 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:35.864603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:35.868371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:35.874318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.874865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.875342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.876219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.876713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.877172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.946177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba3c0e6b-7ed7-4847-a723-dd97288aeb46 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750/action" status: 200 len: 24576 microversion: 2.1 time: 0.087180 Oct 18 14:07:35.946902 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3399/6639] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:07:35 2022] POST /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750/action => generated 24576 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:07:36.591307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:36.591962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:36.601158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:36.601753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:36.602242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:36.603018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:36.603493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:36.603933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:36.744266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:36.752795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:36.754820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:36.756432 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a581655-6df3-4aff-8284-04200edf4bdb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.169173 Oct 18 14:07:36.757030 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3241/6640] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:36 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:37.783735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:37.784486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:37.793146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:37.793730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:37.794324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:37.795395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:37.795942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:37.796398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:37.937021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:37.955455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:37.955455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:37.955455 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de622a8b-f83b-4d06-a209-2b95bc123364 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.173761 Oct 18 14:07:37.955455 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3400/6641] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:37 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:38.982412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:38.983074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:38.990707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:38.991198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:38.991648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:38.992354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:38.992820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:38.993280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:39.135397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:39.143919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:39.145418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:39.146623 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c10988c-4412-4322-a268-64eed270cf34 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.168239 Oct 18 14:07:39.147195 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3242/6642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:38 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:40.173226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:40.173824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:40.184788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:40.185314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:40.185774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:40.186522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:40.186999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:40.187450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:40.338954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:40.348013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:40.349511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:40.350783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4cec618b-2adc-41a8-8e2b-2fa9d29a75e1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.181701 Oct 18 14:07:40.351370 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3401/6643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:40 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:41.381121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:41.381853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:41.389562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.389562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.390236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.391020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.391312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.391746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.550352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:41.559696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:41.561147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:41.562649 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d445988f-e5ff-4e3e-93d0-e3526c962789 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.186363 Oct 18 14:07:41.563287 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3243/6644] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:41 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:42.150398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1465607756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1315374410", "security_groups": [{"name": "tempest-secgroup-smoke-473996800"}], "block_device_mapping_v2": [{"uuid": "ac98593e-83e3-4d49-8351-2b6c889e8a77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:42.271556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:07:42.590599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:42.595655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:42.602675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:42.603886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:42.604352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:42.605085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:42.605745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:42.606227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:42.689275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:07:42.689723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:07:42.690267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:07:42.690704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:07:42.691140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:07:42.701117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:42.701635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:42.702277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:42.702908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:42.703398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:42.703855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:42.723508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:07:42.729976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:07:42.792631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:42.797024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:07:42.799284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac98593e-83e3-4d49-8351-2b6c889e8a77',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:07:42.804211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:42.806170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:42.807100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-efbc2091-08fa-4a08-8414-fe4a2539db10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.220433 Oct 18 14:07:42.808055 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3244/6645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:42 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:43.247994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b58e73e0-61f5-45de-9397-63b0092ca231 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.102650 Oct 18 14:07:43.249106 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3402/6646] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:07:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:07:43.260290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53e1af35-6a94-430f-9e2b-5345e07d8664 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:43.261068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53e1af35-6a94-430f-9e2b-5345e07d8664 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:43.320478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53e1af35-6a94-430f-9e2b-5345e07d8664 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:43.328566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53e1af35-6a94-430f-9e2b-5345e07d8664 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1095 microversion: 2.1 time: 0.072142 Oct 18 14:07:43.329160 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3245/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:43 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:43.833159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:43.833803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:43.840681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:43.841195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:43.841691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:43.842439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:43.842921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:43.843375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:43.981524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:43.992073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:43.997043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:43.997043 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc31e2e1-0589-43f8-8546-2cec6953215a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.166243 Oct 18 14:07:43.997043 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3403/6648] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:43 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:44.353268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:44.353914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:44.361296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:44.361737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:44.362212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:44.362902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:44.363361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:44.364411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:44.436430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:44.445462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-206c6369-1f43-4c20-aac4-14cb3aa12f70 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1145 microversion: 2.1 time: 0.096162 Oct 18 14:07:44.446388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3246/6649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:44 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:45.026477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:45.027255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:45.034616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:45.035255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:45.035779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:45.036519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:45.036996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:45.037594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:45.231866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:45.242017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:45.243726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:45.245110 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84cc6da3-45bc-4eba-ab4c-84ab0a36afa3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.222733 Oct 18 14:07:45.245878 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3404/6650] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:45 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:45.476258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:45.477877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:45.485901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:45.486504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:45.487559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:45.489639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:45.490650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:45.491309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:45.570548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:45.580746 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1b125e4-d5c3-43b7-8a34-944dee43134e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1201 microversion: 2.1 time: 0.115623 Oct 18 14:07:45.581659 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3247/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:45 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:46.272480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:46.273138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:46.281249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:46.283605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:46.284857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:46.286387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:46.286727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:46.287177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:46.552654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:46.566462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:46.569217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:46.571276 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3029a7a0-d693-4ef7-b55d-1932743d1d2d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1744 microversion: 2.20 time: 0.303249 Oct 18 14:07:46.575827 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3405/6652] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:46 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1744 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:46.610414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:46.611135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:46.618726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:46.619496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:46.620458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:46.621609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:46.622211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:46.622718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:46.828547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:46.839783 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-838c557e-83a3-476d-ad08-9a5a60625a6c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.236437 Oct 18 14:07:46.840963 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3248/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:46 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:47.085004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:47.091925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:47.095316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.095843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.096314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.097079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.097557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.098021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.159255 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bd8f004-98fd-4f02-85e3-a5249788b085 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "POST /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750/action" status: 200 len: 32649 microversion: 2.1 time: 0.078276 Oct 18 14:07:47.160952 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3406/6654] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:07:47 2022] POST /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750/action => generated 32649 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:07:47.602045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:47.603041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:47.609773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.611179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.612877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.613947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.615087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.615763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.869275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:47.871043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:47.880243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.881704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.888303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.888303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:47.888303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:47.888303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:47.913281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:47.925454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:47.930623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:47.935714 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d025baf0-2678-487d-a750-1708095b7eca tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1744 microversion: 2.20 time: 0.335697 Oct 18 14:07:47.936346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3249/6655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:47 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1744 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:48.107832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:48.116419 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-886b8717-0b4e-4f4d-9614-5b627e05a628 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.254846 Oct 18 14:07:48.116997 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3407/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:47 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:48.233801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b35a07-2b1c-4b92-a2f6-76182c089a1b", "tag": "ce96f56e-ddef-4397-baca-9d08c4927a7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:48.254791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:48.263197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:48.263957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:48.297419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] Creating event network-changed:ce96f56e-ddef-4397-baca-9d08c4927a7c for instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b on n-h2-858383-13 Oct 18 14:07:48.314318 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4887225d-76d1-4400-8ead-351b6f880ae8 req-491825f3-3b02-4ee7-8d98-1d3b5ef4db96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079180 Oct 18 14:07:48.315449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3250/6657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:48.893100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e4b8c8-131b-4e73-9721-e9bd66ac3750", "tag": "53f99dca-696d-4b0b-984c-6ea1780ac3e5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:48.896487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:48.897793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:48.924783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:48.925594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:48.933578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:48.933578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:48.933578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:48.933578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:48.960390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:48.961172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:48.961623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:49.029005 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] Creating event network-changed:53f99dca-696d-4b0b-984c-6ea1780ac3e5 for instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 on n-h1-858383-13 Oct 18 14:07:49.046277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-16e71f39-6519-4617-9767-44e2435611a4 req-161457f4-50bc-42a9-9d24-25e80503ecb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160458 Oct 18 14:07:49.046942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3251/6658] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:49.050678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:07:49.058452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:49.059449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:49.069287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:49.072643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:49.072643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:49.082648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:49.084006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:49.087345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:49.508357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5dd17a0-2376-4d79-8a2f-a9e7412076ed tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 204 len: 0 microversion: 2.1 time: 0.631631 Oct 18 14:07:49.509451 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3408/6659] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:07:48 2022] DELETE /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:07:49.516851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:49.520942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:49.535586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:49.540310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:49.541170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:49.541984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:49.542801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:49.543264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:50.074303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:50.095604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca084641-a2e5-4766-acd5-59dc9f6169c2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.584244 Oct 18 14:07:50.096209 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3409/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:49 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:50.130906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:50.130906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:50.154982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:50.155508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:50.155977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:50.156724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:50.157208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:50.157659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:50.183452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:50.194155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:50.201966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:50.203771 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fec1fdc0-c644-4e5e-a490-98b4953cc315 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 1.155429 Oct 18 14:07:50.206169 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3252/6661] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:49 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:50.475530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:50.484377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-393c8d2d-9423-4500-9565-b90f6df08dd2 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1670 microversion: 2.1 time: 0.370667 Oct 18 14:07:50.487065 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3410/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:50 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:51.122965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:51.124622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:51.137649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.139724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.140377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:51.150359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.150359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.150359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:51.241094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:51.242509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:51.266286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.270517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.272126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:51.276538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.278671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.279428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:51.772308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:51.775253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:51.789445 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a41cf8f8-9377-43ff-a00f-41e528f2ec09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.669109 Oct 18 14:07:51.792330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3253/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:51 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:51.799059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:51.800542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:51.803487 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-137be04d-e84a-4564-8eee-2d50f8f94058 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.568169 Oct 18 14:07:51.803487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3411/6664] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:51 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:51.807760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:51.808657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:51.825890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.826812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.827448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:51.828741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:51.830308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:51.832310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.140489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:52.166502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-684e8003-a9f3-4ecb-8207-20f41cae387f tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1670 microversion: 2.1 time: 0.368577 Oct 18 14:07:52.183494 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3254/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:51 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:52.196395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "name": "network-vif-plugged", "status": "completed", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:52.230600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.231806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.232583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.251211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:52.257576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] Creating event network-vif-plugged:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h2-858383-13 Oct 18 14:07:52.266031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-76b12990-3d5f-4d85-938f-f0de61b1d53a req-41d95649-ed03-499c-b154-c33d822cf815 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434188 Oct 18 14:07:52.267476 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3412/6666] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:52.582121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e4b8c8-131b-4e73-9721-e9bd66ac3750", "name": "network-vif-deleted", "tag": "53f99dca-696d-4b0b-984c-6ea1780ac3e5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:52.602071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.603181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.603641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.640177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] Creating event network-vif-deleted:53f99dca-696d-4b0b-984c-6ea1780ac3e5 for instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 on n-h1-858383-13 Oct 18 14:07:52.660319 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-32774c85-be45-47c9-90f5-60445790f05d req-9ed99d10-3c8d-438c-8411-22a554d2a9a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080734 Oct 18 14:07:52.663693 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3255/6667] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:52.815785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:52.820072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:52.823874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:52.826049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:52.831682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:52.834203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:52.847300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.847878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.848594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.849428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.849908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.850391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.855822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.856766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.857592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:52.859440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:52.862417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:52.868955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.100776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:53.117128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:53.119056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:53.131364 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9dbb23a2-b549-4d3e-b5e0-d65e5acac8d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.300544 Oct 18 14:07:53.144164 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3256/6668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:52 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:07:53.198787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:53.200064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:53.214013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.215059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.215771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.221798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.222553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.226209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.272472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.273362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.274043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.275667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lazy-loading 'fault' on Instance uuid 19e4b8c8-131b-4e73-9721-e9bd66ac3750 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:07:53.325648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:53.333151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:53.340825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e66870b1baa4c3aaebe72cf76b25453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:53.355628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-217e5791-4776-43a3-8e17-faa6c9ea620a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.540754 Oct 18 14:07:53.356244 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3413/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:52 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:53.379360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a315cdd-6fbc-484e-9e7d-18a42a8649df tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 200 len: 1338 microversion: 2.1 time: 0.188300 Oct 18 14:07:53.400803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3257/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:53 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:53.606632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:53.607457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:53.618992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:53.625759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.629918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.632263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.635899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.636590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.638169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.640448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:53.641716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:53.642198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:53.681812 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] Creating event network-changed:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:07:53.689498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:07:53.716286 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40b1df43-231a-477d-9c18-8f527c95a5ca req-f1d7d4e0-9490-460e-932e-4c93b772acf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101680 Oct 18 14:07:53.716917 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3258/6671] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:07:54.165040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:54.166941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:54.170373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43add36f-3e75-4461-a91a-9e6d63b05c54 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 204 len: 0 microversion: 2.1 time: 0.569206 Oct 18 14:07:54.171326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3414/6672] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:07:53 2022] DELETE /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:07:54.183752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:54.197973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.213201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.215948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.216816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.217591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.221650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.230409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.231891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.240650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:54.432178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:54.453801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:54.453801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:54.453801 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15920aec-a73b-42d1-ad2d-fb4802697234 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.291238 Oct 18 14:07:54.474275 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3259/6673] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:54 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:07:54.479305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:54.479930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:54.486906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.487644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.488127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.489397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.489868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.490331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.500128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:54.512383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c83c4864-67fc-4fc2-833c-bc4ab10ded0e tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1584 microversion: 2.1 time: 0.335350 Oct 18 14:07:54.527509 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3415/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:54 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1584 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:54.541523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:54.543541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] [instance: 19e4b8c8-131b-4e73-9721-e9bd66ac3750] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:54.552991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.558703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.558703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.558703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:54.558703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:54.558703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:54.578584 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] HTTP exception thrown: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Request method failure captured: Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 HTTP/1.1 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrJR6k1ATdORqtHnni3iVH-mCMwgTrWrazzHKGaEHG-0MqP3ZxCP4uR8NYPzn6FOcUtEx0NAN4-H6apKd_fIbCGY_nD0SzyM-msRjKY8Q8o_fjcOI6JXofTSkisVMYkxPYAJGujJrpmK6p-WgnHhYRSfikuxEKz_g5z0pvMuePMQbEI Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ccbc15ce8ee64fa1b767c3bfb5926fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ccbc15ce8ee64fa1b767c3bfb5926fee Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkBasicOps-1550375438 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 8e66870b1baa4c3aaebe72cf76b25453 Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkBasicOps-1550375438-project Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '19e4b8c8-131b-4e73-9721-e9bd66ac3750'} Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:54.580549 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Returning 404 to user: Instance 19e4b8c8-131b-4e73-9721-e9bd66ac3750 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-719ffb11-e823-476b-a5c2-5ac133261741 tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750" status: 404 len: 111 microversion: 2.1 time: 0.054768 Oct 18 14:07:54.598831 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3416/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:54 2022] GET /compute/v2.1/servers/19e4b8c8-131b-4e73-9721-e9bd66ac3750 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:54.746837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:54.758542 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a93cba8-6f20-4c83-95e1-8a28e6c2c6a8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1278 microversion: 2.1 time: 0.283078 Oct 18 14:07:54.761600 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3260/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:54 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:55.042006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-193e029b-0958-4b7c-94d3-3e5fcced8e3a tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] Calling method '.version_select at 0x7fb32b9c18b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:55.165767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-193e029b-0958-4b7c-94d3-3e5fcced8e3a tempest-TestNetworkBasicOps-1550375438 tempest-TestNetworkBasicOps-1550375438-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-509586092" status: 202 len: 0 microversion: 2.1 time: 0.129091 Oct 18 14:07:55.176933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3417/6677] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 14:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-509586092 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:07:55.482525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:55.484070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:55.507368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.511250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.512328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:55.515316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.516488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.517574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:55.556528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:55.560502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:55.594033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.599185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.601874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:55.609571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.611355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.614659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:55.835356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:55.844831 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-45e19bc9-fe0f-4fc8-9e35-3b37a841f642 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1584 microversion: 2.1 time: 0.297764 Oct 18 14:07:55.847516 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3418/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:55 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1584 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:55.854583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:55.855948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:55.864899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.866034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.867037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:55.868145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:55.868867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:55.869899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:56.132369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:56.147033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88df44c2-4836-4e7b-8cfb-e091e3052379 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.296245 Oct 18 14:07:56.161933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3419/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:55 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:56.302216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:56.313898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:56.315787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:56.317230 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-211e7da2-7556-4783-9329-454167f4e636 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.839077 Oct 18 14:07:56.318391 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3261/6680] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:55 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:56.875844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:56.878833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:56.902486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:56.903884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:56.905030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:56.906566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:56.915084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:56.916057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.185564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:57.185564 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-446e1d8b-dae2-4d9b-9c54-826896dc1f85 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1466 microversion: 2.1 time: 0.292450 Oct 18 14:07:57.185564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3420/6681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:56 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1466 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:57.186090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:57.186090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:57.201013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:57.204121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:57.206683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.208802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:57.210131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:57.210980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.344103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:57.344812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:57.353010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:57.353535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:57.354000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.354765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:57.355286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:57.355742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.562246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:57.573072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:57.574626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:57.576000 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3be94651-d49d-486e-b65d-d7964ffd4515 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.236183 Oct 18 14:07:57.594294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3421/6682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:57 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:07:57.752763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26897e4-8086-466e-bd4f-7594f120d8d7", "name": "network-vif-deleted", "tag": "7b43b596-b4f9-4111-8d72-67d8ac50f7a8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:57.767437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:57.768334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:57.768494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:57.769185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:57.786712 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ee6db36-7e55-4397-ae4f-b4eb74d1ed2a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.608701 Oct 18 14:07:57.789120 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] Creating event network-vif-deleted:7b43b596-b4f9-4111-8d72-67d8ac50f7a8 for instance a26897e4-8086-466e-bd4f-7594f120d8d7 on n-h1-858383-13 Oct 18 14:07:57.803689 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3262/6683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:57 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:57.804901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c3b8045a-09b7-4dc4-8209-f53c5ab3b261 req-303ed062-7e49-4e70-a470-43435b7896b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057299 Oct 18 14:07:57.805907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3422/6684] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:07:58.193729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:58.195101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:58.210311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.211198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.211993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:58.213392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.214670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.216817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:58.393461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:58.406469 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1019b87-40bc-4ef2-b605-7382975b1116 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.217355 Oct 18 14:07:58.426873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3263/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:58 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:58.604382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:58.605273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:58.617984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.618787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.619823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:58.622568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.624017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.626796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:58.820550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:58.822317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:58.851465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.855877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.858429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:58.860133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:58.862377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:58.862854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:59.022499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:59.036746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:59.040475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:59.043638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-371b4e06-23f0-4556-a962-558ce7366442 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.443048 Oct 18 14:07:59.048604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3423/6686] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:07:58 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:07:59.441464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:59.442024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:59.455756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:59.456379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:59.456890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:59.463281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:59.464716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:59.464716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:59.563527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:59.586436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d56d38c-b46b-45dd-a4f2-4921ea0925d9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.774438 Oct 18 14:07:59.588082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3264/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:58 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:59.668079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:59.681220 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59f3697b-3feb-4786-9e22-696ebbc4c05c tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.243397 Oct 18 14:07:59.682542 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3424/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:59 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:00.093870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:00.094896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:00.140399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.145430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.145969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:00.149603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.150127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.150592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:00.617869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:00.618575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:00.643282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.644052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.646217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:00.646920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.647429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.647902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:00.682032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:00.691542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:00.693640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:00.718093 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6c2216a-cd2c-4563-a7ac-d68fc82a7d1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.628933 Oct 18 14:08:00.727017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3265/6689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:00 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:00.755729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:00.760345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:00.805182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.806136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.809734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:00.810840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:00.811526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:00.812166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:01.110961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:01.136064 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31e3d044-49b6-4bef-a2d6-40830f0f54bb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.407490 Oct 18 14:08:01.136686 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3266/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:00 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:01.150573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:01.164108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f58ae22-1e6d-40e1-ad9f-e4fe2e16aa94 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.554924 Oct 18 14:08:01.167174 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3425/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:00 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:01.758241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:01.758881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:01.774269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:01.774772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:01.775222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:01.775941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:01.776405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:01.776836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:02.165935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:02.168541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:02.184282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:02.188316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:02.190406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:02.193737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:02.196848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:02.203033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:02.227911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:02.237798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:02.245289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:02.248414 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65008f92-a099-41b2-9ca2-5a2b6ea0c5cf tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.495449 Oct 18 14:08:02.255873 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3267/6692] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:01 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:02.274818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:02.277465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:02.287665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:02.288567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:02.289247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:02.290233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:02.290935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:02.291598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:02.445565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:02.456585 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbde46b0-bb37-43bb-9f81-008fe29cb89a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.297853 Oct 18 14:08:02.471675 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3426/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:02 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:02.749987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:02.759718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-edf81d3a-d5d6-4703-b490-82c37c26b6b9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.501515 Oct 18 14:08:02.760371 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3268/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:02 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:03.306534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:03.306534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:03.309769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.310568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.311289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.312340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.313050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.313603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.484053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:03.484802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:03.497706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.504351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.508368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.508722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.509292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.509801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.629643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:03.639775 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0e911e72-f7dc-4de3-b029-5d87cd546fcb tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.159627 Oct 18 14:08:03.640511 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3269/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:03 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:08:03.787480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:03.787998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:03.801251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.801251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.801251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.804573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:03.805089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:03.808823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:03.998335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:04.011534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:04.019175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:04.022012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4116803f-a27b-468b-8588-12079d59aad2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.724960 Oct 18 14:08:04.036129 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3427/6696] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:03 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:04.161858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:04.170833 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6461f2c6-8e6c-4eca-aebf-8604fe9ea585 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.387592 Oct 18 14:08:04.171433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3270/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:03 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:08:04.668699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:04.669350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:04.676906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:04.677742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:04.678499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:04.679240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:04.679897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:04.680555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:04.825330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:04.825330 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79aae012-49ee-4b8c-a513-39803e12e329 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.098123 Oct 18 14:08:04.825330 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3428/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:04 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:05.053498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:05.054146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:05.067754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.068525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.078868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:05.082462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.083280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.083913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:05.220778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:05.231426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:05.240759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:05.283674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.286609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.287146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:05.287933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.288428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.302540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:05.557847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:05.574695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:05.576804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:05.578272 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2eef7516-124a-4e05-920f-04d19ee26674 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.529430 Oct 18 14:08:05.587411 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3271/6699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:05 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:05.718200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:05.731999 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-faf908c8-998b-48f3-b66a-2490d5249159 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.535261 Oct 18 14:08:05.733387 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3429/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:05 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:05.846312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:05.847242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:05.856985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=71 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:05.859079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.865110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.871758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:05.871758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:05.871758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:05.871758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.044148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:06.055882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ce668c3-0026-48cd-ae7e-f7c36a4b34fa tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1230 microversion: 2.1 time: 0.213484 Oct 18 14:08:06.063159 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3272/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:05 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1230 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:06.616912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:06.617761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:06.625183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.626101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.626913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.627948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.628807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.629615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.640291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:06.765656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:06.766644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:06.794743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.799121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.799599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.800569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.801025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.802297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:07.009747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:07.021191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:07.022716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:07.029147 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-180f3f31-ab33-4f4d-af26-162f21571920 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.414972 Oct 18 14:08:07.030439 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3430/6702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:06 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:07.066895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:07.080302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:07.081305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:07.082419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6ce0155-cea4-490f-b9a9-145769e263d0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.324103 Oct 18 14:08:07.084026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3273/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:06 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:07.104463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:07.105565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:07.106290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:07.107296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:07.107994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:07.108649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:07.159811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:07.162783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:07.163698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:07.166921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lazy-loading 'fault' on Instance uuid a26897e4-8086-466e-bd4f-7594f120d8d7 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:08:07.237827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ca9fe7c4461a07baa70d73f04e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0109abe8e76e4e5e9f622e401f9921b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:07.250009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-209afa5e-f258-4ec6-bdb4-211d6cdd690a tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 200 len: 1235 microversion: 2.1 time: 0.174738 Oct 18 14:08:07.251501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3431/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:07 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 1235 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:08:07.733690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b35a07-2b1c-4b92-a2f6-76182c089a1b", "name": "network-vif-plugged", "status": "completed", "tag": "ce96f56e-ddef-4397-baca-9d08c4927a7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:07.757196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:07.757914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:07.758574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:07.788612 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] Creating event network-vif-plugged:ce96f56e-ddef-4397-baca-9d08c4927a7c for instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b on n-h2-858383-13 Oct 18 14:08:07.804732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9ade0ab8-a3f1-4bc2-822a-f58ed4ce1862 req-20e4af77-0712-42f5-a3a5-21ea53a2d430 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077104 Oct 18 14:08:07.815322 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3274/6705] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:08.062787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:08.064228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:08.073474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.074438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.075310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.076335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.077111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.077796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.112990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:08.115050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:08.128855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.129260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.130184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.133046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.133876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.135007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.249840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:08.260632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:08.271074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:08.271074 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6cb14aed-8831-4ea9-a9ab-6728cc54f731 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.205941 Oct 18 14:08:08.293048 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3432/6706] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:08 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:08.317488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:08.322130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] [instance: a26897e4-8086-466e-bd4f-7594f120d8d7] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:08.346605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.347554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.348891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.352033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:08.352831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:08.353540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:08.395361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] HTTP exception thrown: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Request method failure captured: Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 HTTP/1.1 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrHYREJQshnFhxC94p7EzqCcnCcZ4vLL8FI2hmMJH2uxu0JpzIXUMzrWtcoRuGjpTTTZAOf3T9eoX86txHFaENku9IG3SyOP-aTjL1A7SMTN6RfqAW4GV2_ekyp07W3phZPjM_vwgvH5Z-4_dmnk-3IFNg8i_EA2SwxsPBIWYIRusn8 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 0109abe8e76e4e5e9f622e401f9921b0 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBackupRestore-463195417 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0109abe8e76e4e5e9f622e401f9921b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0109abe8e76e4e5e9f622e401f9921b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0109abe8e76e4e5e9f622e401f9921b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0109abe8e76e4e5e9f622e401f9921b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBackupRestore-463195417 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 0109abe8e76e4e5e9f622e401f9921b0 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBackupRestore-463195417 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBackupRestore-463195417-project Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 0b5c1ca9fe7c4461a07baa70d73f04e7 Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBackupRestore-463195417-project Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'a26897e4-8086-466e-bd4f-7594f120d8d7'} Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:08:08.397230 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:08:08.402892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Returning 404 to user: Instance a26897e4-8086-466e-bd4f-7594f120d8d7 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:08:08.405098 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4af7ad7b-feea-44e6-8529-75f99aff3c97 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7" status: 404 len: 111 microversion: 2.1 time: 0.108461 Oct 18 14:08:08.410365 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3433/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:08 2022] GET /compute/v2.1/servers/a26897e4-8086-466e-bd4f-7594f120d8d7 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:08:08.416306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:08.456269 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-373c1909-21e5-45c5-9cb6-0f69f22efaf2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.340867 Oct 18 14:08:08.483163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3275/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:08 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:08:09.150415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ae58330-6712-47ef-9b40-8897d9636cc9 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] Calling method '.version_select at 0x7fb32bcab4c0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:09.248053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ae58330-6712-47ef-9b40-8897d9636cc9 tempest-TestVolumeBackupRestore-463195417 tempest-TestVolumeBackupRestore-463195417-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1241537019" status: 202 len: 0 microversion: 2.1 time: 0.099111 Oct 18 14:08:09.248053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3434/6709] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 14:08:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1241537019 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:08:09.297681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:09.298684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:09.308519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:09.309385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:09.311249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:09.312255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:09.312953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:09.313616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:09.353849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:09.481858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:09.482547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:09.502885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:09.506746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:09.507754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:09.508585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:09.509105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:09.510224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:09.526019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:09.546323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:09.548173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:09.550081 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-20d174f6-408b-4734-ac25-d51579057195 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.256645 Oct 18 14:08:09.551281 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3276/6710] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:09 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:09.776336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:09.784967 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12148df7-78fc-4067-a974-9024861acca5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1266 microversion: 2.1 time: 0.307393 Oct 18 14:08:09.786261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3435/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:09 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:10.577017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:10.578319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:10.597655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:10.598199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:10.598658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:10.606138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:10.606815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:10.607286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:10.814920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:10.816951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:10.829529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:10.837051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:10.837900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:10.841697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:10.846393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:10.848000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:10.957939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:10.968017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:10.986587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:10.993868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98e17baf-507b-4f38-bff0-dff93a33f304 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.420929 Oct 18 14:08:11.000063 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3277/6712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:10 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:11.144863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:11.159148 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20c5b018-90ef-4b00-84e2-b634e25c92a7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1452 microversion: 2.1 time: 0.347923 Oct 18 14:08:11.160662 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3436/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:10 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1452 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:11.189594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:11.190413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:11.198239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:11.199020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:11.200265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:11.201298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:11.202578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:11.203267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:11.752855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:11.769861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53e85bd7-44f1-4129-89bb-1b048c360952 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1452 microversion: 2.1 time: 0.584227 Oct 18 14:08:11.771104 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3278/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:11 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1452 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:12.033048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:12.034439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:12.060639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:12.063094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:12.063855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:12.064965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:12.067066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:12.068164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:12.330381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:12.346670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:12.349030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:12.350907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f838d8fc-b3d6-4374-b920-154353ace624 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1739 microversion: 2.20 time: 0.323118 Oct 18 14:08:12.352223 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3437/6715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:12 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:13.378234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:13.380316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:13.422860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:13.430193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:13.430193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:13.430193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:13.430193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:13.430193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:13.858231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:13.891628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:13.891628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:13.892711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa5420e3-ed21-4ce1-a550-4d6d2c9de5a5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1721 microversion: 2.20 time: 0.518768 Oct 18 14:08:13.893289 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3279/6716] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:13 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1721 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:14.943691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:14.947116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:14.975612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:14.982827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:14.982827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:14.982827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:14.982827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:14.982827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:15.817345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:15.833549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:15.841085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:15.846139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bac35e13-825c-4f33-b939-f0fa72f3838a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1721 microversion: 2.20 time: 0.924821 Oct 18 14:08:15.855036 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3438/6717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:14 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1721 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:16.763404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b35a07-2b1c-4b92-a2f6-76182c089a1b", "tag": "ce96f56e-ddef-4397-baca-9d08c4927a7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:16.800895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:16.800895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:16.800895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:16.815040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] Creating event network-changed:ce96f56e-ddef-4397-baca-9d08c4927a7c for instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b on n-h2-858383-13 Oct 18 14:08:16.836262 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8687c8a8-1c67-4143-a1a1-6881235583d6 req-3fbb436d-c490-4a79-a209-8b35419f3acd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076607 Oct 18 14:08:16.838933 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3280/6718] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:16.886322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:16.887099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:16.908049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:16.909002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:16.910336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:16.915576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:16.916662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:16.926474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:17.858854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "name": "network-vif-unplugged", "status": "completed", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:17.877042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:17.877544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:17.877998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:17.896666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:17.906268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:17.909377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] Creating event network-vif-unplugged:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h2-858383-13 Oct 18 14:08:17.919558 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-54d50503-1a7a-4116-a04c-ac9f6403b23e req-adfea9ec-ac65-4873-be07-0357be9c4d1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064660 Oct 18 14:08:17.920787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3281/6719] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:17.923981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:17.925999 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dab6fa71-5e86-4d88-8098-65a5ded017a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1721 microversion: 2.20 time: 1.045166 Oct 18 14:08:17.933703 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3439/6720] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:16 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1721 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:18.976827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:18.977606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:18.999595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:19.008018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:19.008903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:19.009888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:19.011675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:19.013907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:19.689379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:19.699305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:19.701120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:19.702750 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-962e3500-e24e-4497-a73b-a25a7ea603ab tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1664 microversion: 2.20 time: 0.733397 Oct 18 14:08:19.718956 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3282/6721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:18 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1664 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:19.730506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "681bcd03-7ad4-4516-ab0d-aa98f4d69984"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:19.733719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:19.744028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:19.746381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:19.751293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:19.752102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:19.752607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:19.753068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:21.378266 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5a4d2be-31a8-49ec-b473-57368a8ab588 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.648743 Oct 18 14:08:21.378266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3440/6722] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 18 14:08:19 2022] POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 188 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:08:21.608708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:21.609848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:21.621095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:21.621599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:21.628723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:21.629849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:21.631215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:21.632715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:21.738443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 14:08:22.242650 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c808181c-03be-4c33-89b3-ccedca1d6b0e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/action" status: 202 len: 0 microversion: 2.20 time: 0.638897 Oct 18 14:08:22.249908 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3283/6723] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 14:08:21 2022] POST /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:08:22.258179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:22.258904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:22.289128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:22.289431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:22.295973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:22.297111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:22.303090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:22.303835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:22.627862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:22.644800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:22.645781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:22.648756 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c709bfe-613d-4609-ad3b-bd9b8eb32b72 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1750 microversion: 2.20 time: 0.396397 Oct 18 14:08:22.650153 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3441/6724] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:22 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1750 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:23.680380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:23.681009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:23.688673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:23.692500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:23.693141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:23.694584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:23.695618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:23.710199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:24.053636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:24.072110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:24.076216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:24.092509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11d25089-d0d9-463c-94d6-89167ac4b4f3 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1750 microversion: 2.20 time: 0.416055 Oct 18 14:08:24.093143 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3284/6725] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:23 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1750 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:25.125287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:25.125915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:25.170502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:25.178686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:25.179617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:25.182889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:25.185426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:25.187475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:25.481804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:25.503791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:25.505911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:25.507461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2327f75a-7bff-4ce2-bb69-7bf6296fd9d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1750 microversion: 2.20 time: 0.387133 Oct 18 14:08:25.508429 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3442/6726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:25 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1750 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:26.539983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:26.540604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:26.576138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:26.585610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:26.586779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:26.588320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:26.596782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:26.596782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:26.974137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:26.993795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:26.996064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:26.997511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d8d748b-cbf8-4483-8cdb-187ca96b9f6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.464932 Oct 18 14:08:26.998700 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3285/6727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:26 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:28.033705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:28.035545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:28.065114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:28.065677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:28.066400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:28.077350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:28.078170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:28.078817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:28.440080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:28.482986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:28.488584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:28.490687 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73553a04-3565-48a5-a39a-26a1ca100012 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.462655 Oct 18 14:08:28.492511 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3443/6728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:28 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:29.524720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:29.529695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:29.561847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:29.562880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:29.566904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:29.568190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:29.569096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:29.573370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:30.090090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:30.110289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:30.116259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:30.117607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eed4549a-49db-4c5c-b504-0fe4e57c9492 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.597264 Oct 18 14:08:30.118255 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3286/6729] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:29 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:31.149709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:31.160004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:31.176179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:31.179493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:31.181336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:31.184465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:31.186841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:31.187618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:31.863700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:31.875666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:31.897544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:31.913625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2669a132-f666-4e5a-b407-e403e4172dc0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.762920 Oct 18 14:08:31.916530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3444/6730] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:31 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:32.949206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:32.950459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:32.976215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:32.978221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:32.979439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:32.981364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:32.983258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:32.984073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:33.412383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:33.434220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:33.442920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:33.444347 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-557b0534-4577-401f-bd52-3fe5be5ec455 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.499788 Oct 18 14:08:33.481783 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3287/6731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:32 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:34.480983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:34.482430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:34.496031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:34.498869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:34.500823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:34.506147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:34.506147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:34.508282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:34.561591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:34.992416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:35.008825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:35.010374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:35.016899 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1048ab20-9303-48ef-a45e-f450440a3c75 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.541765 Oct 18 14:08:35.034859 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3445/6732] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:34 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:36.049416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:36.050509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:36.057007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:36.071970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:36.093927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:36.093927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:36.093927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:36.093927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:36.093927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:36.098571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee2f6b93-832c-4eab-b3d0-a76ec7958a68 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Action: 'create', calling method: .version_select at 0x7fb32bded5e0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1148208314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk4oFHI68Oc36oV7Q8fJNCp0WBdcG7aP6vpux8pgPuwu6QY2fhBxnE4p8aivyZnJKxyuceLwfLM+fesYx5oGt7c4p4P2cofrBOAGg+FWxB2QvTqdBCtc/S5O6lNXVrmNA=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:36.108533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:36.123063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ee2f6b93-832c-4eab-b3d0-a76ec7958a68 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for project 98dbcb42beaa4345ad9a6851c067bc99. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:08:36.134392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-ee2f6b93-832c-4eab-b3d0-a76ec7958a68 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for user afb029d693404bd6bfd636535dac99ab and project 98dbcb42beaa4345ad9a6851c067bc99. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:08:36.255436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee2f6b93-832c-4eab-b3d0-a76ec7958a68 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.459784 Oct 18 14:08:36.256974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3288/6733] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:08:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:36.291373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:36.304110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:36.305807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:36.311549 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c75c6445-a9ca-40a4-b9f5-74a9804402d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1752 microversion: 2.20 time: 0.264984 Oct 18 14:08:36.311549 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3446/6734] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:36 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:08:37.339728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:37.340308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:37.353792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:37.355054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:37.355584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:37.356384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:37.357088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:37.359032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:37.593887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:37.604711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:37.606506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:37.608509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e0bcdee9-b86f-479e-8714-e1f9d4f50411 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.274192 Oct 18 14:08:37.609283 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3289/6735] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:37 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:38.637219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:38.637938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:38.653889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.676810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.676810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.677607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.678379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.679023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.822552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:38.842577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.843494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.844220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.869014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] Creating event network-changed:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h1-858383-13 Oct 18 14:08:38.882577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f6e0b55f-f6e9-488e-b0d2-3c8cc24170e1 req-3f22f44d-046c-4b81-abab-c02fbf4f4710 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063832 Oct 18 14:08:38.886711 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3290/6736] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:08:38.931566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:38.942984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:38.944470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:38.945783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca5de181-413d-4c07-b65e-cb6c9e471d61 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.313749 Oct 18 14:08:38.947112 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3447/6737] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:38 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:39.976571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:39.977930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:40.010952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:40.011826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:40.012545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:40.013592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:40.014298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:40.014964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:40.023168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:40.202283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-819973817", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1148208314", "security_groups": [{"name": "tempest-secgroup-smoke-156979627"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "adb6e317-b4f1-44a8-a150-5806e2933c56"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:40.236860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:40.258680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:40.266101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:40.267737 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25a086ff-3cc7-4ac1-9f5a-9fe29cefda20 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.297086 Oct 18 14:08:40.282084 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3291/6738] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:39 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:40.369524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] validate_networks() for [('adb6e317-b4f1-44a8-a150-5806e2933c56', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:08:40.976417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for project 98dbcb42beaa4345ad9a6851c067bc99. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:08:40.995620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for user afb029d693404bd6bfd636535dac99ab and project 98dbcb42beaa4345ad9a6851c067bc99. Resources: dict_keys(['metadata_items']) {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:08:41.020125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:08:41.020968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:08:41.021849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:08:41.022631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:08:41.023331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:08:41.036819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:41.037612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:41.041194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.041194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:41.041194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:41.041194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.066995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for project 98dbcb42beaa4345ad9a6851c067bc99. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:08:41.073479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Getting quotas for user afb029d693404bd6bfd636535dac99ab and project 98dbcb42beaa4345ad9a6851c067bc99. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:08:41.088129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:08:41.095943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:08:41.283346 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3bd2b005-7290-4cba-993a-7e7421d2d7d5 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.085232 Oct 18 14:08:41.303044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-975c190d-7c75-4114-9c3f-31fa67ec689f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:41.304591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-975c190d-7c75-4114-9c3f-31fa67ec689f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:41.307109 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3448/6739] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:08:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 14:08:41.329803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:41.330754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:41.365163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:41.365871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:41.372206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.373096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:41.373667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:41.374043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.499685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-975c190d-7c75-4114-9c3f-31fa67ec689f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:41.510376 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-975c190d-7c75-4114-9c3f-31fa67ec689f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1302 microversion: 2.1 time: 0.214949 Oct 18 14:08:41.527402 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3292/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:41 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1302 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:41.658525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:41.675361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:41.679087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:41.679087 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dd38950-f544-48e4-912e-ea1f3b96114f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.368999 Oct 18 14:08:41.684402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3449/6741] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:41 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:42.539526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd560f63-6760-4506-b52e-cca5657021fa tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:42.540935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cd560f63-6760-4506-b52e-cca5657021fa tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:42.664141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cd560f63-6760-4506-b52e-cca5657021fa tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:42.672062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd560f63-6760-4506-b52e-cca5657021fa tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1302 microversion: 2.1 time: 0.136779 Oct 18 14:08:42.688260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3293/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:42 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:08:42.710613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:42.711965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:42.726551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:42.727097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:42.727629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:42.728430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:42.728972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:42.729486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:42.942900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:42.953951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:42.956576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:42.957827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4b7a811-4990-437d-9466-ee0feee7b334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.252034 Oct 18 14:08:42.977308 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3450/6743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:42 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:43.696630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:43.698492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:43.707949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:43.708771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:43.709561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:43.710551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:43.711221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:43.711961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:43.789635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:43.798216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3605b6a0-752f-4143-b3e4-fcce002a793f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.106154 Oct 18 14:08:43.800618 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3294/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:43 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:43.992183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:43.992902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:44.000993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:44.001504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:44.001964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:44.003187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:44.003672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:44.004123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:44.218081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:44.227099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:44.229320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:44.230348 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-680f1098-2977-4a3e-bfc9-48b6959619ae tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.246780 Oct 18 14:08:44.231766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3451/6745] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:43 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:44.824622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:44.825959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:44.840026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:44.841224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:44.841774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:44.842741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:44.843425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:44.844620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:44.925359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:44.935326 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cbf45ea5-8562-41f4-89a7-e2306184e0c0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.114415 Oct 18 14:08:44.936653 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3295/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:44 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:45.258918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:45.259652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:45.268000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:45.268902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:45.269788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:45.270851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:45.271615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:45.272305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:45.480017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:45.491155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:45.492810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:45.494088 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e770ba8-7d16-472a-b1ae-1a969c604d35 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.239425 Oct 18 14:08:45.509808 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3452/6747] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:45 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:45.959342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:45.960237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:45.970444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:45.971237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:45.972305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:45.973718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:45.974450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:45.975262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:46.064484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:46.076166 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96993981-0689-46ca-a13a-f2f1ee5a7530 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.121617 Oct 18 14:08:46.079292 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3296/6748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:45 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:46.521868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:46.522876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:46.533498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:46.535492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:46.535492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:46.536458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:46.537291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:46.537696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:46.730529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:46.741668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:46.743274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:46.744559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aab83ea6-9765-436b-bde6-edb413aed54c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.227438 Oct 18 14:08:46.745324 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3453/6749] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:46 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:47.103489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:47.104125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:47.126016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:47.126547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:47.127005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:47.127772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:47.128244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:47.128686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:47.226829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:47.236446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b513235-8933-48e5-9e26-e31f71075250 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.137140 Oct 18 14:08:47.237324 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3297/6750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:47 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:47.771068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:47.771633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:47.779069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:47.779575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:47.780171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:47.780894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:47.781370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:47.781825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:47.962950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:47.978297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:47.980224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:47.985773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2bc9ebc-0cf2-46a8-a1a6-b24bef835098 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.218762 Oct 18 14:08:47.990706 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3454/6751] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:47 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:48.269879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:48.271784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:48.279547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:48.280151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:48.280976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:48.281806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:48.282381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:48.282912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:48.357460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:48.366024 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-04969623-8201-4c12-9293-49da88df5366 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.104838 Oct 18 14:08:48.374514 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3298/6752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:48 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:49.033109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:49.033827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:49.041353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:49.041887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:49.042823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:49.043364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:49.043854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:49.044308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:49.204137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:49.213191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:49.214690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:49.215921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4219497-f033-47f7-91fe-11eae5b04d10 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.187047 Oct 18 14:08:49.216486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3455/6753] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:49 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:49.388946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:49.389610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:49.397223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:49.397735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:49.398241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:49.398956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:49.399433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:49.399873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:49.478997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:49.487486 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3559999-16fa-4410-a2b0-141a79f31ff0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1306 microversion: 2.1 time: 0.101780 Oct 18 14:08:49.488098 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3299/6754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:49 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:50.243301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:50.244422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:50.251983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:50.256387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:50.256387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:50.256387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:50.256387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:50.256387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:50.406380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:50.414469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:50.415937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:50.417138 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6b8c38cb-940b-47e9-94c3-36af5f662a19 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.178846 Oct 18 14:08:50.417711 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3456/6755] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:50 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:50.511206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:50.512032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:50.520912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:50.521528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:50.522084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:50.523263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:50.524004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:50.524451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:50.593618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:50.602569 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eff1fdae-aae7-4f85-a8e4-5e207ce8da54 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1354 microversion: 2.1 time: 0.095178 Oct 18 14:08:50.603381 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3300/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:50 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:51.444126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:51.445047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:51.447072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:51.448409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:51.457641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:51.458418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:51.458980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:51.459798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:51.460288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:51.460743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:51.629321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:51.632332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:51.634231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:51.639035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:51.639554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:51.640204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:51.641329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:51.641971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:51.642626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:51.645541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:51.649304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:51.650710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08a671fa-3dde-4532-b11f-d06eebd661dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.210665 Oct 18 14:08:51.655083 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3457/6757] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:51 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:52.072935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:52.085651 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b97a2065-5b56-45ca-91ad-461bc4a3896b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1362 microversion: 2.1 time: 0.459186 Oct 18 14:08:52.090449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3301/6758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:51 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:52.678378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:52.678378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:52.685407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:52.685925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:52.686427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:52.687170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:52.687653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:52.688711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:52.874541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:52.890344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:52.895434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:52.896719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6482d32-282f-4f5f-a328-499fcb754b6a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.223644 Oct 18 14:08:52.897673 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3458/6759] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:52 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:53.107011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:53.108245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:53.115802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:53.116522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:53.116993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:53.117656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:53.118588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:53.119218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:53.119818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:53.364010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:53.373672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ebccf0fd-b577-4586-ac03-7af644247a10 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.270520 Oct 18 14:08:53.374379 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3302/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:53 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:53.852969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac5dd61-dd29-4b8f-8327-d176f0add834", "tag": "38490761-fb8f-4215-a39f-a1cbfbcd787c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:53.863691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:53.864194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:53.864647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:53.884951 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] Creating event network-changed:38490761-fb8f-4215-a39f-a1cbfbcd787c for instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 on n-h1-858383-13 Oct 18 14:08:53.886480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0c47d893-d7ba-4e12-ba69-5744bf6f7b6f req-26b9a645-7c8e-4acf-86b4-adda156259e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Oct 18 14:08:53.887343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3459/6761] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:53.933103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:53.934902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:53.946764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:53.947539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:53.948599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:53.949967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:53.950739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:53.951209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:54.192716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:54.203853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:54.206285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:54.207837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a53d2fec-3c35-496e-84e3-f45492149934 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.282234 Oct 18 14:08:54.208730 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3303/6762] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:53 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:54.398805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:54.399539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:54.410629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:54.411423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:54.411921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:54.412658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:54.413149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:54.413854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:54.582169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:54.595320 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08af0bb2-7817-4537-9f27-57833c150b3f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.199557 Oct 18 14:08:54.596786 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3460/6763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:54 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:55.262679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:55.262679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:55.266323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:55.266833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:55.267283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:55.268040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:55.268639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:55.269182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:55.422770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:55.432797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:55.434314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:55.435884 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-765e2230-07f8-4a95-9261-8c6d4c6e36af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.183099 Oct 18 14:08:55.436471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3304/6764] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:55 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:08:55.621662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:55.622630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:55.630231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:55.630760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:55.631493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:55.632470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:55.633165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:55.633630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:55.794248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:55.804259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-983b988a-3d06-4c25-8dfe-6015bdba57b0 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.188243 Oct 18 14:08:55.805142 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3461/6765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:55 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:56.461862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:56.462541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:56.470106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:56.470609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:56.471110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:56.471834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:56.472303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:56.472744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:56.633069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:56.638008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:56.640247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:56.641481 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad340f39-6198-451c-833f-f78797e02584 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.183086 Oct 18 14:08:56.648308 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3305/6766] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:56 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:56.827642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:56.828330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:56.838523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:56.839124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:56.839603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:56.840376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:56.840857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:56.841316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:57.029707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:57.038629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4571fc39-19c2-4ad7-b353-ad7e78e4ef87 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.214859 Oct 18 14:08:57.039217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3462/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:56 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:57.666557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:57.667259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:57.676006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:57.676494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:57.676936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:57.677639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:57.678120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:57.678553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:57.824730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:57.833880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:57.835833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:57.837094 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24d948b1-32d0-4bc5-9d44-494892ae7bf1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.174471 Oct 18 14:08:57.837660 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3306/6768] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:57 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:58.062086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:58.062642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:58.069631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:58.070172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:58.070642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:58.071362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:58.071844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:58.072301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:58.093370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:58.219607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:58.228428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed45e712-863a-4406-817d-eb9faa3201f3 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.170288 Oct 18 14:08:58.229013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3463/6769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:58 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:58.868511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:58.870190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:58.880479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:58.880479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:58.880479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:58.880479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:58.881229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:58.881622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:59.061590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:59.074388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:59.076073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:59.077299 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb604300-24e6-41fd-a901-eaa98e4d90c2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.216302 Oct 18 14:08:59.077876 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3307/6770] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:08:58 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:08:59.251768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:59.252420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:59.261333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:59.261859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:59.262353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:59.263086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:59.263589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:59.264105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:59.437997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:59.483708 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b1ce5b3-5033-4a75-aa71-ac7996432cbf tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.206712 Oct 18 14:08:59.483708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3464/6771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:59 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:00.103076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:00.103987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:00.112109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:00.112884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:00.113538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:00.114306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:00.114944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:00.115554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:00.503298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:00.507348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:00.526466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:00.617033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:00.617033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:00.617033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:00.617033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:00.617033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:00.618971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:00.618971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:00.618971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:00.618971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e857a052-3aea-4338-b812-c30e8bbfc680 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.515230 Oct 18 14:09:00.618971 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3308/6772] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:00 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:00.738300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:00.746372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d72b46a-7d40-453c-96d3-b6680b756e17 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.250611 Oct 18 14:09:00.747357 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3465/6773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:00 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:00.775196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "name": "network-vif-plugged", "status": "completed", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:00.786866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:00.787717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:00.788166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:00.807174 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] Creating event network-vif-plugged:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h1-858383-13 Oct 18 14:09:00.812737 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-454c2621-a23d-4dcf-92db-d3fda694e43b req-630d6c6c-3e8a-485b-ac76-34b107d7f1ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041337 Oct 18 14:09:00.813354 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3309/6774] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:01.643508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:01.643508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:01.649670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:01.650002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:01.650506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:01.651284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:01.651773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:01.652230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:01.772085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:01.773088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:01.780888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:01.781581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:01.782089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:01.782806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:01.783315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:01.783755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:01.803252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:01.830918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:01.840940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:01.843012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:01.844749 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56aa6e4f-2195-484d-8975-91436099a3de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.207450 Oct 18 14:09:01.846346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3466/6775] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:01 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:01.945466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:01.953568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0bf00f72-b557-4c99-a4b1-c2878f9541db tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.186316 Oct 18 14:09:01.954610 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3310/6776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:01 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:02.829533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac5dd61-dd29-4b8f-8327-d176f0add834", "name": "network-vif-plugged", "status": "completed", "tag": "38490761-fb8f-4215-a39f-a1cbfbcd787c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:02.841042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:02.841617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:02.842090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:02.854508 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] Creating event network-vif-plugged:38490761-fb8f-4215-a39f-a1cbfbcd787c for instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 on n-h1-858383-13 Oct 18 14:09:02.865228 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-81d2c0ef-eefe-46c1-8c3d-a80de6151499 req-c7d8319a-6dc8-4a1d-bdea-4298faee83e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034832 Oct 18 14:09:02.865228 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3467/6777] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:02.873241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:02.874042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:02.883487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:02.885653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:02.886183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:02.887303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:02.887969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:02.888239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:02.977724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:02.978436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:02.985155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:02.985669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:02.986161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:02.986890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:02.987373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:02.987872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:03.127990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:03.137542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:03.139021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:03.140201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62e41595-8f94-468d-b264-63c63e5c1d49 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.272639 Oct 18 14:09:03.140762 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3311/6778] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:02 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:03.153680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:03.161816 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbd1b63c-2729-455b-b0f9-a69aa97eabcd tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.188745 Oct 18 14:09:03.162449 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3468/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:02 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:04.167589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:04.168346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:04.177160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:04.178655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:04.179842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:04.180716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:04.181433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:04.182145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:04.186231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:04.186231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:04.199256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:04.199769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:04.203488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:04.209001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:04.210884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:04.212808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:04.354904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:04.391691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:04.394563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:04.398346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98753572-ee62-4485-9197-0b884364e50a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1808 microversion: 2.20 time: 0.233594 Oct 18 14:09:04.398346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3312/6780] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:04 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:04.398927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:04.407660 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a81878dd-064a-4efc-8262-78c2d33d2253 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1427 microversion: 2.1 time: 0.226330 Oct 18 14:09:04.408841 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3469/6781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:04 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:05.441347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:05.441960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:05.447562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:05.448206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:05.462704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.463234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.464860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.466599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.471291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.471291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.471565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.617034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:05.629279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:05.632038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:05.633771 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f0400aed-248d-4f5f-a169-c63aacfe7e91 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1795 microversion: 2.20 time: 0.197196 Oct 18 14:09:05.638094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:05.643176 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3313/6782] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:05 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1795 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:05.652341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e48d1586-6c5d-4e0b-9e4f-561e79343e63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1608 microversion: 2.1 time: 0.209006 Oct 18 14:09:05.668043 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3470/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:05 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1608 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:05.675637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:05.676258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:05.682543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.685217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.685217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.685217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.685217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.685217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.846429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:05.854457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1df8e53b-3ec7-456c-9329-85bb1f690f1c tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1608 microversion: 2.1 time: 0.183151 Oct 18 14:09:05.855039 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3314/6784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:05 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1608 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:05.880334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:05.881410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:05.888037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.888708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.889171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:05.890085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:05.890570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:05.891015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:06.042545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:06.051601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-293a6e22-7d56-423b-a875-e6f27aba657f tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1608 microversion: 2.1 time: 0.177729 Oct 18 14:09:06.052191 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3471/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:05 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1608 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:08.609290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac5dd61-dd29-4b8f-8327-d176f0add834", "tag": "38490761-fb8f-4215-a39f-a1cbfbcd787c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:08.615797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:08.621090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:08.621540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:08.621981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:08.635377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] Creating event network-changed:38490761-fb8f-4215-a39f-a1cbfbcd787c for instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 on n-h1-858383-13 Oct 18 14:09:08.641322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f1a9a583-5abc-4a06-aaab-1addcb92d8dc req-09143d8d-0cac-4800-bcea-3c6366366604 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035721 Oct 18 14:09:08.642193 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3315/6786] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:38.975086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:38.975660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:38.978552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:38.979232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=46 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:38.984478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:38.984990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:38.985506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:38.986266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:38.986748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:38.987241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.018786 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0707cddd-e7a9-4951-a4a3-67c5e12f8e9e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments/681bcd03-7ad4-4516-ab0d-aa98f4d69984" status: 200 len: 194 microversion: 2.20 time: 0.047976 Oct 18 14:09:39.019395 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3472/6787] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Oct 18 14:09:38 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments/681bcd03-7ad4-4516-ab0d-aa98f4d69984 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:09:39.094954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=29 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:39.099870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:39.100465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:39.107502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.108001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.108451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.109165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.109619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.110102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.197840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lazy-loading 'services' on Instance uuid 0275ae28-fb08-43ea-a192-df0b7a7649a3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:09:39.360680 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93d4a8af-c779-486a-b335-4933513c2b29 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments/681bcd03-7ad4-4516-ab0d-aa98f4d69984" status: 202 len: 0 microversion: 2.20 time: 0.267993 Oct 18 14:09:39.361424 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3316/6788] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 18 14:09:39 2022] DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments/681bcd03-7ad4-4516-ab0d-aa98f4d69984 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:09:39.372479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:39.375141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:39.382386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.382895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.383440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.384193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.384675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.385122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.425579 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3522ff1-0852-40c3-b96f-3f1e106410aa tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058170 Oct 18 14:09:39.426216 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3473/6789] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:39 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:09:40.121280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-311504932", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "d04d139b-8074-4e41-93cd-b33cf572d529"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:40.176089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] validate_networks() for [('d04d139b-8074-4e41-93cd-b33cf572d529', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:09:40.439625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:40.441852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:40.449372 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.450193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.450857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.451769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.452427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.453070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.491892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-022f41f6-09e0-4d72-a75a-a9e807f6e1f6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056546 Oct 18 14:09:40.497536 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3474/6790] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:40 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:09:40.656079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:09:40.656513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:09:40.656991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:09:40.657484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:09:40.657904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:09:40.666873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.667369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.667814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.668552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.669959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.670428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.688052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Getting quotas for project 1a8c4e9a4615417cb58a66de310680ac. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:09:40.694032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Getting quotas for user 4baf8112fb494a5c8cffd2874ce56795 and project 1a8c4e9a4615417cb58a66de310680ac. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:09:40.707461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:09:40.710101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:09:40.827859 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d6cf0bb-3d8f-42f8-af5a-61cc0f7743fd tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829093 Oct 18 14:09:40.828742 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3317/6791] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:09:40.841402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71e640ab-e5ea-4ca3-beef-4c0358e2858e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:40.842580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71e640ab-e5ea-4ca3-beef-4c0358e2858e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:40.972124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71e640ab-e5ea-4ca3-beef-4c0358e2858e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:40.979773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71e640ab-e5ea-4ca3-beef-4c0358e2858e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1214 microversion: 2.1 time: 0.143415 Oct 18 14:09:40.980668 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3475/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:40 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:41.506876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:41.510244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:41.516694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:41.517186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:41.517640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:41.518370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:41.518831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:41.519261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:41.551266 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f20bbeaa-6c08-433a-9ad5-ce7a9dcec745 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050167 Oct 18 14:09:41.551860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3318/6793] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:41 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:09:42.003302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bd25d835-8783-4944-b075-3fcc859c563e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:42.004195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bd25d835-8783-4944-b075-3fcc859c563e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:42.067472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bd25d835-8783-4944-b075-3fcc859c563e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:42.075293 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bd25d835-8783-4944-b075-3fcc859c563e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1214 microversion: 2.1 time: 0.076419 Oct 18 14:09:42.076293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3476/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:41 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:42.564615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:42.567416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:42.575476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:42.576043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:42.576491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:42.577192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:42.577653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:42.578117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:42.609509 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e2e286de-e4d1-4493-9b73-7bd4e73e52a7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049355 Oct 18 14:09:42.610331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3319/6795] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:42 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:09:43.098706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:43.099257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:43.106830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.107365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.107877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.108749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.109230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.109684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.171669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:43.180418 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a92666c-7942-497d-89e4-58a59f6b1b5e tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1266 microversion: 2.1 time: 0.085711 Oct 18 14:09:43.181215 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3477/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:43 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:43.621863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:43.624374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:43.632034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.635427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.635427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.635427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.635427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.635427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.667628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dd0b8e5d-bf21-47bd-9b1e-eaa433536f2b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049684 Oct 18 14:09:43.668525 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3320/6797] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:43 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:09:44.211972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:44.212870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:44.227219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.228120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.228252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.228939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.229457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.229916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.375254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:44.383985 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed779127-f1a8-41b6-82d5-fd07043c39ce tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.176633 Oct 18 14:09:44.384604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3478/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:44 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:44.680319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:44.682552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:44.689341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.689837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.690321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.691023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.691486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.691922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.721386 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63562737-d64a-4912-a1ce-1a87cc5c3164 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045539 Oct 18 14:09:44.721953 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3321/6799] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:09:44 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:44.787353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:44.787878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:44.794239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.794747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.795200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.796143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.796631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.797087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.823461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:09:45.159908 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f847f6e-4122-4e68-b2d6-74a48f3c1ef6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 204 len: 0 microversion: 2.20 time: 0.376433 Oct 18 14:09:45.160525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3479/6800] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:09:44 2022] DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 14:09:45.169520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:45.170184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:45.176980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.177477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.178789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.179533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.180211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.180852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.285516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa747ba8-8b79-47e1-b790-d0e3d016b6a8", "tag": "b5034286-fcd9-4af0-8eb0-3303f0b10444"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:45.297633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.298222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.299069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.313517 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] Creating event network-changed:b5034286-fcd9-4af0-8eb0-3303f0b10444 for instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 on n-h2-858383-13 Oct 18 14:09:45.319397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-058eaece-31a3-46db-84ab-1681064dda71 req-9a24cc5f-5c70-4fc2-84e6-ff8fd042e97e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037409 Oct 18 14:09:45.320644 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3480/6801] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:09:45.330299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:45.348579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:45.364819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:45.366662 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2dc37e63-039c-446c-81e8-fb5de1e9f08e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.200928 Oct 18 14:09:45.367909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3322/6802] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:45 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:09:45.408175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:45.408902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:45.416330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.416931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.417458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.418373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.418923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.419441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.502809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:45.503334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:45.509824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.510354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.510805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.511511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:45.511978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:45.512415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:45.538726 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-388f4af4-900c-48dd-afd0-756353886d3b tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.040043 Oct 18 14:09:45.539330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3323/6803] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 14:09:45 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834/os-server-password => generated 116 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:09:45.955868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:45.964602 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-578741b2-d897-4f81-8e46-9dd498621411 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.560601 Oct 18 14:09:45.965225 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3481/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:45 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:46.394580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:46.395631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:46.403253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:46.403745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:46.404191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:46.404889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:46.405350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:46.405790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:46.540970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:46.549081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:46.550562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:46.551733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9ce6d83a-9ac3-4af2-959e-ac9db0a2369f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1723 microversion: 2.20 time: 0.161271 Oct 18 14:09:46.552393 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3324/6805] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:46 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:46.987064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:46.987706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:46.994750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:46.995270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:46.995732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:46.996453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:46.996929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:46.997379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:47.129880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:47.139170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf68408a-4d30-4831-8c67-f0421eef1055 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.155942 Oct 18 14:09:47.139792 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3482/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:46 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:47.579853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:47.580523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:47.588323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:47.589081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:47.589537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:47.590304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:47.590789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:47.591272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:47.995499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:47.999742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:48.001349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:48.002597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ec2510c-8f90-411a-a393-65be6636d404 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1656 microversion: 2.20 time: 0.428326 Oct 18 14:09:48.014110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3325/6807] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:47 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1656 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:48.171402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:48.172125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:48.175281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275ae28-fb08-43ea-a192-df0b7a7649a3", "name": "network-vif-deleted", "tag": "f0459814-4af7-462e-899b-5580974b8424"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:48.181188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:48.181935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:48.187264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:48.187264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:48.187264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:48.187264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:48.187632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:48.187632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:48.187632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:48.197675 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] Creating event network-vif-deleted:f0459814-4af7-462e-899b-5580974b8424 for instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 on n-h1-858383-13 Oct 18 14:09:48.203343 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-14600073-66b8-4d6e-a48e-8288d1285c94 req-0c5bc111-aa04-47a7-a00d-4c6c53e448a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032292 Oct 18 14:09:48.203951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3326/6808] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:48.326118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:48.334583 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc259db8-ea8b-4aa8-9ae4-4936a6437fde tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.174665 Oct 18 14:09:48.335159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3483/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:48 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:49.030223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:49.030943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:49.038448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:49.038940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:49.039386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:49.040086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:49.040544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:49.040981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:49.073961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:49.074516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:49.074961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:49.075417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lazy-loading 'fault' on Instance uuid 0275ae28-fb08-43ea-a192-df0b7a7649a3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:09:49.123355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:49.132813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:49.134480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:49.135927 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be1f635b-481f-411d-acd4-9180c2092dee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 200 len: 1371 microversion: 2.20 time: 0.111403 Oct 18 14:09:49.136496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3327/6810] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:49 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:49.358731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:49.359359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:49.366354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:49.366890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:49.367358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:49.368072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:49.368560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:49.369011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:49.500436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:49.508994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be2edf88-8c66-4e36-87e5-35c1f19f167c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.154309 Oct 18 14:09:49.509568 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3484/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:49 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:50.163710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:50.175467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:50.189012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 HTTP/1.1 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0275ae28-fb08-43ea-a192-df0b7a7649a3'} Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:09:50.190682 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07b5cc05-2132-414c-8b6a-2a1ae469691a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 404 len: 111 microversion: 2.20 time: 0.032934 Oct 18 14:09:50.200399 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3328/6812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:50 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:09:50.201396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b2d1a7c-eb43-4d3e-98ab-c92c8a49d8d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '.version_select at 0x7fb330ce1ca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:50.280095 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b2d1a7c-eb43-4d3e-98ab-c92c8a49d8d9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431787794" status: 204 len: 0 microversion: 2.20 time: 0.082619 Oct 18 14:09:50.280709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3485/6813] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 14:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431787794 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 14:09:50.533085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:50.533705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:50.541648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:50.542167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:50.542607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:50.543299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:50.543755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:50.544184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:50.675896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:50.678623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:50.686218 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1da1d9e2-7beb-4d0a-9331-c6b9b3d7bd60 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.156916 Oct 18 14:09:50.687052 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3329/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:50 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:51.038792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-655b0f55-31d4-4610-a9a6-7bf13e441536 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: .version_select at 0x7fb3352bec10>, body: {"keypair": {"name": "tempest-keypair-1099881458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiE4mMbnxTltNjqKqiMvwGlowXB8CB/TPR+pkGiyW2SMXukJBJVN4t0pol1l9YR9d8Dg/HfPfPrGN5IFU+29ccgcs8YKlbzRTz4ZrQAyIEWnIo2jJUML99Mu3Va1NcDBQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:51.055081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-655b0f55-31d4-4610-a9a6-7bf13e441536 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for project 1858431337674b66a5b20c21bea03164. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:09:51.060268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-655b0f55-31d4-4610-a9a6-7bf13e441536 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for user 59e8ec11269d4e2f9e78e95950642232 and project 1858431337674b66a5b20c21bea03164. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:09:51.157461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-655b0f55-31d4-4610-a9a6-7bf13e441536 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.123624 Oct 18 14:09:51.158075 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3486/6815] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 18 14:09:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 14:09:51.710381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:51.711150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:51.713201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:51.719276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:51.719787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:51.720235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:51.720937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:51.721404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:51.721835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:51.853652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:51.861425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53f861a0-98a0-4257-9ac7-c44bee6be681 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.156154 Oct 18 14:09:51.861994 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3330/6816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:51 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:52.037509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa747ba8-8b79-47e1-b790-d0e3d016b6a8", "name": "network-vif-plugged", "status": "completed", "tag": "b5034286-fcd9-4af0-8eb0-3303f0b10444"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:52.047813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:52.048474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:52.048768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:52.060286 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] Creating event network-vif-plugged:b5034286-fcd9-4af0-8eb0-3303f0b10444 for instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 on n-h2-858383-13 Oct 18 14:09:52.065241 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5168b0b0-bd04-4803-a58d-162cad0c66ee req-f4cab6a7-7386-4cc1-9033-e50bad6125e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 Oct 18 14:09:52.065837 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3487/6817] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:52.884698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:52.885365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:52.892294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:52.892792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:52.893239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:52.893971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:52.894443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:52.894889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:53.029918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:53.038388 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9cf16231-b5c0-4b1c-8e94-a1a9b2a99375 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1314 microversion: 2.1 time: 0.157988 Oct 18 14:09:53.038983 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3331/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:52 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:53.421188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-899818938", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f2a4e5-7315-4cd6-9cfb-e500b1385b93"}], "security_groups": [{"name": "tempest-securitygroup--1514871577"}], "key_name": "tempest-keypair-1099881458", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:53.536341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] validate_networks() for [('43f2a4e5-7315-4cd6-9cfb-e500b1385b93', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:09:53.912339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:09:53.912790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:09:53.913290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:09:53.913722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:09:53.914188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:09:53.923180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:53.923686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:53.924147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:53.924902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:53.925375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:53.925924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:53.944061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for project 1858431337674b66a5b20c21bea03164. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:09:53.949291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Getting quotas for user 59e8ec11269d4e2f9e78e95950642232 and project 1858431337674b66a5b20c21bea03164. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:09:53.961544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:09:53.964020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:09:54.060696 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:54.061433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:54.068412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.068818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.069270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.069964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.070451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.070886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.075937 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a2b305d-8a06-4bc1-9f6e-f90388c6e466 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.660238 Oct 18 14:09:54.077076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3488/6819] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 18 14:09:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 14:09:54.088436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:54.089133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:54.156710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.165692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.167311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.168653 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ad89762-38a3-44b1-8d95-af1e110668b1 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1281 microversion: 2.20 time: 0.084390 Oct 18 14:09:54.169461 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3489/6820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:54 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:09:54.212285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.220475 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f6cabb6e-d56b-490f-b475-81b1b412ab0c tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1501 microversion: 2.1 time: 0.163606 Oct 18 14:09:54.221045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3332/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:54 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:54.244216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:54.244856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:54.252296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.252841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.253272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.253991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.254495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.254946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.386301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.394212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e987ca9e-bbd1-4000-a1cd-122629ce19e3 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1501 microversion: 2.1 time: 0.153785 Oct 18 14:09:54.394785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3490/6822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:54 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:54.418026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:54.418618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:54.424596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.425086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.425529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.426255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.426716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.427140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.449840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lazy-loading 'flavor' on Instance uuid fa747ba8-8b79-47e1-b790-d0e3d016b6a8 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:09:54.453898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:54.703135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b7bf801-46b8-45b0-a5aa-cd490ac57c6b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action" status: 202 len: 0 microversion: 2.1 time: 0.288856 Oct 18 14:09:54.703787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3333/6823] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:09:54 2022] POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:09:54.712817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:54.713453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:54.720472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.721004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.721465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.722417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:54.722903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:54.723494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:54.857887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:54.865794 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d2b6262-981b-4f49-9cc6-801e8f113fd8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1509 microversion: 2.1 time: 0.157669 Oct 18 14:09:54.866402 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3491/6824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:54 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:55.196682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:55.197395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:55.204048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:55.204700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:55.209279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:55.209279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:55.209279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:55.209279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:55.271178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:55.279671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:55.281129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:55.282412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f99c419-7dc0-40cb-8dd7-8a95cbb97c2f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1285 microversion: 2.20 time: 0.091669 Oct 18 14:09:55.282992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3334/6825] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:55 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:55.890159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:55.890795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:55.898204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:55.898711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:55.899168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:55.899876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:55.900357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:55.900803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.035419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:56.044036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-576e5eda-451e-4f54-8be2-4507b06aa3bf tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1492 microversion: 2.1 time: 0.157738 Oct 18 14:09:56.044600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3492/6826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:55 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:56.066617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:56.067328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:56.073953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.074514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.074966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.075667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.076133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.076570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.297207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39711906-e874-4a88-b30b-da820e5003d8 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action" status: 202 len: 0 microversion: 2.1 time: 0.233949 Oct 18 14:09:56.300822 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3335/6827] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:09:56 2022] POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:09:56.306601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:56.307619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:56.309321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:56.310248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:56.315188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.319352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.319352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.319352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.319352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.319763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.319763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.319954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.320045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.320235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:56.320937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:56.321711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:56.421947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:56.447565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:56.456444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:56.457346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-42e92039-31bc-4c31-82b8-12e1de45fdfb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1341 microversion: 2.20 time: 0.152916 Oct 18 14:09:56.476628 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3336/6828] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:56 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:09:56.489630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:56.495531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:56.503657 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d9bfc11-9cf1-4544-b656-8ad313d8446b tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1498 microversion: 2.1 time: 0.201619 Oct 18 14:09:56.504758 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3493/6829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:56 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:57.484460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:57.485087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:57.503723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:57.504638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:57.505599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:57.507319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:57.507809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:57.508246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:57.529633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:57.530503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:57.541870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:57.542441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:57.543063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:57.543787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:57.544264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:57.544709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:57.703744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:57.708172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:57.713600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:57.715089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:57.716253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9e8b0868-38ff-4d0e-9caa-390dfbe47ae7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.235821 Oct 18 14:09:57.718091 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3337/6830] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:57 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:57.719427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2b31c79-4917-461a-b635-82500857d019 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1498 microversion: 2.1 time: 0.194248 Oct 18 14:09:57.720074 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3494/6831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:57 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:58.165848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:58.176216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.181737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.185463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.194645 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] Creating event network-changed:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:09:58.199633 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2c80113c-0f16-4032-84cc-907549ad1dc5 req-35a412c1-60e9-4f3d-b717-8fa4e7ff5d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 Oct 18 14:09:58.200242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3338/6832] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:58.745200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:58.745802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:58.746236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:58.746631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:58.753542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.753753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.754259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.754509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.754704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.754976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.755811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.756480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.757138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.757602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.757770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.758417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.893253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:58.901629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb72ea41-0b34-46ef-b14a-a94e9875025a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1501 microversion: 2.1 time: 0.160970 Oct 18 14:09:58.902516 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3495/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:58 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:58.924914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:58.933939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:58.933939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.933939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.933939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.933939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:58.934537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:58.934829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:58.960607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lazy-loading 'flavor' on Instance uuid fa747ba8-8b79-47e1-b790-d0e3d016b6a8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:09:58.994818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:59.003228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:59.004759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:59.005921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-766c3dbf-3ee4-4b0a-adff-63e74a0ba0e0 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.264483 Oct 18 14:09:59.006801 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3339/6834] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:09:58 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:09:59.234075 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e53c2a1e-7d0c-44cb-985d-2fbc0516f095 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action" status: 202 len: 0 microversion: 2.1 time: 0.312916 Oct 18 14:09:59.234799 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3496/6835] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:09:58 2022] POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:09:59.243574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:59.244192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:59.262339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:59.388450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:59.396546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b67861e2-1fe3-4d3f-83f0-a04160607604 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1509 microversion: 2.1 time: 0.157544 Oct 18 14:09:59.397645 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3340/6836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:59 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:00.033093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:00.033846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:00.041050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.041543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.042003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.042742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.043218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.043664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.181424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:00.189757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:00.191379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:00.192740 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db18f342-aa79-4c28-98e3-64c21e48ec65 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.164683 Oct 18 14:10:00.198227 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3497/6837] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:00 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:00.420959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:00.421584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:00.428665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.429156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.429603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.430321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.430780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.431211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.572674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:00.580621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b864efa-0b6d-4909-83be-9e6cec5e590a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1492 microversion: 2.1 time: 0.163545 Oct 18 14:10:00.581139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3341/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:00 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1492 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:00.604220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:00.604785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:00.610920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.611436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.611904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.612621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.613110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.613565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.802270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-663c13c4-c7e5-4617-9d7d-4d05e66dfb84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action" status: 202 len: 0 microversion: 2.1 time: 0.202129 Oct 18 14:10:00.802838 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3498/6839] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:10:00 2022] POST /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:10:00.812407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:00.816720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:00.819578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.820073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.820524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.821360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:00.821816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:00.822304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:00.958501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:00.969109 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9554290-2881-49f5-a9a7-403ac14f9436 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1498 microversion: 2.1 time: 0.160630 Oct 18 14:10:00.969704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3342/6840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:00 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:01.219215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:01.219937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:01.226917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:01.227462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:01.227925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:01.228647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:01.229129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:01.229579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:01.448979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:01.457870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:01.460011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:01.461160 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e311f66d-f3d4-4454-adc9-8581ff347b6d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.247237 Oct 18 14:10:01.461722 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3499/6841] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:01 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:01.992840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:01.993522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:02.000347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:02.000828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:02.001267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:02.001954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:02.002452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:02.002882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:02.134612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:02.142529 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59652b7c-447f-4a73-9a60-406835a24f20 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1498 microversion: 2.1 time: 0.153695 Oct 18 14:10:02.143134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3343/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:01 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:02.486868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:02.487511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:02.494653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:02.498654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:02.498654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:02.498654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:02.498654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:02.498654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:02.629744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:02.638339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:02.639803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:02.640928 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc233d24-6156-499b-850c-7cd5baea661c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.158013 Oct 18 14:10:02.641482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3500/6843] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:02 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:03.168883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:03.169503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:03.176335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.176912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.177358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.178586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.179036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.179466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.315945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:03.324105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f69d5b7c-644a-4a87-9eb2-ad3af18b48d9 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1501 microversion: 2.1 time: 0.159079 Oct 18 14:10:03.324881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3344/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:03 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:03.347146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:03.347668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:03.351683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:03.355186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.355700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.356164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.356967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.357451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.357915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.383428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:10:03.666488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:03.666989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:03.690720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.695403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.695403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.695403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.695403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.695403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.745058 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2cdf885-ec7b-4497-8626-e6d901331c84 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 204 len: 0 microversion: 2.1 time: 0.401418 Oct 18 14:10:03.745756 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3501/6845] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:10:03 2022] DELETE /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:10:03.754531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:03.755264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:03.761478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.761989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.762492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.763220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:03.763700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:03.764162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:03.830296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:03.839009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:03.840523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:03.841740 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bd325ef-85e4-4a01-9f38-754c98923f24 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.179879 Oct 18 14:10:03.842631 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3345/6846] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:03 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:10:03.909742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:03.917811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3eafd080-a092-4dee-9853-0d762d11073f tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1507 microversion: 2.1 time: 0.167417 Oct 18 14:10:03.918553 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3502/6847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:03 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:10:04.867841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:04.868460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:04.875378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:04.875871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:04.876326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:04.877027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:04.877491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:04.877928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:04.942415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:04.943121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:04.946576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:04.947427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:04.952030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:04.955021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:04.955021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:04.955021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:04.955021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:04.955021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:05.020605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:05.030245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:05.032030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:05.033337 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a14b3f23-9b94-458f-835c-be5ff72aa22a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.169366 Oct 18 14:10:05.034102 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3346/6848] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:04 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:05.104429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:05.112531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b00cb3f8-4898-41d3-9252-49737af4f96a tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1507 microversion: 2.1 time: 0.174334 Oct 18 14:10:05.113217 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3503/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:04 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:05.160398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "name": "network-vif-plugged", "status": "completed", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:05.170636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:05.171123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:05.171561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:05.183412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] Creating event network-vif-plugged:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:10:05.188733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ad2a1c1e-b6cd-4930-b535-21ce636debf1 req-80af5475-a1a0-47a4-9fa9-9c322c1888cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032070 Oct 18 14:10:05.189312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3347/6850] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:10:06.059766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:06.060437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:06.067545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:06.068057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:06.069062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:06.069784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:06.070303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:06.075195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:06.139053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:06.139774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:06.147981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:06.148479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:06.149004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:06.149654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:06.156242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:06.156758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:06.226262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:06.234412 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9a694bb-da10-43dd-90bd-97ba049098be tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1465 microversion: 2.1 time: 0.100338 Oct 18 14:10:06.234999 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3348/6851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:06 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1465 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:10:06.282706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:06.291632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:06.293305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:06.294489 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3906e59b-ed34-426c-b0dc-d4f4e75914c7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1407 microversion: 2.20 time: 0.238697 Oct 18 14:10:06.295290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3504/6852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:06 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:06.324741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa747ba8-8b79-47e1-b790-d0e3d016b6a8", "name": "network-vif-deleted", "tag": "b5034286-fcd9-4af0-8eb0-3303f0b10444"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:06.334983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:06.335475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:06.335915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:06.339669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:06.346986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] Creating event network-vif-deleted:b5034286-fcd9-4af0-8eb0-3303f0b10444 for instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 on n-h2-858383-13 Oct 18 14:10:06.352173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-81539cf6-7a07-4df7-bb3e-2a2d66f8ab50 req-1d1fce5b-c96c-4fe6-a102-6088a0825af1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099881 Oct 18 14:10:06.352801 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3349/6853] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:10:07.259998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:07.260566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:07.267548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.269084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.269606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.270395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.270911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.271355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.304758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.305272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.305768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.306280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lazy-loading 'fault' on Instance uuid fa747ba8-8b79-47e1-b790-d0e3d016b6a8 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:10:07.322290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:07.323010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:07.341083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.341575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.342020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.342741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.343218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.343632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.372699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4baf8112fb494a5c8cffd2874ce56795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c4e9a4615417cb58a66de310680ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:07.376242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:07.380261 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b16c380-6d23-4ef5-95c4-be606733ce40 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 200 len: 1304 microversion: 2.1 time: 0.125082 Oct 18 14:10:07.381579 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3505/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:07 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:07.483035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:07.491233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:07.493613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:07.493938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc9b94c2-8718-4c9d-a102-3bdeb1990587 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1600 microversion: 2.20 time: 0.176571 Oct 18 14:10:07.494544 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3350/6855] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:07 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:07.519476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:07.520511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:07.527282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.527838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.528308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.529026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:07.529510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:07.529965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:07.609652 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3bd1c2c-96e1-497f-b3ad-e1101a9c7aec tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094110 Oct 18 14:10:07.610285 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3506/6856] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 18 14:10:07 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:10:08.405514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:08.406445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] [instance: fa747ba8-8b79-47e1-b790-d0e3d016b6a8] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:08.414328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:08.414838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:08.415293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:08.416046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:08.416519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:08.416961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:08.432155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] HTTP exception thrown: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Request method failure captured: Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 HTTP/1.1 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrOhUrZxg-3vhbDuipegsiH8m4x7lf8U9i2dgv7r7ekToUzFz0H5OdMFz7oFtiW2A_GToOA7Gnii3uYxNDjK97NBb3H2ImVnbqKvyr_hUH4ir6U2J5vQgAAQJlz2lCtC662yGW2NJYYc4FHkHJkw7ceZ4cLTwxqgYxwbgiI8iF7oWMo Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 1a8c4e9a4615417cb58a66de310680ac Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestServerAdvancedOps-1673324007 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a8c4e9a4615417cb58a66de310680ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a8c4e9a4615417cb58a66de310680ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a8c4e9a4615417cb58a66de310680ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a8c4e9a4615417cb58a66de310680ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestServerAdvancedOps-1673324007 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 1a8c4e9a4615417cb58a66de310680ac Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestServerAdvancedOps-1673324007 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestServerAdvancedOps-1673324007-project Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 4baf8112fb494a5c8cffd2874ce56795 Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestServerAdvancedOps-1673324007-project Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'fa747ba8-8b79-47e1-b790-d0e3d016b6a8'} Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:10:08.433862 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] Returning 404 to user: Instance fa747ba8-8b79-47e1-b790-d0e3d016b6a8 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2b1416fb-ec3a-40d1-95bc-03a2fab06e86 tempest-TestServerAdvancedOps-1673324007 tempest-TestServerAdvancedOps-1673324007-project] 10.222.0.27 "GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8" status: 404 len: 111 microversion: 2.1 time: 0.034238 Oct 18 14:10:08.439361 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3351/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:08 2022] GET /compute/v2.1/servers/fa747ba8-8b79-47e1-b790-d0e3d016b6a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:10:08.941065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:08.953305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:08.954376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:08.955092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:08.973005 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] Creating event network-changed:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:10:08.981877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ed5e9db6-c21e-45f8-abe8-e133d52f7eac req-df50c651-72b6-4ad8-8896-c4743da5c1af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043237 Oct 18 14:10:08.981877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3507/6858] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:10:44.910575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:44.911181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:44.913477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:44.914170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:44.918916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:44.919406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:44.920497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:44.921193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:44.921661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:44.922114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:44.946303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-788a41e2-df1d-449f-afd4-3fa7c04684db tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/ips" status: 200 len: 152 microversion: 2.20 time: 0.039985 Oct 18 14:10:44.946869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3352/6859] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 18 14:10:44 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:10:48.109516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:48.110235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:48.112492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:48.117731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:48.118285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:48.118754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:48.119486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:48.119967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:48.120422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:48.150249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lazy-loading 'flavor' on Instance uuid de0f7b47-82af-4ad1-bfee-25fca2d2ff64 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:10:48.644549 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54fe5a6e-c992-4651-981d-4491f0a87774 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/action" status: 202 len: 0 microversion: 2.20 time: 0.540083 Oct 18 14:10:48.645136 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3508/6860] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 14:10:48 2022] POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:10:48.654195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:48.655255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:48.662834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:48.663333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:48.663781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:48.664490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:48.664967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:48.665409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:48.803221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:48.811397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:48.813507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:48.814720 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfca0b97-bca0-4304-ac60-6f6afb9de3dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.165053 Oct 18 14:10:48.815290 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3353/6861] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:48 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:49.842092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:49.842758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:49.850342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:49.850856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:49.851316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:49.852020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:49.852494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:49.852941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:49.983288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:49.991728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:49.993390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:49.994704 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9365b93c-c4f9-409d-83d6-c4de9ab3b346 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.158154 Oct 18 14:10:49.995272 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3509/6862] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:49 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:51.020814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:51.021424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:51.028466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:51.028946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:51.029404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:51.030080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:51.030541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:51.030968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:51.161769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:51.169909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:51.171439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:51.172655 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b475f2b0-b030-4585-82c1-6e9c97242d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.155843 Oct 18 14:10:51.173737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3354/6863] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:51 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:52.200678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:52.201297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:52.209539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:52.210037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:52.210522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:52.211229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:52.211701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:52.212142 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:52.349298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:52.357979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:52.359668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:52.365745 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5c45ce0-3528-4850-a70d-ae14e1a87a6c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.164206 Oct 18 14:10:52.365745 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3510/6864] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:52 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:53.386785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:53.387474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:53.393460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:53.393969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:53.400115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.400892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.401412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.402239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.402769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.403178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.403325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.403697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.404173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.404894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.405376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.405831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.429486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:10:53.537727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:53.546336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:53.547935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:53.549728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-142cad45-bcf6-4166-9e97-a01fd90cfee6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.167089 Oct 18 14:10:53.550337 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3511/6865] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:53 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:53.734664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eab5134d-d8cf-49da-b48e-7815a3809c8b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 204 len: 0 microversion: 2.1 time: 0.545392 Oct 18 14:10:53.735204 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3355/6866] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:10:53 2022] DELETE /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:10:53.744441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:53.748845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:53.751112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.751614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.752073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.752776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:53.753258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:53.753707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:53.887208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:53.895518 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee932755-b380-41d9-b89a-e6d167b77483 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1577 microversion: 2.1 time: 0.155427 Oct 18 14:10:53.896088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3512/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:53 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:54.575829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:54.576531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:54.583407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:54.583987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:54.584318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:54.585005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:54.585460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:54.585909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:54.714232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:54.722912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:54.724364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:54.725528 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-edec9fd9-b194-4d82-9dca-0427ab09ff9c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.153975 Oct 18 14:10:54.726110 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3356/6868] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:54 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:54.919378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:54.920015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:54.926928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:54.927432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:54.927890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:54.928598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:54.929072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:54.929515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:55.059197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:55.067681 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ce2b392-5199-431e-9ef7-3c9940fe2389 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1577 microversion: 2.1 time: 0.152179 Oct 18 14:10:55.068254 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3513/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:54 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:55.750956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:55.752052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:55.759177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:55.759671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:55.760119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:55.760816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:55.761283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:55.761720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:55.894497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:55.902760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:55.904201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:55.905368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1072bd7-a3ed-4f1f-88e9-265264b9aea7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.158491 Oct 18 14:10:55.905941 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3357/6870] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:55 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:56.091732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:56.103588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:56.103588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:56.103588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:56.103588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:56.103588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:56.104119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:56.104301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:56.206161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:56.215153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5a2c8e6-ee6d-4d38-a386-b64250a46d75 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1510 microversion: 2.1 time: 0.127559 Oct 18 14:10:56.215956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3514/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:56 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1510 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:56.392583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b35a07-2b1c-4b92-a2f6-76182c089a1b", "name": "network-vif-deleted", "tag": "ce96f56e-ddef-4397-baca-9d08c4927a7c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:10:56.402647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:56.403138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:56.403591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:56.414986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] Creating event network-vif-deleted:ce96f56e-ddef-4397-baca-9d08c4927a7c for instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b on n-h2-858383-13 Oct 18 14:10:56.420491 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-51ffc141-4d96-448c-a51d-ed406a6f5bca req-26c61584-2c69-43e0-b10b-682afbd9d3cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Oct 18 14:10:56.421368 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3358/6872] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:10:56.930458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:56.931394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:56.937526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:56.938329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:56.938801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:56.939529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:56.940011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:56.940673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:57.082775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:57.091814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:57.093566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:57.096409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42aeb6ec-efbd-46a3-ad59-0062a7a07be8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.170036 Oct 18 14:10:57.096980 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3515/6873] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:56 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:57.246998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:57.247703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:57.255789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:57.258809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:57.258809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:57.258809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:57.258809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:57.258809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:57.322233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:57.331254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c57d2c3b-45ef-4f0b-8e9c-fc2b47418a79 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1226 microversion: 2.1 time: 0.088654 Oct 18 14:10:57.331942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3359/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:57 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:58.121747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:58.122420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:58.129448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:58.129959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:58.130448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:58.131160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:58.131910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:58.132361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:58.278865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:58.287242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:58.288700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:58.289922 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a719d51-6eb2-4ecc-939b-5ac367be373c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.172277 Oct 18 14:10:58.290515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3516/6875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:58 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:10:58.354611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:58.355759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:58.362739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:58.363236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:58.363677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:58.364367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:58.364828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:58.365260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:58.432620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:58.441962 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4b4125b6-61d7-41e2-ada6-ac02b14fb089 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1226 microversion: 2.1 time: 0.091440 Oct 18 14:10:58.442648 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3360/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:58 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:10:59.315542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:59.316222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:59.328608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:59.329128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:59.330137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:59.330874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:59.331359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:59.331989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:59.472879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:10:59.474174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:10:59.482147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:59.484426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:59.485006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:59.485658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:59.487169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:10:59.487716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:10:59.488220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:10:59.492594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:59.494343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:59.495765 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1299dd42-fdb3-4042-8496-abdabfd50589 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.184454 Oct 18 14:10:59.511750 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3517/6877] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:10:59 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:10:59.562544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:10:59.571323 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99be61ba-2bc1-4ff1-814f-30ea2bc69fd2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1226 microversion: 2.1 time: 0.110221 Oct 18 14:10:59.572132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3361/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:10:59 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:00.524109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:00.524845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:00.532046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:00.533070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:00.533761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:00.534514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:00.535001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:00.535471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:00.595732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:00.597084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:00.604150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:00.604735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:00.605460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:00.606283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:00.606824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:00.607484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:00.672603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:00.673894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:00.681223 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-708a806c-2e81-4297-8974-8f771f835f68 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1226 microversion: 2.1 time: 0.089878 Oct 18 14:11:00.681820 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3362/6879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:00 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:00.694261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:00.694261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:00.694261 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7aa0d99b-2653-450c-8788-e98be7665e3c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.165306 Oct 18 14:11:00.694261 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3518/6880] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:00 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:01.704577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:01.705256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:01.711952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:01.712466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:01.712614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:01.712990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:01.713128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:01.713718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:01.714269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:01.714701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:01.720874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:01.721529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:01.722138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:01.723014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:01.723600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:01.724156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:01.747473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:01.747954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:01.748397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:01.748847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid 06b35a07-2b1c-4b92-a2f6-76182c089a1b {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:11:01.790262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:01.799632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f5132b19-23df-4a7a-9b18-10a0e38f5386 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 200 len: 1185 microversion: 2.1 time: 0.099101 Oct 18 14:11:01.800713 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3363/6881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:01 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 1185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:01.856761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:01.865725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:01.867359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:01.868566 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e444647e-f145-4a8d-985e-b30cc39acc37 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.161073 Oct 18 14:11:01.869113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3519/6882] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:01 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:02.822163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:02.822734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:02.829444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:02.829932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:02.830402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:02.831091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:02.831556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:02.831983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:02.845845 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b HTTP/1.1 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '06b35a07-2b1c-4b92-a2f6-76182c089a1b'} Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:02.847618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13702960-1496-4dfd-8f54-e1df6d5f2cde tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 404 len: 111 microversion: 2.1 time: 0.030817 Oct 18 14:11:02.856711 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3364/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:02 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:02.895739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:02.896376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:02.905055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:02.905585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:02.906045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:02.906790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:02.907270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:02.908297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:02.908958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-765357323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1315374410", "security_groups": [{"name": "tempest-secgroup-smoke-473996800"}], "block_device_mapping_v2": [{"uuid": "ac98593e-83e3-4d49-8351-2b6c889e8a77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:03.025990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:11:03.048760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:03.057545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:03.059211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:03.060510 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-31bd8b53-fa09-4549-a3f7-41b21c0b9723 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.169385 Oct 18 14:11:03.061110 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3520/6884] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:02 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:03.388050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:11:03.388480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:11:03.388959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:11:03.389372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:11:03.389786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:11:03.399941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:03.400520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:03.400912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:03.401580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:03.402040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:03.402494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:03.419038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:11:03.424299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:11:03.484937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:11:03.487115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac98593e-83e3-4d49-8351-2b6c889e8a77',volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:11:04.049728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eef6f2f1-0639-4ecf-8b87-1553da74f61a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.146080 Oct 18 14:11:04.050582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3365/6885] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:11:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 14:11:04.061533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21a17e74-0ee2-4aa0-ab2f-97447f360f22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:04.062200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21a17e74-0ee2-4aa0-ab2f-97447f360f22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:04.085882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:04.086681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:04.093160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:04.093659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:04.094135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:04.094843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:04.095532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:04.096091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:04.119083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21a17e74-0ee2-4aa0-ab2f-97447f360f22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:04.127965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21a17e74-0ee2-4aa0-ab2f-97447f360f22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1094 microversion: 2.1 time: 0.070202 Oct 18 14:11:04.129002 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3521/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:04 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:04.260456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:04.270302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:04.272056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:04.273315 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c52f1cb-3a49-44e5-8997-3a64826236b4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.191526 Oct 18 14:11:04.273957 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3366/6887] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:04 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:11:05.151731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:05.152371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:05.160802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:05.161255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:05.161719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:05.162468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:05.162948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:05.163395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:05.182773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:05.229801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:05.237643 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8b79d37-b39d-431a-860b-1585e467eca3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1144 microversion: 2.1 time: 0.089997 Oct 18 14:11:05.238959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3522/6888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:05 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:05.298921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:05.302089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:05.306464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:05.306996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:05.307448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:05.308156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:05.308662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:05.309117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:05.458290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:05.467299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:05.473632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:05.473632 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4bcf222a-9e4e-4636-88ec-448615864963 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1745 microversion: 2.20 time: 0.175331 Oct 18 14:11:05.473632 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3367/6889] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:05 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:06.261260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:06.261997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:06.270470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:06.271066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:06.271603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:06.272377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:06.272871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:06.273334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:06.357886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:06.369153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57a9c23f-2a6c-47dc-9eda-c4642e56c806 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1210 microversion: 2.1 time: 0.112213 Oct 18 14:11:06.369760 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3523/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:06 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:06.496869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:06.498766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:06.507228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:06.508040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:06.509304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:06.510048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:06.510533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:06.511208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:06.663833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:06.667368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:06.683435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:06.683435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:06.683435 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df4cbb09-b9a5-43df-a2d7-a50e27fbd9af tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.184160 Oct 18 14:11:06.690639 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3368/6891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:06 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:07.256498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "name": "network-vif-plugged", "status": "completed", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:07.275797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:07.277102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:07.277771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:07.290691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] Creating event network-vif-plugged:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:11:07.296462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3423a5c7-913e-41ed-833f-d5bd78125897 req-b3f03bf3-b5cf-4b30-8f86-7173c3a16136 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043546 Oct 18 14:11:07.297356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3524/6892] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:07.395180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:07.396173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:07.410407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:07.411339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:07.411850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:07.412529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:07.412999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:07.413432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:07.595438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:07.619836 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be455371-e39d-4802-bb2d-d791a7dc5aac tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1277 microversion: 2.1 time: 0.230126 Oct 18 14:11:07.639261 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3369/6893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:07 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:07.704308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:07.705045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:07.716066 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:07.723647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:07.723647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:07.723647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:07.723647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:07.723647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:08.031626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:08.042101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:08.043704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:08.045339 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efcff5f4-1278-4a0d-bba0-42aad2940bee tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.345315 Oct 18 14:11:08.046126 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3525/6894] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:07 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:08.157229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0be3d0a-346b-4597-afaf-ea224a50978e", "tag": "6b11176c-942a-44f6-ba2a-5634d9c7dec2"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:08.173898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:08.175220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:08.175220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:08.188523 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] Creating event network-changed:6b11176c-942a-44f6-ba2a-5634d9c7dec2 for instance a0be3d0a-346b-4597-afaf-ea224a50978e on n-h2-858383-13 Oct 18 14:11:08.194624 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7fd30224-db08-4263-869a-40745dba699e req-32b6ee3e-9b49-465d-b27d-134594dc0257 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041184 Oct 18 14:11:08.196070 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3370/6895] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:08.648002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:08.649288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:08.658712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:08.670925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:08.676771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:08.678205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:08.679062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:08.680081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:08.959034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:08.967913 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-767335a6-6500-4488-be7d-409682a489e2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1277 microversion: 2.1 time: 0.323742 Oct 18 14:11:08.968993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3526/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:08 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1277 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:09.072957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:09.073591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:09.089973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:09.090695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:09.091138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:09.091857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:09.092326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:09.092773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:09.265482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:09.277174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:09.279170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:09.280718 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8b0968c-2b1a-43a2-b916-f1ea1bd6cd58 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.212995 Oct 18 14:11:09.281889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3371/6897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:09 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:09.998591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:09.998591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:10.005019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:10.005747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:10.006417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:10.007565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:10.008232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:10.008849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:10.169744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:10.181976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c67c161c-5ac2-40f7-baa8-57a75fdea1e3 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1277 microversion: 2.1 time: 0.191797 Oct 18 14:11:10.182589 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3527/6898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:09 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:10.307476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:10.309596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:10.323916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:10.324423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:10.324872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:10.325576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:10.326030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:10.326495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:10.508215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:10.520430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:10.522778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:10.524613 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6641c60c-4e31-46ff-bc3f-f46750804ee8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.221113 Oct 18 14:11:10.532648 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3372/6899] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:10 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:11.205648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:11.206811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:11.213660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:11.214285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:11.214958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:11.215616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:11.216103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:11.216589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:11.362358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:11.374083 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1954526a-e453-443a-b5a1-524f283fb5b7 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1277 microversion: 2.1 time: 0.172842 Oct 18 14:11:11.390545 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3528/6900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:11 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:11.552345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:11.554218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:11.572233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:11.572888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:11.573590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:11.574569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:11.575245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:11.575904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:11.746018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:11.754906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:11.756901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:11.758501 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ee61ab0-ebea-497b-ad35-1db947417deb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.210344 Oct 18 14:11:11.759358 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3373/6901] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:11 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:12.411881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:12.412531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:12.435683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:12.436679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:12.437341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:12.438296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:12.439238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:12.440270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:12.611750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:12.620424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65de1b1c-468a-4c74-b130-5b261088883e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1277 microversion: 2.1 time: 0.212907 Oct 18 14:11:12.622183 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3529/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:12 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:12.784985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:12.786335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:12.794849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:12.795450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:12.795968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:12.796751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:12.797293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:12.797837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:12.965741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:12.980936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:12.982524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:12.983941 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9e08f85-0723-4171-b983-9620b5baf62e tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.203561 Oct 18 14:11:12.998513 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3374/6903] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:12 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:13.647311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:13.648673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:13.656405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:13.656928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:13.657397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:13.658167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:13.658652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:13.659108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:13.806964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:13.815218 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a05afd6f-ca24-4b94-a132-2cbeea448fc2 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.172071 Oct 18 14:11:13.815993 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3530/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:13 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:14.010193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:14.011011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:14.012993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:14.013803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:14.019780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:14.020303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:14.020730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:14.021441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:14.021910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:14.022399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:14.166176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:14.175039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:14.176551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:14.177805 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3888e11b-314f-4de7-ac03-9109ec027713 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.172038 Oct 18 14:11:14.178440 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3375/6905] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:14 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:14.840821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:14.841448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:14.848536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:14.851719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:14.854501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:14.854501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:14.854501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:14.854501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:14.855041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:15.010818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:15.019256 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-037f79e3-1997-4a79-b703-1b362a62064a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.182303 Oct 18 14:11:15.019968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3531/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:14 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:15.202678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:15.203458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:15.211655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:15.212157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:15.212660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:15.213411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:15.213874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:15.214357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:15.356806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:15.365462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:15.366958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:15.368150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-594aeb06-3d5f-4f01-a1e1-f05960f8dda5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.169631 Oct 18 14:11:15.368715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3376/6907] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:15 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:16.047184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:16.049530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:16.056969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:16.060821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:16.060821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:16.060821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:16.060821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:16.060821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:16.222473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:16.230538 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1af6c965-de9b-4d2d-87e3-ffbf2abc381d tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.188778 Oct 18 14:11:16.246239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3532/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:16 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:16.395582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:16.396431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:16.403740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:16.404269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:16.404687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:16.405401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:16.405875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:16.406312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:16.563114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:16.572720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:16.574333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:16.575538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5857268-3d9a-42d2-a4bf-de96c15077e2 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.184818 Oct 18 14:11:16.576449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3377/6909] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:16 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:17.254532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:17.255175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:17.262740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:17.263256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:17.263715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:17.264446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:17.264996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:17.265447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:17.408556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:17.416702 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5d2b9c2-32f8-48f3-b379-a81cdf426532 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.166061 Oct 18 14:11:17.417428 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3533/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:17 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:17.607094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:17.607708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:17.615639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:17.616160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:17.617208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:17.619983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:17.620524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:17.621071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:17.775813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:17.775813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:17.775813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:17.775813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-25346303-3dbd-497a-9ba3-6befae1822e9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.172515 Oct 18 14:11:17.775813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3378/6911] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:17 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:18.440616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:18.441970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:18.444957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=55 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.451175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.452040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.452760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.453751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.454322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.456158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.608419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:18.616799 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17dd8afb-3987-4970-9322-1a199ba7569a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.180796 Oct 18 14:11:18.617392 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3534/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:18 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:18.800947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:18.801683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:18.804423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.809188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.809684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.810194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.810887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.811350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.811781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.948082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:19.168875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:19.168875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:19.168875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9fb57d1e-d985-4a46-82b8-14c7fd20be99 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1740 microversion: 2.20 time: 0.162852 Oct 18 14:11:19.168875 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3379/6913] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:18 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:19.640202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:19.640851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:19.648835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.649341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.649806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:19.650620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.651105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.651563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:19.794122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:19.802557 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f8bd0c3-6c81-42bf-b8cb-32e4dd743cee tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.166279 Oct 18 14:11:19.803169 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3535/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:19 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:19.985885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:19.986443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:19.994723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.995223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.995675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:19.996386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.996853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.997288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:20.194785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:20.203485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:20.204957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:20.206178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-93fa12ca-00dd-44fa-b317-4d8cf183db1d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1722 microversion: 2.20 time: 0.224490 Oct 18 14:11:20.206824 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3380/6915] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:19 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:20.826840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:20.827584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:20.835266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:20.835765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:20.836223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:20.836936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:20.837406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:20.837856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:20.968737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:20.976612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af2357c0-2c1b-41b1-bee3-6077d78ca404 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.153733 Oct 18 14:11:20.977191 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3536/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:20 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:21.232038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:21.232578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:21.239929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:21.240418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:21.240872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:21.241561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:21.242020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:21.242477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:21.374426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:21.382953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:21.384414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:21.385602 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91215f22-7e63-45d5-88df-481d9a13e09f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1722 microversion: 2.20 time: 0.157673 Oct 18 14:11:21.386202 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3381/6917] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:21 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:21.999855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:22.000508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:22.008436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.008937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.009397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.010207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.010691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.011140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.145760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:22.153528 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-927c57ec-1575-486a-9ead-563a654188f1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.157636 Oct 18 14:11:22.154115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3537/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:21 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:22.413251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0be3d0a-346b-4597-afaf-ea224a50978e", "name": "network-vif-plugged", "status": "completed", "tag": "6b11176c-942a-44f6-ba2a-5634d9c7dec2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:22.429533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:22.430194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:22.432272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.432783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.433242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.437298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.437824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.438295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.439075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.439552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.439982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.445127 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] Creating event network-vif-plugged:6b11176c-942a-44f6-ba2a-5634d9c7dec2 for instance a0be3d0a-346b-4597-afaf-ea224a50978e on n-h2-858383-13 Oct 18 14:11:22.453439 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d7f64f7d-f12f-4a21-98f8-747d80542061 req-d5fac6df-7fe3-4b12-9520-4224df73e3c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043705 Oct 18 14:11:22.454951 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3538/6919] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:22.591230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:22.611897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:22.613354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:22.614665 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a2f044e-40d4-4253-944c-aa68dc488b69 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1722 microversion: 2.20 time: 0.207552 Oct 18 14:11:22.621864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3382/6920] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:22 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:23.178466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:23.180089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:23.187542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.188123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.188586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.189724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.190297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.190745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.329814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:23.337950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e31471e-745f-41be-b806-6c4e8f26c622 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1265 microversion: 2.1 time: 0.164781 Oct 18 14:11:23.338681 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3539/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:23 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:23.640350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:23.641001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:23.648568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.649062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.649508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.650229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.650695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.651133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.786798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:23.794996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:23.796472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:23.798352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a05d997-385c-48bd-a0eb-43454a1702f8 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1665 microversion: 2.20 time: 0.161919 Oct 18 14:11:23.798915 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3383/6922] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:23 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:23.823445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5ee8f3d-9b0d-4763-8d9c-94ae3f1a1963"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:23.825784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:23.832491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.832990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.833444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.834174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.834657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.835100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.853006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:24.361061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:24.361720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:24.367762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.368252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.368699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.369392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.369856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.370322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.502240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:24.510390 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f1eb2f6-4a7a-4623-8145-10c1b2fba111 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1451 microversion: 2.1 time: 0.153216 Oct 18 14:11:24.510970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3384/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:24 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:24.519078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "name": "network-vif-unplugged", "status": "completed", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:24.524788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.525324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.525823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.537226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_external_events [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] Unable to find a host for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64. Dropping event network-vif-unplugged {{(pid=121009) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 14:11:24.538144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7b9296e1-4b4e-45e5-913b-6637842595ca req-73222b14-0a76-4001-87b7-5dad85217d6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026214 Oct 18 14:11:24.538751 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3385/6924] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 14:11:24.543163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:24.543777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:24.549605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.550127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.550589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.553718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.553718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.553718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.689093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:24.693072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:24.697695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c35410a0-789a-43fa-8c8c-4429b5aa1f09 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1451 microversion: 2.1 time: 0.158022 Oct 18 14:11:24.698310 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3386/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:24 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:24.807979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b147a42b-16dc-4aa4-9238-4d3a798f5ddd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.988403 Oct 18 14:11:24.808546 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3540/6926] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 18 14:11:23 2022] POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments => generated 188 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:11:24.934291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:24.934791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:24.941787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.942299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.942752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.943443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.943915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.944328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:25.474214 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-287edf1f-1668-4fe0-9758-b0c6e5014d43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments/d5ee8f3d-9b0d-4763-8d9c-94ae3f1a1963" status: 202 len: 0 microversion: 2.20 time: 0.543806 Oct 18 14:11:25.474857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3387/6927] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 18 14:11:24 2022] DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments/d5ee8f3d-9b0d-4763-8d9c-94ae3f1a1963 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:11:25.538671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:25.539297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:25.550231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:25.550753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:25.551220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:25.551950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:25.552430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:25.552887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:25.650309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121010) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 14:11:26.030848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5fc0433-e240-4b9d-9730-8969d98a9391 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/action" status: 202 len: 0 microversion: 2.20 time: 0.496084 Oct 18 14:11:26.031526 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3541/6928] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 18 14:11:25 2022] POST /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:11:26.039647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:26.040266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:26.047386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:26.047919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:26.048366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:26.050712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:26.051201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:26.051653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:26.291679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:26.302915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:26.304586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:26.305782 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06461289-e85c-4b6e-a351-e9415838d83c tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1673 microversion: 2.20 time: 0.270082 Oct 18 14:11:26.306373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3388/6929] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:26 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:26.886290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0be3d0a-346b-4597-afaf-ea224a50978e", "tag": "6b11176c-942a-44f6-ba2a-5634d9c7dec2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:26.898694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:26.899208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:26.899670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:26.920821 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] Creating event network-changed:6b11176c-942a-44f6-ba2a-5634d9c7dec2 for instance a0be3d0a-346b-4597-afaf-ea224a50978e on n-h2-858383-13 Oct 18 14:11:26.927276 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dba40829-1f68-4d41-86c4-eebf2840e4d9 req-17b91c24-a466-4f0b-b017-76b912cd056b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142725 Oct 18 14:11:26.928504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3542/6930] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:27.333105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:27.334888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:27.345041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:27.345865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:27.346615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:27.347437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:27.348013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:27.348663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:27.576769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:27.593542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:27.596110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:27.597451 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34df5b6a-6a41-432d-a76f-93a115a2b94d tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1673 microversion: 2.20 time: 0.269324 Oct 18 14:11:27.598127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3389/6931] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:27 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:28.626529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:28.627630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:28.638833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:28.639759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:28.640603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:28.641921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:28.643344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:28.644183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:28.784721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:28.793136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:28.794636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:28.795834 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-860f0276-baa4-4aa1-8dc1-67c0e8f44131 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.173773 Oct 18 14:11:28.796411 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3543/6932] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:28 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:29.824850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:29.826396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:29.835825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:29.836664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:29.837791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:29.838869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:29.839671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:29.840442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:30.009465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:30.019671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:30.021445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:30.023192 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca697af7-db34-4c5c-b783-a525de9979f5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.203769 Oct 18 14:11:30.023989 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3390/6933] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:29 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:31.051837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:31.053271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:31.061538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:31.062318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:31.062957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:31.063849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:31.064350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:31.065007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:31.234273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:31.244239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:31.245672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:31.246914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c058cb85-7b4d-42cd-b962-e30167d433a4 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.200568 Oct 18 14:11:31.247772 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3544/6934] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:31 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:32.274755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:32.275365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:32.293684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:32.294442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:32.294891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:32.295607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:32.296218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:32.296658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:32.430001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:32.438134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:32.440236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:32.441402 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08e03488-80e2-4aed-aa6b-5a2f952bc9dd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.170602 Oct 18 14:11:32.441967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3391/6935] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:32 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:33.591472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:33.592121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:33.600781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.601291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.601760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.602670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.603148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.605683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.754202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:33.761463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:33.762976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:33.764271 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-adf1ebf1-f90f-443f-b866-0c5e5b440024 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.295956 Oct 18 14:11:33.771501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3545/6936] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:33 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:34.792014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:34.792745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:34.800207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:34.800688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:34.801145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:34.801904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:34.802401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:34.802873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:34.958088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:34.970171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:34.971822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:34.973044 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d301329-9c6c-4814-bfae-16ffd24b144a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.185162 Oct 18 14:11:34.973973 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3392/6937] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:34 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:36.000551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:36.001113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:36.009030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:36.009645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:36.010224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:36.010967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:36.011455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:36.011912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:36.173879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:36.183125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:36.184593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:36.185793 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12153bd5-25d2-441e-9677-20cb13163fbd tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.189583 Oct 18 14:11:36.186395 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3546/6938] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:35 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:37.212074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:37.212690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:37.219751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:37.220273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:37.220720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:37.221415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:37.221878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:37.222336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:37.369363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:37.378710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:37.381181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:37.382720 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-92f9b55e-92fc-4bc2-a3f6-b1483e859334 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.174621 Oct 18 14:11:37.390974 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3393/6939] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:37 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 14:11:38.409435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:38.410165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:38.416979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:38.417488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:38.418247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:38.418969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:38.419444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:38.419895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:38.556002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:38.564754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:38.566265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:38.567444 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bba6dc17-453f-472c-b5cc-bd3d8fe279ef tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.163233 Oct 18 14:11:38.568013 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3547/6940] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:38 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:39.592868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:39.593483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:39.601226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:39.601723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:39.602215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:39.602919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:39.603385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:39.603823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:39.735605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:39.743793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:39.745245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:39.746449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b76b4072-dff3-497d-89a5-e6c3723f198b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.157643 Oct 18 14:11:39.747016 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3394/6941] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:39 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:40.772844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:40.773400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:40.783853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.784362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.784819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.785540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.786011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.786490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.922028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:40.931264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:40.933069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:40.934436 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3019effb-9125-4a7e-93e2-23d1683f3061 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.165923 Oct 18 14:11:40.935005 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3548/6942] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:40 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:41.964559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:41.965172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:41.972041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:41.972529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:41.972972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:41.973655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:41.974145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:41.974579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:42.103480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:42.112162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:42.113618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:42.114825 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9e2b663-4583-40ea-a0eb-5a490135c9fb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.154177 Oct 18 14:11:42.115395 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3395/6943] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:41 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:43.142572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:43.143206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:43.150132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:43.150635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:43.151093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:43.151794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:43.152265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:43.152708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:43.290172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:43.298497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:43.300544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:43.301760 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fd936f0-0964-4346-8da2-13f2e51fb9de tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.164238 Oct 18 14:11:43.302606 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3549/6944] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:43 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:43.400093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "name": "network-vif-plugged", "status": "completed", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:43.411755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:43.412248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:43.412791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:43.423950 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] Creating event network-vif-plugged:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:11:43.429194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-286f3d73-d5f8-4664-a9c4-c645d6e1c6f8 req-27c75740-3333-4de2-b9ae-ec82b6ffc344 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Oct 18 14:11:43.429920 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3396/6945] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:44.327593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:44.328224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:44.335019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:44.335522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:44.335982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:44.336689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:44.337163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:44.337605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:44.469531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:44.478390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:44.479853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:44.481028 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7aaaf975-9866-4c9a-8738-9f24c00992c5 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.157426 Oct 18 14:11:44.481583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3550/6946] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:44 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:45.508894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:45.509601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:45.515801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:45.516292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:45.516740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:45.517434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:45.518570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:45.519010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:45.654683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:45.663646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:45.665101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:45.666323 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-92ce226a-0926-436a-b020-aba4d03ec05a tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1731 microversion: 2.20 time: 0.162821 Oct 18 14:11:45.666891 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3397/6947] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:45 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:11:46.693062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:46.693691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:46.700470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:46.701023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:46.701510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:46.702252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:46.702777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:46.703292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:46.835842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:46.851381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:46.852842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:46.854033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5247e446-ff8c-41d1-9097-0b58fe19859b tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1718 microversion: 2.20 time: 0.165554 Oct 18 14:11:46.854620 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3551/6948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:11:46 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:12:19.866955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:19.869197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:19.871716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=37 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:19.872399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:19.877170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.877672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.878168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.878871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.879338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.879784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.909764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6163ee49-50ba-444e-a8d6-23d95cafd932 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046891 Oct 18 14:12:19.910372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3398/6949] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 18 14:12:19 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:19.975451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:19.975974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:19.978342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:19.979052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:19.984426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.990574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.990574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.990574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.990574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.990574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:20.013506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:12:20.292269 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10f7536d-266e-4d2c-8ff7-6d328a787907 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 204 len: 0 microversion: 2.20 time: 0.320651 Oct 18 14:12:20.292786 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3552/6950] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:12:19 2022] DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 14:12:20.300999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:20.301615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:20.308339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:20.308908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:20.309367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:20.310083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:20.310541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:20.310972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:20.442143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:20.450798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:20.452241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:20.453430 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06d95aff-cfa5-43df-b0b5-b0373d8083d7 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.156371 Oct 18 14:12:20.454101 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3399/6951] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:20 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:12:21.480561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:21.481287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:21.489040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:21.489540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:21.490046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:21.490783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:21.491258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:21.491706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:21.633993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:21.643252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:21.644710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:21.645938 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-681f0e26-2290-4e8e-b487-6b7a04221358 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.169770 Oct 18 14:12:21.646541 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3553/6952] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:21 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:12:22.672782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:22.673422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:22.680571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:22.681065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:22.681509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:22.682242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:22.682697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:22.683126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:22.917955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:22.927222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:22.931201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59e8ec11269d4e2f9e78e95950642232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1858431337674b66a5b20c21bea03164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:22.931201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6bb82f1-6dde-49b9-b364-2ce4f9d92982 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 200 len: 1724 microversion: 2.20 time: 0.261387 Oct 18 14:12:22.931201 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3400/6953] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:22 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 14:12:23.118377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f7b47-82af-4ad1-bfee-25fca2d2ff64", "name": "network-vif-deleted", "tag": "19cf2392-6126-44eb-b88a-3c2e5ff50028"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:23.130702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:23.131215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:23.131683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:23.145347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] Creating event network-vif-deleted:19cf2392-6126-44eb-b88a-3c2e5ff50028 for instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 on n-h1-858383-13 Oct 18 14:12:23.151174 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2d077f60-4525-4a2b-a4e3-f03d44c3934f req-5f421239-2abd-4870-a11f-8b89e336d922 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043946 Oct 18 14:12:23.151888 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3554/6954] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:23.956733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:23.957355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:23.964359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:23.964851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:23.965297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:23.966002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:23.966494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:23.966930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:23.983907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 HTTP/1.1 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'de0f7b47-82af-4ad1-bfee-25fca2d2ff64'} Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:23.985650 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-225ae51c-fd1e-4ef9-96e2-5de4722b4ffb tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 404 len: 111 microversion: 2.20 time: 0.034735 Oct 18 14:12:23.993040 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3401/6955] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:23 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:12:23.999907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5d7b41fb-68f3-40ea-b1b1-b157d01e902f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '.version_select at 0x7fb330fafca0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:24.004489 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d7b41fb-68f3-40ea-b1b1-b157d01e902f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [25cc2e65-4a13-4993-a360-6a7b8c9c97d6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:12:25.012893 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d7b41fb-68f3-40ea-b1b1-b157d01e902f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [25cc2e65-4a13-4993-a360-6a7b8c9c97d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 58764. Oct 18 14:12:25.111386 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5d7b41fb-68f3-40ea-b1b1-b157d01e902f tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099881458" status: 204 len: 0 microversion: 2.20 time: 1.114663 Oct 18 14:12:25.113931 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3555/6956] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 18 14:12:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099881458 => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 14:12:29.298836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:29.299350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:29.306259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.306759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.307203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.307902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.308364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.308798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.581984 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 HTTP/1.1 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'de0f7b47-82af-4ad1-bfee-25fca2d2ff64'} Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:29.583567 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:29.587378 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4930e5d-55dc-4d77-9169-536d206afbc6 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 404 len: 111 microversion: 2.20 time: 0.290116 Oct 18 14:12:29.588704 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3402/6957] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:12:29 2022] DELETE /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:12:29.596389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:29.603808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: de0f7b47-82af-4ad1-bfee-25fca2d2ff64] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:29.603958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.604389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.604853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.605644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.606179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.606632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.621357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 HTTP/1.1 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'de0f7b47-82af-4ad1-bfee-25fca2d2ff64'} Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.623354 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance de0f7b47-82af-4ad1-bfee-25fca2d2ff64 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48dc1a73-82c5-4933-a6e8-f0b50f8e5e43 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64" status: 404 len: 111 microversion: 2.20 time: 0.035379 Oct 18 14:12:29.630309 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3556/6958] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:29 2022] GET /compute/v2.1/servers/de0f7b47-82af-4ad1-bfee-25fca2d2ff64 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:12:33.011726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:33.012251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:33.020373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:33.023231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:33.023850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:33.024746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:33.025310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:33.025757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:33.041374 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 HTTP/1.1 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '0275ae28-fb08-43ea-a192-df0b7a7649a3'} Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:33.042983 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-46ac2411-9110-4dbf-8343-65d993645bfc tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 404 len: 111 microversion: 2.20 time: 0.036976 Oct 18 14:12:33.047577 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3403/6959] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 18 14:12:33 2022] DELETE /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:12:33.053556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:33.054232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] [instance: 0275ae28-fb08-43ea-a192-df0b7a7649a3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:33.061770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:33.062335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:33.062834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:33.063621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:33.064111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:33.064563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:33.081051 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] HTTP exception thrown: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Request method failure captured: Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 HTTP/1.1 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrLo_da5sKTEGEQCkqAYU_ZRsSpnjUvIhluNaTeAnctKOemt1l9nUm1sqz3rdpDvorh8sJ67PQLeFyYvpDh8hLqEOIzUpDSUwMot2vz-9_viFBP7tOdQDIO3qnijmFchCI0QwNSioI9Jl6TiXxpgUHSnfcyKtn5naWO7SzZXM6culzo Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1858431337674b66a5b20c21bea03164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1858431337674b66a5b20c21bea03164"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1858431337674b66a5b20c21bea03164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 1858431337674b66a5b20c21bea03164 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35587317 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 59e8ec11269d4e2f9e78e95950642232 Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35587317-project Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '0275ae28-fb08-43ea-a192-df0b7a7649a3'} Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.082744 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:12:33.086725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] Returning 404 to user: Instance 0275ae28-fb08-43ea-a192-df0b7a7649a3 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:33.087382 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8ee6e616-c013-4edc-bdfd-28786c171ca9 tempest-AttachVolumeShelveTestJSON-35587317 tempest-AttachVolumeShelveTestJSON-35587317-project] 10.222.0.27 "GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3" status: 404 len: 111 microversion: 2.20 time: 0.036937 Oct 18 14:12:33.090193 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3557/6960] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 18 14:12:33 2022] GET /compute/v2.1/servers/0275ae28-fb08-43ea-a192-df0b7a7649a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:12:44.528145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:44.528887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=24 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:44.655010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9c4a0941-9c2d-47e2-ad6d-c4c1b478ce3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: .version_select at 0x7fb32bcc30d0>, body: {"keypair": {"name": "tempest-keypair-1778059125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMmnsg+ZheuFsbOwDQU5pDZwHzbfykVzPlZZ1yjLcRHF/30E9698himiXJWEigIXRdh05cQ9hnttorNGA2igj/7zGxvwlJxvDCuIs0MfW/18FzXJfojDXFVKDbjocUv/g=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:44.673276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c4a0941-9c2d-47e2-ad6d-c4c1b478ce3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:44.678698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-9c4a0941-9c2d-47e2-ad6d-c4c1b478ce3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:44.766168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9c4a0941-9c2d-47e2-ad6d-c4c1b478ce3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.243685 Oct 18 14:12:44.767683 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3404/6961] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:12:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:47.152386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1847287254", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b116030-807c-4293-afcb-4683b2a05e7c"}], "security_groups": [{"name": "tempest-securitygroup--562305951"}], "key_name": "tempest-keypair-1778059125", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:47.162946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:47.163320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:47.291729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] validate_networks() for [('4b116030-807c-4293-afcb-4683b2a05e7c', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:12:47.710552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:12:47.711021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:12:47.711527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:12:47.712239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:12:47.712706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:12:47.722937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:47.723550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:47.724009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:47.724760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:47.725236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:47.725680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:47.745595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:47.749538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:47.769538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:12:47.769538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:12:47.931212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27236fd3-fc20-43a5-8b4e-20ce4c890296 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.783710 Oct 18 14:12:47.931877 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3558/6962] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:12:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:12:47.953711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31425e50-369b-41d7-9ff5-74de07688ade tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:47.954452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31425e50-369b-41d7-9ff5-74de07688ade tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:48.036692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31425e50-369b-41d7-9ff5-74de07688ade tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:48.045907 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31425e50-369b-41d7-9ff5-74de07688ade tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1242 microversion: 2.1 time: 0.097861 Oct 18 14:12:48.046781 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3405/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:47 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:49.075697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-533f8937-181f-4768-8eb4-521dfad4b731 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:49.076461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-533f8937-181f-4768-8eb4-521dfad4b731 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:49.131989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-533f8937-181f-4768-8eb4-521dfad4b731 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:49.139456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-533f8937-181f-4768-8eb4-521dfad4b731 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1242 microversion: 2.1 time: 0.068612 Oct 18 14:12:49.140031 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3559/6964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:49 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:12:50.163069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:50.163719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:50.171055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:50.171542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:50.172556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:50.173244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:50.173710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:50.174163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:50.235287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:50.242918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8ba5cc6-2303-43be-b098-b53c5a93ddfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1294 microversion: 2.1 time: 0.083800 Oct 18 14:12:50.243505 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3406/6965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:50 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:51.267133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:51.267788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:51.274794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:51.275308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:51.275772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:51.276498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:51.276976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:51.277431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:51.461264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:51.470935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-adfdb53f-c23c-4dd7-8c9e-6bf6efbb47d7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.207723 Oct 18 14:12:51.471725 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3560/6966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:51 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:52.349614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f0586-7f9a-4467-ba49-4673a02ffe53", "tag": "805ac8c0-12fc-4e71-bd21-d4468156ad17"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:52.361062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:52.361552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:52.361996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:52.373374 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] Creating event network-changed:805ac8c0-12fc-4e71-bd21-d4468156ad17 for instance 473f0586-7f9a-4467-ba49-4673a02ffe53 on n-h2-858383-13 Oct 18 14:12:52.379256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0a3499c9-4810-4c8e-a732-247a7fdaec4c req-1a60bf96-7f84-41c8-914a-54c03b727c83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033678 Oct 18 14:12:52.380004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3407/6967] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:52.496515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:52.497075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:52.504757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:52.505345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:52.505813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:52.506558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:52.507040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:52.507747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:52.734164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:52.743556 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-21976c6c-158a-45bf-81f4-87d41f1c7e0e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.251011 Oct 18 14:12:52.744144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3561/6968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:52 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:53.769310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:53.770033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:53.776345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:53.776956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:53.777409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:53.778154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:53.778625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:53.779060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:53.908020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:53.915797 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e3c55b6a-b3cc-47e6-8837-157d4165b043 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.152270 Oct 18 14:12:53.916373 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3408/6969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:53 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:54.939544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:54.940178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:54.947129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:54.947629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:54.948085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:54.948788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:54.949258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:54.949702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:55.083784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:55.091712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f8ad70a8-a7c2-4a21-93e1-792904a7cf2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.156723 Oct 18 14:12:55.092296 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3562/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:54 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:56.113543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:56.114205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:56.121587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:56.122093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:56.122541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:56.123235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:56.123694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:56.124125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:56.255277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:56.263409 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-421ce651-a77e-4957-9104-1a8ad48989cb tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.153942 Oct 18 14:12:56.263967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3409/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:56 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:57.287607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:57.288247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:57.295173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:57.295678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:57.296144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:57.296863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:57.297395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:57.298474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:57.430609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:57.438325 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f921cf64-01e1-40d6-ae17-f109c3f9e572 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.155250 Oct 18 14:12:57.438904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3563/6972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:57 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:58.461043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:58.461706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:58.464676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:58.470322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:58.470819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:58.471262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:58.472011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:58.472465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:58.472901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:58.606081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:58.614082 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-10f3fd35-2619-4209-9b9f-5907214f82d6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.156928 Oct 18 14:12:58.614680 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3410/6973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:58 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:12:58.784003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:58.851010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f0586-7f9a-4467-ba49-4673a02ffe53", "name": "network-vif-plugged", "status": "completed", "tag": "805ac8c0-12fc-4e71-bd21-d4468156ad17"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:58.860565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:58.861059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:58.861510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:58.872558 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] Creating event network-vif-plugged:805ac8c0-12fc-4e71-bd21-d4468156ad17 for instance 473f0586-7f9a-4467-ba49-4673a02ffe53 on n-h2-858383-13 Oct 18 14:12:58.878414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-081b0023-f39a-4816-b2b3-c11ad31825fb req-acc4b112-395c-4694-b952-1d043650498e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098825 Oct 18 14:12:58.879071 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3564/6974] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:59.637458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:59.638110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:59.645438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:59.645926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:59.646479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:59.647248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:59.647713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:59.648149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:59.780246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:59.788631 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e4f0fc7-2587-4819-a3ed-dda5b04e3294 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1367 microversion: 2.1 time: 0.155445 Oct 18 14:12:59.789200 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3411/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:59 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:00.809439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:00.815464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:00.816188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:00.822703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:00.823220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:00.824145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:00.824389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:00.825065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:00.825809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:00.968914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:00.978626 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33341ec2-7492-4bdd-a356-f7edc1ca17f7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1558 microversion: 2.1 time: 0.170284 Oct 18 14:13:00.979211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3565/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:00 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:01.001801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:01.002390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:01.010390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:01.010881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:01.011333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:01.012026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:01.012486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:01.012918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:01.096860 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98315ce6-aef3-4d40-959b-7397f8a905e1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099030 Oct 18 14:13:01.097467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3412/6977] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:13:00 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:02.113123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f0586-7f9a-4467-ba49-4673a02ffe53", "tag": "805ac8c0-12fc-4e71-bd21-d4468156ad17"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:02.123778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:02.128975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:02.128975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:02.136890 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] Creating event network-changed:805ac8c0-12fc-4e71-bd21-d4468156ad17 for instance 473f0586-7f9a-4467-ba49-4673a02ffe53 on n-h2-858383-13 Oct 18 14:13:02.142168 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6c684845-c120-4f0c-877c-62ec674dfbeb req-dabaa1c4-106a-4496-ac53-2768b363af9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033200 Oct 18 14:13:02.142776 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3566/6978] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:13:38.123715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:38.124545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:38.128506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:38.129069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:38.138080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:38.138826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:38.139410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:38.140146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:38.140642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:38.141072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:38.165676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-313f6dc8-0001-4d04-809f-16c0048c56df tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/ips" status: 200 len: 150 microversion: 2.1 time: 0.043971 Oct 18 14:13:38.170456 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3413/6979] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 14:13:38 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:41.049784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:41.050576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=36 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:41.057946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a46bb204-919c-4d75-99cc-301acb7a2c04"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:41.060445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:41.067127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:41.067248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:41.067620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:41.068338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:41.068817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:41.069276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:41.890193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd559879-7004-49f0-a53c-ead0ac44aeaf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842522 Oct 18 14:13:41.890833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3567/6980] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:13:41 2022] POST /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:49.330422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:49.330954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:49.337487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.337974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.338449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.339139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.339603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.340039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.366681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:13:49.746732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fe94d51-63f7-41b7-868f-59e81ae2e977 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 204 len: 0 microversion: 2.1 time: 0.540278 Oct 18 14:13:49.747335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3414/6981] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:13:49 2022] DELETE /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:13:49.757212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:49.759408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:49.765910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.766492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.766949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.767700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.768171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.768638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.917860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:49.925851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7faa54c3-213d-4bca-ade2-73e30bea9c63 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1732 microversion: 2.1 time: 0.173889 Oct 18 14:13:49.926678 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3568/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:49 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:50.949975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:50.950712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:50.957487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:50.957989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:50.958459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:50.959153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:50.959626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:50.960067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:51.095406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:51.103226 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86bc74ec-9dba-4842-a709-f19f8e19b22e tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1732 microversion: 2.1 time: 0.157364 Oct 18 14:13:51.104167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3415/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:50 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:52.032233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-720809910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1315374410", "security_groups": [{"name": "tempest-secgroup-smoke-473996800"}], "block_device_mapping_v2": [{"uuid": "57846267-7691-45a0-bb99-ae8cc0f13a21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c4a92ff-bbc4-4cbe-94b2-3a1274828811"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:52.127059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:52.127841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:52.135776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.136438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.136897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.137644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.138134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.138575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.156273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] validate_networks() for [('1c4a92ff-bbc4-4cbe-94b2-3a1274828811', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:13:52.496669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:52.505273 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d842075e-3fd0-4bb6-8ccd-47824c48f776 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1665 microversion: 2.1 time: 0.382334 Oct 18 14:13:52.518868 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3416/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:52 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1665 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:52.561184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac5dd61-dd29-4b8f-8327-d176f0add834", "name": "network-vif-deleted", "tag": "38490761-fb8f-4215-a39f-a1cbfbcd787c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:52.571740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.572499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.578825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.580608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:13:52.581078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:13:52.581565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:13:52.581989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:13:52.582450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:13:52.585848 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] Creating event network-vif-deleted:38490761-fb8f-4215-a39f-a1cbfbcd787c for instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 on n-h1-858383-13 Oct 18 14:13:52.592221 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ecb46cc0-4773-428a-9b93-608231cd16ce req-e8d12ef4-6fb5-4f14-84ac-83772aa3b14c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035024 Oct 18 14:13:52.593013 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3417/6985] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:13:52.598236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.598750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.599208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.599954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.600427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.600870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.626546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:13:52.632292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Getting quotas for user c0fc58ba6c524ee79755a72aa1f7ce1d and project b10dd8d3e1be4c6e9ceea751db7a775e. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:13:52.695906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:13:52.698716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57846267-7691-45a0-bb99-ae8cc0f13a21',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:13:53.183399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8226e787-11d5-4f09-8eb9-40dcd5bfe5ba tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.155016 Oct 18 14:13:53.184629 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3569/6986] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:13:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:13:53.196729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5564ae8a-76b9-46ef-9d97-6269bb573fe9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:53.198708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5564ae8a-76b9-46ef-9d97-6269bb573fe9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:53.278826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5564ae8a-76b9-46ef-9d97-6269bb573fe9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:53.286622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5564ae8a-76b9-46ef-9d97-6269bb573fe9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1094 microversion: 2.1 time: 0.095018 Oct 18 14:13:53.287434 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3418/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:53 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:53.530361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:53.531020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:53.537431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:53.537976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:53.538810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:53.539555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:53.540097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:53.540552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:53.577506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:53.578014 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:53.578525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:53.578994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lazy-loading 'fault' on Instance uuid 6ac5dd61-dd29-4b8f-8327-d176f0add834 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:13:53.627985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb029d693404bd6bfd636535dac99ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98dbcb42beaa4345ad9a6851c067bc99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:53.639177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-950dfc30-eb22-42ec-83c0-98fcb066a942 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 200 len: 1388 microversion: 2.1 time: 0.113421 Oct 18 14:13:53.640303 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3570/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:53 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 1388 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:53.771685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fedf4e77-066c-4ede-8132-f711811a99b2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: .version_select at 0x7fb32bcc3310>, body: {"keypair": {"name": "tempest-keypair-115014698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATlWlul7t7iJjbRi3MkP4mWZ31KlG84p45Mj953XkfQSA9A5Kg0VX9GZxXJivF67a1reV/2dPBV+TQ0uUBfTtm7RfpPZe2U+DlbqekpNIXv05Yx8bs012TAzjs2m7bFAg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:53.788277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fedf4e77-066c-4ede-8132-f711811a99b2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:13:53.801251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fedf4e77-066c-4ede-8132-f711811a99b2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:13:53.926837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fedf4e77-066c-4ede-8132-f711811a99b2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158942 Oct 18 14:13:53.927448 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3419/6989] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:13:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:54.309640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:54.310416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:54.317277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.319742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.319742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.319742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.319742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.320056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.381969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:54.390859 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-359a7d0a-58ba-4b44-b63f-bedcf964c982 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1144 microversion: 2.1 time: 0.085800 Oct 18 14:13:54.391666 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3571/6990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:54 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:54.665291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:54.665952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:54.674494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.675163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.675709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.676932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.677500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.678001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.692325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] HTTP exception thrown: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Request method failure captured: Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 HTTP/1.1 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrNV0DW6MWjd1sqdgCjfGDCeDP7qyYDCe-W8eeW8PmlgtSyoFjBsvhgbJqgPCob9gQ7tRdmtSgpLC-l6mxcW38lm_GeuaQc0lAIR0bHkCQU9uIizBq--cDCi6vUcJY9cNa1X6yy1NNgnTLelyQMud7_USObUEoifCrH_5Pfv-kXtPW4 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: afb029d693404bd6bfd636535dac99ab Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '6ac5dd61-dd29-4b8f-8327-d176f0add834'} Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:54.694150 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:54.697454 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:54.701484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Returning 404 to user: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:54.701484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35d9bee8-d9b1-43cf-912d-0dde00c0b111 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 404 len: 111 microversion: 2.1 time: 0.038874 Oct 18 14:13:54.701484 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3420/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:54 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:55.254991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:55.256653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:55.263350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.268700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.269177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.269965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.270478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.270927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.294755 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] HTTP exception thrown: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Request method failure captured: Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 HTTP/1.1 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrNV0DW6MWjd1sqdgCjfGDCeDP7qyYDCe-W8eeW8PmlgtSyoFjBsvhgbJqgPCob9gQ7tRdmtSgpLC-l6mxcW38lm_GeuaQc0lAIR0bHkCQU9uIizBq--cDCi6vUcJY9cNa1X6yy1NNgnTLelyQMud7_USObUEoifCrH_5Pfv-kXtPW4 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: afb029d693404bd6bfd636535dac99ab Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '6ac5dd61-dd29-4b8f-8327-d176f0add834'} Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:55.296478 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Returning 404 to user: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e46a454c-90e8-4667-a337-1037f3ff5feb tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 404 len: 111 microversion: 2.1 time: 0.046902 Oct 18 14:13:55.300084 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3572/6992] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:13:55 2022] DELETE /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:55.307596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:55.308296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] [instance: 6ac5dd61-dd29-4b8f-8327-d176f0add834] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:55.314265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.314841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.315302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.316010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.316479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.316916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.330586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] HTTP exception thrown: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Request method failure captured: Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 HTTP/1.1 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrNV0DW6MWjd1sqdgCjfGDCeDP7qyYDCe-W8eeW8PmlgtSyoFjBsvhgbJqgPCob9gQ7tRdmtSgpLC-l6mxcW38lm_GeuaQc0lAIR0bHkCQU9uIizBq--cDCi6vUcJY9cNa1X6yy1NNgnTLelyQMud7_USObUEoifCrH_5Pfv-kXtPW4 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_98dbcb42beaa4345ad9a6851c067bc99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 98dbcb42beaa4345ad9a6851c067bc99 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestServerBasicOps-1862634357 Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: afb029d693404bd6bfd636535dac99ab Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestServerBasicOps-1862634357-project Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '6ac5dd61-dd29-4b8f-8327-d176f0add834'} Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:55.332174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Returning 404 to user: Instance 6ac5dd61-dd29-4b8f-8327-d176f0add834 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc9fb317-0c62-4b93-b563-94a49a1e0039 tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834" status: 404 len: 111 microversion: 2.1 time: 0.029932 Oct 18 14:13:55.335375 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3421/6993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:55 2022] GET /compute/v2.1/servers/6ac5dd61-dd29-4b8f-8327-d176f0add834 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:55.414569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:55.415746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:55.425188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.426276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.426947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.427758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.428308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.429228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.518741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:55.529484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c865e1b-a418-4f66-ab92-4f464d84b55f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1200 microversion: 2.1 time: 0.118950 Oct 18 14:13:55.530569 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3573/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:55 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:55.638935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8bf17524-ab12-4891-8cff-5886cfd6d79d tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] Calling method '.version_select at 0x7fb32bdf7940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:55.714728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8bf17524-ab12-4891-8cff-5886cfd6d79d tempest-TestServerBasicOps-1862634357 tempest-TestServerBasicOps-1862634357-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1148208314" status: 202 len: 0 microversion: 2.1 time: 0.080017 Oct 18 14:13:55.719132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3422/6995] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 14:13:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1148208314 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:13:56.554338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:56.555602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:56.564126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:56.572084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:56.572084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:56.572084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:56.572084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:56.572084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:56.669103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:56.682356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb3d72df-681a-4c96-bf0d-3b799ce907d5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1210 microversion: 2.1 time: 0.131907 Oct 18 14:13:56.685734 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3574/6996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:56 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:56.717337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-841467164", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b116030-807c-4293-afcb-4683b2a05e7c"}], "security_groups": [{"name": "tempest-securitygroup--1946963082"}], "key_name": "tempest-keypair-115014698", "user_data": "}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:56.877059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] validate_networks() for [('4b116030-807c-4293-afcb-4683b2a05e7c', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:13:57.624928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:13:57.625364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:13:57.627043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:13:57.627043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:13:57.627043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:13:57.644389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.644899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.645351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.651805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.655853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.655853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.697522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:13:57.705485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:13:57.712745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:57.713420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:57.727839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.728377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.728849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.730166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.730652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.731105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.750797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:13:57.753960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:13:57.984426 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21cc2c3a-b92b-4bb8-89d4-ffd8a3c984da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.272240 Oct 18 14:13:57.985083 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3423/6997] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:13:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:13:57.999084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-335d3f9c-c0b2-4414-a412-83e150b32946 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:58.011870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-335d3f9c-c0b2-4414-a412-83e150b32946 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:58.141916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:58.150296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ac788f0-626b-46dd-8aaa-a0496aa66c14 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1277 microversion: 2.1 time: 0.441954 Oct 18 14:13:58.158942 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3575/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:57 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1277 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:58.184738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-335d3f9c-c0b2-4414-a412-83e150b32946 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:58.188846 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-335d3f9c-c0b2-4414-a412-83e150b32946 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1240 microversion: 2.1 time: 0.195281 Oct 18 14:13:58.192799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3424/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:57 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1240 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:58.612573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a9addf-b477-4a91-8ea9-e3d0f1113129", "tag": "a0f6bcf2-5133-40c0-8e24-0ad725e3be5a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:58.632499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:58.633637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:58.634339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:58.654414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] Creating event network-changed:a0f6bcf2-5133-40c0-8e24-0ad725e3be5a for instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 on n-h1-858383-13 Oct 18 14:13:58.662917 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-406652e5-8aee-40b8-8384-a6c239bae951 req-c2f87520-327d-42c1-ae65-65c4579950ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055043 Oct 18 14:13:58.666204 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3576/7000] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:59.183751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:59.184948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:59.192141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:59.192666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:59.193115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:59.193915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:59.194582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:59.195174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:59.236032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e931b3c-7ac6-4a9a-b0f6-e2c0fbb52adf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:59.236890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e931b3c-7ac6-4a9a-b0f6-e2c0fbb52adf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:59.365363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e931b3c-7ac6-4a9a-b0f6-e2c0fbb52adf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:59.384607 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e931b3c-7ac6-4a9a-b0f6-e2c0fbb52adf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1240 microversion: 2.1 time: 0.167986 Oct 18 14:13:59.386862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3577/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:59 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:59.643298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:59.659500 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8c79783-bf83-4eb4-ac5b-5d50620265bf tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1277 microversion: 2.1 time: 0.480282 Oct 18 14:13:59.661515 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3425/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:59 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1277 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:00.415491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:00.418009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:00.436302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.438269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.439496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:00.442256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.444189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.444930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:00.624009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:00.624009 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b22b6d4-3036-495c-b28d-e637ecdf25a2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1292 microversion: 2.1 time: 0.177486 Oct 18 14:14:00.624009 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3578/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:00 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:00.686448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:00.687237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.698582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:01.036242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:01.053667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5508b80-f8a9-46cb-9bc2-a9bdca52a9e9 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1277 microversion: 2.1 time: 0.371727 Oct 18 14:14:01.072229 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3426/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:00 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:01.617500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:01.618439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:01.628310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:01.628914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:01.629729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:01.631026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:01.632097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:01.632902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:01.739369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:01.748656 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61f1c5ea-8f6f-4136-b5c5-2bfec9b73208 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1298 microversion: 2.1 time: 0.135612 Oct 18 14:14:01.749496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3579/7005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:01 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:02.083913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:02.085340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:02.099821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.100593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.101214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:02.102129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.103577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.104408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:02.256891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:02.267325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38ee0637-cd44-4872-8cba-df0e129cbeb8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1277 microversion: 2.1 time: 0.190027 Oct 18 14:14:02.269313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3427/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:02 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:02.774532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:02.775366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:02.782377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:02.784775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.785383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.789256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:02.791363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.791869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.792334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:03.150402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:03.158515 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-032f8fcf-f4aa-48e4-8791-f4f3ca0cb160 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.389531 Oct 18 14:14:03.159099 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3580/7007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:02 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:03.290952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:03.292964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:03.301249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:03.302012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:03.302687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:03.303558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:03.304164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:03.304743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:03.459795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:03.475236 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aa89060d-0a9a-4001-96ad-9b456c664122 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.187856 Oct 18 14:14:03.476314 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3428/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:03 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:04.183678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:04.184250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:04.195979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:04.196522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:04.196974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.201814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:04.202564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:04.203333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.385016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a1ba23-574a-4613-a02c-59cb0149fc81", "tag": "aecd2487-05d1-46de-ad68-894994635b30"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:04.396503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:04.398395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:04.398395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.409947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] Creating event network-changed:aecd2487-05d1-46de-ad68-894994635b30 for instance c2a1ba23-574a-4613-a02c-59cb0149fc81 on n-h2-858383-13 Oct 18 14:14:04.415453 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-edde464e-25a8-4d00-a992-fd9a249b4d6d req-65c166dd-9532-4beb-99eb-9c63719214d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034550 Oct 18 14:14:04.419410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3429/7009] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:04.446512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:04.457366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9630f6e5-81bf-4323-bb74-06bea0d4cef8 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.278275 Oct 18 14:14:04.475202 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3581/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:04 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:04.505365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:04.506043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:04.516793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:04.517566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:04.518075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.518793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:04.519262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:04.519756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.751920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:04.763208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-824f4848-f404-4417-985f-4812e2123cb1 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.262888 Oct 18 14:14:04.763208 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3430/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:04 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:05.483440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:05.484661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:05.491922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.492437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.493996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:05.493996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.494188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.494669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:05.643719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:05.652622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ce2d635-6d42-49ee-9616-dae96479fcd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.173174 Oct 18 14:14:05.653793 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3582/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:05 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:05.785611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:05.786394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:05.795826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.796462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.797032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:05.798436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.799009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.799630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:06.011169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:06.019296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ea97a77-4cac-40b3-bdc9-e0c54d2c8c32 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.237981 Oct 18 14:14:06.019882 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3431/7013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:05 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:06.676230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:06.676868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:06.683873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:06.684382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:06.684841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:06.685569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:06.686039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:06.686515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:06.827710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:06.835621 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de712c6d-89fc-4b20-ac7e-13931b5a333f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.163417 Oct 18 14:14:06.836438 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3583/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:06 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:07.044135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:07.048271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:07.055335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.056147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.056714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.058186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.058766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.059314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.199179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:07.208337 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc0e3685-77a1-4deb-b5bd-77ceec8b701f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.167886 Oct 18 14:14:07.209097 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3432/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:07 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:07.859023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:07.859548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:07.866177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.866731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.867186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.867894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.868367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.868864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:08.004222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:08.007999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:08.012587 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-966a3f11-495f-4c71-9d97-2206050a8a48 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.157645 Oct 18 14:14:08.013171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3584/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:07 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:08.231634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:08.232267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:08.234440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:08.236024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=14 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:08.241271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:08.245533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:08.245533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:08.245533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:08.245533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:08.245533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:08.392600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:08.401668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1de6f69e-3ecc-437a-a4f7-d69ba66ae783 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.173497 Oct 18 14:14:08.402315 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3433/7017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:08 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:09.036846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:09.037669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:09.046241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.046812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.047262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.047981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.048455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.048904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.108300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a1ba23-574a-4613-a02c-59cb0149fc81", "name": "network-vif-plugged", "status": "completed", "tag": "aecd2487-05d1-46de-ad68-894994635b30"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:09.118551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.119061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.120080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.131479 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] Creating event network-vif-plugged:aecd2487-05d1-46de-ad68-894994635b30 for instance c2a1ba23-574a-4613-a02c-59cb0149fc81 on n-h2-858383-13 Oct 18 14:14:09.138253 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1663a0f9-0193-4693-98cf-ca62348b8d59 req-262713a9-6df9-4bee-b459-d06e2e69a926 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Oct 18 14:14:09.139366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3434/7018] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:09.221139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:09.229433 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79fdb942-c3a1-4bf3-9380-2635750d7a75 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.196367 Oct 18 14:14:09.231709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3585/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:09 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:09.427607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:09.428246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:09.435350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.439647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.439647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.439647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.439647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.439647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.570508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:09.578533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ce9df17f-bf53-4ef4-9090-b25170aaaac8 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.155224 Oct 18 14:14:09.579108 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3435/7020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:09 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:14:10.252961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:10.253596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:10.255481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:10.261411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.261970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.262412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.263131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.263672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.264126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.394212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:10.402665 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0fe3cf70-3cff-4dff-b400-a8db556781db tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1366 microversion: 2.1 time: 0.153646 Oct 18 14:14:10.407698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3586/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:10 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:10.601223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:10.601849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:10.609640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.613650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.613650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.613650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.613650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.613650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.616264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:10.748513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:10.756427 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c96ced30-5c5c-4396-a073-4609724d81f0 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.159258 Oct 18 14:14:10.757082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3436/7022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:10 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:11.426888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:11.427555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.430267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:11.435027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.435527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.436046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.436686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.437157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.437601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.573717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:11.581625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b70a42a2-27c8-4b64-a531-919575f97161 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1556 microversion: 2.1 time: 0.158716 Oct 18 14:14:11.582229 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3587/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:11 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:11.603961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:11.604461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.611961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.612450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.612896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.613592 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.614077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.614514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.693207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38f15fdc-a977-4e5d-953e-1c664b03ada9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093085 Oct 18 14:14:11.693813 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3437/7024] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:14:11 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:11.780428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:11.781074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.787324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.789791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.789791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.789791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.789791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.790152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.925973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:11.934496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-345d55f0-e6a1-4f8b-b50a-b03ab30d2343 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.158017 Oct 18 14:14:11.935646 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3588/7025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:11 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:12.723171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a1ba23-574a-4613-a02c-59cb0149fc81", "tag": "aecd2487-05d1-46de-ad68-894994635b30"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:12.734757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:12.734757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:12.734757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:12.745821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] Creating event network-changed:aecd2487-05d1-46de-ad68-894994635b30 for instance c2a1ba23-574a-4613-a02c-59cb0149fc81 on n-h2-858383-13 Oct 18 14:14:12.751150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9809ebe7-c708-4c6e-ab37-6b99c812ca31 req-cd8b3813-d022-4220-87a6-b824af94dbb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032675 Oct 18 14:14:12.751682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3438/7026] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:12.958708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:12.959970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:12.968196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:12.969574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:12.972393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:12.972393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:12.972393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:12.972393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:13.174343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:13.183503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-400f8759-0e8b-4bde-8f72-6b9c683a50f5 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.229077 Oct 18 14:14:13.184095 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3589/7027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:12 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:14.134891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a9addf-b477-4a91-8ea9-e3d0f1113129", "name": "network-vif-plugged", "status": "completed", "tag": "a0f6bcf2-5133-40c0-8e24-0ad725e3be5a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:14.144568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:14.148702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:14.148702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:14.156623 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] Creating event network-vif-plugged:a0f6bcf2-5133-40c0-8e24-0ad725e3be5a for instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 on n-h1-858383-13 Oct 18 14:14:14.161795 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-e7e9af41-f906-498e-8f3e-fbc8c5678636 req-abd9616c-9c03-42cd-8e12-2a502d562dae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Oct 18 14:14:14.162461 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3439/7028] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:14.206864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:14.207532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:14.216155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:14.216922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:14.217418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:14.218287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:14.218771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:14.219208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:14.379132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:14.387907 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c856acc8-87f5-4648-bc4b-9f97a7912acd tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.185210 Oct 18 14:14:14.388420 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3590/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:14 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:15.412685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:15.413425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:15.420444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.420940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.421392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.422114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.422583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.423023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.563775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:15.572637 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d032077-2a80-4c6b-ab66-3aa59b8312c6 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1265 microversion: 2.1 time: 0.165136 Oct 18 14:14:15.579474 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3440/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:15 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:16.596602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:16.597244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:16.604530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.605039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.605497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.606240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.606714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.607162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.737440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:16.745983 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7f3e749-4973-415e-b241-bba5232026fb tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1451 microversion: 2.1 time: 0.153480 Oct 18 14:14:16.746594 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3591/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:16 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:16.769083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:16.769737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:16.777254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.777724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.778201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.778891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.779352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.779781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.911980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:16.919808 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e25749a2-1d8d-44ff-ac5f-ae6a5c159b28 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1451 microversion: 2.1 time: 0.154712 Oct 18 14:14:16.920503 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3441/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:16 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:19.379810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a9addf-b477-4a91-8ea9-e3d0f1113129", "tag": "a0f6bcf2-5133-40c0-8e24-0ad725e3be5a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:19.391431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:19.393506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:19.393506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:19.410480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] Creating event network-changed:a0f6bcf2-5133-40c0-8e24-0ad725e3be5a for instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 on n-h1-858383-13 Oct 18 14:14:19.411219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-abded8cf-fa90-4b3e-91d7-a39b176844e3 req-b7db6ef2-c5cf-40cb-bb74-daed468c91f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035188 Oct 18 14:14:19.412041 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3592/7033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:48.746019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:48.746575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:48.748886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:48.749780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=24 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:48.755210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.755700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.756240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:48.756985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.757442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.758151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:48.783404 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ae651ff-ef68-401c-9392-d4d71d8518dd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/ips" status: 200 len: 150 microversion: 2.1 time: 0.041751 Oct 18 14:14:48.783977 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3442/7034] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 14:14:48 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:48.794544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=11 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:48.795309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=44 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:48.800215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a46bb204-919c-4d75-99cc-301acb7a2c04"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:48.802672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:48.808911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.809421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.809864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:48.810592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.811062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.819337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.080344 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/os-volume_attachments HTTP/1.1 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 74 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: {"volumeAttachment": {"volumeId": "a46bb204-919c-4d75-99cc-301acb7a2c04"}} Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': 'c2a1ba23-574a-4613-a02c-59cb0149fc81', 'body': {'volumeAttachment': {'volumeId': 'a46bb204-919c-4d75-99cc-301acb7a2c04'}}} Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:14:49.082753 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 400 to user: Invalid volume: volume a46bb204-919c-4d75-99cc-301acb7a2c04 is already attached to instances: 473f0586-7f9a-4467-ba49-4673a02ffe53 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0af58ce8-6881-4b7c-a1fa-2c9749b8d9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.291855 Oct 18 14:14:49.091473 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3593/7035] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:14:48 2022] POST /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:14:49.093556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:49.094082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:49.101094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:49.101591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:49.102042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.102819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:49.103285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:49.103722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.128745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:14:49.380067 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a10a9b34-75e3-4620-9f33-60943800a20a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 204 len: 0 microversion: 2.1 time: 0.289793 Oct 18 14:14:49.380708 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3443/7036] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:14:49 2022] DELETE /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:14:49.389403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:49.390793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:49.396936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:49.397541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:49.398006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.398746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:49.399223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:49.399671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.533729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:49.541920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ee01693-13e9-489f-9f63-06cf31c3882f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1681 microversion: 2.1 time: 0.156617 Oct 18 14:14:49.542560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3594/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:49 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:14:50.568704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:50.569411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:50.576875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:50.577360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:50.577798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:50.578527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:50.578986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:50.579417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:50.716446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:50.724764 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8305d318-d7d0-409a-9945-f9d1e83ef9ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1681 microversion: 2.1 time: 0.161431 Oct 18 14:14:50.725330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3444/7038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:50 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:51.705223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a1ba23-574a-4613-a02c-59cb0149fc81", "name": "network-vif-deleted", "tag": "aecd2487-05d1-46de-ad68-894994635b30"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:51.717256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:51.723519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:51.723519 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:51.729914 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] Creating event network-vif-deleted:aecd2487-05d1-46de-ad68-894994635b30 for instance c2a1ba23-574a-4613-a02c-59cb0149fc81 on n-h2-858383-13 Oct 18 14:14:51.735470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-110babca-9d62-4951-9654-235357938fc6 req-ce965106-e64e-4798-80ba-86a3f74793d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Oct 18 14:14:51.736074 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3595/7039] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:51.752929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:51.757350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:51.763152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:51.763860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:51.764318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:51.765038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:51.765669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:51.766129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:51.840893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:51.850572 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8e648ce-6aae-40b2-9b27-2ad4831b6c42 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 200 len: 1613 microversion: 2.1 time: 0.101574 Oct 18 14:14:51.851677 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3445/7040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:51 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:52.875904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:52.876679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:52.883146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:52.883661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:52.884118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:52.884824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:52.885300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:52.885771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:52.899562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 HTTP/1.1 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c2a1ba23-574a-4613-a02c-59cb0149fc81'} Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:14:52.901603 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62cba9db-ecd9-4b49-8b1b-768fe4fc4fb4 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 404 len: 111 microversion: 2.1 time: 0.032282 Oct 18 14:14:52.905315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3596/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:52 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:14:52.912459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af2f82fc-7867-422e-b00e-c455d8ba05da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '.version_select at 0x7fb3309ca1f0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:53.009259 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af2f82fc-7867-422e-b00e-c455d8ba05da tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115014698" status: 202 len: 0 microversion: 2.1 time: 0.101362 Oct 18 14:14:53.009864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3446/7042] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 14:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115014698 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:14:53.849507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:53.850064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:53.856174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:53.856701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:53.857192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:53.857925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:53.858522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:53.858972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:53.944526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'services' on Instance uuid 473f0586-7f9a-4467-ba49-4673a02ffe53 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:14:54.155062 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-361e73f6-cad2-45fe-8180-6bf38419cd53 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments/a46bb204-919c-4d75-99cc-301acb7a2c04" status: 202 len: 0 microversion: 2.1 time: 0.310068 Oct 18 14:14:54.155668 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3597/7043] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:14:53 2022] DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments/a46bb204-919c-4d75-99cc-301acb7a2c04 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:14:54.167570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:54.170497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:54.177137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:54.177653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:54.178122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:54.178823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:54.179288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:54.179718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:54.210354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5eeaa90b-3ed8-4586-bc60-963f0b03d1ee tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049626 Oct 18 14:14:54.210847 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3447/7044] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:54 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:55.225197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:55.227615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:55.234293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:55.234805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:55.235266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:55.235980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:55.236470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:55.236909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:55.268094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22bab90d-f0bc-43d3-b776-ad466add6135 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048683 Oct 18 14:14:55.268888 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3598/7045] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:55 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:56.281084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:56.283502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:56.291011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:56.291508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:56.291957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:56.292730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:56.293202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:56.293644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:56.324407 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f1397547-0129-4de0-a671-59273b0c3ca0 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047439 Oct 18 14:14:56.325008 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3448/7046] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:56 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:57.338081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:57.340570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:57.347638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:57.348145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:57.348702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:57.349666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:57.350330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:57.350820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:57.384758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-728cf19c-a6c4-4d91-b55a-9889bfe02fdc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051294 Oct 18 14:14:57.385398 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3599/7047] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:57 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:58.397195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:58.402519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:58.409127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:58.409622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:58.410251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:58.411816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:58.412105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:58.412539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:58.446190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ac8fe2b3-733f-4ff6-b96b-4ba9b490facd tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053101 Oct 18 14:14:58.446767 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3449/7048] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:58 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:59.459770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:59.462205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:59.470122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.470653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.471113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.471845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.472324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.472774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.505102 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aec77487-9713-49ef-8c72-764d52729012 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049952 Oct 18 14:14:59.505656 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3600/7049] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:14:59 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:14:59.569374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:59.570177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:59.577067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.577558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.578006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.578718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.579177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.579607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.607726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:14:59.808059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee73d2ef-d366-4698-a47b-040702c8cf8a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 204 len: 0 microversion: 2.1 time: 0.242256 Oct 18 14:14:59.808582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3450/7050] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:14:59 2022] DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:14:59.819903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:59.820530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:59.826510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.827010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.827471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.828176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.828677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.829121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.966889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:59.974883 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22101b32-46c4-451a-ba15-76e0db146c70 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1682 microversion: 2.1 time: 0.159339 Oct 18 14:14:59.975463 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3601/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:59 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:15:00.998490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:00.999194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:01.006635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.007118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.007560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.008506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.008960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.009388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.141192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:01.148934 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48a6a5e0-20e1-4723-8fc4-35a185948ad1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1682 microversion: 2.1 time: 0.154820 Oct 18 14:15:01.149495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3451/7052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:00 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:02.181370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:02.182362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:02.192187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:02.193055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:02.193907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:02.195172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:02.195987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:02.196714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:02.296590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:02.307240 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbd65b8e-6554-4591-8707-254d63b92949 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1615 microversion: 2.1 time: 0.136844 Oct 18 14:15:02.307746 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3602/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:02 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:02.481027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f0586-7f9a-4467-ba49-4673a02ffe53", "name": "network-vif-deleted", "tag": "805ac8c0-12fc-4e71-bd21-d4468156ad17"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:02.491814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:02.492301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:02.495184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:02.505173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] Creating event network-vif-deleted:805ac8c0-12fc-4e71-bd21-d4468156ad17 for instance 473f0586-7f9a-4467-ba49-4673a02ffe53 on n-h2-858383-13 Oct 18 14:15:02.511330 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-93831dff-d775-4a6f-9d8e-e7f7fcf56cf9 req-ca090677-e869-4470-a146-b9d45bddc727 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 Oct 18 14:15:02.512265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3452/7054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:15:03.330570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:03.331231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:03.338473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.338980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.339439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.340211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.340723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.341172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.377527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.378031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.378515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.379070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'fault' on Instance uuid 473f0586-7f9a-4467-ba49-4673a02ffe53 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:15:03.425583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:03.437503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe76d35b-7f82-4fcb-b3bc-b6ce5f74e9cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 200 len: 1332 microversion: 2.1 time: 0.110688 Oct 18 14:15:03.438454 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3603/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:03 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:04.462355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:04.463110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:04.470444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.470943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.471390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.472088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.472550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.472986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.486350 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 HTTP/1.1 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '473f0586-7f9a-4467-ba49-4673a02ffe53'} Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:04.488034 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b09eeac1-ba37-4852-8828-01de562bd632 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 404 len: 111 microversion: 2.1 time: 0.032835 Oct 18 14:15:04.492134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3453/7056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:04 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:15:04.498889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42724591-ad30-4c21-89c9-5b1ae05312b7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '.version_select at 0x7fb331807040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:04.609121 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42724591-ad30-4c21-89c9-5b1ae05312b7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778059125" status: 202 len: 0 microversion: 2.1 time: 0.114016 Oct 18 14:15:04.609744 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3604/7057] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 14:15:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778059125 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:15:05.360096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a2f2df17-c2e4-4c4f-8902-c5ba8d250f63 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: .version_select at 0x7fb32bd07430>, body: {"keypair": {"name": "tempest-keypair-656010032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG54E7PyafpgGwl4NInLSg5kTIhna8qdfMhDj3DddwNio3Vkp69hppiWO0gZ9Rv/t0VOkcY0djgo1l4SYGT/Om1ptcWwXRnNmJW7Gv0NUivyyAGItLoF2qNH6WXhvAfoXQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:05.375584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a2f2df17-c2e4-4c4f-8902-c5ba8d250f63 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:15:05.381278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-a2f2df17-c2e4-4c4f-8902-c5ba8d250f63 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:15:05.472346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a2f2df17-c2e4-4c4f-8902-c5ba8d250f63 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116381 Oct 18 14:15:05.472954 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3454/7058] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:15:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:07.587919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2144992521", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b116030-807c-4293-afcb-4683b2a05e7c"}], "security_groups": [{"name": "tempest-securitygroup--1274971383"}], "key_name": "tempest-keypair-656010032", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:07.693213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] validate_networks() for [('4b116030-807c-4293-afcb-4683b2a05e7c', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:15:08.061849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:15:08.062327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:15:08.062819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:15:08.063247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:15:08.063676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:15:08.073195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:08.073691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:08.074185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:08.075127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:08.075470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:08.075916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:08.093531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:15:08.098871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:15:08.111173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:15:08.113967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:15:08.232918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-012fb5f8-45b9-49a6-86e6-05468a14451d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650650 Oct 18 14:15:08.233741 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3605/7059] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:15:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:15:08.244773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34934636-2d6b-44d2-bb56-79d48985b192 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:08.245403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34934636-2d6b-44d2-bb56-79d48985b192 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:08.301826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34934636-2d6b-44d2-bb56-79d48985b192 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:08.309179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34934636-2d6b-44d2-bb56-79d48985b192 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1241 microversion: 2.1 time: 0.068354 Oct 18 14:15:08.309761 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3455/7060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:08 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:09.332840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:09.334117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:09.340243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:09.340753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:09.341218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:09.341932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:09.342437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:09.342890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:09.407362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:09.415153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd25fca8-15d0-4d26-b674-a07035443f79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1245 microversion: 2.1 time: 0.087151 Oct 18 14:15:09.415727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3606/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:09 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:10.437623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:10.438365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:10.446595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:10.447121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:10.447652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:10.448431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:10.448902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:10.449345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:10.525143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:10.532932 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-349fe436-7117-4684-a72c-e3a55ff03331 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1293 microversion: 2.1 time: 0.099307 Oct 18 14:15:10.534216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3456/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:10 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:11.557951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:11.558516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:11.566151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:11.566926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:11.569536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:11.570408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:11.570910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:11.572095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:11.717561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:11.726847 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb0a92e6-5745-469f-b6b9-413dd1505c14 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.173839 Oct 18 14:15:11.727455 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3607/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:11 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:12.493251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d521fa55-b0cb-4fce-883c-61a470f17db4", "tag": "324b485b-ee37-4e4e-9016-3d55ff2c821f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:12.503824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:12.504317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:12.504764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:12.516222 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] Creating event network-changed:324b485b-ee37-4e4e-9016-3d55ff2c821f for instance d521fa55-b0cb-4fce-883c-61a470f17db4 on n-h1-858383-13 Oct 18 14:15:12.521725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-791de74d-d614-49fd-a729-469fdf3e4407 req-7e6fd322-fa9c-4b64-9ee1-2199cf3c78b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Oct 18 14:15:12.522680 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3457/7064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:15:12.750009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:12.750758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:12.758444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:12.758959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:12.759425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:12.760281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:12.760787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:12.761242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:12.896317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:12.903953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e756e5ff-0cb1-4810-9438-af41d46dbe0b tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.157845 Oct 18 14:15:12.904523 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3608/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:12 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:13.928971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:13.929685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:13.935921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:13.936411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:13.936855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:13.937546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:13.938010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:13.938470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:14.075260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:14.082994 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-803a48a4-1431-42b7-99af-2e619ba0f291 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.159683 Oct 18 14:15:14.083636 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3458/7066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:13 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:15.105637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:15.106300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:15.113288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:15.113801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:15.114302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:15.115019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:15.115500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:15.115954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:15.248411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:15.256754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e54f426b-c5b1-43a5-9172-ec8e8af30f69 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.155093 Oct 18 14:15:15.257329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3609/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:15 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:16.280509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:16.281134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:16.288369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:16.288871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:16.289331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:16.290044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:16.290537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:16.290981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:16.421823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:16.430363 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01a2df4a-0fad-496c-bf65-7bc6672b222c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.153713 Oct 18 14:15:16.430943 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3459/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:16 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:17.453593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:17.454249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:17.460845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:17.461346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:17.462086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:17.462811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:17.463282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:17.463727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:17.596557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:17.604355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9bea2270-db25-49d5-b0a3-190862516b68 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.154868 Oct 18 14:15:17.604961 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3610/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:17 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:18.380089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d521fa55-b0cb-4fce-883c-61a470f17db4", "name": "network-vif-plugged", "status": "completed", "tag": "324b485b-ee37-4e4e-9016-3d55ff2c821f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:18.386444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.391580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:18.392060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:18.392498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:18.403491 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] Creating event network-vif-plugged:324b485b-ee37-4e4e-9016-3d55ff2c821f for instance d521fa55-b0cb-4fce-883c-61a470f17db4 on n-h1-858383-13 Oct 18 14:15:18.408592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1a879609-3481-4fd6-9a01-f1c910b3cd80 req-22ea112d-a5e4-4880-8d83-1a8b5f9369ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Oct 18 14:15:18.409242 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3460/7070] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:18.627751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:18.628385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:18.631075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.631790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.637675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:18.638220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:18.638683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:18.639399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:18.639874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:18.640324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:18.660259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.772078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:18.780218 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc0faa66-f9dc-4799-b67e-351c5d25ff1c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.156410 Oct 18 14:15:18.780800 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3611/7071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:18 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:19.805961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:19.806575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:19.808847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:19.814595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:19.815092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:19.815532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:19.816234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:19.816695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:19.817127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:19.822034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:19.962014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:19.969854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3be155c4-f9ce-4c1c-b490-df81e442b3c6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1367 microversion: 2.1 time: 0.169973 Oct 18 14:15:19.970624 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3461/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:19 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:20.993559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:20.994212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:20.997036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:21.001744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.002286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.002743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.003447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.003915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.004357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.137630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:21.145567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd14c5c1-84f3-41d5-b4bd-6f057628e29e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1558 microversion: 2.1 time: 0.156396 Oct 18 14:15:21.146165 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3612/7073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:20 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:21.168469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:21.168972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:21.177341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.177827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.178296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.178984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.180106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.180591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.257554 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e798ddb6-98c3-44cf-868f-ae88c509ddb2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093533 Oct 18 14:15:21.258458 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3462/7074] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:15:21 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:22.230316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d521fa55-b0cb-4fce-883c-61a470f17db4", "tag": "324b485b-ee37-4e4e-9016-3d55ff2c821f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:22.240713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:22.241295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:22.241807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:22.253604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] Creating event network-changed:324b485b-ee37-4e4e-9016-3d55ff2c821f for instance d521fa55-b0cb-4fce-883c-61a470f17db4 on n-h1-858383-13 Oct 18 14:15:22.259941 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5968c067-3b74-414b-ba3e-b16c590d9024 req-761b1e25-ac62-40d8-9ab5-e5ba19f7c775 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033332 Oct 18 14:15:22.260560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3613/7075] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:58.153226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:58.154076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=9 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:58.158040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:58.158591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:58.164706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:58.165212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:58.165785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:58.166649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:58.167125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:58.167606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:58.191351 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7d636551-abf5-42d8-9463-ad9bfa5a6bfc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/ips" status: 200 len: 150 microversion: 2.1 time: 0.041980 Oct 18 14:15:58.191935 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3463/7076] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 14:15:58 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:00.953916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:00.954709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:00.958973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8caf0142-385e-447b-9689-5b3d0acff354"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:00.961473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:00.968249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:00.968751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:00.969214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:00.969927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:00.970507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:00.970960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:01.732600 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3503f62c-28ed-4ed2-a0c8-52236d59f757 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779743 Oct 18 14:16:01.733089 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3614/7077] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:16:00 2022] POST /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:13.507018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8caf0142-385e-447b-9689-5b3d0acff354"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:13.509632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:13.518297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.518911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.519227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.519922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.520382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.520813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.602011 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments HTTP/1.1 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 74 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: {"volumeAttachment": {"volumeId": "8caf0142-385e-447b-9689-5b3d0acff354"}} Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: exception: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': 'd521fa55-b0cb-4fce-883c-61a470f17db4', 'body': {'volumeAttachment': {'volumeId': '8caf0142-385e-447b-9689-5b3d0acff354'}}} Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:16:13.603774 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 400 to user: Invalid volume: volume 8caf0142-385e-447b-9689-5b3d0acff354 is already attached to instances: d521fa55-b0cb-4fce-883c-61a470f17db4 {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a3399ba1-7c59-4e6e-9386-6023f33d70ea tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102284 Oct 18 14:16:13.607589 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3464/7078] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:16:13 2022] POST /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:16:13.669175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:13.674857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:13.674857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:13.675059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:13.681034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.681532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.681988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.682732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.683199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.683635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.763950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'services' on Instance uuid d521fa55-b0cb-4fce-883c-61a470f17db4 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:16:13.925041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70de3f18-d11a-4015-9075-6469a764a348 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments/8caf0142-385e-447b-9689-5b3d0acff354" status: 202 len: 0 microversion: 2.1 time: 0.257455 Oct 18 14:16:13.925583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3615/7079] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:16:13 2022] DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments/8caf0142-385e-447b-9689-5b3d0acff354 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:16:13.933989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:13.936206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:13.942318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.942824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.943271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.943973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:13.944435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:13.944873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:13.975698 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8aea792-7254-44bb-8abc-481d5a691102 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Oct 18 14:16:13.976292 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3465/7080] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:13 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:14.990413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:14.992687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:14.999767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:15.000265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:15.000715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:15.001413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:15.001881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:15.002344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:15.034915 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9592c0ee-5d3d-49cd-84ac-128470d6e0bf tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Oct 18 14:16:15.035489 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3616/7081] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:14 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:16.047893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:16.050344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:16.058018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:16.058574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:16.059026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:16.059836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:16.060352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:16.060783 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:16.096811 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a5784f38-e39b-4357-9084-995f3141ee31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052772 Oct 18 14:16:16.097297 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3466/7082] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:16 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:17.109901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:17.112166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:17.119235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:17.119748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:17.120216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:17.120931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:17.121409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:17.121861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:17.152811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f48ec3cc-7d33-4aaf-9084-79da05092b2f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Oct 18 14:16:17.153282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3617/7083] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:17 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:18.165327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:18.168153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:18.174659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:18.175179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:18.175623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:18.176312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:18.176768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:18.177199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:18.207619 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f886ae69-f39a-450a-aa7b-49c916d5ee29 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046575 Oct 18 14:16:18.208189 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3467/7084] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:18 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:19.220086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:19.222367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:19.229156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.229662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.230158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.230872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.231352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.231799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.261572 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64e587ad-08aa-455a-8c84-5c91945b8339 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045536 Oct 18 14:16:19.262137 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3618/7085] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:16:19 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:16:19.324102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:19.324609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:19.331348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.331831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.332270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.332963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.333423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.333858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.358418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:16:19.612630 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1f961a76-9649-4fb6-ad00-81dfffe0bcf1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 204 len: 0 microversion: 2.1 time: 0.292648 Oct 18 14:16:19.613238 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3468/7086] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:16:19 2022] DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:16:19.622161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:19.622804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:19.628962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.629471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.629946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.630690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:19.631172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:19.631628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:19.765845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:19.773632 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e83c831-a244-41c2-967a-e37f0229086a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1682 microversion: 2.1 time: 0.156040 Oct 18 14:16:19.774239 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3619/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:19 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:20.798829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:20.799480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:20.806375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:20.806867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:20.807318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:20.808014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:20.808478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:20.808913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:20.943730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:20.952137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fedbef0a-b595-42f9-8106-9dc440753a6a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1682 microversion: 2.1 time: 0.157726 Oct 18 14:16:20.952718 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3469/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:20 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:21.976350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:21.979511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:21.984145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:21.984599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:21.985068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:21.985790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:21.986297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:21.986751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:22.049942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:22.058590 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d47c73e6-5e2a-43ec-9c61-e90f868eed31 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1614 microversion: 2.1 time: 0.086241 Oct 18 14:16:22.059179 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3620/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:21 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:22.214240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d521fa55-b0cb-4fce-883c-61a470f17db4", "name": "network-vif-deleted", "tag": "324b485b-ee37-4e4e-9016-3d55ff2c821f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:22.225620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:22.226140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:22.226593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:22.246360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] Creating event network-vif-deleted:324b485b-ee37-4e4e-9016-3d55ff2c821f for instance d521fa55-b0cb-4fce-883c-61a470f17db4 on n-h1-858383-13 Oct 18 14:16:22.246360 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-79f08a29-9fb8-4862-a5e7-2ce63513a30f req-85a67f84-c72b-4a07-9536-c0ea2b666f75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Oct 18 14:16:22.246360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3470/7090] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:23.082395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:23.083171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:23.090309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:23.090839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:23.091291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:23.092024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:23.092486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:23.092972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:23.127031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:23.127552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:23.128128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:23.128607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'fault' on Instance uuid d521fa55-b0cb-4fce-883c-61a470f17db4 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:16:23.171903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:23.180313 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-762930e5-86b4-42a8-8396-625919559384 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 200 len: 1331 microversion: 2.1 time: 0.101728 Oct 18 14:16:23.180961 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3621/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:23 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:24.216753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:24.229546 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 HTTP/1.1 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd521fa55-b0cb-4fce-883c-61a470f17db4'} Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:24.231097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2f6ad81c-5c93-4483-8a19-ae83884498ad tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 404 len: 111 microversion: 2.1 time: 0.031841 Oct 18 14:16:24.235175 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3471/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:24 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:16:24.241416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abfb9c71-0946-4efc-aab4-ec0b70137c3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '.version_select at 0x7fb330faf9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:24.315721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abfb9c71-0946-4efc-aab4-ec0b70137c3a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656010032" status: 202 len: 0 microversion: 2.1 time: 0.078112 Oct 18 14:16:24.316304 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3622/7093] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 14:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656010032 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:16:25.075082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d8ab12e-a60a-43ce-8e9d-1eb3cda92098 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: .version_select at 0x7fb3309ca310>, body: {"keypair": {"name": "tempest-keypair-95625287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1SnWnmZ/JW6jPR/ya62ffvpjThjA8jTPDZnwIoJtqo3e4FMHcUYUqFzmlcqxKR/GPnpMK1agXLH5ysAO51IyCWe9aVEziI6TbI/9L1tecrXEbftUAbTfa7TbLfFg2oMw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:25.090208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1d8ab12e-a60a-43ce-8e9d-1eb3cda92098 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:16:25.096155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-1d8ab12e-a60a-43ce-8e9d-1eb3cda92098 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:16:25.190515 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d8ab12e-a60a-43ce-8e9d-1eb3cda92098 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.119864 Oct 18 14:16:25.191094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3472/7094] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:16:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:27.315194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1189157393", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b116030-807c-4293-afcb-4683b2a05e7c"}], "security_groups": [{"name": "tempest-securitygroup--1590242412"}], "key_name": "tempest-keypair-95625287", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:27.417607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] validate_networks() for [('4b116030-807c-4293-afcb-4683b2a05e7c', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:16:27.855309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:16:27.855751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:16:27.856243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:16:27.856726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:16:27.857161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:16:27.866005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:27.866537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:27.867022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:27.867768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:27.868244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:27.868695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:27.888786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:16:27.894440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Getting quotas for user 3707d5fd73034aefaa470c08814a0809 and project 6d7ca279292a4614b7314c4546e24680. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:16:27.907393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:16:27.909704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:16:28.002668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f746314b-27f1-41cb-8ed1-4f51ac0d09b3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692710 Oct 18 14:16:28.003487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3623/7095] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:16:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:16:28.016594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-149305c9-f2ab-4ecf-910e-142c3e236056 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:28.017221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-149305c9-f2ab-4ecf-910e-142c3e236056 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:28.073745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-149305c9-f2ab-4ecf-910e-142c3e236056 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:28.081436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-149305c9-f2ab-4ecf-910e-142c3e236056 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1240 microversion: 2.1 time: 0.070528 Oct 18 14:16:28.082017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3473/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:28 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:29.105220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:29.106631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:29.113563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:29.114122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:29.114549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:29.115254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:29.115726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:29.116174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:29.182107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:29.189996 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88f64fcb-a5f2-4018-8f6a-44fbd3106617 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1244 microversion: 2.1 time: 0.089876 Oct 18 14:16:29.190591 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3624/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:29 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:30.212982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:30.213602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:30.222642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:30.223137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:30.223585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:30.224283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:30.224743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:30.225177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:30.293082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:30.303225 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53d6b2e4-9ca2-4676-9609-485fc85e6b79 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1300 microversion: 2.1 time: 0.094126 Oct 18 14:16:30.304193 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3474/7098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:30 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:31.327826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:31.328383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:31.335321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:31.335826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:31.336289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:31.336995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:31.337470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:31.337916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:31.547513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:31.556862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f277682-e5ed-4d90-89a6-49b74c723362 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.232057 Oct 18 14:16:31.556862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3625/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:31 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:32.087969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df12ab52-ec22-456e-a897-7b61725a904e", "tag": "2e4e9c46-e1fc-41af-a1c5-507a93a02c6a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:32.100017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:32.100769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:32.101520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:32.117964 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] Creating event network-changed:2e4e9c46-e1fc-41af-a1c5-507a93a02c6a for instance df12ab52-ec22-456e-a897-7b61725a904e on n-h2-858383-13 Oct 18 14:16:32.124086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5a3c2c6d-17e4-4484-9381-e7a0e798421d req-1e51bd5f-27c2-442b-a882-f5f53be32d2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113477 Oct 18 14:16:32.124697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3475/7100] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:32.578256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:32.578911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:32.586476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:32.587043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:32.587498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:32.588267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:32.588729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:32.589541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:32.843594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:32.851771 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc5d42b1-a4ee-4d06-9138-50e82f03c36a tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.277955 Oct 18 14:16:32.858622 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3626/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:32 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:33.876376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:33.877090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:33.883344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:33.884099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:33.884546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:33.885238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:33.885703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:33.886175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:34.027498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:34.035224 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d8cd73af-4dd9-4c5d-9627-051eb0126cd7 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.164080 Oct 18 14:16:34.035814 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3476/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:33 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:35.057998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:35.058673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:35.066163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:35.069903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:35.069903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:35.069903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:35.069903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:35.069903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:35.200285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:35.208143 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-368eec43-8b69-42a0-9c4f-671e980ba7fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.154116 Oct 18 14:16:35.208784 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3627/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:35 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:36.230955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:36.231620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:36.238791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.239287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.239739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.240448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.240914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.241355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.378752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:36.387322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27b27e90-26c6-4e64-a14b-cb97b58c4959 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.160334 Oct 18 14:16:36.388532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3477/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:36 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:37.415613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:37.416209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:37.416979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:37.417638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:37.427596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.428099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.428550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.429324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.429799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.430274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.434695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.435185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.435811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.436517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.436985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.437418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.464099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:16:37.579285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:37.587754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d555fef3-32bc-4eca-a4bd-dec321782a3f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.180800 Oct 18 14:16:37.588349 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3628/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:37 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:37.599197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a9addf-b477-4a91-8ea9-e3d0f1113129", "tag": "a0f6bcf2-5133-40c0-8e24-0ad725e3be5a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:37.611671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.612231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.612697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.625101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] Creating event network-changed:a0f6bcf2-5133-40c0-8e24-0ad725e3be5a for instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 on n-h1-858383-13 Oct 18 14:16:37.630946 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-49a9eb9e-9872-4640-9b51-327a9e739034 req-277336b7-d6fe-4c38-8a7d-6872ddc9b2f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041431 Oct 18 14:16:37.631559 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3629/7106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:37.766074 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ca784019-6161-4b9d-bbc5-47e63cacd696 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 204 len: 0 microversion: 2.1 time: 0.357296 Oct 18 14:16:37.766800 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3478/7107] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:16:37 2022] DELETE /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:16:37.776767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:37.777488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:37.784273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.784789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.785245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.786144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.786624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.787069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.874785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:37.901125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:37.935266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:37.943779 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54c11423-2e03-4e58-9183-fc4ff4faea22 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1576 microversion: 2.1 time: 0.171810 Oct 18 14:16:37.944371 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3630/7108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:37 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:38.613393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:38.614301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:38.616324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:38.622327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.622833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.623283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:38.624022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.624472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.624907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:38.759757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:38.767548 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4c93f1f7-cabf-4efe-8578-9b38756d5268 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.158525 Oct 18 14:16:38.768127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3479/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:38 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:38.970974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:38.971638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:38.978447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.978948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.979405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:38.980107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.980655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.981100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:39.113107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:39.121096 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb23d408-31d0-45b8-8d25-a45e38983488 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1576 microversion: 2.1 time: 0.155226 Oct 18 14:16:39.121680 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3631/7110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:38 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:39.762092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12ab52-ec22-456e-a897-7b61725a904e", "name": "network-vif-plugged", "status": "completed", "tag": "2e4e9c46-e1fc-41af-a1c5-507a93a02c6a"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:39.773088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:39.773585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:39.774025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:39.785906 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] Creating event network-vif-plugged:2e4e9c46-e1fc-41af-a1c5-507a93a02c6a for instance df12ab52-ec22-456e-a897-7b61725a904e on n-h2-858383-13 Oct 18 14:16:39.791225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:39.791817 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c266c87a-6b2a-4247-af44-9e8f452bd782 req-4af1a9e9-2b35-4b33-a8e8-3a8c2b085518 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033783 Oct 18 14:16:39.791950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:39.792492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3480/7111] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:39.798181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:39.798694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:39.799173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:39.799891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:39.800361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:39.800809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:40.017563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:40.021656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:40.027624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-885b000b-61aa-46a1-bf66-08c84aa9493f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.240630 Oct 18 14:16:40.028604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3632/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:39 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:40.145982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:40.146732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:40.153599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:40.154079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:40.154534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:40.155284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:40.155754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:40.156271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:40.160969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:40.427230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:40.437781 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d5ccbfd-7a53-4a03-b9b0-df17d507c10c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1390 microversion: 2.1 time: 0.295937 Oct 18 14:16:40.455657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3481/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:40 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:40.523032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a9addf-b477-4a91-8ea9-e3d0f1113129", "name": "network-vif-deleted", "tag": "a0f6bcf2-5133-40c0-8e24-0ad725e3be5a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:40.533238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:40.533833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:40.534379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:40.550291 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] Creating event network-vif-deleted:a0f6bcf2-5133-40c0-8e24-0ad725e3be5a for instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 on n-h1-858383-13 Oct 18 14:16:40.552731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ee402d5b-4d4b-4d68-9c0d-16eea52eaaae req-276e29a4-caf0-48ee-8f28-a66e29991772 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118236 Oct 18 14:16:40.553419 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3633/7114] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:41.051405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:41.051931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:41.059039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:41.059535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:41.059983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:41.060688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:41.061156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:41.061593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:41.197586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:41.206124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b92338b-578a-4874-aa2f-b17b7de2aad9 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1366 microversion: 2.1 time: 0.158654 Oct 18 14:16:41.206715 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3482/7115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:41 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:41.466921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:41.468291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:41.477789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:41.478395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:41.482013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:41.482013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:41.482013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:41.482013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:41.547558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:41.555661 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-296997aa-d217-4295-8911-575a8b7c547f tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1225 microversion: 2.1 time: 0.094546 Oct 18 14:16:41.560247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3634/7116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:41 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:42.229025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:42.229593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:42.237119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.237613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.238082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.238796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.239260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.239697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.372244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:42.380474 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1a30f4db-d9f3-4394-9aeb-4e0dc10c2807 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1556 microversion: 2.1 time: 0.155464 Oct 18 14:16:42.381071 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3483/7117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:42 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:42.403213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:42.404240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:42.410472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.410984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.411446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.412166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.412643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.413089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.497877 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-673a1ab2-14f8-4e81-bbd0-6f9d31dc0cc2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098508 Oct 18 14:16:42.498679 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3635/7118] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:16:42 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:42.580925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:42.581853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:42.588882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.590381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.590943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.593599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.593599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.593599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.663867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:42.673215 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da8dfeba-dac5-4b43-8a93-f2dccde34e9c tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1225 microversion: 2.1 time: 0.097876 Oct 18 14:16:42.674498 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3484/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:42 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:43.599668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df12ab52-ec22-456e-a897-7b61725a904e", "tag": "2e4e9c46-e1fc-41af-a1c5-507a93a02c6a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:43.614153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:43.615169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:43.615891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:43.631129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] Creating event network-changed:2e4e9c46-e1fc-41af-a1c5-507a93a02c6a for instance df12ab52-ec22-456e-a897-7b61725a904e on n-h2-858383-13 Oct 18 14:16:43.637209 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-caa499b8-e890-443a-b233-b3dc5048f07e req-e0d058d4-4979-4a43-bbd1-a14d56aed578 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044657 Oct 18 14:16:43.638368 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3636/7120] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:43.696938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:43.698196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:43.701252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:43.706455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:43.710715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:43.710715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:43.710715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:43.710715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:43.710715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:43.816812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:43.836201 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6e925d0-a61b-412e-b199-ee2515797751 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1225 microversion: 2.1 time: 0.143136 Oct 18 14:16:43.846167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3485/7121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:43 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:44.862449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:44.863219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:44.866260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:44.871998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:44.873230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:44.873707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:44.874492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:44.874983 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:44.875441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:44.949444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:44.957831 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95e97ada-4055-4a5e-bc94-112aea090104 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1225 microversion: 2.1 time: 0.100074 Oct 18 14:16:44.961448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3637/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:44 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:45.981013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:45.982395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:45.989558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:45.990072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:45.990523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:45.991223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:45.991691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:45.992179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:46.023738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:46.024233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:46.024685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:46.025145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid 41a9addf-b477-4a91-8ea9-e3d0f1113129 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:16:46.066613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:46.074559 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e0fd3d09-996b-4e70-8f1c-85b0060f4cab tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 200 len: 1230 microversion: 2.1 time: 0.097562 Oct 18 14:16:46.075140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3486/7123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:45 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:47.098500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:47.099060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 41a9addf-b477-4a91-8ea9-e3d0f1113129] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:47.105649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:47.106177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:47.107141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:47.107840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:47.108316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:47.108760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:47.122771 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 HTTP/1.1 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '41a9addf-b477-4a91-8ea9-e3d0f1113129'} Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:16:47.127193 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 41a9addf-b477-4a91-8ea9-e3d0f1113129 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbaf34ed-278e-48a3-b956-bf670b04b274 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129" status: 404 len: 111 microversion: 2.1 time: 0.032050 Oct 18 14:16:47.131582 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3638/7124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:47 2022] GET /compute/v2.1/servers/41a9addf-b477-4a91-8ea9-e3d0f1113129 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:16:53.548746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:53.549388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:53.553780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0be3d0a-346b-4597-afaf-ea224a50978e", "tag": "6b11176c-942a-44f6-ba2a-5634d9c7dec2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:53.557988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.567181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.567690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.568033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.568187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.568959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.569841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.570447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.570966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.581901 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] Creating event network-changed:6b11176c-942a-44f6-ba2a-5634d9c7dec2 for instance a0be3d0a-346b-4597-afaf-ea224a50978e on n-h2-858383-13 Oct 18 14:16:53.587695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f7f23491-e6b8-4ab9-b302-1dc2f7e89a85 req-db314ece-3f02-411d-ae34-a6647926fa59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038801 Oct 18 14:16:53.588615 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3639/7125] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:53.609549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:16:53.898182 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afa5cacd-9db6-4b6f-9555-ccab1dd70142 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 204 len: 0 microversion: 2.1 time: 0.353719 Oct 18 14:16:53.905002 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3487/7126] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:16:53 2022] DELETE /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:16:53.918961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:53.919714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:53.927040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.927769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.928462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.929369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.930010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.930638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:54.113287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:54.121910 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-990158c0-86e4-4a45-85c9-3799d4645886 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1576 microversion: 2.1 time: 0.213814 Oct 18 14:16:54.122814 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3640/7127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:53 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:55.147406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:55.148148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:55.155000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.155498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.155951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.156658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.157130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.157570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.224157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:55.232398 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-88060464-afb5-483a-9fe5-eb7f89a9cd5a tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1390 microversion: 2.1 time: 0.089362 Oct 18 14:16:55.232968 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3488/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:55 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:55.604668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0be3d0a-346b-4597-afaf-ea224a50978e", "name": "network-vif-deleted", "tag": "6b11176c-942a-44f6-ba2a-5634d9c7dec2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:55.615993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.619481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.619481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.631601 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] Creating event network-vif-deleted:6b11176c-942a-44f6-ba2a-5634d9c7dec2 for instance a0be3d0a-346b-4597-afaf-ea224a50978e on n-h2-858383-13 Oct 18 14:16:55.636773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ff27bee7-2611-4472-b2f3-c1e2c07d3bb3 req-136d31b4-6aa9-42ac-9946-fffdaf46a97f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035942 Oct 18 14:16:55.637611 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3641/7129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:56.256671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:56.257227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:56.264934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:56.265427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:56.265877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:56.266613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:56.267082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:56.267520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:56.329857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:56.337891 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d51ff9a9-370e-4014-bac6-9de26c4c6e05 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1225 microversion: 2.1 time: 0.085195 Oct 18 14:16:56.338496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3489/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:56 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:57.361484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:57.362131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:57.369262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:57.369770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:57.370276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:57.371001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:57.371478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:57.372471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:57.439299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:57.447460 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdf05a67-724d-4d13-b8ca-709497674106 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1225 microversion: 2.1 time: 0.090317 Oct 18 14:16:57.462076 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3642/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:57 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:58.472524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:58.473180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:58.480322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.480837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.481406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.482301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.482616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.483067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.551703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:58.559784 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8d34b73-8ec2-4f93-abe3-063305a10320 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1225 microversion: 2.1 time: 0.091162 Oct 18 14:16:58.560374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3490/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:58 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:59.583282 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:59.583853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:59.590898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:59.591396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:59.591919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.592751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:59.593215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:59.593673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.627345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:59.627858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:59.629457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.629457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lazy-loading 'fault' on Instance uuid a0be3d0a-346b-4597-afaf-ea224a50978e {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:16:59.675373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0fc58ba6c524ee79755a72aa1f7ce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:59.684650 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5eca35e2-bd42-4420-bfee-930eb301a36e tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 200 len: 1230 microversion: 2.1 time: 0.104841 Oct 18 14:16:59.685432 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3643/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:59 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:00.708954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:00.709512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: a0be3d0a-346b-4597-afaf-ea224a50978e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:00.716341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:00.716832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:00.717308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:00.718005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:00.718500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:00.718935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:00.732599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e HTTP/1.1 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'a0be3d0a-346b-4597-afaf-ea224a50978e'} Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:00.734295 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance a0be3d0a-346b-4597-afaf-ea224a50978e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8651cd9e-609e-4397-b0af-3ac36eda6037 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e" status: 404 len: 111 microversion: 2.1 time: 0.030826 Oct 18 14:17:00.738391 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3491/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:00 2022] GET /compute/v2.1/servers/a0be3d0a-346b-4597-afaf-ea224a50978e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:01.528682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:01.529204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:01.536390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.536893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.537351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.538085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.538554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.539000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.552720 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b HTTP/1.1 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '06b35a07-2b1c-4b92-a2f6-76182c089a1b'} Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:01.554442 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b9831f3-6ca1-4221-bb77-f9be8382322b tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 404 len: 111 microversion: 2.1 time: 0.031886 Oct 18 14:17:01.557959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3644/7135] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:01 2022] DELETE /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:01.564751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:01.565390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] [instance: 06b35a07-2b1c-4b92-a2f6-76182c089a1b] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:01.571555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.576031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.588476 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] HTTP exception thrown: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Request method failure captured: Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b HTTP/1.1 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrFQECKA697zu5DWxnK_LgnNlKVpf9xZ6CyGCRi01ZrepfYbYnhgfhzNrsVGBmaUjLfBs4uS40DixjVHXGut0oAFHJz8C6vCnvb4UgVtncEHLWQBvVyov1YaRL-3T2CwBlgOw6SYEdr_wYY35ZHXRb_dMFXCnkpaHGLpds41QfMJMoc Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b10dd8d3e1be4c6e9ceea751db7a775e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: b10dd8d3e1be4c6e9ceea751db7a775e Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestVolumeBootPattern-452109503 Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: c0fc58ba6c524ee79755a72aa1f7ce1d Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestVolumeBootPattern-452109503-project Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '06b35a07-2b1c-4b92-a2f6-76182c089a1b'} Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.590026 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Returning 404 to user: Instance 06b35a07-2b1c-4b92-a2f6-76182c089a1b could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-766ebe88-dfc9-41af-88fe-3d52f8407608 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b" status: 404 len: 111 microversion: 2.1 time: 0.031238 Oct 18 14:17:01.594994 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3492/7136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:01 2022] GET /compute/v2.1/servers/06b35a07-2b1c-4b92-a2f6-76182c089a1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:05.234105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12b6379c-b0fd-4257-9c3c-32d84667a396 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] Calling method '.version_select at 0x7fb330b0cb80>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:05.327766 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12b6379c-b0fd-4257-9c3c-32d84667a396 tempest-TestVolumeBootPattern-452109503 tempest-TestVolumeBootPattern-452109503-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1315374410" status: 202 len: 0 microversion: 2.1 time: 0.098013 Oct 18 14:17:05.328469 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3645/7137] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 14:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1315374410 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:17:19.665377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:19.666011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:19.668799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:19.669458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:19.674743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:19.675239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:19.675686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:19.676382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:19.676847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:19.677285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:19.700834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d117b8ff-9cb1-4b17-9460-b7ede539ec49 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039452 Oct 18 14:17:19.701408 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3493/7138] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 14:17:19 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:17:22.306382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6148c59a-b600-4b95-8171-129d2aef64d5"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:22.308748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:22.311745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=48 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:22.312529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:22.317246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:22.317748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:22.318239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:22.318952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:22.319515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:22.319968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:23.075863 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82908bec-84e2-4e1f-801f-16d132096d99 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "POST /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773664 Oct 18 14:17:23.076480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3646/7139] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:17:22 2022] POST /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:34.956095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:34.956590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:34.965318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:34.965836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:34.966310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:34.967002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:34.967459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:34.968019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:35.051235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'services' on Instance uuid df12ab52-ec22-456e-a897-7b61725a904e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:17:35.323964 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5a9bd2a9-6ab4-488f-accb-7174d3f052f3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments/6148c59a-b600-4b95-8171-129d2aef64d5" status: 202 len: 0 microversion: 2.1 time: 0.371694 Oct 18 14:17:35.324554 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3494/7140] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:17:34 2022] DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments/6148c59a-b600-4b95-8171-129d2aef64d5 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:17:35.332538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:35.333568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:35.337952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:35.340356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:35.348109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:35.348618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:35.349089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:35.349806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:35.350310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:35.350760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:35.380259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ad24a4f-68bd-43d6-add8-735e00c2ecb6 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050461 Oct 18 14:17:35.380820 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3647/7141] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:35 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:36.393565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:36.396111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:36.403264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:36.403755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:36.404200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:36.404889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:36.405349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:36.405780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:36.437015 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b8fa0fb-1150-4573-b3f7-b040ddae9705 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Oct 18 14:17:36.437582 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3495/7142] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:36 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:37.450939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:37.453371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:37.461900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:37.462867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:37.463329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:37.464063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:37.464537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:37.465023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:37.498330 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7885b4d8-0e18-49f7-8ad7-3d7fc495fa7f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051972 Oct 18 14:17:37.498923 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3648/7143] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:37 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:38.511987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:38.515017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:38.522315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:38.522849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:38.523301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:38.524063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:38.524534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:38.524975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:38.559945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f45266dd-598a-4223-a85b-2ad7749ae49f tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052224 Oct 18 14:17:38.560575 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3496/7144] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:38 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:39.573315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:39.575525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:39.583103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:39.583646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:39.584116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:39.584834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:39.585311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:39.585824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:39.620563 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c6231bf-9e80-4dc2-bfe4-775b56c19be3 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051342 Oct 18 14:17:39.621243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3649/7145] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:39 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:40.632971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:40.635526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:40.642940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:40.643435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:40.643884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:40.644583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:40.645045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:40.645482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:40.676159 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b553783a-130b-496b-9a60-78358986390c tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047220 Oct 18 14:17:40.676726 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3497/7146] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:17:40 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:17:40.739325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:40.739877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:40.746750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:40.747248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:40.747708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:40.748408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:40.748878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:40.749321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:40.775079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:17:41.022513 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-972457d1-523a-4c48-8b2b-d101b732d799 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 204 len: 0 microversion: 2.1 time: 0.287163 Oct 18 14:17:41.023030 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3650/7147] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:40 2022] DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:17:41.031276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:41.032500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:41.038635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:41.039131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:41.039579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:41.040341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:41.040807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:41.041244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:41.171904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:41.180312 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2de83dfd-4f41-48c1-b0f1-cc31c45370d2 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1681 microversion: 2.1 time: 0.153046 Oct 18 14:17:41.180881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3498/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:41 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:42.204057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:42.204715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:42.211597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:42.212100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:42.212560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:42.213264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:42.213736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:42.214213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:42.346229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:42.354134 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc682ba1-7b5b-429d-9a7a-b2f5dc0a7592 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1681 microversion: 2.1 time: 0.154423 Oct 18 14:17:42.354699 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3651/7149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:42 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:43.559387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:43.560203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:43.566964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:43.567457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:43.567900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:43.568600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:43.571441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:43.571441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:43.641073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:43.651843 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32dbac0d-a721-45eb-80c5-b07da6f875cc tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1613 microversion: 2.1 time: 0.278521 Oct 18 14:17:43.652535 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3499/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:43 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1613 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:43.685522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df12ab52-ec22-456e-a897-7b61725a904e", "name": "network-vif-deleted", "tag": "2e4e9c46-e1fc-41af-a1c5-507a93a02c6a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:43.696673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:43.697490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:43.697637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:43.709081 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] Creating event network-vif-deleted:2e4e9c46-e1fc-41af-a1c5-507a93a02c6a for instance df12ab52-ec22-456e-a897-7b61725a904e on n-h2-858383-13 Oct 18 14:17:43.714577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5ceaa31f-052c-4e71-8847-5357716e3389 req-85d22799-e978-47b9-a58f-37ec08d00c32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Oct 18 14:17:43.715594 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3652/7151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:44.680220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:44.680220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:44.684710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:44.685204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:44.685716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:44.686660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:44.687023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:44.687364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:44.719939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:44.720839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:44.721276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:44.721730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lazy-loading 'fault' on Instance uuid df12ab52-ec22-456e-a897-7b61725a904e {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:17:44.764840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3707d5fd73034aefaa470c08814a0809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7ca279292a4614b7314c4546e24680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:44.773328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5854d819-cc01-446e-8546-834c6dc494a1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 200 len: 1330 microversion: 2.1 time: 0.101300 Oct 18 14:17:44.777987 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3500/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:44 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:45.797932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:45.799262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:45.805607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:45.806140 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:45.806606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:45.807322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:45.807800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:45.808252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:45.822018 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e HTTP/1.1 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'df12ab52-ec22-456e-a897-7b61725a904e'} Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:45.823670 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e184c75-d1a0-4da3-8530-19e2f73fe51d tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 404 len: 111 microversion: 2.1 time: 0.032513 Oct 18 14:17:45.827619 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3653/7153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:45 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:45.834649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5a4d7f9-5fbd-4b66-88f5-265b84579185 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '.version_select at 0x7fb33521f670>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:45.926885 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5a4d7f9-5fbd-4b66-88f5-265b84579185 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95625287" status: 202 len: 0 microversion: 2.1 time: 0.096014 Oct 18 14:17:45.927815 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3501/7154] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 14:17:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95625287 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:17:50.048080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:50.048587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:50.055517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:50.056135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:50.056602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:50.057320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:50.057797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:50.058279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:50.073143 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e HTTP/1.1 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'df12ab52-ec22-456e-a897-7b61725a904e'} Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:50.074760 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4981a6c0-ec65-4bf1-b4ab-a3468e2d29fa tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 404 len: 111 microversion: 2.1 time: 0.032025 Oct 18 14:17:50.078206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3654/7155] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:50 2022] DELETE /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:50.086543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:50.087108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: df12ab52-ec22-456e-a897-7b61725a904e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:50.093985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:50.094552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:50.094998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:50.095690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:50.096149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:50.096586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:50.109705 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e HTTP/1.1 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'df12ab52-ec22-456e-a897-7b61725a904e'} Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:50.111361 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance df12ab52-ec22-456e-a897-7b61725a904e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b316f1e-ca58-4503-9fc6-7757ad99fc32 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e" status: 404 len: 111 microversion: 2.1 time: 0.031204 Oct 18 14:17:50.118673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3502/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:50 2022] GET /compute/v2.1/servers/df12ab52-ec22-456e-a897-7b61725a904e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:53.529218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:53.529751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:53.537085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.539448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.539448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.539448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.539448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.539861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.554728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 HTTP/1.1 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'd521fa55-b0cb-4fce-883c-61a470f17db4'} Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:53.556316 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:53.560158 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6cafaac3-c368-4f79-a576-5937be8df105 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 404 len: 111 microversion: 2.1 time: 0.032602 Oct 18 14:17:53.561554 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3655/7157] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:53 2022] DELETE /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:53.572142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:53.572903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: d521fa55-b0cb-4fce-883c-61a470f17db4] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:53.580059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.580578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.581103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.582001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.582564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.583075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.597078 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 HTTP/1.1 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'd521fa55-b0cb-4fce-883c-61a470f17db4'} Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.598757 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance d521fa55-b0cb-4fce-883c-61a470f17db4 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e0755813-bc38-45ef-81c8-351a85cd6a78 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4" status: 404 len: 111 microversion: 2.1 time: 0.037686 Oct 18 14:17:53.602763 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3503/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:53 2022] GET /compute/v2.1/servers/d521fa55-b0cb-4fce-883c-61a470f17db4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:53.609408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:53.610090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:53.617935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.618480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.618919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.619661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.620470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.620922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.635848 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 HTTP/1.1 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c2a1ba23-574a-4613-a02c-59cb0149fc81'} Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:53.637411 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-35224848-b0d3-4395-bbd8-c2fcccbbaf5e tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 404 len: 111 microversion: 2.1 time: 0.033509 Oct 18 14:17:53.641078 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3656/7159] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:53 2022] DELETE /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:53.647665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:53.648385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: c2a1ba23-574a-4613-a02c-59cb0149fc81] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:53.654724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.655301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.655826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.656626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:53.657166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:53.657780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:53.671620 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 HTTP/1.1 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c2a1ba23-574a-4613-a02c-59cb0149fc81'} Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:53.673802 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance c2a1ba23-574a-4613-a02c-59cb0149fc81 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:53.678122 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ccec20b-c5a5-4ad5-9027-3df7893f1288 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81" status: 404 len: 111 microversion: 2.1 time: 0.032793 Oct 18 14:17:53.679124 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3504/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:53 2022] GET /compute/v2.1/servers/c2a1ba23-574a-4613-a02c-59cb0149fc81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:57.089137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:57.089676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:57.098234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:57.098745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:57.099205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:57.099921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:57.100393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:57.100835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:57.115177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 HTTP/1.1 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '473f0586-7f9a-4467-ba49-4673a02ffe53'} Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:57.116955 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4dd7d59d-2664-4d9c-811f-372a8497d8d1 tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 404 len: 111 microversion: 2.1 time: 0.033115 Oct 18 14:17:57.123751 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3657/7161] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:17:57 2022] DELETE /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:57.128971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:57.129714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] [instance: 473f0586-7f9a-4467-ba49-4673a02ffe53] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:57.137192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:57.137760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:57.138315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:57.139083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:57.139623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:57.140129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:57.154387 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] HTTP exception thrown: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Request method failure captured: Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 HTTP/1.1 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrRcGTpiUQjC-OJR5iMqML1dPRDjGS5iufNZfcoXq1zuBvMlaebTlOWF277LFfIkhxSc54ULnJVC2MCfPjZbndiV9A6jS0khHpPZcndswkqZMIBtB17KdJfUlHMqOVTrdzo5m_uqzYBfzl0RbRrXURrVxePEAXRinHymRhQXfyoiZPA Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d7ca279292a4614b7314c4546e24680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d7ca279292a4614b7314c4546e24680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 6d7ca279292a4614b7314c4546e24680 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-743029058 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 3707d5fd73034aefaa470c08814a0809 Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-AttachVolumeNegativeTest-743029058-project Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '473f0586-7f9a-4467-ba49-4673a02ffe53'} Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:57.155966 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] Returning 404 to user: Instance 473f0586-7f9a-4467-ba49-4673a02ffe53 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8ccdac2-a77d-4085-b7c2-05be0c3ce2af tempest-AttachVolumeNegativeTest-743029058 tempest-AttachVolumeNegativeTest-743029058-project] 10.222.0.27 "GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53" status: 404 len: 111 microversion: 2.1 time: 0.032658 Oct 18 14:17:57.164488 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3505/7162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:57 2022] GET /compute/v2.1/servers/473f0586-7f9a-4467-ba49-4673a02ffe53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:21:08.330396 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:21:08.331568 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:21:08.332082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:08.332827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:08.333576 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:21:08.333720 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 18 14:21:08.336067 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:21:08.336170 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 18 14:21:08.338351 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:21:08.338456 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 18 14:21:08.349154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-784067187", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "4b4bdc14-6f3b-4505-8717-f829dfd5a983"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:08.581826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] validate_networks() for [('4b4bdc14-6f3b-4505-8717-f829dfd5a983', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:21:08.936063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:21:08.939758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:21:08.939758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:21:08.939758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:21:08.939758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:21:08.947495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:08.947997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:08.948457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:08.949200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:08.949676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:08.950157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:08.967968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Getting quotas for project f09061f81e9c4850a4ec04996daa2a57. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:21:08.973203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Getting quotas for user 6cbfc2c4bddf4f979ab328d336d074a2 and project f09061f81e9c4850a4ec04996daa2a57. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:21:08.985364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:21:08.987679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:21:09.087311 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae546581-9c97-425d-ac97-62697780569e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758836 Oct 18 14:21:09.087971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3658/7163] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:21:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:21:09.097475 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:21:09.098369 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:21:09.099132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:09.099881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:09.101107 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:21:09.101257 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf (ip 10.222.0.27) !!! Oct 18 14:21:09.102780 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:21:09.102899 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf (ip 10.222.0.27) !!! Oct 18 14:21:09.108027 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:21:09.108124 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf (ip 10.222.0.27) !!! Oct 18 14:21:09.112485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13452bb1-f96e-444e-a7dd-2134e3731727 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:09.113114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13452bb1-f96e-444e-a7dd-2134e3731727 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:09.237103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13452bb1-f96e-444e-a7dd-2134e3731727 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:09.244763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13452bb1-f96e-444e-a7dd-2134e3731727 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1213 microversion: 2.1 time: 0.149410 Oct 18 14:21:09.245462 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3506/7164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:09 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:10.271597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:10.272133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:10.285067 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34050. Oct 18 14:21:10.286816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:10.287324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:10.287778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:10.288492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:10.288965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:10.289446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:10.295225 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34048. Oct 18 14:21:10.360985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:10.369624 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b2430d6-b10b-4a46-a503-9e55f5e70069 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1217 microversion: 2.1 time: 0.104742 Oct 18 14:21:10.370202 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3659/7165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:10 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:11.394004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:11.394701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:11.403785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:11.404280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:11.404727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:11.405425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:11.405893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:11.406375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:11.410986 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34056. Oct 18 14:21:11.414200 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34054. Oct 18 14:21:11.478765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:11.491440 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-13ad2678-22fc-487a-aca9-01a6e1fa1c35 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1283 microversion: 2.1 time: 0.096525 Oct 18 14:21:11.491440 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3507/7166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:11 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:12.513803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:12.514524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:12.521870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:12.522429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:12.522896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:12.523737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:12.524221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:12.524668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:12.727415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:12.735279 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8aebeeb0-7134-4068-bfb1-cf3edbebfe09 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.226174 Oct 18 14:21:12.735851 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3660/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:12 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:21:12.864312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85e55b85-d482-4e13-b031-12c098046cdf", "tag": "741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:12.875426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:12.875922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:12.876360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:12.888329 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] Creating event network-changed:741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728 for instance 85e55b85-d482-4e13-b031-12c098046cdf on n-h2-858383-13 Oct 18 14:21:12.894312 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d52df6ed-504d-427b-a46b-1382f7d21a0c req-d4264ab4-cedd-471e-ba58-39a2d9a56fa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Oct 18 14:21:12.894914 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3508/7168] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:13.759271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:13.759947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:13.767154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:13.767662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:13.768124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:13.768830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:13.769306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:13.769755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:13.898554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:13.906953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1aa7edfe-3ce6-4034-b01c-cf7e466c0c00 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.151597 Oct 18 14:21:13.907524 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3661/7169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:13 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:14.930203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:14.930943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:14.938038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:14.938611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:14.939061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:14.939788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:14.940248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:14.940683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:15.068430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:15.076194 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6776ebb1-792d-4529-abb9-77c757ea061c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.150316 Oct 18 14:21:15.076770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3509/7170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:14 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:16.099354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:16.099984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:16.106862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:16.107365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:16.107819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:16.108526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:16.108997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:16.109438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:16.243820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:16.251559 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c63d5fc3-8d55-483a-b036-eed071573193 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.156116 Oct 18 14:21:16.252186 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3662/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:16 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:17.276386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:17.277119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:17.284024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:17.285350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:17.285350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:17.285740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:17.286241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:17.286681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:17.420069 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:17.427784 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-500a24cf-d580-4dc9-938d-07842b75405b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.155928 Oct 18 14:21:17.428359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3510/7172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:17 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:18.450970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:18.451605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:18.458889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:18.459394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:18.459850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:18.460561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:18.461053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:18.461481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:18.596244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:18.603975 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66e6dc9d-2680-414f-a993-23e3c508952c tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.157392 Oct 18 14:21:18.605157 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3663/7173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:18 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:18.939091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e55b85-d482-4e13-b031-12c098046cdf", "name": "network-vif-plugged", "status": "completed", "tag": "741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:18.948924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:18.949418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:18.949867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:18.961641 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] Creating event network-vif-plugged:741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728 for instance 85e55b85-d482-4e13-b031-12c098046cdf on n-h2-858383-13 Oct 18 14:21:18.966971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7060777e-65bb-49b6-b1fb-44424d836b2c req-d00ff7ac-d681-46bf-95d1-bd4133be7557 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099429 Oct 18 14:21:18.967727 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3511/7174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:19.627171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:19.627802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:19.629798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:19.630503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:19.636551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:19.637081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:19.637538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:19.638275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:19.638752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:19.639204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:19.770086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:19.778670 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a39b6472-ac9b-4f49-9e72-752b8bfedcd7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1313 microversion: 2.1 time: 0.155411 Oct 18 14:21:19.779293 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3664/7175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:19 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:20.798820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:20.803808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:20.806340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:20.810881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:20.811378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:20.811875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:20.812580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:20.813052 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:20.813493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:20.942934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:20.950790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ed9894e-505f-4554-a83b-d6c8e20bd3c5 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1497 microversion: 2.1 time: 0.153064 Oct 18 14:21:20.952706 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3512/7176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:20 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:21.676308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:21.676855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:21.684403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:21.684934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:21.685379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:21.686158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:21.686644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:21.687097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:21.712911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:21:21.951207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba1d1318-ac4c-4f1c-8e52-a085b77405e1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 204 len: 0 microversion: 2.1 time: 0.278406 Oct 18 14:21:21.951832 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3665/7177] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:21:21 2022] DELETE /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:21:21.961352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:21.961998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:21.969046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:21.969531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:21.969976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:21.970698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:21.971159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:21.971680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:22.103529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:22.111816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4a9e0f0c-571c-4cc8-8bde-f8b917ac4086 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1503 microversion: 2.1 time: 0.154893 Oct 18 14:21:22.112402 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3513/7178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:21 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:23.137227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:23.137944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:23.144788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:23.145290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:23.145752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:23.146468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:23.146938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:23.147376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:23.280356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:23.288237 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f159b8c-ff70-4c4e-a123-8d80094cb31b tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1503 microversion: 2.1 time: 0.156315 Oct 18 14:21:23.288807 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3666/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:23 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:23.874623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85e55b85-d482-4e13-b031-12c098046cdf", "name": "network-vif-deleted", "tag": "741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:23.884858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:23.885645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:23.886093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:23.897173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] Creating event network-vif-deleted:741eefe4-a4e2-4d4b-ac0f-c7aa10cbe728 for instance 85e55b85-d482-4e13-b031-12c098046cdf on n-h2-858383-13 Oct 18 14:21:23.903058 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0d13c12c-d7c7-4c3e-808a-b6acb61586a0 req-210c3264-914f-4a21-97f9-69e991d80932 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Oct 18 14:21:23.903642 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3514/7180] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:24.311603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:24.312240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:24.319215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:24.319718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:24.320174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:24.320876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:24.321348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:24.321794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:24.353388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:24.353887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:24.354374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:24.354838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lazy-loading 'fault' on Instance uuid 85e55b85-d482-4e13-b031-12c098046cdf {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:21:24.395927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:24.404820 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8f71709-1436-401b-8472-23bb0ecc61c0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 200 len: 1303 microversion: 2.1 time: 0.097318 Oct 18 14:21:24.405388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3667/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:24 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:25.429708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:25.430437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 85e55b85-d482-4e13-b031-12c098046cdf] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:25.437177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:25.437664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:25.438158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:25.438922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:25.439385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:25.439814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:25.453790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] HTTP exception thrown: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Request method failure captured: Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf HTTP/1.1 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrZRXy6g1Mf4r3Nqr1Ziq8Oj8eLMS3BCXT9vqXlBHWsDWJKZTwK1pZa_axq1P30FJBIPgAFtNJi2_GJmEYhKQw1DCFK0bOnd0KXBJEnCx52-Wxg6oIexDqqu4CBSv2Xmx9iSmxgraWOUEUVcidySda3DMiwjZMhe8N7yOw5KixzCtNA Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: f09061f81e9c4850a4ec04996daa2a57 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-VolumesActionsTest-944998031 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-VolumesActionsTest-944998031 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: f09061f81e9c4850a4ec04996daa2a57 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-VolumesActionsTest-944998031 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-VolumesActionsTest-944998031-project Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 6cbfc2c4bddf4f979ab328d336d074a2 Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-VolumesActionsTest-944998031-project Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '85e55b85-d482-4e13-b031-12c098046cdf'} Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:21:25.455484 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Returning 404 to user: Instance 85e55b85-d482-4e13-b031-12c098046cdf could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b222bfa0-0ea3-4462-87d8-1e5ecd62e3a3 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf" status: 404 len: 111 microversion: 2.1 time: 0.032369 Oct 18 14:21:25.460577 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3515/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:25 2022] GET /compute/v2.1/servers/85e55b85-d482-4e13-b031-12c098046cdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:21:25.506071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1335767697", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "4b4bdc14-6f3b-4505-8717-f829dfd5a983"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:25.559278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] validate_networks() for [('4b4bdc14-6f3b-4505-8717-f829dfd5a983', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:21:25.905695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:21:25.906172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:21:25.906662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:21:25.907118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:21:25.907552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:21:25.916620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:25.917743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:25.918237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:25.919024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:25.919475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:25.919997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:25.937337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Getting quotas for project f09061f81e9c4850a4ec04996daa2a57. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:21:25.942603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Getting quotas for user 6cbfc2c4bddf4f979ab328d336d074a2 and project f09061f81e9c4850a4ec04996daa2a57. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:21:25.954783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:21:25.957072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:21:26.056036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-279a9a28-b504-4e38-867d-2ec61d9adfa6 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553704 Oct 18 14:21:26.056709 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3668/7183] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:21:26.068211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2042214-d4d0-408b-84bc-c4ef990fd8d2 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:26.068944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2042214-d4d0-408b-84bc-c4ef990fd8d2 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:26.130041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2042214-d4d0-408b-84bc-c4ef990fd8d2 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:26.137280 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2042214-d4d0-408b-84bc-c4ef990fd8d2 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1214 microversion: 2.1 time: 0.073406 Oct 18 14:21:26.137847 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3516/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:26 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:27.161457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:27.162218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:27.168818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:27.169322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:27.169781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:27.170517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:27.170990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:27.171451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:27.236383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:27.244107 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95a3141e-2c03-4412-968a-d1800ec7441e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1218 microversion: 2.1 time: 0.087497 Oct 18 14:21:27.244677 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3669/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:27 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:28.268102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:28.268913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:28.277580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:28.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:28.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:28.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:28.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:28.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:28.345787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:28.355686 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f4dd2413-ebbc-4512-8a74-455de194e8a0 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1274 microversion: 2.1 time: 0.091226 Oct 18 14:21:28.356231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3517/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:28 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:29.379269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:29.380083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:29.387303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:29.387879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:29.388345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:29.389056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:29.389537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:29.389989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:29.620467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:29.628362 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9ad907c-e020-4f25-9aab-2269933e2d11 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.253090 Oct 18 14:21:29.628939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3670/7187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:29 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:29.868260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2515cd22-2c29-4361-8e68-1214fb46df26", "tag": "10948611-4206-40ea-b489-a47d1718db5f"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:29.878573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:29.884050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:29.884050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:29.892053 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] Creating event network-changed:10948611-4206-40ea-b489-a47d1718db5f for instance 2515cd22-2c29-4361-8e68-1214fb46df26 on n-h2-858383-13 Oct 18 14:21:29.897235 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c1aaed31-aa2b-4cf1-b9f8-b3ce93ad4132 req-1b6981a1-0378-4009-8bb0-7d38450e9e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032569 Oct 18 14:21:29.898173 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3518/7188] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:30.654077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:30.654730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:30.661962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:30.666808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:30.666808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:30.666808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:30.666808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:30.666808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:30.800281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:30.808013 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3556f149-48b2-42a8-b472-2ee32eacf26e tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.159051 Oct 18 14:21:30.808612 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3671/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:30 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:31.832659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:31.833347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:31.840165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:31.840653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:31.841101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:31.841795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:31.842285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:31.842723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:31.971437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:31.979185 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e36b656-ba8d-4749-9322-66e85ec46b33 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.151921 Oct 18 14:21:31.979758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3519/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:31 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:33.002247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:33.002807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:33.010681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:33.011180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:33.011723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:33.012387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:33.012873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:33.013324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:33.455470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:33.463879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-84c2af27-a118-433e-b9ce-ce546d9366b7 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.465606 Oct 18 14:21:33.465032 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3672/7191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:32 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:34.487033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:34.487649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:34.494496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:34.494988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:34.495431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:34.496122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:34.496581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:34.497014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:34.626875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:34.634522 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99f39b67-433b-4029-a1cf-7253b53f2935 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.151343 Oct 18 14:21:34.635082 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3520/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:34 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:34.991947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2515cd22-2c29-4361-8e68-1214fb46df26", "name": "network-vif-plugged", "status": "completed", "tag": "10948611-4206-40ea-b489-a47d1718db5f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:35.002761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:35.003206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:35.003667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:35.015376 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] Creating event network-vif-plugged:10948611-4206-40ea-b489-a47d1718db5f for instance 2515cd22-2c29-4361-8e68-1214fb46df26 on n-h2-858383-13 Oct 18 14:21:35.020431 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cedfafb5-307c-4874-a2c4-fec4b7330856 req-1f695b62-959d-428e-8b9b-fdf793106570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Oct 18 14:21:35.021017 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3673/7193] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:35.657145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:35.657868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:35.664701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:35.665201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:35.665651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:35.666392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:35.666867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:35.667828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:35.797514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:35.805522 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9762143-7047-47af-a50f-cb040829af96 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1314 microversion: 2.1 time: 0.152382 Oct 18 14:21:35.807836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3521/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:35 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:36.826729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:36.827461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:36.832422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:36.833154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:36.839418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:36.839925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:36.840387 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:36.841102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:36.841581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:36.842032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:36.861710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:36.976296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:36.984486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c96d4883-0502-475e-b41a-96e5a3404ad1 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1497 microversion: 2.1 time: 0.158814 Oct 18 14:21:36.985054 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3674/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:36 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:37.638693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:37.639217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:37.641165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:37.646957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:37.647448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:37.654182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:37.654182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:37.654182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:37.654182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:37.678527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:21:37.882041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3fbcf62-329d-4292-b143-a1036ea12e98 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 204 len: 0 microversion: 2.1 time: 0.247807 Oct 18 14:21:37.882676 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3522/7196] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:21:37 2022] DELETE /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:21:37.891800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:37.893154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:37.900875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:37.901377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:37.901877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:37.902617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:37.903089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:37.903532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:38.032817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:38.040622 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ea758b4-c321-4d38-949a-cfbe3a5c3cac tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1503 microversion: 2.1 time: 0.153348 Oct 18 14:21:38.041188 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3675/7197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:37 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:21:39.064970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:39.065714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:39.072637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:39.073132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:39.073577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:39.074308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:39.074772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:39.075208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:39.205427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:39.207762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:39.214012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3b96ddf3-358f-41d5-83df-47c1dcb3b436 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1503 microversion: 2.1 time: 0.153476 Oct 18 14:21:39.220510 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3523/7198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:39 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:39.869614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2515cd22-2c29-4361-8e68-1214fb46df26", "name": "network-vif-deleted", "tag": "10948611-4206-40ea-b489-a47d1718db5f"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:39.875151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:39.884581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:39.885089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:39.885844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:39.897153 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] Creating event network-vif-deleted:10948611-4206-40ea-b489-a47d1718db5f for instance 2515cd22-2c29-4361-8e68-1214fb46df26 on n-h2-858383-13 Oct 18 14:21:39.902209 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-81b77863-27dc-4467-89dc-d42a2c2ea393 req-a6acaccb-a6b2-48a8-919e-daa03db1684e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104461 Oct 18 14:21:39.902812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3676/7199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:40.239443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:40.240086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:40.242834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:40.248962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:40.249466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:40.251751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:40.251751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:40.251751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:40.251751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:40.284951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:40.285476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:40.285905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:40.286467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lazy-loading 'fault' on Instance uuid 2515cd22-2c29-4361-8e68-1214fb46df26 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:21:40.330336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbfc2c4bddf4f979ab328d336d074a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09061f81e9c4850a4ec04996daa2a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:40.338821 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18e0462e-a595-409f-a03b-d28647795785 tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 200 len: 1304 microversion: 2.1 time: 0.104856 Oct 18 14:21:40.339899 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3524/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:40 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:41.363934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:41.364678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] [instance: 2515cd22-2c29-4361-8e68-1214fb46df26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:41.371411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:41.371906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:41.372358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:41.373055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:41.373527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:41.373970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:41.388295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] HTTP exception thrown: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Request method failure captured: Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 HTTP/1.1 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrZRXy6g1Mf4r3Nqr1Ziq8Oj8eLMS3BCXT9vqXlBHWsDWJKZTwK1pZa_axq1P30FJBIPgAFtNJi2_GJmEYhKQw1DCFK0bOnd0KXBJEnCx52-Wxg6oIexDqqu4CBSv2Xmx9iSmxgraWOUEUVcidySda3DMiwjZMhe8N7yOw5KixzCtNA Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f09061f81e9c4850a4ec04996daa2a57 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesActionsTest-944998031 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f09061f81e9c4850a4ec04996daa2a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-VolumesActionsTest-944998031 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f09061f81e9c4850a4ec04996daa2a57 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesActionsTest-944998031 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-VolumesActionsTest-944998031-project Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 6cbfc2c4bddf4f979ab328d336d074a2 Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-VolumesActionsTest-944998031-project Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '2515cd22-2c29-4361-8e68-1214fb46df26'} Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:21:41.389911 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] Returning 404 to user: Instance 2515cd22-2c29-4361-8e68-1214fb46df26 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ac21c49-c8f4-47e0-9494-30c90b0415cd tempest-VolumesActionsTest-944998031 tempest-VolumesActionsTest-944998031-project] 10.222.0.27 "GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26" status: 404 len: 111 microversion: 2.1 time: 0.032725 Oct 18 14:21:41.394480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3677/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:41 2022] GET /compute/v2.1/servers/2515cd22-2c29-4361-8e68-1214fb46df26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:22:31.295328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:31.296084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=9 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:31.484436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-173dd458-cc57-41b4-8bce-20df6d26deac tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1228173490", "availability_zone": "foo_zone"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:31.488108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.aggregate [None req-173dd458-cc57-41b4-8bce-20df6d26deac tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Generated uuid 536349b9-dc70-4da1-963e-3bceb75e2636 for aggregate {{(pid=121009) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 14:22:31.559929 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-173dd458-cc57-41b4-8bce-20df6d26deac tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.268202 Oct 18 14:22:31.561163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3525/7202] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Oct 18 14:22:31 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:31.572259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c76b9203-c8cf-42e1-8dc0-23c560a7a096 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:31.577669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:31.662110 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c76b9203-c8cf-42e1-8dc0-23c560a7a096 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.093637 Oct 18 14:22:31.669371 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3678/7203] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 14:22:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:31.675017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:31.678762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:31.679253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:31.679708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:31.680448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:31.680915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:31.681362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:31.707156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5dab2d00-01ec-4f75-a30e-50831a44e76a tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035853 Oct 18 14:22:31.707777 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3526/7204] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Oct 18 14:22:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:31.719643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-855bb215-5521-48a6-a774-6e635c87b314 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:31.728357 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-855bb215-5521-48a6-a774-6e635c87b314 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012790 Oct 18 14:22:31.728898 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3679/7205] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 14:22:31 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:31.740925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d30ca32a-433a-42e5-bf28-843890c85425 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-13"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:31.752210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d30ca32a-433a-42e5-bf28-843890c85425 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:31.752694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d30ca32a-433a-42e5-bf28-843890c85425 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:31.753144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d30ca32a-433a-42e5-bf28-843890c85425 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:32.152114 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d30ca32a-433a-42e5-bf28-843890c85425 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.414770 Oct 18 14:22:32.152854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3527/7206] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 14:22:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:22:32.167820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-58a6fecc-d402-4c68-9d14-b0c2a7c4e780 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:32.175394 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-58a6fecc-d402-4c68-9d14-b0c2a7c4e780 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.013999 Oct 18 14:22:32.175941 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3680/7207] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 14:22:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:32.188481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-77180ab4-b516-4978-9a89-93da6ad87aed tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1761704137", "availability_zone": "foo_zone"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:32.299767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-77180ab4-b516-4978-9a89-93da6ad87aed tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.115668 Oct 18 14:22:32.300754 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3528/7208] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Oct 18 14:22:32 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:22:32.312260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ef9024e-7c41-43d5-a50e-55c56f5c7ced tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:32.393874 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ef9024e-7c41-43d5-a50e-55c56f5c7ced tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.085527 Oct 18 14:22:32.401290 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3681/7209] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 14:22:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:32.407082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1591f2ce-f7ba-4089-a676-6967c578e5b5 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:32.415914 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1591f2ce-f7ba-4089-a676-6967c578e5b5 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.013314 Oct 18 14:22:32.416591 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3529/7210] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 14:22:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:22:32.431133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee3c7dc6-2a6d-4bc6-b916-732e5fe6b953 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-13"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:32.443915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee3c7dc6-2a6d-4bc6-b916-732e5fe6b953 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:32.444534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee3c7dc6-2a6d-4bc6-b916-732e5fe6b953 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:32.445039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee3c7dc6-2a6d-4bc6-b916-732e5fe6b953 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:32.756661 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee3c7dc6-2a6d-4bc6-b916-732e5fe6b953 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.329446 Oct 18 14:22:32.757583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3682/7211] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Oct 18 14:22:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:32.769477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3215f72e-2247-4ac3-8c08-9b0472919334 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:32.867421 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3215f72e-2247-4ac3-8c08-9b0472919334 tempest-TestAggregatesBasicOps-1066767837 tempest-TestAggregatesBasicOps-1066767837-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.101637 Oct 18 14:22:32.868146 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3530/7212] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 14:22:32 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 14:22:59.749403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:59.750746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:59.900806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-903197540", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:00.090200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] validate_networks() for None {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:23:00.367391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:23:00.367848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:23:00.368342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:23:00.368770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:23:00.369203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:23:00.379261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:00.379932 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:00.381186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:00.381186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:00.381658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:00.382501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:00.404222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Getting quotas for project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:00.407431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Getting quotas for user 7c219aa3af75469396c9d7018a0bf062 and project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:00.420135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:23:00.422524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:23:00.516438 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b20adc02-6c8c-469f-a24a-f965a62d6975 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768689 Oct 18 14:23:00.520204 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3683/7213] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:23:00.528634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:00.529484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:00.530234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:00.546223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c72bbf7-9e99-4ba0-bccb-a03dd988c1b4 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:00.546658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c72bbf7-9e99-4ba0-bccb-a03dd988c1b4 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:00.747761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c72bbf7-9e99-4ba0-bccb-a03dd988c1b4 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:00.756090 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c72bbf7-9e99-4ba0-bccb-a03dd988c1b4 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1221 microversion: 2.1 time: 0.229259 Oct 18 14:23:00.756657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3531/7214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:00 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:01.780733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.781294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.788529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.789050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.789518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.790271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.790762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.791355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.857341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:01.865805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-583a5aed-f6ab-428a-96d2-b4b7232d88ab tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1225 microversion: 2.1 time: 0.089999 Oct 18 14:23:01.866401 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3684/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:01 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:02.889170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:02.889937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:02.897506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:02.898045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:02.898570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:02.899214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:02.899683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:02.900148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:02.971908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:02.979912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aceefdf2-7f5b-4181-b0f4-f43e42ea4fbd tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1279 microversion: 2.1 time: 0.094951 Oct 18 14:23:02.980489 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3532/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:02 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:04.012250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:04.012901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:04.020127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.020811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.021288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:04.022018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.022559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.023017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:04.271744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:04.279709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-efbb17f8-11ba-49a4-ba7f-fb63a2757258 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.271577 Oct 18 14:23:04.280381 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3685/7217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:04 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:04.978830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57", "tag": "4cce83bd-24d2-456a-b97d-2739b0e2a2bb"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:04.988451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.989018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.989624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:05.000818 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] Creating event network-changed:4cce83bd-24d2-456a-b97d-2739b0e2a2bb for instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 on n-h2-858383-13 Oct 18 14:23:05.006937 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-87e50192-1019-404b-b420-60ca57c56fa5 req-8c9fbda4-d58f-4ef6-8d70-5b24335b5b51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088759 Oct 18 14:23:05.007645 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3533/7218] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:05.303917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:05.304553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:05.311369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:05.311880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:05.312346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:05.313065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:05.313548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:05.313998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:05.454940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:05.462577 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60ec3ecf-6f47-40a1-9051-0a2c7df7124c tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.163019 Oct 18 14:23:05.463360 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3686/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:05 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:06.486177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:06.486996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:06.493276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:06.493841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:06.494410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:06.495174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:06.495709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:06.496238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:06.635718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:06.643824 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0eea6b5a-7555-4af2-af7c-60bf1ba7812f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.162777 Oct 18 14:23:06.645048 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3534/7220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:06 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:07.673390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:07.674031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:07.682951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:07.683468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:07.683936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:07.684658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:07.685143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:07.685601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:07.817878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:07.825728 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e14ad57a-9238-44b7-9d75-0b5353d5c844 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.156335 Oct 18 14:23:07.826361 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3687/7221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:07 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:08.849422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:08.849956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:08.856852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:08.857344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:08.857791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:08.858519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:08.858990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:08.859440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:08.987520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:08.995204 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c215104-9fbb-41cf-9848-417c3e3dae66 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.150288 Oct 18 14:23:08.995773 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3535/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:08 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:10.018067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:10.018702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:10.025546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.026046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.026533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.027243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.027713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.028155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.156684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:10.164430 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-74361f03-49fc-430a-92f8-fb5300613fc3 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.150366 Oct 18 14:23:10.164994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3688/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:10 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:11.187110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:11.187727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:11.190680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:11.198932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:11.206171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:11.206171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:11.206171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:11.206171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:11.206171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:11.335957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:11.343788 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fd1224f6-cb3d-446f-9d8b-2cf933a09529 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.160587 Oct 18 14:23:11.344492 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3536/7224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:11 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:11.418431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:11.419209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:11.474214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57", "name": "network-vif-plugged", "status": "completed", "tag": "4cce83bd-24d2-456a-b97d-2739b0e2a2bb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:11.484028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:11.484525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:11.484979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:11.496567 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] Creating event network-vif-plugged:4cce83bd-24d2-456a-b97d-2739b0e2a2bb for instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 on n-h2-858383-13 Oct 18 14:23:11.501545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-50eefc2b-b55c-4b6a-832d-b749d1288c9a req-f897ad17-e74b-413a-838d-fcc4674527f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088062 Oct 18 14:23:11.502154 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3689/7225] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:12.366676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:12.367328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:12.373572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:12.374075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:12.374538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:12.375222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:12.375684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:12.376116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:12.507651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:12.515757 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8cef4274-56d2-454e-9c14-1d5d4f5f749f tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1321 microversion: 2.1 time: 0.152984 Oct 18 14:23:12.516327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3537/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:12 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:13.541826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.542574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.548837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.549347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.549813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.550562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.551050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.551520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.691261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:13.699034 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dc162de-ddc6-470e-ba44-490ddacc0b24 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1470 microversion: 2.1 time: 0.162403 Oct 18 14:23:13.699603 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3690/7227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:13.773054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7cfde7b4-a3b3-45bb-b1b6-97732781d7b2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '.version_select at 0x7fb33048f940>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.838370 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7cfde7b4-a3b3-45bb-b1b6-97732781d7b2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f4bb711cf2324436bc577ad89e58201f" status: 200 len: 371 microversion: 2.1 time: 0.118290 Oct 18 14:23:13.838939 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3538/7228] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/os-quota-sets/f4bb711cf2324436bc577ad89e58201f => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:13.850998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0aedf8ea-5bc9-4b30-bf76-058ef463f233 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-56517433", "id": 627430100, "os-flavor-access:is_public": "True"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:13.907940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0aedf8ea-5bc9-4b30-bf76-058ef463f233 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.060636 Oct 18 14:23:13.908534 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3691/7229] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:23:13 2022] POST /compute/v2.1/flavors => generated 433 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:23:13.921164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "627430100"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:13.923674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.929661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.930188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.930638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.936642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.936642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.936642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.094702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '86d1cd9202154823a87f177106ca1ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb711cf2324436bc577ad89e58201f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:14.100860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-56517433 {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:23:14.107733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.108229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.108673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.109419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.109882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.110353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.133610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Getting quotas for project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:14.138879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Getting quotas for user 7c219aa3af75469396c9d7018a0bf062 and project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:14.151582 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.compute.api [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] ram quota exceeded for f4bb711cf2324436bc577ad89e58201f, tried to resize instance. Oct 18 14:23:14.152401 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Request method failure captured: Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action HTTP/1.1 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 38 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrbDvX_aIld0-Nfq6aTD5-5maYCiDARHTb92LziskhmT5va2EW_O9-9KddWUIgozk4eM6zaDKENhEi5KEcUEMpbNY5fVaqdhhCE-qRzqe4IKAQ88cNAyq6zXTowE-hlT4sF5hBbeX6IDmlJWza9VnhI10PR9ynnBXy8qS-ZqRPiWyZA Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: f4bb711cf2324436bc577ad89e58201f Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Role: reader,member,admin Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: reader,member,admin Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: f4bb711cf2324436bc577ad89e58201f Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersAdminNegativeTestJSON-269557122-project-admin Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 86d1cd9202154823a87f177106ca1ee7 Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersAdminNegativeTestJSON-269557122-project-admin Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: {"resize": {"flavorRef": "627430100"}} Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57', 'body': {'resize': {'flavorRef': '627430100'}}} Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.164998 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f2a04c45-aaa6-4909-9598-de35c81a5726 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action" status: 403 len: 118 microversion: 2.1 time: 0.249282 Oct 18 14:23:14.170227 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3539/7230] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:13 2022] POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action => generated 118 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:14.176077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69df4601-153a-4387-9a14-cbe1c82a01ee tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.251179 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69df4601-153a-4387-9a14-cbe1c82a01ee tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/627430100" status: 202 len: 0 microversion: 2.1 time: 0.079286 Oct 18 14:23:14.251795 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3692/7231] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 14:23:14 2022] DELETE /compute/v2.1/flavors/627430100 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:23:14.263792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f57aa13-5459-4c4e-b95a-ae63dbb14fc7 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.284761 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f57aa13-5459-4c4e-b95a-ae63dbb14fc7 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024983 Oct 18 14:23:14.285334 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3540/7232] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 14:23:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:14.306187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5664e2a-8789-4b71-8632-cd26325e737b tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '.version_select at 0x7fb330392dc0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.375198 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5664e2a-8789-4b71-8632-cd26325e737b tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f4bb711cf2324436bc577ad89e58201f" status: 200 len: 371 microversion: 2.1 time: 0.072752 Oct 18 14:23:14.375762 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3693/7233] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 14:23:14 2022] GET /compute/v2.1/os-quota-sets/f4bb711cf2324436bc577ad89e58201f => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:14.388375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cddae56c-b7ab-43ae-b00d-4f0af87683af tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-441223162", "id": 772183323, "os-flavor-access:is_public": "True"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:14.450835 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cddae56c-b7ab-43ae-b00d-4f0af87683af tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.066363 Oct 18 14:23:14.451437 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3541/7234] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:23:14 2022] POST /compute/v2.1/flavors => generated 433 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:14.465914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "772183323"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:14.468317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:14.475957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.476463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.476921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.477629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.478128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.478571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.638929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '86d1cd9202154823a87f177106ca1ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bb711cf2324436bc577ad89e58201f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:14.645126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-441223162 {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:23:14.651804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.652307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.652763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.653505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.653978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.654449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.677852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Getting quotas for project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:14.682907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Getting quotas for user 7c219aa3af75469396c9d7018a0bf062 and project bbd3fe6e57dd48a1ae7001cd48714739. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:14.694953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] cores quota exceeded for f4bb711cf2324436bc577ad89e58201f, tried to resize instance. Oct 18 14:23:14.695500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Request method failure captured: Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action HTTP/1.1 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 38 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrbDvX_aIld0-Nfq6aTD5-5maYCiDARHTb92LziskhmT5va2EW_O9-9KddWUIgozk4eM6zaDKENhEi5KEcUEMpbNY5fVaqdhhCE-qRzqe4IKAQ88cNAyq6zXTowE-hlT4sF5hBbeX6IDmlJWza9VnhI10PR9ynnBXy8qS-ZqRPiWyZA Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: f4bb711cf2324436bc577ad89e58201f Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Role: reader,member,admin Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: reader,member,admin Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4bb711cf2324436bc577ad89e58201f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: f4bb711cf2324436bc577ad89e58201f Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-269557122 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminNegativeTestJSON-269557122-project-admin Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 86d1cd9202154823a87f177106ca1ee7 Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminNegativeTestJSON-269557122-project-admin Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: {"resize": {"flavorRef": "772183323"}} Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57', 'body': {'resize': {'flavorRef': '772183323'}}} Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.697580 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56d3c1ef-19ba-4c55-ba9f-551a283bc51a tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action" status: 403 len: 113 microversion: 2.1 time: 0.237206 Oct 18 14:23:14.701879 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3694/7235] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:14 2022] POST /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57/action => generated 113 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:14.708105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0277a69a-6360-426f-b7c3-9ea18b631b73 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.776343 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0277a69a-6360-426f-b7c3-9ea18b631b73 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/772183323" status: 202 len: 0 microversion: 2.1 time: 0.072087 Oct 18 14:23:14.776951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3542/7236] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 14:23:14 2022] DELETE /compute/v2.1/flavors/772183323 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:23:14.784868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8793a15d-1967-4445-acfb-970d4e97c420 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.808854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8793a15d-1967-4445-acfb-970d4e97c420 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027475 Oct 18 14:23:14.809344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3695/7237] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 14:23:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:14.833570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:14.834145 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:14.840827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.841329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.841781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.842519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:14.842988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:14.843434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:14.867665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:23:15.165495 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db61787d-82b1-475d-8fa9-7e7acc8e50f5 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 204 len: 0 microversion: 2.1 time: 0.336205 Oct 18 14:23:15.166155 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3543/7238] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:14 2022] DELETE /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:23:15.174390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:15.175042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:15.181620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:15.182149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:15.182603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:15.183316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:15.183770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:15.184210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:15.318350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:15.326028 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26f9fb94-3876-425a-9ce4-374b69d7ecb1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1476 microversion: 2.1 time: 0.155600 Oct 18 14:23:15.326610 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3696/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:15 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:16.350096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:16.350811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:16.357673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:16.358186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:16.358642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:16.359335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:16.359806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:16.360237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:16.497003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:16.504874 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2bba8063-bf08-4eb0-a8fb-10f4e058d1d1 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1476 microversion: 2.1 time: 0.159621 Oct 18 14:23:16.505447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3544/7240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:16 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:17.103545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57", "name": "network-vif-deleted", "tag": "4cce83bd-24d2-456a-b97d-2739b0e2a2bb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:17.115229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:17.115736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:17.116194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:17.128244 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] Creating event network-vif-deleted:4cce83bd-24d2-456a-b97d-2739b0e2a2bb for instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 on n-h2-858383-13 Oct 18 14:23:17.134144 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0405e839-b2b7-4b60-aa01-440b45a68d2c req-a173b24f-3cff-4f72-b54d-bb00cd6e41a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Oct 18 14:23:17.134749 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3697/7241] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:17.528720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:17.529333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:17.536799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:17.537300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:17.537750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:17.538496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:17.538963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:17.539408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:17.571345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:17.571879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:17.572420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:17.573061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lazy-loading 'fault' on Instance uuid ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:23:17.614693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c219aa3af75469396c9d7018a0bf062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd3fe6e57dd48a1ae7001cd48714739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:17.622361 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38dd5e0c-a8d3-4947-b2b8-0104d3b19334 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 200 len: 1311 microversion: 2.1 time: 0.097561 Oct 18 14:23:17.622934 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3545/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:17 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:18.646995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:18.647752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] [instance: ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:18.653934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:18.654474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:18.654940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:18.655653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:18.656138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:18.656591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:18.669818 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] HTTP exception thrown: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Request method failure captured: Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 HTTP/1.1 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrbC34RpzQZsGhdajwVYsAY-w7fNPSAbOPBNkqzURXpHKXQ8jhhb3f_8ysXvH4hVQAVReXTFp-no90WW59Cd7yJiz_DSHCcJP9WXPpTb0Ou6f2fbg7QT0rmga0Kyduq7VxEpzov5xWypusMQVA59ZK5WYwvSTvAEE_r7m5Mvnj3eh-s Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: bbd3fe6e57dd48a1ae7001cd48714739 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-825969987 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bbd3fe6e57dd48a1ae7001cd48714739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bbd3fe6e57dd48a1ae7001cd48714739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bbd3fe6e57dd48a1ae7001cd48714739"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bbd3fe6e57dd48a1ae7001cd48714739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersAdminNegativeTestJSON-825969987 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: bbd3fe6e57dd48a1ae7001cd48714739 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-825969987 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersAdminNegativeTestJSON-825969987-project Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7c219aa3af75469396c9d7018a0bf062 Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersAdminNegativeTestJSON-825969987-project Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57'} Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:18.671479 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] Returning 404 to user: Instance ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e536e21c-4cad-419b-ac3f-95f3cb006536 tempest-ServersAdminNegativeTestJSON-825969987 tempest-ServersAdminNegativeTestJSON-825969987-project] 10.222.0.27 "GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57" status: 404 len: 111 microversion: 2.1 time: 0.031872 Oct 18 14:23:18.676672 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3698/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:18 2022] GET /compute/v2.1/servers/ead9ed37-2911-46c2-bb3b-0f0bc9ac8d57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:26.856665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:26.857531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:26.972493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1485615725", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "227f6e1f-b862-4544-97bb-d2ef7dac6e6f"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:27.029653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] validate_networks() for [('227f6e1f-b862-4544-97bb-d2ef7dac6e6f', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:23:27.413036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:23:27.413463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:23:27.413939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:23:27.414393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:23:27.414807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:23:27.423932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:27.424424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:27.424868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:27.425591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:27.426152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:27.426510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:27.444406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Getting quotas for project 4a777d3dbab447a7931482286b7304fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:27.449821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Getting quotas for user 7d5ff5333e314722bd805995ff846b9e and project 4a777d3dbab447a7931482286b7304fb. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:27.463472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:23:27.465927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:23:27.608438 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f8879eb3-51ed-4f9b-acea-29dd177ead2e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757291 Oct 18 14:23:27.609139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3546/7244] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:23:27.620501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3780cd00-d2e5-44ff-8f2a-68f0ac3432be tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:27.621131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3780cd00-d2e5-44ff-8f2a-68f0ac3432be tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:27.624421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:27.625201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:27.684732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3780cd00-d2e5-44ff-8f2a-68f0ac3432be tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:27.692196 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3780cd00-d2e5-44ff-8f2a-68f0ac3432be tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1215 microversion: 2.1 time: 0.075599 Oct 18 14:23:27.692785 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3699/7245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:27 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:28.717412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:28.722945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:28.729016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:28.729513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:28.729956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:28.730876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:28.731337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:28.731777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:28.795305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:28.803829 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-62e1d9c1-938e-4a20-b40a-c4b7adbad48f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1219 microversion: 2.1 time: 0.091274 Oct 18 14:23:28.804398 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3547/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:28 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:29.834452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:29.835654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:29.842078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=63 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:29.847846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:29.848430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:29.848959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:29.849700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:29.850216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:29.850734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:29.935763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:29.950789 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9a81205-ee70-4bba-acbf-61f7fca2be99 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1275 microversion: 2.1 time: 0.124745 Oct 18 14:23:29.954113 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3700/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:29 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:30.975398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:30.975926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:30.978605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:30.983398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:30.983888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:30.984332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:30.985028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:30.985487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:30.985917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:30.990087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:31.118266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:31.126622 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff12b92c-ba58-4d69-87fa-1b5e02ed2b57 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.155836 Oct 18 14:23:31.127196 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3548/7248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:30 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:31.446557 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:31.457663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:31.463070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:31.463703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:31.464221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:31.476046 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] Creating event network-changed:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h2-858383-13 Oct 18 14:23:31.481015 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-603b1e5d-b850-4b40-b8d0-6116ecee4421 req-f50aab66-1628-4432-a694-f7248506e138 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038806 Oct 18 14:23:31.481968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3701/7249] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:32.152118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:32.152673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:32.161613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:32.162248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:32.162772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:32.163768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:32.165112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:32.165637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:32.303625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:32.312816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4878cd8b-8106-4316-945b-4b964c454bd5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.165045 Oct 18 14:23:32.313403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3549/7250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:32 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:33.337386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:33.338135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:33.345245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:33.345761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:33.346252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:33.350721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:33.350721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:33.350721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:33.484039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:33.492592 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fa3c882-e809-4af3-a950-52c7fd2c946e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.160356 Oct 18 14:23:33.493171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3702/7251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:33 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:34.515718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:34.516344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:34.523544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:34.524044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:34.524535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:34.525272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:34.525742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:34.526218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:34.654782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:34.662618 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f45f2fb-4d26-4f0c-b9ca-66d9f90d88db tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.150837 Oct 18 14:23:34.663192 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3550/7252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:34 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:35.686899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:35.687529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:35.695446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.695997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.696463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.697180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.697684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.698167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.827684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:35.836212 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ad2e83c-5458-408f-b209-2dc5dc233744 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.153481 Oct 18 14:23:35.837192 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3703/7253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:35 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:36.859481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:36.860156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:36.866961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:36.867454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:36.872095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:36.872095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:36.872095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:36.872095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:36.995217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:37.002945 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0e2de51-56c5-42c1-b83a-b7bebd2851d0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.147411 Oct 18 14:23:37.003523 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3551/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:36 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:37.512447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "name": "network-vif-plugged", "status": "completed", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:37.523501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:37.524006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:37.524463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:37.535431 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] Creating event network-vif-plugged:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h2-858383-13 Oct 18 14:23:37.540940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-72ea5524-0469-450a-a6cb-45610122d785 req-1f2d7c49-cb7e-4d97-a90d-b893d353bfde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032617 Oct 18 14:23:37.541533 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3704/7255] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:38.027494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:38.028070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:38.029956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:38.030708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:38.036732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:38.037231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:38.037754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:38.038465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:38.038934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:38.039420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:38.174763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:38.182967 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8900fa7c-076f-488f-b836-69c87e1e0167 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1315 microversion: 2.1 time: 0.159560 Oct 18 14:23:38.183557 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3552/7256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:38 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:39.204123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:39.209849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:39.210589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:39.216770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.217274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.217728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.218457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.218933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.219379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.350367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:39.358149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-98c1785a-65ea-4353-b366-a1e94dbfe67b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1503 microversion: 2.1 time: 0.155091 Oct 18 14:23:39.358727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3705/7257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:39 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:39.381123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:39.383572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:39.390932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.391416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.391862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.392561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.393001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.393429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.421856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:39.427247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Old instance type m1.heat2, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:23:39.433551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:23:39.433976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:23:39.434487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:23:39.435161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:23:39.435578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:23:39.620596 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc602d76-70b1-4bc5-b849-b00d65503b59 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "POST /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017/action" status: 202 len: 0 microversion: 2.1 time: 0.243961 Oct 18 14:23:39.621231 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3553/7258] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:39 2022] POST /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:23:39.629512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:39.630753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:39.636982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.637719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.638319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.638948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.639428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.639875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.770678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:39.778626 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b8589f1-2a84-448a-ba42-9253867eb913 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1512 microversion: 2.1 time: 0.153114 Oct 18 14:23:39.779442 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3706/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:39 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:40.802175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:40.802849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:40.810609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:40.811097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:40.811543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:40.812242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:40.812709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:40.813152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:40.945695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:40.954635 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef0ec753-2986-4600-a598-bf520a70b194 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1512 microversion: 2.1 time: 0.156411 Oct 18 14:23:40.957072 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3554/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:40 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:41.981753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:41.982329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:41.988716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:41.989223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:41.989681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:41.990421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:41.990899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:41.991351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:42.119125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:42.126876 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-736f99b0-9723-4f98-949d-eac6e56ca97d tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1512 microversion: 2.1 time: 0.149182 Oct 18 14:23:42.127479 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3707/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:41 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:43.150582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:43.151203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:43.157164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:43.157650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:43.158115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:43.158811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:43.159277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:43.159707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:43.298011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:43.305818 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea6ee160-c9f2-421d-aa42-1cd1a49cdab6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1512 microversion: 2.1 time: 0.159508 Oct 18 14:23:43.306420 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3555/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:43 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:44.328886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:44.329515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:44.336383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:44.336880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:44.337347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:44.338039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:44.338536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:44.338979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:44.472749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:44.481296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a318d5a-a84a-4bfe-8e08-0582d6f01189 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.156342 Oct 18 14:23:44.481931 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3708/7263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:44 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:45.505260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:45.505874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:45.513548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:45.514039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:45.514504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:45.515189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:45.515652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:45.516081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:45.644959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:45.653216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9f3fc11b-96a8-40c2-8a80-81c46613b96f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.151819 Oct 18 14:23:45.653998 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3556/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:45 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:46.677038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:46.677662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:46.685162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.685656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.686143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.686848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.687320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.687760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.817884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:46.825779 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47445140-ed01-45b8-927f-03f6b2392bdb tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152661 Oct 18 14:23:46.826391 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3709/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:46 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:47.849637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:47.850759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:47.857651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:47.858175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:47.858617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:47.859303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:47.859763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:47.860194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:47.990013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:47.997703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-babb05b2-a68d-4f4b-b5e2-206cf8b15d3f tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152112 Oct 18 14:23:47.998303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3557/7266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:47 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:49.021555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.022892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.029770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.030313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.030781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.031489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.031968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.032420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.161325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.169915 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe929920-0407-4e30-8e0f-c1df3f222885 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152298 Oct 18 14:23:49.170518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3710/7267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:50.192789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:50.193414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:50.200995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.201491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.201948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.202678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.203148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.203610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.333414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:50.341215 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1ee9c4e-01d6-483c-8a17-86c082a3b4b7 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152386 Oct 18 14:23:50.341791 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3558/7268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:50 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:51.364262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:51.364893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:51.372481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:51.372984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:51.373438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:51.374167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:51.374643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:51.375087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:51.514672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:51.525846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cffa8bb1-8d38-4445-80fe-70b8d5658098 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.165218 Oct 18 14:23:51.526496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3711/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:51 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:52.553080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:52.553702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:52.562803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:52.563293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:52.563735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:52.564426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:52.564889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:52.565321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:52.693561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:52.701470 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fbcc9b0-04ed-44d4-8fed-7775dc881f1e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152265 Oct 18 14:23:52.702045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3559/7270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:52 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:53.724345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:53.724885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:53.732437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:53.732952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:53.733412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:53.734389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:53.734621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:53.735072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:53.867614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:53.875427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8bf9301a-3dcc-4b10-8c00-294189a44d1c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.155109 Oct 18 14:23:53.876010 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3712/7271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:53 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:54.898961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:54.899593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:54.906489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:54.906987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:54.907446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:54.908151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:54.908617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:54.909083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:55.042636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:55.050575 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5cd7827a-1631-4d3e-a84c-69bfd4921094 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.155545 Oct 18 14:23:55.051140 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3560/7272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:54 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:56.075955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:56.076598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:56.090918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:56.091432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:56.091895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:56.092654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:56.093134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:56.093579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:56.226862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:56.234614 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0785cc52-eda1-49ba-aaa3-6a2db13d863c tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.163968 Oct 18 14:23:56.235182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3713/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:56 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:57.258150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:57.258773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:57.268959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:57.269455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:57.269904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:57.270624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:57.271090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:57.271527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:57.398746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:57.407179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c9959c24-1b21-4f93-9021-637c3c866cd8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.152976 Oct 18 14:23:57.407755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3561/7274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:57 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:58.430312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:58.431338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:58.438281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:58.438782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:58.439236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:58.439938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:58.440410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:58.440852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:58.574169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:58.582076 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4579294-41f8-4351-9d01-69c337477ae5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.155696 Oct 18 14:23:58.582652 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3714/7275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:58 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:59.606869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:59.607406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:59.616624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:59.617120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:59.617575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:59.618993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:59.619458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:59.619899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:59.755268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:59.763581 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8f24c600-b5d1-4e13-b2e7-8c0eadef703e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.161357 Oct 18 14:23:59.764359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3562/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:59 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:00.787868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:00.814004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=83 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:00.935128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:00.942884 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60ddc5c7-5a6b-44e4-a0c8-b62ceb1068c3 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.158996 Oct 18 14:24:00.943451 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3715/7277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:00 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:01.966403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:01.967020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:01.975063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:01.975556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:01.975996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:01.976683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:01.977140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:01.978197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:01.992626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:02.108547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:02.116254 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c84fc046-6d6f-45f0-9c3c-ccd3ab9aa5f2 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.154286 Oct 18 14:24:02.116823 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3563/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:01 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:03.141109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:03.141735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:03.148749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:03.149250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:03.150796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:03.151553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:03.152168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:03.152691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:03.296031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:03.303821 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3ff97fc-5658-409d-bcf0-c9b437eb8c7b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.166672 Oct 18 14:24:03.304400 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3716/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:03 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:04.331808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:04.332425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:04.335421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:04.340695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:04.344141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:04.344141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:04.344141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:04.344141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:04.344141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:04.479390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:04.487124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6f8417d-f5a9-4185-86f5-498ee089a49e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.159321 Oct 18 14:24:04.487707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3564/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:04 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:05.509288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:05.509920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:05.513001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=32 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:05.517783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:05.518323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:05.518783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:05.519487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:05.519962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:05.520403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:05.654365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:05.662185 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7267cc48-66a1-4e01-8cfb-ecf354d9f8ba tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.156722 Oct 18 14:24:05.662759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3717/7281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:05 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:06.685854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:06.686505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:06.693549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:06.694068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:06.694526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:06.695227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:06.695689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:06.696124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:07.132812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:07.141534 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c71c4c87-fcc6-44a2-9d55-86e19d03276e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.459552 Oct 18 14:24:07.142123 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3565/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:06 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:08.165934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:08.166612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:08.173641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:08.174180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:08.174643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:08.175386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:08.175859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:08.176334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:08.331306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:08.339611 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c746a64a-6c7d-4f9f-9d5b-224ce634d037 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.178303 Oct 18 14:24:08.340199 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3718/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:08 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:09.362726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:09.363341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:09.371006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:09.371501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:09.371980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:09.372676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:09.373139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:09.373577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:09.501726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:09.509478 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-da61d232-c089-469c-a11a-09f0f54cbaf5 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.150695 Oct 18 14:24:09.510075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3566/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:09 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:10.533360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:10.534128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:10.540450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:10.541588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:10.542071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:10.542769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:10.543803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:10.544257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:10.686119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:10.693968 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-07ea55c6-8681-4db3-9b32-47210f08a953 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1517 microversion: 2.1 time: 0.164522 Oct 18 14:24:10.694573 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3719/7285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:10 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:11.537918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "name": "network-vif-unplugged", "status": "completed", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:11.547555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:11.548045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:11.548492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:11.560379 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Creating event network-vif-unplugged:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h1-858383-13 Oct 18 14:24:11.565900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:24:11.578233 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-16540e27-3210-4b77-ad2d-8bb23f7d235c req-649e2968-d9b2-435c-89df-e90474530840 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093621 Oct 18 14:24:11.579192 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3567/7286] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:11.717939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:11.718680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:11.725788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:11.730222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:11.730222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:11.730222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:11.730222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:11.730222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:11.861496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:11.869846 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c7f745c-dc5d-489e-b09d-48519951cfa0 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1516 microversion: 2.1 time: 0.155507 Oct 18 14:24:11.870486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3720/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:11 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:12.896141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:12.896845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:12.903008 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:12.903502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:12.903950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:12.904645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:12.905107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:12.905541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:13.042332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:13.050137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9947b57-321a-4567-a9c3-024335dfb73e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1514 microversion: 2.1 time: 0.159327 Oct 18 14:24:13.050707 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3568/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:12 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:13.594434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:13.604630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:13.605379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:13.605575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:13.617207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Creating event network-changed:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h1-858383-13 Oct 18 14:24:13.622826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:24:13.633812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a7674191-82bd-4ad9-8296-4a64c9041ddd req-59cea036-0ce6-4500-ad17-7250024ea5c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043082 Oct 18 14:24:13.634464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3721/7289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:14.074879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:14.075507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:14.082864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:14.083369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:14.083823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:14.084551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:14.085006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:14.085445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:14.241805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:14.250996 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3516b2b1-4998-4183-a3e0-7b0aad4ca80e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1514 microversion: 2.1 time: 0.179887 Oct 18 14:24:14.252449 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3569/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:14 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:15.281287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:15.282010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:15.290360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:15.290870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:15.291895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:15.292604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:15.293084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:15.293531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:15.423814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:15.431533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8aa4ad8-d77d-4867-9d01-e9e49b302a87 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1511 microversion: 2.1 time: 0.155351 Oct 18 14:24:15.432727 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3722/7291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:15 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:15.454340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:15.455405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:15.462591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:15.463753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:15.464210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:15.464949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:15.465420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:15.465868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:15.494271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:24:15.618354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.compute.api [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Found an unconfirmed migration during delete, id: 16, status: finished Oct 18 14:24:17.928921 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e86a680e-5d77-406d-94f6-28d2a76596a8 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 204 len: 0 microversion: 2.1 time: 2.478222 Oct 18 14:24:17.929624 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3570/7292] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:24:15 2022] DELETE /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 0 bytes in 2480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:24:17.938217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:17.938853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:17.948452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:17.948958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:17.949424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:17.950158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:17.950640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:17.951090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:18.088197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:18.096034 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e3635bf-10bd-4835-9f32-321b186e81e6 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1503 microversion: 2.1 time: 0.161729 Oct 18 14:24:18.096601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3723/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:17 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:19.120398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:19.121109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:19.125204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "name": "network-vif-plugged", "status": "completed", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:19.128889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:19.129430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:19.129890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:19.130633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:19.131106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:19.131582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:19.143862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:19.144425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:19.144966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:19.156510 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] Creating event network-vif-plugged:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h1-858383-13 Oct 18 14:24:19.161717 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-79984b55-5775-41ad-add2-157c118eabfb req-1d98e417-152b-4454-8a40-36101e5f574c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047212 Oct 18 14:24:19.162243 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3571/7294] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:19.264432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:19.272264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b28844d7-46a9-4d20-9362-e110a5be6348 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1503 microversion: 2.1 time: 0.156554 Oct 18 14:24:19.272825 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3724/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:19 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:24:19.892023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea8a53-9bf3-4ee1-9b49-e177212e8017", "name": "network-vif-deleted", "tag": "30ecacb2-58ab-4ded-82b0-e8013b102876"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:19.902381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:19.902868 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:19.903318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:19.915028 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] Creating event network-vif-deleted:30ecacb2-58ab-4ded-82b0-e8013b102876 for instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 on n-h1-858383-13 Oct 18 14:24:19.920044 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ffcacd1a-e46b-4fb9-99f5-2df8fe44cf71 req-e2d6de50-1c98-4458-b6a2-0083de3445d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Oct 18 14:24:19.920652 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3572/7296] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:20.296598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:20.297223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:20.304139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:20.304641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:20.305094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:20.305797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:20.306303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:20.306749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:20.349428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:20.349929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:20.350421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:20.350890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lazy-loading 'fault' on Instance uuid 53ea8a53-9bf3-4ee1-9b49-e177212e8017 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:24:20.397094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5ff5333e314722bd805995ff846b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a777d3dbab447a7931482286b7304fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:20.405770 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cf450a6-ef31-4f1b-9292-40c038aea352 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 200 len: 1305 microversion: 2.1 time: 0.113544 Oct 18 14:24:20.406480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3725/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:20 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:21.430552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:21.431269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:21.437948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.438467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.438909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.439593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.440059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.440492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.454525 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] HTTP exception thrown: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Request method failure captured: Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 HTTP/1.1 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrbeNKyn9oCu0-IwVLpS-Tvjrqm9pNS7gu1CTaI2kvjRSPJYqedEq8F3JArafXKp5BS1UopiClohgWddZDeypa3dHJlPDz7WoiQrPP086A2AZmvN0yXSjP1t0Z6383D_wZeHKks5c_drST6RbxWha251DT4vCItCq501dgR0b3-RpxQ Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a777d3dbab447a7931482286b7304fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7d5ff5333e314722bd805995ff846b9e Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '53ea8a53-9bf3-4ee1-9b49-e177212e8017'} Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.456118 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Returning 404 to user: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-414839bb-2239-45a1-b264-700c9bc63f64 tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 404 len: 111 microversion: 2.1 time: 0.032053 Oct 18 14:24:21.461432 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3573/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:21 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:24:21.475428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:21.475957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:21.483023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.489940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.489940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.489940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.489940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.489940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.499836 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] HTTP exception thrown: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Request method failure captured: Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 HTTP/1.1 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrbeNKyn9oCu0-IwVLpS-Tvjrqm9pNS7gu1CTaI2kvjRSPJYqedEq8F3JArafXKp5BS1UopiClohgWddZDeypa3dHJlPDz7WoiQrPP086A2AZmvN0yXSjP1t0Z6383D_wZeHKks5c_drST6RbxWha251DT4vCItCq501dgR0b3-RpxQ Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a777d3dbab447a7931482286b7304fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7d5ff5333e314722bd805995ff846b9e Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '53ea8a53-9bf3-4ee1-9b49-e177212e8017'} Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:24:21.501512 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Returning 404 to user: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c51404c-3596-48e4-a968-5b2a6b147c6b tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "DELETE /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 404 len: 111 microversion: 2.1 time: 0.031573 Oct 18 14:24:21.505435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3726/7299] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:24:21 2022] DELETE /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:24:21.512933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:21.513606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] [instance: 53ea8a53-9bf3-4ee1-9b49-e177212e8017] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:21.519539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.520025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.520471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.521153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:21.521615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:21.522043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:21.536180 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] HTTP exception thrown: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Request method failure captured: Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 HTTP/1.1 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrbeNKyn9oCu0-IwVLpS-Tvjrqm9pNS7gu1CTaI2kvjRSPJYqedEq8F3JArafXKp5BS1UopiClohgWddZDeypa3dHJlPDz7WoiQrPP086A2AZmvN0yXSjP1t0Z6383D_wZeHKks5c_drST6RbxWha251DT4vCItCq501dgR0b3-RpxQ Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a777d3dbab447a7931482286b7304fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a777d3dbab447a7931482286b7304fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 4a777d3dbab447a7931482286b7304fb Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-DeleteServersTestJSON-33007139 Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7d5ff5333e314722bd805995ff846b9e Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-DeleteServersTestJSON-33007139-project Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '53ea8a53-9bf3-4ee1-9b49-e177212e8017'} Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:21.540343 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] Returning 404 to user: Instance 53ea8a53-9bf3-4ee1-9b49-e177212e8017 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad97908e-0cbf-4543-9ba8-cc8d9cc7e55e tempest-DeleteServersTestJSON-33007139 tempest-DeleteServersTestJSON-33007139-project] 10.222.0.27 "GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017" status: 404 len: 111 microversion: 2.1 time: 0.031378 Oct 18 14:24:21.545097 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3574/7300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:21 2022] GET /compute/v2.1/servers/53ea8a53-9bf3-4ee1-9b49-e177212e8017 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:24:31.938227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=21 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:31.939073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=67 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:32.055077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-848842328", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9dcd6ff3-aa20-469c-9122-47e2e74e0e0a"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:32.112813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] validate_networks() for [('9dcd6ff3-aa20-469c-9122-47e2e74e0e0a', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:24:32.525043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:24:32.525490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:24:32.525998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:24:32.526462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:24:32.526894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:24:32.536592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:32.537100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:32.537560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:32.538349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:32.538832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:32.539284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:32.555848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for project ee305e628b7a4f069272604cf496df83. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:24:32.561077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for user e338ca8ecf9646e1b5f798d5ea65f5c9 and project ee305e628b7a4f069272604cf496df83. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:24:32.573385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:24:32.576265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:24:32.691648 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cee4a242-f87e-409f-a4c1-55ba0958b817 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758930 Oct 18 14:24:32.697156 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3727/7301] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:24:32.704138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21ec875a-e4fc-4ad7-9929-89fb04dee928 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:32.704989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21ec875a-e4fc-4ad7-9929-89fb04dee928 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:32.721479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:32.722629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:32.781875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21ec875a-e4fc-4ad7-9929-89fb04dee928 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:32.791628 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21ec875a-e4fc-4ad7-9929-89fb04dee928 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1217 microversion: 2.1 time: 0.091384 Oct 18 14:24:32.792212 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3575/7302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:32 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:33.815985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:33.816824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:33.824684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:33.825198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:33.825659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:33.826413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:33.826917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:33.827363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:33.894787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:33.904712 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90191a40-1f1e-43f5-88ea-6ced3441d2b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1221 microversion: 2.1 time: 0.093814 Oct 18 14:24:33.905410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3728/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:33 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:34.928455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:34.929078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:34.937737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:34.938284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:34.938738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:34.939456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:34.939916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:34.940351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:35.015894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:35.026086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-39a90329-8fa1-41e4-9e17-1d9319f12e9b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1277 microversion: 2.1 time: 0.101874 Oct 18 14:24:35.026755 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3576/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:34 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:36.049960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:36.050760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:36.057719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:36.058339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:36.058870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:36.059683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:36.060232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:36.060751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:36.203757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:36.211791 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2722da57-6a0f-49b2-bfe6-0802c152e543 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.165662 Oct 18 14:24:36.212951 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3729/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:36 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:36.629097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:36.640254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:36.645763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:36.645763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:36.652574 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] Creating event network-changed:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h1-858383-13 Oct 18 14:24:36.657985 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-23f7b891-de90-4893-9eed-c696daf17400 req-f607c367-e564-4015-beb4-99c2caf268e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Oct 18 14:24:36.658604 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3577/7306] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:37.236938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:37.237474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:37.244603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:37.245117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:37.245579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:37.246334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:37.246815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:37.247266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:37.385442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:37.394149 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76abf772-5e24-4503-8b7f-4c6f93f223c9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.161199 Oct 18 14:24:37.405506 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3730/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:37 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:38.419710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:38.420441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:38.427960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.428509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.428958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.429660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.430137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.430570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.574345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:38.582130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-61246a6b-25f5-45f2-9eb4-3c5bbe23b834 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.167350 Oct 18 14:24:38.582705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3578/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:38 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:39.604267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:39.604930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:39.612501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:39.613007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:39.613468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:39.614218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:39.614698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:39.615149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:39.747628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:39.755926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a752496-1206-4a1c-b77c-d595333b025a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.155497 Oct 18 14:24:39.756509 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3731/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:39 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:40.780792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:40.781711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:40.789576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:40.790131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:40.795339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:40.795339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:40.795339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:40.795339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:40.944757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:40.952765 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cbe2bce3-0f12-4a6e-9635-3b8b9d2a2d8f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.176833 Oct 18 14:24:40.953352 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3579/7310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:40 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:24:41.975759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:41.976394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:41.983901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:41.984407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:41.984864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:41.985572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:41.986048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:41.986516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:42.120301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:42.128223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bff59691-8fa0-4fcf-9144-35b1527509c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.156641 Oct 18 14:24:42.128807 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3732/7311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:41 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:43.153415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:43.154047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:43.156566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:43.161456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:43.161944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:43.162421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:43.163123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:43.163583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:43.169038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:43.276467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "name": "network-vif-plugged", "status": "completed", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:43.282728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:43.283440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:43.289455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:43.289953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:43.290443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:43.305349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:43.308882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] Creating event network-vif-plugged:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h1-858383-13 Oct 18 14:24:43.314313 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9d634e83-bd35-4a49-9d4a-0f537f6ae129 req-efd73a45-be4c-4d73-bb11-e61726e130ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041765 Oct 18 14:24:43.314918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3733/7312] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:24:43.315999 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb4f01cd-0131-430b-aaf5-a4575dd9d357 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.167003 Oct 18 14:24:43.324113 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3580/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:43 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:44.343858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:44.344527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:44.351319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:44.351795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:44.352238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:44.352929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:44.353390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:44.353819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:44.521246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:44.529110 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ca27056-62ef-45c0-8baf-5dc8073e1a16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1317 microversion: 2.1 time: 0.189356 Oct 18 14:24:44.529682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3581/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:44 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:45.554660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:45.555370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:45.563432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:45.563940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:45.564422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:45.565134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:45.565631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:45.566099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.068302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:46.078037 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-718be21d-c263-4813-a641-56f6c1cf1039 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1507 microversion: 2.1 time: 0.529102 Oct 18 14:24:46.078741 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3734/7315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:45 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:46.103722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:46.104527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:46.113772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.116518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.116518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.116518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.119028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.119732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.334197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:46.341988 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28f13467-eb4a-4c57-ae72-a38d58ca2639 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1507 microversion: 2.1 time: 0.242986 Oct 18 14:24:46.342668 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3582/7316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:46 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:46.364068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:46.366478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:46.373022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.373524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.373977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.374788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.375326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.375832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.533735 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7eb32d13-d15a-4469-8d51-1d983c1c3ec6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "PUT /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1079 microversion: 2.1 time: 0.173404 Oct 18 14:24:46.534518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3735/7317] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 14:24:46 2022] PUT /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1079 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:46.553469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:46.555735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:46.560735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.561221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.561688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.562412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.562874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.563309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.707255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:46.715170 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-992016b1-21a6-4fe9-817b-3b8682ef75e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1505 microversion: 2.1 time: 0.165661 Oct 18 14:24:46.721722 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3583/7318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:46 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:46.737912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:46.738597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:46.745416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.746544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.747023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.747731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.748193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.748639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.875375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:46.886825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d72ffd7-1182-4402-9d63-bcff35ff7148 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1505 microversion: 2.1 time: 0.152560 Oct 18 14:24:46.887404 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3736/7319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:46 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:24:46.909278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:46.911571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:46.918043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.918788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.919238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.919922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:46.920378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:46.920807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:46.947654 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:46.953090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Old instance type m1.heat2, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:24:46.959525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:24:46.959960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:24:46.960439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:24:46.960857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:24:46.961275 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:24:47.166025 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-97a589b1-59eb-45d9-954e-9a28536c81bd tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e/action" status: 202 len: 0 microversion: 2.1 time: 0.260700 Oct 18 14:24:47.166948 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3584/7320] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:24:46 2022] POST /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:24:47.175363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:47.175992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:47.181875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:47.182413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:47.182867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:47.183577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:47.184050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:47.184490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:47.319435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:47.327969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c918fc1-b60a-4e1a-9394-fcece0a53ce3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1516 microversion: 2.1 time: 0.156404 Oct 18 14:24:47.328551 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3737/7321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:47 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:48.351602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:48.352146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:48.359291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:48.359785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:48.360231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:48.364128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:48.364128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:48.364128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:48.495215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:48.504083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fda5a5cf-cd89-4739-a230-0db33a50109e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1516 microversion: 2.1 time: 0.157512 Oct 18 14:24:48.504655 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3585/7322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:48 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:49.528130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:49.528909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:49.535668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:49.536167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:49.536629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:49.537353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:49.537803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:49.538278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:49.673233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:49.681394 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78ad7f03-42bc-49bf-8419-cc82a523317f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1516 microversion: 2.1 time: 0.157215 Oct 18 14:24:49.681969 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3738/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:49 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:50.705885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:50.706464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:50.713270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:50.713765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:50.716621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:50.716621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:50.716621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:50.716621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:50.844687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:50.852392 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b6c6cd2-bb84-4863-8977-483072914d7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.150486 Oct 18 14:24:50.852969 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3586/7324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:50 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:51.876561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:51.877223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:51.884047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.884548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.885010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:51.885701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.886201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.886913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:52.018471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:52.026226 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82254c6c-9eec-48e1-a49e-a8fef3287daa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153534 Oct 18 14:24:52.026791 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3739/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:51 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:53.049153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:53.049838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:53.056599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:53.057088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:53.057626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:53.058334 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:53.058795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:53.059225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:53.202458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:53.210935 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21264958-cd1c-463b-a201-eeb260a9a977 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.165690 Oct 18 14:24:53.211532 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3587/7326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:53 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:54.233655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:54.234361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:54.241113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:54.241609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:54.242092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:54.242812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:54.243294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:54.243749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:54.376627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:54.384736 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bf8e4f32-b9cf-4839-b177-505f3f234121 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.154988 Oct 18 14:24:54.385314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3740/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:54 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:55.408914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:55.409537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:55.416419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:55.416914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:55.417363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:55.418083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:55.418558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:55.419564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:55.550471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:55.558461 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e3798c4-b085-4fb3-a402-ffd47086c982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153325 Oct 18 14:24:55.559049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3588/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:55 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:56.581941 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:56.582603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:56.589593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.590128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.591262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.591979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.592456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.592906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.722469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:56.730221 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a94e216-1baf-48c5-8165-62b45c25b2de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.152394 Oct 18 14:24:56.730795 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3741/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:56 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:57.753241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:57.753858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:57.760782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:57.766178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:57.766178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:57.766178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:57.766178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:57.766178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:57.896613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:57.904908 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f112651-f348-4ede-b244-e14868b27ec5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.155561 Oct 18 14:24:57.905476 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3589/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:57 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:24:58.927113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:58.927769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:58.935187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:58.935683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:58.936139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:58.936843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:58.937310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:58.937754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:59.065449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:59.073297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10e3b04d-a621-4c37-bb2f-6e0fb74ae549 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.150092 Oct 18 14:24:59.073875 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3742/7331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:58 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:00.097586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:00.098309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:00.105362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.105864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.106376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.107090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.107587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.108033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.243552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:00.251763 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c6c62d8-edad-4230-b0ef-f648d96a9982 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.158174 Oct 18 14:25:00.252359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3590/7332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:00 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:01.275851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:01.276468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:01.283893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:01.284397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:01.284858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:01.285564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:01.286040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:01.286511 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:01.416178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:01.425869 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83c4154e-d406-4214-9818-3825f37a0953 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153892 Oct 18 14:25:01.426465 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3743/7333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:01 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:02.449370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:02.450490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:02.457386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:02.457884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:02.458365 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:02.459071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:02.459537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:02.459978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:02.589043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:02.593187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:02.597834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c657270-ca4d-4e95-aec5-ff7aa9a60b16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.152536 Oct 18 14:25:02.598453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3591/7334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:02 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:03.620918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:03.621581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:03.625832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:03.629319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:03.629830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:03.630450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:03.631179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:03.631644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:03.632092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:03.636222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:03.764284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:03.772359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05208c12-0c12-48bc-b562-d484a42a6115 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.155365 Oct 18 14:25:03.772968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3744/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:03 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:04.798154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:04.798721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:04.805862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.806373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.806816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.807532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.807987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.808420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.943041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:04.951563 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8035af29-86b0-4465-99a2-5d8730af90c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.157942 Oct 18 14:25:04.952142 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3592/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:04 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:05.975272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:05.975912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:05.983719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:05.984230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:05.984694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:05.985404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:05.985885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:05.986359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:06.122245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:06.130048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-439362a0-729b-459b-98f1-a5fb22e992c1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.158751 Oct 18 14:25:06.130653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3745/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:05 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:07.153732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:07.154403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:07.157128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=43 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:07.161904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:07.162439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:07.162887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:07.163583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:07.164044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:07.164479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:07.294972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:07.302785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3a3522a1-1182-468b-b526-99a2dc53a2d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153164 Oct 18 14:25:07.303366 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3593/7338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:07 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:08.327285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:08.327916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:08.335065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:08.335571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:08.336030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:08.336754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:08.337231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:08.337681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:08.468192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:08.476108 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73f68408-41e9-4089-9905-ea37fdef4069 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153165 Oct 18 14:25:08.476685 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3746/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:08 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:09.499330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:09.499948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:09.506912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:09.507394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:09.507837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:09.508522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:09.508977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:09.509406 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:09.642735 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:09.650501 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4b0bbef-8f5a-4086-b736-5a257b2ebff6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.155145 Oct 18 14:25:09.651078 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3594/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:09 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:10.673786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:10.674444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:10.680682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:10.681182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:10.681637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:10.682365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:10.682929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:10.683375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:10.816103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:10.823994 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26a91209-f741-4604-9dc6-f2d7f9596399 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.154082 Oct 18 14:25:10.825099 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3747/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:10 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:11.848262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:11.848838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:11.855085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:11.855566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:11.856006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:11.856686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:11.857143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:11.857570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:11.987659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:11.996172 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e17c743a-cdbf-45c3-b4dc-8de4a49dba37 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.152408 Oct 18 14:25:11.997359 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3595/7342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:11 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:13.020172 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:13.020826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:13.027674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:13.031781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:13.031781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:13.031781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:13.031781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:13.031781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:13.160232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:13.168328 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7712f80f-1245-44aa-b4c7-7f40d3f96f2e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.152033 Oct 18 14:25:13.168904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3748/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:13 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:14.192290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:14.192922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:14.199753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:14.200249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:14.200704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:14.201404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:14.201872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:14.202341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:14.333289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:14.341733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba539f7f-6ff7-42a6-8e88-1a9206fe6a5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153314 Oct 18 14:25:14.342348 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3596/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:14 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:15.364956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:15.365585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:15.372979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.373484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.373943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.374679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.375156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.375604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.505502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:15.514171 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a442528-cf95-4a48-8d3e-e05b5963bd74 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.153080 Oct 18 14:25:15.514748 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3749/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:15 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:16.536468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:16.537093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:16.544501 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:16.544991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:16.545434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:16.546151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:16.546643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:16.547077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:16.682919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:16.691237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3342a47a-b2a5-4002-933a-43db06a14bc8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1521 microversion: 2.1 time: 0.158723 Oct 18 14:25:16.691816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3597/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:16 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:17.714558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:17.715678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:17.722684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:17.723783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:17.723783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:17.724364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:17.724843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:17.725294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:17.966612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:17.974512 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b38bca74-f76b-46a0-8f5e-1822e4e53bfb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1520 microversion: 2.1 time: 0.263873 Oct 18 14:25:17.975102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3750/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:17 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:18.133389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "name": "network-vif-unplugged", "status": "completed", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:18.144554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:18.147240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:18.147240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:18.157463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Creating event network-vif-unplugged:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h2-858383-13 Oct 18 14:25:18.162804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:25:18.174003 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0f3480c4-3f0b-4bac-b451-89ac557c747f req-ca09617e-e117-4182-aa98-6bd4b39c15c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044284 Oct 18 14:25:18.175889 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3598/7348] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:18.999245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:18.999886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:19.006910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:19.007419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:19.007885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:19.008607 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:19.009083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:19.009534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:19.174481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:19.181177 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6167397-b3d4-4568-9bdc-1d3142185ebf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1520 microversion: 2.1 time: 0.186418 Oct 18 14:25:19.181756 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3751/7349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:18 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:20.190695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:20.201234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:20.201719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:20.202189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:20.204404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:20.205035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:20.211766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:20.212273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:20.212732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:20.213442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:20.213675 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Creating event network-changed:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h2-858383-13 Oct 18 14:25:20.213927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:20.214399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:20.219027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:25:20.229511 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-273719cf-bc9a-4a78-9158-81142b34d8fa req-5f07a88d-7c5a-449e-9875-65a0f5ee1b28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043645 Oct 18 14:25:20.230387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3599/7350] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:25:20.348450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:20.356900 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6273e674-1142-4774-8b65-e3fbc396c189 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1518 microversion: 2.1 time: 0.156342 Oct 18 14:25:20.357485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3752/7351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:20 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:21.382378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:21.383777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:21.390744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.391465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.391912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.392619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.393109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.393605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.525624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:21.534016 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-72445773-6c6b-4c12-9f0a-d0fd36467146 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1515 microversion: 2.1 time: 0.156794 Oct 18 14:25:21.534621 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3600/7352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:21 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:21.556805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:21.558466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:21.564263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.564836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.565296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.566008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.566509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.566954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.785743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4490e91-028b-4255-8a0a-471344f165aa tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e/action" status: 204 len: 0 microversion: 2.1 time: 0.232546 Oct 18 14:25:21.786493 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3753/7353] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:25:21 2022] POST /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e/action => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:25:21.794862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:21.796457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:21.803553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.804130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.804656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.805487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:21.806152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:21.806589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:21.942476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:21.953014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0271aa11-005f-4275-899b-220bf1bd32c4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1515 microversion: 2.1 time: 0.162114 Oct 18 14:25:21.953621 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3601/7354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:21 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:22.978527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:22.979920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:22.992517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:22.993057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:22.993638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:22.994405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:22.994890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:22.995434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:23.128794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:23.137423 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05780429-fe72-4ebd-a5a6-25e5a70900b1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1515 microversion: 2.1 time: 0.163540 Oct 18 14:25:23.138149 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3754/7355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:22 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:24.022256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "name": "network-vif-plugged", "status": "completed", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:24.033479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:24.033967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:24.034436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:24.045636 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] Creating event network-vif-plugged:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h2-858383-13 Oct 18 14:25:24.050514 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-aaefd864-d28b-4472-8f61-0534c093c546 req-b1f18049-2efc-4019-b964-5529d9c9380d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Oct 18 14:25:24.051101 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3602/7356] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:24.161148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:24.161876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:24.168974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:24.169448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:24.169912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:24.170665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:24.171148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:24.171598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:24.304385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:24.312550 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fdfd167d-4a81-4f7d-837e-4a637215f5d8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1507 microversion: 2.1 time: 0.155535 Oct 18 14:25:24.314162 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3755/7357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:24 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:24.336444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:24.337159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:24.344379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:24.348473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:24.348473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:24.348473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:24.348473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:24.348473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:24.474890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:24.482667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9639fe5-e02f-48ab-92ec-e3ebd9d18948 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1507 microversion: 2.1 time: 0.150693 Oct 18 14:25:24.483234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3603/7358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:24 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:24.508333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d9aaaf4-af26-4c61-a098-c54c68c88dd1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'create', calling method: .version_select at 0x7fb335432e50>, body: {"keypair": {"name": "tempest-keypair-1812799891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfiS0wPfBTYsMwU4akLhzdixwSgwIjiLzOrtzBNx5+/g+y3KYYzP5no0i2EDudhVbZELtcUX0IaaBwOBYuq/17c3GllQEWT+QFeKzm//bH89xsiqIfkU4Q9vdkV0aiy4A=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:24.524288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0d9aaaf4-af26-4c61-a098-c54c68c88dd1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for project ee305e628b7a4f069272604cf496df83. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:24.529371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-0d9aaaf4-af26-4c61-a098-c54c68c88dd1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for user e338ca8ecf9646e1b5f798d5ea65f5c9 and project ee305e628b7a4f069272604cf496df83. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:24.627878 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d9aaaf4-af26-4c61-a098-c54c68c88dd1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123394 Oct 18 14:25:24.628496 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3756/7359] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:26.642638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:26.651309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:26.651309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:26.651309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:26.651309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:26.651793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:26.652852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:26.653417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:26.781974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:26.789955 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22842e3a-aa46-4122-99d7-88a7018fcd16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 200 len: 1507 microversion: 2.1 time: 0.151335 Oct 18 14:25:26.790560 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3604/7360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:26 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:26.813382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:26.813929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:26.820621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:26.821127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:26.821588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:26.822343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:26.822873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:26.823272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:26.847891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:25:27.117589 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67d25104-e4c6-4e2c-b04e-b35d9f814faf tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 204 len: 0 microversion: 2.1 time: 0.308387 Oct 18 14:25:27.117916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3757/7361] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:25:26 2022] DELETE /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:25:27.176769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-731032309", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "9dcd6ff3-aa20-469c-9122-47e2e74e0e0a"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:27.232094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] validate_networks() for [('9dcd6ff3-aa20-469c-9122-47e2e74e0e0a', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:25:27.596254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:25:27.596716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:25:27.597200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:25:27.597621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:25:27.598038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:25:27.606881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:27.607379 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:27.607828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:27.608557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:27.609022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:27.609457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:27.626691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for project ee305e628b7a4f069272604cf496df83. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:27.631983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Getting quotas for user e338ca8ecf9646e1b5f798d5ea65f5c9 and project ee305e628b7a4f069272604cf496df83. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:27.645202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:25:27.647570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:25:27.753539 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59810dc6-dca2-40c9-9db2-b53a1966c55e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580528 Oct 18 14:25:27.754150 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3605/7362] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:25:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:25:27.766580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a1e9025-5e06-436f-ab40-04bfefa35b2b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:27.767310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a1e9025-5e06-436f-ab40-04bfefa35b2b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:27.821102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a1e9025-5e06-436f-ab40-04bfefa35b2b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:27.828984 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a1e9025-5e06-436f-ab40-04bfefa35b2b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1217 microversion: 2.1 time: 0.067237 Oct 18 14:25:27.829552 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3758/7363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:27 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:28.852877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:28.853420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:28.861255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.861755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.862242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.862949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.863414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.867568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.929730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:28.937610 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4324395-6b2d-4c94-ab99-a189b6fb5fb5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1221 microversion: 2.1 time: 0.089616 Oct 18 14:25:28.938268 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3606/7364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:28 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:29.144640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2870b0c3-fc1b-4c27-970f-23fd92d5676e", "name": "network-vif-deleted", "tag": "b4afc541-d105-42a9-b56e-b13410049f40"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:29.156373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:29.156868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:29.157315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:29.172895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] Creating event network-vif-deleted:b4afc541-d105-42a9-b56e-b13410049f40 for instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e on n-h2-858383-13 Oct 18 14:25:29.177320 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7fa6a00e-3838-475a-8eb9-121f54c3ca5d req-a053eb71-f553-4271-8b41-2222e1035cd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Oct 18 14:25:29.177919 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3759/7365] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:29.961459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:29.961972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:29.968831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:29.969453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:29.969903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:29.970625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:29.971096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:29.971530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:30.034789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:30.044967 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2eba9b3d-c40f-4ef9-8c2a-6b8071e60093 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1269 microversion: 2.1 time: 0.087536 Oct 18 14:25:30.045557 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3607/7366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:29 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:31.069982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:31.070977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:31.078861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:31.079373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:31.079894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:31.080625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:31.081262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:31.081718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:31.106246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:31.285567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:31.293316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9fc61cd0-7f77-4aeb-9a98-4d89f02168e6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.227841 Oct 18 14:25:31.293916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3760/7367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:31 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:31.796622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:31.807050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:31.807686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:31.808132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:31.820088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] Creating event network-changed:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h2-858383-13 Oct 18 14:25:31.825098 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d9396f6a-2167-4e2b-a1bd-254b890a3e70 req-17f1b617-f35c-46c8-9d2d-73e2a928de25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032791 Oct 18 14:25:31.826076 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3608/7368] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:32.317848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:32.318521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:32.326829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:32.327369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:32.327834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:32.328559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:32.329048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:32.329503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:32.533208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:32.541033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2a49d84-0a5f-4463-a077-193434b47bc3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.227609 Oct 18 14:25:32.541780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3761/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:32 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:33.566941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:33.567478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:33.574020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.574020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.575115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.576810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.577285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.577726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.710634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:33.718481 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6f72177f-7b96-4e92-951a-a67cdcd3e6ac tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.157375 Oct 18 14:25:33.719049 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3609/7370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:33 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:34.742113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:34.742709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:34.745419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:34.750237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:34.750746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:34.751211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:34.751921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:34.752398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:34.752856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:34.888251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:34.895954 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6b053fc-51bf-4343-b93a-890187362a6b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.157866 Oct 18 14:25:34.896528 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3762/7371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:34 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:35.919439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:35.920157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:35.926893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:35.927384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:35.927871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:35.928646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:35.929105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:35.929534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:35.934259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=93 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:36.064626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:36.072335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6068ce20-a4c3-4be5-bab1-c0f42e760ad5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.157012 Oct 18 14:25:36.072916 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3610/7372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:35 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:37.100627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:37.101256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:37.108502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.109007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.109463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.110204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.110672 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.111114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.239644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:37.247891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66e56e62-bec4-4669-8fa6-196f749e23c8 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.155125 Oct 18 14:25:37.248464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3763/7373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:37 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:38.045190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "name": "network-vif-plugged", "status": "completed", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:38.051095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:38.051832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:38.052482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:38.058362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:38.058911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:38.059355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:38.069882 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] Creating event network-vif-plugged:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h2-858383-13 Oct 18 14:25:38.074839 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9b750667-2a36-48da-874e-302a4c1b77b1 req-64ceea42-98ab-426b-8847-b2aa90974ae7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Oct 18 14:25:38.075431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3611/7374] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:38.271642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:38.272271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:38.274152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:38.280473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:38.280969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:38.281428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:38.282165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:38.282640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:38.283086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:38.416338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:38.424180 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3545ef6-5ce3-4959-be1f-5915d80bf451 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.156420 Oct 18 14:25:38.424755 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3764/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:38 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:39.450123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:39.450874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:39.460012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.460500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.460942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.461643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.462134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.468180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.602805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:39.610703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e85b2fd-9ce4-4617-838f-9843cea03fee tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1317 microversion: 2.1 time: 0.166872 Oct 18 14:25:39.611303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3612/7376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:39 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:40.634570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:40.635220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:40.642035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.642558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.643011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:40.643709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.644178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.644621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:40.772905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:40.781140 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e126c98-005c-4143-b943-369c059a2535 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1508 microversion: 2.1 time: 0.150407 Oct 18 14:25:40.783756 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3765/7377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:40 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:40.804186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:40.806659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:40.812254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.812744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.813220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:40.813917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.814522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.814962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:40.948543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:40.956473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-faf23bd7-6123-408a-8914-92297b23afd6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1508 microversion: 2.1 time: 0.156202 Oct 18 14:25:40.957043 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3613/7378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:40 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:40.987493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:40.987493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:40.988171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.988674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.989132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:40.989839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:40.990336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:40.990780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.021588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:41.026933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Old instance type m1.heat2, new instance type m1.heat {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:25:41.033855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:25:41.034327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:25:41.034815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:25:41.035243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:25:41.035667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:25:41.258139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2664d703-ffae-4f5d-8d4b-8dcaadaf7501 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409/action" status: 202 len: 0 microversion: 2.1 time: 0.282770 Oct 18 14:25:41.258758 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3766/7379] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:25:40 2022] POST /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:25:41.267497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:41.268116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:41.274141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.274630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.275072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.275762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.276222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.276652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.408909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:41.416703 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eca18f01-5713-4c75-bb90-0bb8138af07e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1515 microversion: 2.1 time: 0.153072 Oct 18 14:25:41.417284 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3614/7380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:41 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:42.441775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:42.442425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:42.449428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:42.450558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:42.451025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:42.451750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:42.452230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:42.452814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:42.584468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:42.592345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5be8675d-6a81-4af5-a0c0-7f2488d61263 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1515 microversion: 2.1 time: 0.155371 Oct 18 14:25:42.592918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3767/7381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:42 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:43.615867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:43.616489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:43.624342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:43.624834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:43.625277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:43.625969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:43.626455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:43.626992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:43.764444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:43.772398 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e762cb70-8f1d-49a6-9919-ff80cb9e4f2a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1515 microversion: 2.1 time: 0.160618 Oct 18 14:25:43.772981 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3615/7382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:43 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:44.795564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:44.796182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:44.803005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:44.803501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:44.803954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:44.804650 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:44.805120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:44.805558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:44.935884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:44.943701 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2fa9d59-077d-4231-8143-84abca69ed12 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.152170 Oct 18 14:25:44.944272 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3768/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:44 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:45.967540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:45.968171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:45.975101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:45.975593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:45.976039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:45.976729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:45.977197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:45.977629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:46.109959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:46.117956 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a17abe27-2b1f-4fae-8b74-4eef52817e7b tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154982 Oct 18 14:25:46.118558 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3616/7384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:45 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:47.142303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:47.142935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:47.149770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:47.150305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:47.150766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:47.151478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:47.151931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:47.152377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:47.291676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:47.299545 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f07350b3-8454-4a88-87c7-579e48be53ad tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.161264 Oct 18 14:25:47.300122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3769/7385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:47 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:48.322855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:48.323461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:48.330335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:48.330817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:48.331256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:48.331962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:48.332421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:48.332848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:48.460106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:48.468634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bfc3fec5-ae54-403d-9ef8-d3a937357868 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.149674 Oct 18 14:25:48.469221 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3617/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:48 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:49.492841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:49.493468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:49.500423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:49.501056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:49.501512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:49.502240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:49.502713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:49.503162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:49.631878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:49.640553 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66f39327-6652-4ad0-8511-8214461e6b21 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.151578 Oct 18 14:25:49.641134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3770/7387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:49 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:50.664316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:50.664942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:50.671865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:50.672359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:50.672808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:50.673498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:50.673956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:50.674420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:50.805674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:50.814110 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5245ca78-c988-4e8c-92a5-2a464136863d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.153688 Oct 18 14:25:50.816717 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3618/7388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:50 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:51.838479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:51.839045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:51.846755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:51.847322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:51.847730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:51.848442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:51.848923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:51.849377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:51.984126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:51.991966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2622ca28-61f9-4203-b544-f5a4ace60ef1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.157635 Oct 18 14:25:51.992541 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3771/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:51 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:53.015474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:53.016095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:53.023582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:53.024086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:53.024535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:53.025230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:53.025690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:53.026192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:53.157449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:53.165216 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3a043ff-2dc3-4f72-9fea-a32bbf9c4a01 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154070 Oct 18 14:25:53.165788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3619/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:53 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:54.189170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:54.189816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:54.196728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:54.197239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:54.197699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:54.198443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:54.198925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:54.199379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:54.329288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:54.337239 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6496f95d-4571-4c6f-9316-19c66b76ae16 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.152005 Oct 18 14:25:54.337883 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3772/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:54 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:55.360685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:55.361305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:55.368035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:55.368522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:55.368965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:55.369656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:55.370137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:55.370565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:55.501044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:55.508856 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a03b9613-b521-42d8-a541-3888b82da795 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.152076 Oct 18 14:25:55.509431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3620/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:55 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:56.532827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:56.533491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:56.540308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:56.540815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:56.541273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:56.541978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:56.542482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:56.542931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:56.671386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:56.679130 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-236847b2-0544-4522-bb42-b9ad0beea8f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.150191 Oct 18 14:25:56.679699 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3773/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:56 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:57.703030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:57.703644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:57.710490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:57.710934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:57.711488 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:57.712187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:57.713002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:57.713447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:57.848922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:57.857709 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4793a56e-984a-49eb-82bc-79e4f410b31f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.159218 Oct 18 14:25:57.858473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3621/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:57 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:58.882921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:58.883564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:58.891194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:58.891699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:58.892161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:58.892870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:58.893348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:58.893797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:59.024178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:59.031961 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5857a26-0b92-4d6c-ab6c-4c3c543a81f0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.153004 Oct 18 14:25:59.032530 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3774/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:58 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:00.054813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:00.055438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:00.063270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:00.063767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:00.064217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:00.064916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:00.065376 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:00.065814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:00.198516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:00.206613 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b7165efc-4777-47ac-80c0-b8cca1c0468d tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.155632 Oct 18 14:26:00.207191 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3622/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:00 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:01.230585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:01.231212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:01.238085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:01.238588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:01.239043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:01.239738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:01.240209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:01.240652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:01.372752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:01.376266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:01.380926 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df73e3f7-64af-4366-b80f-c12dd23e51b2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154269 Oct 18 14:26:01.381506 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3775/7397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:01 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:02.405474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:02.406119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:02.413378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:02.413876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:02.414378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:02.415078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:02.415650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:02.416190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:02.548211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:02.556098 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-070e0890-57ae-4dd2-8c2c-1f0d9abb3067 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.155196 Oct 18 14:26:02.556678 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3623/7398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:02 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:03.580476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:03.581117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:03.588479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:03.589120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:03.589460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:03.590286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:03.591279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:03.591781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:04.044515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:04.052400 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ecceca42-aa91-4dca-891d-99dbbeebc2e3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.476302 Oct 18 14:26:04.052986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3776/7399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:03 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:05.076895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:05.077531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:05.084393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:05.084892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:05.085348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:05.086048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:05.086538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:05.086977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:05.216047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:05.223726 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7bcd3ff9-fe56-4b82-954c-09a7067390e0 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.151437 Oct 18 14:26:05.224297 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3624/7400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:05 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:06.247012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:06.247655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:06.250687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=34 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:06.255548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.256064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.256528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.257258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.257735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.258229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.393848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:06.401850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7cda3272-0326-4cfd-bbcc-31a1a94fbd5f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.158838 Oct 18 14:26:06.402489 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3777/7401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:06 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:07.425469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:07.426113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:07.432983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:07.433467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:07.433943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:07.434702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:07.435164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:07.435596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:07.438256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=86 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:07.567395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:07.575631 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-86ed33c5-9068-47a5-881f-e83dff354f45 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154073 Oct 18 14:26:07.576215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3625/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:07 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:08.598926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:08.599562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:08.607064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:08.614126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:08.614126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:08.614126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:08.614126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:08.614126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:08.740673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:08.749207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdf355eb-5148-43c9-8d8a-c080e13203de tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154272 Oct 18 14:26:08.751510 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3778/7403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:08 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:09.773481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:09.774071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:09.776784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=30 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:09.781450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:09.781943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:09.782445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:09.783115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:09.783577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:09.784014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:09.915831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:09.924072 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3cabd8a6-cdb4-4d37-b91e-eb3fe4b18612 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.154620 Oct 18 14:26:09.924650 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3626/7404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:09 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:10.948333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:10.948975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:10.955233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:10.955749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:10.956202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:10.956901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:10.957373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:10.957825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:11.101085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:11.109888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c10beb80-2c24-4908-9fb5-38cdbdf683f4 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1520 microversion: 2.1 time: 0.165939 Oct 18 14:26:11.110504 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3779/7405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:10 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:12.139960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:12.140758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:12.147204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:12.147693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:12.148141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:12.148844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:12.149306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:12.149738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:12.400431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:12.408779 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d4745842-5293-47c3-b565-719f61ddf324 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1519 microversion: 2.1 time: 0.273001 Oct 18 14:26:12.409365 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3627/7406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:12 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:12.819689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "name": "network-vif-unplugged", "status": "completed", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:12.830718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:12.835149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:12.835149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:12.844249 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Creating event network-vif-unplugged:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h1-858383-13 Oct 18 14:26:12.849705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:26:12.860707 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5fad215e-7ef1-4943-b2fa-d7b943d8f791 req-9f13fc17-9a7d-4b91-81f9-a7cf3de9fdbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044778 Oct 18 14:26:12.861382 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3780/7407] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:13.433160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:13.434593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:13.441513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:13.441996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:13.442469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:13.443161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:13.443615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:13.444046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:13.666506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:13.675182 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-211debb5-c368-49f1-a2d0-22a7f4b69e26 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1519 microversion: 2.1 time: 0.246139 Oct 18 14:26:13.687056 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3628/7408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:13 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:14.701109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:14.701821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:14.708317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:14.708757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:14.709212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:14.709909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:14.710562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:14.710844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:14.845378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:14.853548 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9294314-98ec-4bbc-b740-ed9bedb3d34c tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1517 microversion: 2.1 time: 0.157640 Oct 18 14:26:14.854135 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3781/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:14 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:14.875395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:14.885731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:14.886398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:14.887106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:14.898457 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Creating event network-changed:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h1-858383-13 Oct 18 14:26:14.905191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:26:14.917594 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-72b7bb8c-b1fc-4f3a-ba4f-1dca2097aef9 req-0c180c52-fd42-42a8-b726-1f670726ba45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045846 Oct 18 14:26:14.919001 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3629/7410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:15.876825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:15.877435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:15.884253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.884759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.885212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:15.885974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.886474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.887191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:16.023657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:16.033385 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a5c0624-e576-4044-abaa-600fd036d2bb tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1517 microversion: 2.1 time: 0.160487 Oct 18 14:26:16.033961 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3782/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:15 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:17.057293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:17.058004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:17.065503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.065991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.066464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.067160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.067624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.068062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.197759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:17.205450 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-074bde1e-5049-4c08-a5fb-e13d6447107f tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1514 microversion: 2.1 time: 0.152447 Oct 18 14:26:17.206031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3630/7412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:17 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:17.227785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:17.228699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:17.236178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.236679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.237134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.237839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.238337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.238783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.425287 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a020699-2dc7-4ea8-ada5-75a0e892e1c3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "POST /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409/action" status: 204 len: 0 microversion: 2.1 time: 0.201242 Oct 18 14:26:17.425942 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3783/7413] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:26:17 2022] POST /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:26:17.434504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:17.435890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:17.442099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.442591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.443034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.443731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.444191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.444622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.576820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:17.584743 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4458f794-ab53-471a-a00d-4559b94f459a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1514 microversion: 2.1 time: 0.154120 Oct 18 14:26:17.585682 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3631/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:17 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:18.609381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:18.610162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:18.617237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:18.617742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:18.618237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:18.618947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:18.619421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:18.619874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:18.753225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:18.761041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08b20d9f-b3fa-4c37-8c8d-911f37ceac5e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1514 microversion: 2.1 time: 0.156026 Oct 18 14:26:18.761620 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3784/7415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:18 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:19.782363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "name": "network-vif-plugged", "status": "completed", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:19.784164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:19.784793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:19.791975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:19.792478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:19.792620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:19.792928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:19.793066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:19.793511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:19.793631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:19.794115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:19.794895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:19.805035 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] Creating event network-vif-plugged:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h1-858383-13 Oct 18 14:26:19.810068 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a53c8396-fe75-44d5-890f-21949369906f req-eb5fdd62-698d-4aed-ac8d-62ebc332da7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Oct 18 14:26:19.810679 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3632/7416] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:19.929053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:19.937505 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7bb17680-84b3-43d0-9b30-6df4d42c16a5 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1506 microversion: 2.1 time: 0.157163 Oct 18 14:26:19.938102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3785/7417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:19 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:26:19.961812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:19.962551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:19.968739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:19.969221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:19.969663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:19.970383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:19.970849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:19.971276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.105316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:20.113180 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4820824a-7f8e-405c-9291-f863cd9b963a tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1506 microversion: 2.1 time: 0.155577 Oct 18 14:26:20.113744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3633/7418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:19 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:20.136064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:20.136706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:20.143545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.144048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.144512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.145226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.145703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.146171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.280067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:20.287841 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-88eb2f3b-e717-4339-ba05-bd602693d7c2 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1506 microversion: 2.1 time: 0.155765 Oct 18 14:26:20.288411 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3786/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:20 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:20.310624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:20.311692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:20.317690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.318250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.318707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.319403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.319872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.320310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.345047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:26:20.611227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b39609b3-a671-455a-90a9-c18e3ccbc6cc tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 204 len: 0 microversion: 2.1 time: 0.304106 Oct 18 14:26:20.611857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3634/7420] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:26:20 2022] DELETE /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:26:20.629160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:20.629742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:20.636035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.636578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.637298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.638004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.638507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.639022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.664865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:26:20.779164 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.compute.api [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Instance is already in deleting state, ignoring this request Oct 18 14:26:20.780522 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4fcf408e-217f-4507-87c6-c530ac7e8285 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 204 len: 0 microversion: 2.1 time: 0.155331 Oct 18 14:26:20.781088 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3787/7421] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:26:20 2022] DELETE /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:26:20.789931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:20.790695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:20.798797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.799284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.799722 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.800408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:20.800864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:20.801290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:20.932301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:20.940732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dcf67e7b-1854-4ade-a941-a834b77c80f3 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1512 microversion: 2.1 time: 0.155103 Oct 18 14:26:20.941317 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3635/7422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:20 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:21.963895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:21.964531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:21.972130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:21.972581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:21.973043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:21.973758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:21.974275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:21.974729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:22.103601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:22.111700 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca22be06-c21d-4aa2-b310-557c6b8c36e1 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1512 microversion: 2.1 time: 0.151771 Oct 18 14:26:22.112282 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3788/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:21 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:22.567473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5074e97d-f0fc-4296-a13c-1972f60d0409", "name": "network-vif-deleted", "tag": "9db0a181-eac5-4b0f-b777-dc70e347b730"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:22.578236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:22.578732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:22.579180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:22.590566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] Creating event network-vif-deleted:9db0a181-eac5-4b0f-b777-dc70e347b730 for instance 5074e97d-f0fc-4296-a13c-1972f60d0409 on n-h1-858383-13 Oct 18 14:26:22.596346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-47992d01-bc8e-4cf4-bf86-d502ec8defd0 req-0edc871a-5b49-4cfc-b89d-852daa11e49f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032375 Oct 18 14:26:22.596964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3636/7424] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:23.135854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:23.136512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:23.144025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:23.144534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:23.145004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:23.145847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:23.146353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:23.146804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:23.178220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:23.178724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:23.179185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:23.179651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lazy-loading 'fault' on Instance uuid 5074e97d-f0fc-4296-a13c-1972f60d0409 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:26:23.224502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e338ca8ecf9646e1b5f798d5ea65f5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee305e628b7a4f069272604cf496df83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:23.231457 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0101ef6d-1cfd-410a-8bd0-c5f26a239eb6 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 200 len: 1305 microversion: 2.1 time: 0.099507 Oct 18 14:26:23.232033 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3789/7425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:23 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:24.256969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:24.265901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 5074e97d-f0fc-4296-a13c-1972f60d0409] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:24.265901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:24.265901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:24.265901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:24.266426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:24.266894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:24.267338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:24.280557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] HTTP exception thrown: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Request method failure captured: Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 HTTP/1.1 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrcfdtLFLFcn4apIz5f2LH4y84-ogaRt67GFnFxZmFtcN_RZFAb8EmWR9FanIa43pMsT-tV_UeOaS3GOlqwoWyinWFjkbKIMnKE9fVGXMMlWuCJUvezzp0gC7YfkqCh8XBuhgBssoAJYZMnOchNbjAjfyFx9a5vFaivaKVmi-2cIyMk Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee305e628b7a4f069272604cf496df83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee305e628b7a4f069272604cf496df83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e338ca8ecf9646e1b5f798d5ea65f5c9 Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '5074e97d-f0fc-4296-a13c-1972f60d0409'} Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:24.282213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Returning 404 to user: Instance 5074e97d-f0fc-4296-a13c-1972f60d0409 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3310c42f-2a5b-4d6d-b101-8b8e34f5f9a9 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409" status: 404 len: 111 microversion: 2.1 time: 0.031959 Oct 18 14:26:24.287607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3637/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:24 2022] GET /compute/v2.1/servers/5074e97d-f0fc-4296-a13c-1972f60d0409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:26:24.292367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9bee9a79-608d-4f69-89a5-b160cb685f13 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '.version_select at 0x7fb328169940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:24.400319 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9bee9a79-608d-4f69-89a5-b160cb685f13 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812799891" status: 202 len: 0 microversion: 2.1 time: 0.111653 Oct 18 14:26:24.400907 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3790/7427] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 14:26:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812799891 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:26:25.110448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:25.110952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:25.117062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:25.117615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:25.118230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:25.118920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:25.119380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:25.119806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:25.133725 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] HTTP exception thrown: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Request method failure captured: Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e HTTP/1.1 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrcfdtLFLFcn4apIz5f2LH4y84-ogaRt67GFnFxZmFtcN_RZFAb8EmWR9FanIa43pMsT-tV_UeOaS3GOlqwoWyinWFjkbKIMnKE9fVGXMMlWuCJUvezzp0gC7YfkqCh8XBuhgBssoAJYZMnOchNbjAjfyFx9a5vFaivaKVmi-2cIyMk Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee305e628b7a4f069272604cf496df83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee305e628b7a4f069272604cf496df83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: e338ca8ecf9646e1b5f798d5ea65f5c9 Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '2870b0c3-fc1b-4c27-970f-23fd92d5676e'} Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:26:25.135265 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Returning 404 to user: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2af9bf52-c757-4baa-a523-8349b9688a7e tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 404 len: 111 microversion: 2.1 time: 0.030266 Oct 18 14:26:25.140086 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3638/7428] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:26:25 2022] DELETE /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:26:25.146285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:25.146954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] [instance: 2870b0c3-fc1b-4c27-970f-23fd92d5676e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:25.153605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:25.154127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:25.154589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:25.155299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:25.155774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:25.156228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:25.160320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:25.169204 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] HTTP exception thrown: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Request method failure captured: Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e HTTP/1.1 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrcfdtLFLFcn4apIz5f2LH4y84-ogaRt67GFnFxZmFtcN_RZFAb8EmWR9FanIa43pMsT-tV_UeOaS3GOlqwoWyinWFjkbKIMnKE9fVGXMMlWuCJUvezzp0gC7YfkqCh8XBuhgBssoAJYZMnOchNbjAjfyFx9a5vFaivaKVmi-2cIyMk Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee305e628b7a4f069272604cf496df83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee305e628b7a4f069272604cf496df83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee305e628b7a4f069272604cf496df83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: ee305e628b7a4f069272604cf496df83 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1469793062 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: e338ca8ecf9646e1b5f798d5ea65f5c9 Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerDiskConfigTestJSON-1469793062-project Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '2870b0c3-fc1b-4c27-970f-23fd92d5676e'} Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:25.171049 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] Returning 404 to user: Instance 2870b0c3-fc1b-4c27-970f-23fd92d5676e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5df3cf89-196e-4a8a-b625-fd0e8182f723 tempest-ServerDiskConfigTestJSON-1469793062 tempest-ServerDiskConfigTestJSON-1469793062-project] 10.222.0.27 "GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e" status: 404 len: 111 microversion: 2.1 time: 0.030097 Oct 18 14:26:25.175423 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3791/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:25 2022] GET /compute/v2.1/servers/2870b0c3-fc1b-4c27-970f-23fd92d5676e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:26:35.867920 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:35.868774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:35.979250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5c056d4-5578-4055-a7e5-a209011b754a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: .version_select at 0x7fb3312a5d30>, body: {"keypair": {"name": "tempest-keypair-63924846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoI2ZRNWDn7rep3DdyZEoKlWH14B4atAmEr7u8HpFoQnqukg3dJXRhSglsx35XDgx0o0OYj8EWnOLPSbpDBi066PxPwOkX3qMA4ESkRA0cg2c++rj3qJxa1RZ/YN1bN+w=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:35.995618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c5c056d4-5578-4055-a7e5-a209011b754a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:26:36.000883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c5c056d4-5578-4055-a7e5-a209011b754a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:26:36.086328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5c056d4-5578-4055-a7e5-a209011b754a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.224108 Oct 18 14:26:36.087004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3639/7430] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:26:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:38.409937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-108233828", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "800eccd6-fea4-49d7-a44b-3c60a6d5993e"}], "security_groups": [{"name": "tempest-securitygroup--1445599598"}], "key_name": "tempest-keypair-63924846", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:38.426093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:38.539775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] validate_networks() for [('800eccd6-fea4-49d7-a44b-3c60a6d5993e', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:26:38.948199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:26:38.948684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:26:38.949125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:26:38.949883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:26:38.950444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:26:38.959864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:38.960365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:38.960820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:38.961658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:38.962164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:38.962610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:38.980377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:26:38.986343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:26:38.999597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:26:39.001916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:26:39.153384 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77f1cfd5-995e-4af6-b592-729023fb2c84 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.747800 Oct 18 14:26:39.154072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3792/7431] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:26:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:26:39.166091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53b945ff-697f-4387-9650-8041ef6ca30a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:39.166726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53b945ff-697f-4387-9650-8041ef6ca30a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:39.227615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53b945ff-697f-4387-9650-8041ef6ca30a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:39.236059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53b945ff-697f-4387-9650-8041ef6ca30a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1236 microversion: 2.1 time: 0.073588 Oct 18 14:26:39.237063 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3640/7432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:39 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:40.262276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:40.263051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:40.272837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:40.273278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:40.273742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:40.274523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:40.275001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:40.275687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:40.344592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:40.353328 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-19937950-1c4a-4a82-b05c-8b4f659076bb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1240 microversion: 2.1 time: 0.096639 Oct 18 14:26:40.354205 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3793/7433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:40 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:41.377561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:41.378207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:41.385821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:41.386381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:41.386826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:41.387786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:41.388249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:41.388687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:41.499060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:41.507046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ac47da2-1feb-4978-8efb-8b9c0de14288 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1296 microversion: 2.1 time: 0.133397 Oct 18 14:26:41.507625 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3641/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:41 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:42.533107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:42.533812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:42.540924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:42.541608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:42.542900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:42.542900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:42.543322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:42.543764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:42.681162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:42.689204 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc528b3b-6644-4d7c-97c4-583b06eb1eba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.161023 Oct 18 14:26:42.689780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3794/7435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:42 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:43.135039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:43.151608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:43.152107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:43.152556 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:43.164247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] Creating event network-changed:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h1-858383-13 Oct 18 14:26:43.169046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-967b36f2-8522-4d61-a338-d2096bb63174 req-0de40a09-4971-48b3-b3ab-eedb592a524f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Oct 18 14:26:43.169644 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3642/7436] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:26:43.712952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:43.713608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:43.720471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:43.720968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:43.721533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:43.722261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:43.722741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:43.723188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:43.855248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:43.863758 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de3fc33b-fca7-4e87-9e2c-4bc8b8f74abf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.154742 Oct 18 14:26:43.864327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3795/7437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:43 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:44.888699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:44.889408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:44.895718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:44.896207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:44.896655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:44.897346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:44.897808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:44.898266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:45.032580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:45.040314 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c548e0a2-a3c5-417d-b448-28ff226a8fa3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.157004 Oct 18 14:26:45.040904 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3643/7438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:44 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:46.063597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:46.064235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:46.071032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:46.071541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:46.072005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:46.072715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:46.073198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:46.073645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:46.206806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:46.214660 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cccfbdc7-23b9-4cd5-819a-1bf229220bf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.155008 Oct 18 14:26:46.215405 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3796/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:46 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:47.238140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:47.238961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:47.245899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:47.246422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:47.246870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:47.247559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:47.248017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:47.248445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:47.382098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:47.390138 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-27b8e259-bdf7-4a17-a8f8-ee713e465033 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.156555 Oct 18 14:26:47.390749 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3644/7440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:47 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:48.413466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:48.414261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:48.421283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:48.421779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:48.422272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:48.422970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:48.423567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:48.424660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:48.557548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:48.565966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3af3602f-9e68-4a81-96e0-4f58012cf086 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.156475 Oct 18 14:26:48.566566 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3797/7441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:48 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:49.588893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:49.589445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:49.592278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:49.597674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:49.598182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:49.598628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:49.599316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:49.599771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:49.600199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:49.738807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:49.746816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-be5dcfee-d25a-4d22-a201-2465539de4ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.161982 Oct 18 14:26:49.747387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3645/7442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:49 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:49.930861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "name": "network-vif-plugged", "status": "completed", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:49.936924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:49.937609 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:49.942943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:49.943444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:49.943901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:49.954953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] Creating event network-vif-plugged:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h1-858383-13 Oct 18 14:26:49.960732 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c02a1562-3270-42fe-9bf4-c6f3878085c2 req-4cae5e6a-e3a2-4522-bc9e-ae914e44cb5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 Oct 18 14:26:49.961319 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3798/7443] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:50.771182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:50.771718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:50.778641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:50.779128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:50.779597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:50.780285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:50.780746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:50.781180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:50.913994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:50.921689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28a6820e-93b2-4cf4-94f0-eebd96aedf30 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1362 microversion: 2.1 time: 0.155026 Oct 18 14:26:50.922287 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3646/7444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:50 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:51.946341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:51.947086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:51.953898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:51.954424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:51.954886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:51.955588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:51.956060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:51.956503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:52.091666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:52.099929 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3fa092ab-91d0-4a02-ad0a-09d1e66a975f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1549 microversion: 2.1 time: 0.159159 Oct 18 14:26:52.100508 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3799/7445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:51 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:52.122975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:52.123491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:52.130463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:52.130958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:52.131414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:52.132113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:52.132588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:52.133028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:52.210589 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ad1f2640-8771-457d-a3d3-aa6124133916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091411 Oct 18 14:26:52.211201 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3647/7446] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:26:52 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:53.188821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:53.199549 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:53.200258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:53.200720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:53.212721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] Creating event network-changed:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h1-858383-13 Oct 18 14:26:53.217925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7a6bc524-691e-4691-b477-ed8dc0d1024d req-a898941b-dbd9-4092-8753-c927aaf9b094 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032781 Oct 18 14:26:53.218794 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3800/7447] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:29.109827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:29.110630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:29.114512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:29.115155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.121697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.126442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.126442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.126442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.126442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.126442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.259160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:29.267696 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-70772c44-547e-43cc-8519-2e12bda8eb40 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.160540 Oct 18 14:27:29.268274 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3648/7448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:29 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:29.288613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:29.289379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=43 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:29.293406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:29.294167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.300316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.300821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.301279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.301991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.302506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.302952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.436688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:29.445731 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55e2772b-985f-4fd8-aeb9-5c30296b58a7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.159332 Oct 18 14:27:29.446346 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3801/7449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:29 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:29.468554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:29.469237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.475381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.475875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.476322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.477018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.477482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.477916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.616677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:29.624664 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b0638574-5325-4c40-a9a5-31db34670d28 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.160026 Oct 18 14:27:29.625250 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3649/7450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:29 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:29.648327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:29.650824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.656869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.657378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.657841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.658627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.659087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.659539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.690877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:29.697035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Old instance type m1.heat2, new instance type m1.heat {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:27:29.703807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:27:29.704248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:27:29.704743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:27:29.705174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:27:29.705606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:27:29.936320 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4485e91-371e-4905-9736-5532591da0d3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/action" status: 202 len: 0 microversion: 2.1 time: 0.292049 Oct 18 14:27:29.941039 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3802/7451] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:27:29 2022] POST /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:27:29.945485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:29.946141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.952643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.953235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.953685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.954418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.954886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.955327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:30.097186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:30.105686 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3d0f694a-e1c4-4907-9b2d-7aef649e45e9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1677 microversion: 2.1 time: 0.164067 Oct 18 14:27:30.106348 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3650/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:29 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:31.131236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:31.131871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:31.139981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:31.140490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:31.141088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:31.141820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:31.142325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:31.142783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:31.305721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:31.314427 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55db0470-403f-48eb-bd25-9888ed65bd41 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1677 microversion: 2.1 time: 0.187036 Oct 18 14:27:31.317325 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3803/7453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:31 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:32.337867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:32.338645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:32.345738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:32.346268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:32.346714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:32.347415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:32.347876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:32.348313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:32.554172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:32.562415 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d5a9e45-fc25-458c-9002-40c9aff439d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1677 microversion: 2.1 time: 0.228487 Oct 18 14:27:32.563067 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3651/7454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:32 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:33.586958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:33.587623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:33.595620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:33.596183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:33.597162 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:33.597347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:33.597820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:33.598931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:33.749286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:33.757485 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3b018a7-d92d-4ab0-8e28-7cfaa73961e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.174825 Oct 18 14:27:33.758096 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3804/7455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:33 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:34.782900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:34.783619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:34.791589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:34.796032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:34.796032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:34.796032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:34.796032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:34.796032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:34.925887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:34.935012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5559091c-a7b4-4c03-adc9-a457616d44f3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.156703 Oct 18 14:27:34.935601 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3652/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:34 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:35.958683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:35.959332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:35.966778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:35.967301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:35.967767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:35.968502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:35.968984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:35.969940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:36.148060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:36.161007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0ec5d84-a68f-4c0f-bffe-bc68d8f67c70 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.205918 Oct 18 14:27:36.161991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3805/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:35 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:37.185507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:37.186155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:37.193201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:37.193739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:37.194201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:37.195018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:37.195347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:37.195779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:37.327755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:37.336307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fd0a5c6-2772-4bb7-b64f-7bf85f166dab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.154709 Oct 18 14:27:37.336888 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3653/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:37 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:38.360237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:38.360862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:38.367640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:38.368137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:38.368591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:38.369288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:38.369755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:38.370229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:38.508223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:38.516477 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-655e39b3-802a-451c-8e81-948f2031d3c6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.160303 Oct 18 14:27:38.517082 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3806/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:38 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:39.540342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:39.540994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:39.548550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:39.549048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:39.549493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:39.550253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:39.550719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:39.551157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:39.686398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:39.694166 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a1934802-a04d-4007-81f1-fb41fcaa03de tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.157737 Oct 18 14:27:39.694748 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3654/7460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:39 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:40.717696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:40.718421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:40.725281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:40.725783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:40.726276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:40.726995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:40.727552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:40.728013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:40.866644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:40.874754 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f34780c5-ba4e-46cf-91ea-e653b731c8a3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.161120 Oct 18 14:27:40.875486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3807/7461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:40 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:41.899396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:41.900016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:41.906108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:41.907119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:41.907563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:41.908245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:41.908704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:41.909131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:42.038175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:42.046212 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4876fa5c-4fd8-40a9-860b-7801fa3b7901 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.150801 Oct 18 14:27:42.046799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3655/7462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:41 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:43.070194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:43.070832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:43.077820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:43.078383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:43.078848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:43.079651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:43.080137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:43.080588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:43.214452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:43.222416 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc608d6a-388c-4e1c-aecf-3d83ba1b8381 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.156248 Oct 18 14:27:43.222994 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3808/7463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:43 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:44.246249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:44.246879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:44.255771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:44.256283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:44.256881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:44.257610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:44.258222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:44.258612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:44.398485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:44.407449 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dafdc9b0-1ea5-415f-b5f8-689c30fb8d22 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.165113 Oct 18 14:27:44.410903 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3656/7464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:44 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:45.431397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:45.432044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:45.439043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:45.439556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:45.440027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:45.440745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:45.441227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:45.441677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:45.573475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:45.582091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a160c092-a912-4f1e-993b-b35f3419e3f5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.154569 Oct 18 14:27:45.582689 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3809/7465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:45 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:46.605289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:46.606026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:46.613474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:46.613986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:46.614444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:46.615153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:46.615608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:46.616040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:46.769583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:46.769583 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7e5009f2-c7b1-4eb9-b5d9-470c357cf73a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.160233 Oct 18 14:27:46.769583 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3657/7466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:46 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:47.791435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:47.791990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:47.799788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:47.800348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:47.800917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:47.801727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:47.802306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:47.802835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:47.938499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:47.946412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fdc78f3-5b92-49f6-bd5a-754cf117dd8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.158954 Oct 18 14:27:47.946990 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3810/7467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:47 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:48.969834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:48.970489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:48.978138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:48.978644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:48.979092 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:48.979799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:48.980260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:48.980691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:49.133822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:49.142116 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22d0c80b-d5b7-44b8-98b7-76c882876265 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.176142 Oct 18 14:27:49.142698 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3658/7468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:48 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:50.166436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:50.167061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:50.174010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:50.174539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:50.174992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:50.175704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:50.176175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:50.176621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:50.318178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:50.326595 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c32ee072-3e49-4436-a999-570d12377199 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1682 microversion: 2.1 time: 0.164646 Oct 18 14:27:50.327194 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3811/7469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:50 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:51.350634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:51.351261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:51.358315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:51.358799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:51.359250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:51.360470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:51.360934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:51.361370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:51.382301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "name": "network-vif-unplugged", "status": "completed", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:51.394246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:51.394761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:51.395256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:51.411263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Creating event network-vif-unplugged:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h2-858383-13 Oct 18 14:27:51.418918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] Instance e3a05020-04db-4b25-b6ff-888113493c39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:27:51.430802 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9643525d-adb2-4001-b1fc-3a4eca8ee31d req-8c8651e2-2bbd-4200-ad8d-f76ffc58db98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052594 Oct 18 14:27:51.431435 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3812/7470] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:27:51.508673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:51.517066 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59846a6b-86cd-4746-8cf8-5df727518388 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1681 microversion: 2.1 time: 0.170292 Oct 18 14:27:51.517788 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3659/7471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:51 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:52.542498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:52.543245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:52.550521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:52.550962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:52.551422 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:52.552151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:52.552626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:52.553072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:52.705421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:52.713361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f11626e-9654-421b-9949-2c6b9341b091 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1681 microversion: 2.1 time: 0.176338 Oct 18 14:27:52.713940 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3813/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:52 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:27:53.444890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:53.455858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:53.456339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:53.456773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:53.468768 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Creating event network-changed:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h2-858383-13 Oct 18 14:27:53.474681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] Instance e3a05020-04db-4b25-b6ff-888113493c39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:27:53.485767 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1448eba7-8803-4c60-b543-f2a3766b5e15 req-764bfebe-611c-44b0-8430-dc288f259765 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044765 Oct 18 14:27:53.486388 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3660/7473] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:53.737528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:53.738199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:53.745023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:53.747064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:53.747064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:53.747064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:53.747470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:53.747616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:53.878302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:53.886811 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13f773db-ea25-481e-91cb-dd7db998cccd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1679 microversion: 2.1 time: 0.153220 Oct 18 14:27:53.887643 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3814/7474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:53 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:54.912910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:54.913645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:54.921363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:54.922450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:54.922911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:54.923617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:54.924100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:54.924748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:55.071811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:55.080160 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-140d820b-e949-4780-b4e2-1a050110e118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1676 microversion: 2.1 time: 0.171536 Oct 18 14:27:55.080746 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3661/7475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:54 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:55.103725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:55.104277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:55.111095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:55.111606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:55.112075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:55.112792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:55.113271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:55.113719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:55.152129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:55.303329 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5cc2632-9b19-4904-9d65-d5cc8b52dc9d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/action" status: 204 len: 0 microversion: 2.1 time: 0.203351 Oct 18 14:27:55.303984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3815/7476] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:27:55 2022] POST /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39/action => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:27:55.312055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:55.313222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:55.319243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:55.319743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:55.320189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:55.320893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:55.321355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:55.321785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:55.463865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:55.471947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-51f9eecd-7331-45a5-971b-504b5a9c591c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1676 microversion: 2.1 time: 0.163675 Oct 18 14:27:55.472527 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3662/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:55 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:56.496740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:56.497513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:56.504266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:56.504769 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:56.505228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:56.505959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:56.506456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:56.506956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:56.644645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:56.652628 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f2fd1425-b219-45c2-83ff-cf51a47450fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1676 microversion: 2.1 time: 0.160969 Oct 18 14:27:56.653202 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3816/7478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:56 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:56.674638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "name": "network-vif-plugged", "status": "completed", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:56.685263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:56.685744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:56.686226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:56.698732 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Creating event network-vif-plugged:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h2-858383-13 Oct 18 14:27:56.704680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] Instance e3a05020-04db-4b25-b6ff-888113493c39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:27:56.715369 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-40d5e5aa-d405-45bb-ba34-908f85ac0998 req-3cdd54e2-3457-4cfb-9fb3-e3719f8c54ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045176 Oct 18 14:27:56.716041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3663/7479] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:57.678575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:57.679230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:57.686010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:57.686550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:57.687030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:57.687719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:57.688195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:57.688647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:57.816216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:57.824216 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3dd99dc0-93ba-43dc-bf5c-44508963056f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.149594 Oct 18 14:27:57.824804 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3817/7480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:57 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:57.848412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:57.849118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:57.855271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:57.855763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:57.856210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:57.856902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:57.857361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:57.857795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:57.994969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:58.002948 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5f9a4c13-8c0b-48ab-9cac-3d2cdbbafb19 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.160116 Oct 18 14:27:58.003526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3664/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:57 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:58.026473 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:58.027042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:58.033688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.034216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.034674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.035379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.035850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.036293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.172000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:58.181059 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9665ad1-10fb-48f0-a861-1425d91e3aa2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1668 microversion: 2.1 time: 0.158570 Oct 18 14:27:58.188128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3818/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:58 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:58.203817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:58.204321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:58.210360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.210857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.211307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.212007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.212482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.212923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.217005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:58.238248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:27:58.486562 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f752a0fc-3654-48f2-b6b2-30e0644f0a7b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 204 len: 0 microversion: 2.1 time: 0.287019 Oct 18 14:27:58.487167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3665/7483] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:27:58 2022] DELETE /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:27:58.495443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:58.496078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:58.503227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.503754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.504219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.505190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:58.505675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:58.506160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:58.638433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:58.647211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-091b889b-b1d4-4b73-b301-47f2b864eb65 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1674 microversion: 2.1 time: 0.155602 Oct 18 14:27:58.647733 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3819/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:58 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:59.670550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:59.671274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:59.675202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:59.678758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:59.679257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:59.679709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:59.680411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:59.680880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:59.681317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:59.817690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:59.825425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f14dc596-696f-4ee6-b5dd-d8d5cb2b71d5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1674 microversion: 2.1 time: 0.159250 Oct 18 14:27:59.825996 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3666/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:59 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:00.850097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:00.852370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:00.860043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=43 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:00.860403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a05020-04db-4b25-b6ff-888113493c39", "name": "network-vif-deleted", "tag": "e09b7cb4-e650-44a5-8f21-ac652434d30b"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:00.861506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:00.862026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:00.862533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:00.863418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:00.863912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:00.864490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:00.872893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:00.873736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:00.874388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:00.886660 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] Creating event network-vif-deleted:e09b7cb4-e650-44a5-8f21-ac652434d30b for instance e3a05020-04db-4b25-b6ff-888113493c39 on n-h2-858383-13 Oct 18 14:28:00.892418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-28d6a247-1a22-40d5-8af9-871b70838223 req-cc16604e-81ed-46a7-9813-0907aca7228b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Oct 18 14:28:00.900106 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3667/7486] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:28:00.984085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:00.993857 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4840d26c-05ea-4e5f-9e3e-e12af2ee5ebf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 200 len: 1606 microversion: 2.1 time: 0.147956 Oct 18 14:28:00.994485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3820/7487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:00 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 1606 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:02.019602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:02.020243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:02.026582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.027074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.027520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.028215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.028679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.029114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.042834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 HTTP/1.1 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e3a05020-04db-4b25-b6ff-888113493c39'} Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:28:02.044489 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-988f5a95-6da0-4180-b489-c1286b20a384 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 404 len: 111 microversion: 2.1 time: 0.032165 Oct 18 14:28:02.048786 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3668/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:02 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:28:02.060258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:02.060966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:02.068949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.069455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.069919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.070658 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.071164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.071612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.085462 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 HTTP/1.1 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e3a05020-04db-4b25-b6ff-888113493c39'} Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:28:02.087161 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8adb4d7-f2c4-480a-ac2b-35632fd29f3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 404 len: 111 microversion: 2.1 time: 0.032210 Oct 18 14:28:02.091562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3821/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:02 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:28:02.138407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1362797260", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "800eccd6-fea4-49d7-a44b-3c60a6d5993e"}], "security_groups": [{"name": "tempest-securitygroup--1445599598"}], "key_name": "tempest-keypair-63924846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:02.342606 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] validate_networks() for [('800eccd6-fea4-49d7-a44b-3c60a6d5993e', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:28:02.724938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:28:02.725361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:28:02.725886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:28:02.726320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:28:02.726736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:28:02.736058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.736545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.736981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.737705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:02.738193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:02.738624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:02.755885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:28:02.761725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:28:02.774227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:28:02.777431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:28:02.901888 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f5f938e8-2f6d-4b62-81f0-a39abadfde48 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767572 Oct 18 14:28:02.902573 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3669/7490] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:28:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:28:02.914451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0298a2b5-4c1c-4f12-81ad-97aec6fa3f57 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:02.915088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0298a2b5-4c1c-4f12-81ad-97aec6fa3f57 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:02.971540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0298a2b5-4c1c-4f12-81ad-97aec6fa3f57 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:02.982960 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0298a2b5-4c1c-4f12-81ad-97aec6fa3f57 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1237 microversion: 2.1 time: 0.068356 Oct 18 14:28:02.982960 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3822/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:02 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:04.003380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:04.004007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:04.012001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:04.012758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:04.013203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:04.014000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:04.014496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:04.015078 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:04.076852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:04.085010 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54fac39c-f94a-4352-8529-6b614e2407a5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1241 microversion: 2.1 time: 0.086326 Oct 18 14:28:04.085617 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3670/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:03 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:05.108873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:05.110318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:05.117429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:05.117940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:05.118433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:05.121733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:05.121733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:05.121733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:05.195811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:05.203610 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c220acea-65d6-4b46-8161-f27e2282ed04 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1307 microversion: 2.1 time: 0.098602 Oct 18 14:28:05.204182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3823/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:05 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:06.228022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:06.228746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:06.235694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:06.236186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:06.236639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:06.237338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:06.237797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:06.238264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:06.368242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:06.376380 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fbed74e-a95a-4ef3-b846-c93eba4cd78e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.152271 Oct 18 14:28:06.376980 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3671/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:06 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:06.762999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:06.773148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:06.773644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:06.774115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:06.787055 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] Creating event network-changed:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h2-858383-13 Oct 18 14:28:06.792722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-6854f290-f690-4fdc-acba-8c6509822db6 req-be9fb422-c4e0-4f4f-b7e7-af258bf1ed79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093433 Oct 18 14:28:06.793642 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3824/7495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:28:07.400780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:07.401401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:07.408227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:07.408723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:07.409170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:07.409864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:07.410359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:07.410798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:07.544244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:07.551911 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37374e86-c62c-43fc-b668-d6e5d6a27c26 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.155103 Oct 18 14:28:07.552491 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3672/7496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:07 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:08.576283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:08.577006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:08.584467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:08.584978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:08.585441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:08.586232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:08.586712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:08.587178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:08.794968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:08.803154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-711c8d7c-e380-4a5e-9b3c-c04590643aa0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.231457 Oct 18 14:28:08.803726 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3825/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:08 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:09.828059 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:09.828627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:09.835545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:09.836026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:09.836467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:09.837150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:09.837607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:09.838034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:09.965482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:09.973800 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1f78a1d-227e-41b6-b181-c6c306ce7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.149805 Oct 18 14:28:09.974401 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3673/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:09 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:10.997155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:10.997880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:11.004693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:11.005195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:11.005686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:11.006417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:11.006885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:11.007330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:11.137865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:11.146154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5a6da97-c389-409d-9cbf-c28b2ba61f87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.153095 Oct 18 14:28:11.146715 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3826/7499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:10 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:12.170930 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:12.172327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:12.178320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:12.178824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:12.179273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:12.179971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:12.180434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:12.180869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:12.321989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:12.330912 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9e61185-8297-49c1-bab0-f100ac0b52f0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.165395 Oct 18 14:28:12.331496 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3674/7500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:12 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:12.761251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "name": "network-vif-plugged", "status": "completed", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:12.771940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:12.772451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:12.772914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:12.786139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] Creating event network-vif-plugged:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h2-858383-13 Oct 18 14:28:12.791817 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b8f9e8ba-a902-4c46-9127-047de64eac82 req-0c57f9cc-bb4b-4353-9a59-77b90aec3a83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095337 Oct 18 14:28:12.792424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3827/7501] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:28:13.356771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:13.357561 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:13.361294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:13.362749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:13.366310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:13.366808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:13.367256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:13.367952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:13.368414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:13.368846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:13.501412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:13.509298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-201fae16-bd18-4f17-8ce8-9a8c78860729 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1363 microversion: 2.1 time: 0.156399 Oct 18 14:28:13.511671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3675/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:13 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:14.534168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:14.534800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:14.536771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:14.542705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:14.543208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:14.543666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:14.544690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:14.545184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:14.545620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:14.678483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:14.686154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dcda489b-02f9-4430-a84e-6980d997e704 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1550 microversion: 2.1 time: 0.156431 Oct 18 14:28:14.686731 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3828/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:14 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:14.710135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:14.710648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:14.717306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:14.717791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:14.718280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:14.718964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:14.719420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:14.719849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:14.799177 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15e0e24b-98eb-4b86-840e-6c92363ce4da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093266 Oct 18 14:28:14.799778 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3676/7504] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:28:14 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:28:15.798849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:15.809782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:15.810318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:15.810782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:15.823113 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] Creating event network-changed:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h2-858383-13 Oct 18 14:28:15.828418 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c0373f72-0cb8-448d-88a9-3fda30f85e39 req-25e1d76c-d687-4229-9e1b-1303f5e96c34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034025 Oct 18 14:28:15.830114 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3829/7505] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:28:56.675042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:56.675828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:56.679805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:28:56.685738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:56.686265 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:56.686715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:56.710209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Going to try to stop instance {{(pid=121009) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:28:56.877328 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e1800618-d68a-48f9-8b40-e5339d9dc1b4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action" status: 202 len: 0 microversion: 2.1 time: 0.204336 Oct 18 14:28:56.877942 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3677/7506] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:28:56 2022] POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:28:56.887470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:56.888474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:56.890974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=21 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:56.891671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:56.897318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:56.897835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:56.898331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:56.899057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:56.899545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:56.899997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:57.036050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:57.043851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-794bc15c-eea8-4c32-a5d8-c6dbc40e123e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.160799 Oct 18 14:28:57.045732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3830/7507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:56 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:58.071354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:58.072066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:58.078821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:58.079332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:58.079775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:58.080483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:58.080947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:58.081403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:58.213847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:58.221676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b5f5b6cf-c234-45fb-84e8-1162a8bd5ebd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.156646 Oct 18 14:28:58.222276 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3678/7508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:58 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:28:59.245074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:28:59.245737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:28:59.253663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:59.254186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:59.255156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:59.255937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:28:59.256417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:28:59.256864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:28:59.389399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:28:59.397381 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e54c71c-cdc9-418c-a16d-a20a4e8b934b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.156291 Oct 18 14:28:59.398182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3831/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:28:59 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:00.420615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:00.422624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:00.428424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:00.428924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:00.429368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:00.430119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:00.430584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:00.431019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:00.573181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:00.580963 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-473b98b8-df15-4641-9044-a2741e333e2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.164269 Oct 18 14:29:00.581559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3679/7510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:00 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:01.604605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:01.605236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:01.612139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:01.612643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:01.613103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:01.614352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:01.614897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:01.615426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:01.747548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:01.755973 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d67ee264-a284-4d75-9ba5-fe7bd330326b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.155366 Oct 18 14:29:01.756543 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3832/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:01 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:02.779664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:02.780295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:02.787125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:02.787619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:02.788068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:02.788764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:02.789234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:02.789666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:02.916429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:02.924229 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3bb1148e-2a16-4b6f-9806-7f2de7a191fd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.148537 Oct 18 14:29:02.924811 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3680/7512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:02 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:03.947307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:03.947949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:03.954926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:03.955438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:03.955901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:03.956618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:03.957104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:03.957568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:04.085241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:04.093114 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d0e384d-194c-4f7c-8cdd-d1efb71c052f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.149715 Oct 18 14:29:04.093689 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3833/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:03 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:05.116568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:05.117366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:05.124238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:05.124742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:05.125189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:05.125889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:05.126410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:05.126851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:05.257136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:05.265431 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02b37832-7745-4ae1-9fdb-4e3b00e32125 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.152900 Oct 18 14:29:05.266015 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3681/7514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:05 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:06.288540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:06.289176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:06.296065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:06.296575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:06.297041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:06.297754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:06.298271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:06.298725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:06.427724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:06.435480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c2dad11-709b-4cfa-8eaa-91121570dc32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.150975 Oct 18 14:29:06.436045 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3834/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:06 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:07.460151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:07.460776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:07.467736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:07.468226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:07.468670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:07.469357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:07.469815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:07.470286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:07.598218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:07.605902 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90d24a76-4020-4363-859a-703e2c80bfba tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.150301 Oct 18 14:29:07.606507 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3682/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:07 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:08.628852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:08.629493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:08.636550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:08.637060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:08.637530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:08.638540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:08.639020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:08.641436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:08.774273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:08.782023 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6bf46cc3-c61d-4586-b322-2ba057742630 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.157155 Oct 18 14:29:08.782622 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3835/7517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:08 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:29:09.805408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:09.805954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:09.812996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:09.813492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:09.813937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:09.814661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:09.815127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:09.815566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:09.942101 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:09.949799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1061fcc8-083d-4448-94c2-ba3cc5e054ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.148394 Oct 18 14:29:09.950406 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3683/7518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:09 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:10.973494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:10.974652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:10.980645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:10.981141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:10.981594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:10.982322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:10.982793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:10.983236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:11.118435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:11.126129 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-34794f27-fc16-4be0-b90e-376e0f85ef63 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.156785 Oct 18 14:29:11.126699 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3836/7519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:10 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:12.149460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:12.150190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:12.156538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:12.157032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:12.157483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:12.158211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:12.158707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:12.159138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:12.291204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:12.299346 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63eec884-1624-427e-a272-c535295cf407 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.153869 Oct 18 14:29:12.299937 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3684/7520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:12 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:13.324126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:13.324783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:13.331785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.332292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.332749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.334210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.334696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.335216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.467645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:13.476850 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cbf1d5f-936b-4ee1-8495-4da4cd1910ca tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1656 microversion: 2.1 time: 0.156495 Oct 18 14:29:13.477437 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3837/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:13 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:13.500553 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:13.502965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:13.510299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.510793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.511235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.511919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.512377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.513068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.543378 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:13.548803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:29:13.555877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:29:13.556310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:29:13.556792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:29:13.557208 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:29:13.557630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:29:13.780692 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa1ce558-ab55-4f50-8dbc-b63f6426c4ee tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action" status: 202 len: 0 microversion: 2.1 time: 0.284592 Oct 18 14:29:13.781318 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3685/7522] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:29:13 2022] POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:29:13.789768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:13.790565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:13.797008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.797513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.797972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.798753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:13.799227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:13.799671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:13.929527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:13.937408 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40735242-9e75-4860-a88c-ef062113d695 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.151694 Oct 18 14:29:13.937968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3838/7523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:13 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:14.962370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:14.962921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:14.969667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:14.970589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:14.970713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:14.971313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:14.971782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:14.972219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:15.112015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:15.124473 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d2f4ffcb-fff0-4694-85ff-f94396eee3d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.167498 Oct 18 14:29:15.125065 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3686/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:14 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:16.150007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:16.150776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:16.158205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:16.158724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:16.160527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:16.160527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:16.160527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:16.160874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:16.710241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:16.718463 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f487c58-b963-4cfa-8ee5-d76fa73f93ef tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1679 microversion: 2.1 time: 0.573500 Oct 18 14:29:16.719053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3839/7525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:16 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1679 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:17.742442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:17.742973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:17.749890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:17.750418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:17.750862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:17.751557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:17.752018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:17.752452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:17.885640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:17.893652 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b9460f0a-eef5-41c9-bf1e-b4bb7915ba17 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1684 microversion: 2.1 time: 0.155866 Oct 18 14:29:17.894275 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3687/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:17 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:18.917738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:18.918475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:18.925470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:18.925980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:18.926475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:18.927194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:18.927677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:18.928125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:19.060564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:19.068419 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c761233-3c3b-43c9-92de-0a6991feb1cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1684 microversion: 2.1 time: 0.154490 Oct 18 14:29:19.068990 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3840/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:18 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:20.092665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:20.093399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:20.101136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:20.101639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:20.102180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:20.102893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:20.103377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:20.103806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:20.563760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:20.571875 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c408db03-500b-4d3a-903d-a902bfa7cb7e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1683 microversion: 2.1 time: 0.483073 Oct 18 14:29:20.572618 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3688/7528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:20 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1683 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:20.636780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "name": "network-vif-unplugged", "status": "completed", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:20.647129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:20.647634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:20.648084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:20.659702 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Creating event network-vif-unplugged:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h1-858383-13 Oct 18 14:29:20.665150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] Instance 3de02421-a079-40e6-9e79-0872676391fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:29:20.675937 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a45bb3d8-99b8-4a6e-b372-884e2fef6442 req-f69a6b12-73f4-44be-968b-e40feb9e768c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105096 Oct 18 14:29:20.676550 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3841/7529] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:21.596785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:21.597404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:21.605491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:21.605988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:21.606471 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:21.607177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:21.607642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:21.608079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:21.761873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:21.769924 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-96c62b54-1f55-4dc6-a653-edcef569f761 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1683 microversion: 2.1 time: 0.177119 Oct 18 14:29:21.770524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3689/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:21 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:22.702727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:22.712695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:22.713130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:22.713577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:22.725234 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Creating event network-changed:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h1-858383-13 Oct 18 14:29:22.731283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] Instance 3de02421-a079-40e6-9e79-0872676391fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:29:22.741636 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-50164727-f0b2-4718-bef9-4e0239978f1f req-ee299505-1a59-4568-954f-ee5f6734a44d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044226 Oct 18 14:29:22.742245 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3842/7531] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:22.793440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:22.794049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:22.800884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:22.801385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:22.801837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:22.802572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:22.803037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:22.803480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:22.940706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:22.950417 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-365e7c90-362d-4dec-b1e3-19b0d3521651 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1681 microversion: 2.1 time: 0.160790 Oct 18 14:29:22.951229 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3690/7532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:22 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:23.980469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:23.981189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:23.987312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:23.987814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:23.988342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:23.989007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:23.989510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:23.989929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:24.125382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:24.133854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6ff2632-b397-4e96-b520-51b597fc1df5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1677 microversion: 2.1 time: 0.158552 Oct 18 14:29:24.134540 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3843/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:23 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:24.156773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:24.157296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:24.164322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:24.164811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:24.165255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:24.165939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:24.166429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:24.166860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:24.170821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:24.392862 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3f9cf981-942c-4d8e-9aef-15c000a3f3c3 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action" status: 204 len: 0 microversion: 2.1 time: 0.239641 Oct 18 14:29:24.393473 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3691/7534] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:29:24 2022] POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:29:24.401710 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:24.403200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:24.410008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:24.410547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:24.411005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:24.411713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:24.412181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:24.412622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:24.579945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:24.587962 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c78eb832-9bad-43f4-8f2d-aa892bc8c5a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1677 microversion: 2.1 time: 0.190026 Oct 18 14:29:24.595364 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3844/7535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:24 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:25.613766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:25.614519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:25.620795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:25.621290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:25.621740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:25.622472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:25.622942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:25.623384 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:25.753478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:25.761277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8236b1c3-f345-4fb9-81a3-b0f2611a9a02 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1677 microversion: 2.1 time: 0.152643 Oct 18 14:29:25.761852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3692/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:25 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:26.673102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "name": "network-vif-plugged", "status": "completed", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:26.684455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:26.684957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:26.685406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:26.696966 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] Creating event network-vif-plugged:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h1-858383-13 Oct 18 14:29:26.702358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2ab39db8-3202-41a7-a744-95f0726aed7d req-db35b360-0c44-4ef5-b1b4-de186b2b0281 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032888 Oct 18 14:29:26.703012 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3845/7537] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:26.784898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:26.785522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:26.788387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=37 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:26.793769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:26.794370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:26.794817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:26.795853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:26.796322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:26.796758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:26.928754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:26.937156 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8a187e55-2be3-4297-8312-8b3711301664 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1656 microversion: 2.1 time: 0.156213 Oct 18 14:29:26.937797 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3693/7538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:26 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:26.960104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:26.960821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:26.967512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:26.968010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:26.968460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:26.969156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:26.969625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:26.970085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:27.098588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:27.107075 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc453e71-c5ec-491d-88d6-70641da38d2e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1656 microversion: 2.1 time: 0.151156 Oct 18 14:29:27.107659 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3846/7539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:26 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:27.129262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:27.135203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:27.135698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:27.136144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:27.158372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Going to try to start instance {{(pid=121009) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:29:27.317150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a48b53cc-85e0-4006-b753-972de577647b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action" status: 202 len: 0 microversion: 2.1 time: 0.191632 Oct 18 14:29:27.317762 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3694/7540] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:29:27 2022] POST /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:29:27.326386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:27.327088 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:27.329206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=35 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:27.334086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:27.334697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:27.335161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:27.335879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:27.336366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:27.336818 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:27.477192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:27.481207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:27.485920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0fd58a62-7966-4272-94da-f8274e047195 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1665 microversion: 2.1 time: 0.163677 Oct 18 14:29:27.486567 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3847/7541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:27 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:28.512429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:28.513404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:28.519610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:28.520176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:28.520633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:28.521329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:28.521790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:28.522255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:28.662189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:28.670320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9b66de4e-e829-4331-bed7-5a9ce3c08121 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1665 microversion: 2.1 time: 0.163189 Oct 18 14:29:28.670909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3695/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:28 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:29.695601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:29.696273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:29.703616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:29.704173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:29.704688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:29.705353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:29.705838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:29.706321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:29.848389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:29.856751 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ae1e16c-a537-4586-a8d1-55b363cdad8d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1669 microversion: 2.1 time: 0.165842 Oct 18 14:29:29.857324 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3848/7543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:29 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:29.879880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:29.883524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:29.887211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:29.887697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:29.888423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:29.889136 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:29.889596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:29.890028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:29.918937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:29:30.194379 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12ce9f3e-6b50-4671-98e5-4e7ac11db700 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 204 len: 0 microversion: 2.1 time: 0.318037 Oct 18 14:29:30.195207 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3696/7544] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:29:29 2022] DELETE /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:29:30.203312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:30.204195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:30.210346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:30.211902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:30.211902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:30.212117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:30.212539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:30.213502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:30.344276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:30.352223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa8b47ef-6dc6-4de3-80ec-a8e09134a64f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1675 microversion: 2.1 time: 0.152868 Oct 18 14:29:30.355059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3849/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:30 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:31.376870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:31.377581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:31.384496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:31.385456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:31.385915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:31.386645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:31.387113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:31.387550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:31.522486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:31.530986 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01fae666-1daa-4aad-a9ce-5a992a6c7ff5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1675 microversion: 2.1 time: 0.158516 Oct 18 14:29:31.531568 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3697/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:31 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:32.533122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de02421-a079-40e6-9e79-0872676391fb", "name": "network-vif-deleted", "tag": "cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:32.543913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:32.553314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:32.553314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:32.557204 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:32.557787 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] Creating event network-vif-deleted:cadc3d5f-8cc5-45b4-b2c1-5f6b11a3fe78 for instance 3de02421-a079-40e6-9e79-0872676391fb on n-h1-858383-13 Oct 18 14:29:32.557896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:32.562526 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bc8ee555-2331-4587-9a46-b2533ced023d req-ea061e4c-0ea7-4d3e-bea3-85670e76b527 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033002 Oct 18 14:29:32.563311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3850/7547] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:32.565117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:32.565465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:32.566439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:32.567146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:32.567607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:32.568041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:32.634647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:32.647829 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2047e506-9ea1-4f2b-9d0f-37f9abeedbc1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 200 len: 1607 microversion: 2.1 time: 0.096237 Oct 18 14:29:32.648438 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3698/7548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:32 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 1607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:29:33.680405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:33.681044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:33.687861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:33.688361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:33.688858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:33.689564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:33.690035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:33.690503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:33.705200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb HTTP/1.1 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3de02421-a079-40e6-9e79-0872676391fb'} Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:29:33.706888 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee60ccb9-7480-481f-a93a-710ef8ffc78d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 404 len: 111 microversion: 2.1 time: 0.033147 Oct 18 14:29:33.711305 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3851/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:33 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:29:33.726937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:33.727560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:33.734507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:33.735009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:33.735457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:33.736148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:33.736609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:33.737044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:33.750942 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb HTTP/1.1 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3de02421-a079-40e6-9e79-0872676391fb'} Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:29:33.752595 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a188f372-f742-42ef-a8d8-8c459ae1ac4a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 404 len: 111 microversion: 2.1 time: 0.031095 Oct 18 14:29:33.756499 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3699/7550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:33 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:29:33.803637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-910099628", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "800eccd6-fea4-49d7-a44b-3c60a6d5993e"}], "security_groups": [{"name": "tempest-securitygroup--1445599598"}], "key_name": "tempest-keypair-63924846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:33.908082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] validate_networks() for [('800eccd6-fea4-49d7-a44b-3c60a6d5993e', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:29:34.326590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:29:34.327064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:29:34.327564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:29:34.328001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:29:34.328452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:29:34.337354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:34.341409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:34.341409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:34.341409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:34.341409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:34.341409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:34.357326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:29:34.362694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:29:34.375580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:29:34.377882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:29:34.476309 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9b32e1b-209c-43cf-aef0-92a647e32fc9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676925 Oct 18 14:29:34.476961 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3852/7551] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:29:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:29:34.488400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-754af663-24e8-49f4-9b9e-3ebd49e70e9c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:34.489028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-754af663-24e8-49f4-9b9e-3ebd49e70e9c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:34.544540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-754af663-24e8-49f4-9b9e-3ebd49e70e9c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:34.553411 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-754af663-24e8-49f4-9b9e-3ebd49e70e9c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1236 microversion: 2.1 time: 0.068922 Oct 18 14:29:34.554073 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3700/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:34 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:35.578243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:35.578905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:35.588802 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:35.589311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:35.589771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:35.590527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:35.591016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:35.591468 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:35.654891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:35.662767 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e895847-3328-4e06-84b0-7b68c3d2fb5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1240 microversion: 2.1 time: 0.089326 Oct 18 14:29:35.663344 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3853/7553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:35 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:36.686427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:36.687836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:36.696271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:36.696777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:36.697276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:36.697968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:36.698473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:36.698919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:36.770320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:36.778849 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-064770a8-c5db-4063-8668-d63124b174ad tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1306 microversion: 2.1 time: 0.096424 Oct 18 14:29:36.779431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3701/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:36 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:37.804042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:37.804689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:37.811999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:37.812513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:37.812982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:37.813706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:37.814215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:37.814673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:38.009627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:38.017644 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54bfb3b8-6da1-467f-ba71-76c237216210 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.217669 Oct 18 14:29:38.018250 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3854/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:37 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:38.165317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:38.176293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:38.176785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:38.177422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:38.188621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] Creating event network-changed:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:29:38.193557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-39490483-169c-49a9-a0f4-3a53850a81dd req-4e170830-90b8-4369-800e-f3ec7cdf5723 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Oct 18 14:29:38.194348 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3702/7556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:39.040827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:39.041409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:39.048362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:39.048866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:39.049330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:39.050037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:39.050580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:39.050999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:39.183200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:39.190964 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75df84a2-c2ab-4f1f-9f7d-fc4205ba4430 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.154083 Oct 18 14:29:39.191535 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3855/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:39 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:40.216467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:40.218407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:40.223594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:40.224086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:40.224543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:40.225237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:40.225701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:40.226171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:40.356395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:40.364191 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db3166ca-dff9-4994-93d2-a0aebfc7f5e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.153008 Oct 18 14:29:40.364760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3703/7558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:40 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:41.389501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:41.390199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:41.396349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:41.396855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:41.397328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:41.398021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:41.398528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:41.398975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:41.532531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:41.540596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91b05704-d5ae-40ea-8e20-5b3e1ffac60e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.156291 Oct 18 14:29:41.551323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3856/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:41 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:29:42.566801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:42.567343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:42.569856 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:42.570010 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:29:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 (ip 10.222.0.27) !!! Oct 18 14:29:42.579317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:42.579867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:42.580315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:42.581040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:42.581527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:42.581960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:42.719641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:42.727335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe8ed4dd-19f3-4a01-9ab1-54ca537cd61c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.164906 Oct 18 14:29:42.727920 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3704/7560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:42 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:43.213447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-plugged", "status": "completed", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:43.218924 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:43.219077 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 14:29:43.230232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:43.230737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:43.231278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:43.243193 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] Creating event network-vif-plugged:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:29:43.248533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2e431683-d35b-44fe-9568-afe4dde6836b req-2e5cd961-89a9-4b3c-8b73-471f198f2c76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038840 Oct 18 14:29:43.249154 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3857/7561] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:43.750201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:43.750818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:43.757822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:43.758339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:43.758823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:43.759506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:43.760481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:43.760910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:43.891747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:43.899553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-144442b3-f86c-4205-88a6-e9c389d17624 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1362 microversion: 2.1 time: 0.153221 Oct 18 14:29:43.900127 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3705/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:43 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:44.922247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:44.922975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:44.927214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:44.931169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:44.935370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:44.935886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:44.936344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:44.937064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:44.937539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:44.937985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:45.145982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:45.155264 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-394dde01-aafa-4423-b4ed-6ef6c2badd80 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1548 microversion: 2.1 time: 0.234931 Oct 18 14:29:45.156034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3858/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:44 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1548 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:45.181955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:45.181955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:45.181955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:45.187512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:45.188006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:45.188448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:45.189279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:45.189848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:45.190313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:45.205491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:45.271592 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a6308642-1af2-4786-a187-37b372d4bd86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096945 Oct 18 14:29:45.279588 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3706/7564] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:29:45 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:46.585221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:46.595842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:46.596463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:46.596992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:46.609186 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] Creating event network-changed:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:29:46.614509 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7fcb0f06-34a7-4c1f-8f7b-939f942450e4 req-25a70a12-8cb8-4f59-9e83-6f124d6d5aa7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032996 Oct 18 14:29:46.615645 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3859/7565] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:30:27.400601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:27.405100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:27.407382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:27.414165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:27.414736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:27.415192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:27.415889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:27.416353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:27.416790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:27.446603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:27.452081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Old instance type m1.heat2, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:30:27.459581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:30:27.461850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:30:27.461850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:30:27.461850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:30:27.461850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:30:27.619237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a71723f7-e873-47e3-a24a-65c328e87c4e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/action" status: 202 len: 0 microversion: 2.1 time: 0.220472 Oct 18 14:30:27.619866 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3707/7566] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:30:27 2022] POST /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:30:27.627820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:27.628953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=52 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:27.633452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:27.634186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:27.640879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:27.645442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:27.645442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:27.645442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:27.645442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:27.645442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:27.791705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:27.800376 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-488b0ff5-2ef8-4c73-bcb6-00e29b154417 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1676 microversion: 2.1 time: 0.175787 Oct 18 14:30:27.800967 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3860/7567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:27 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:28.826081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:28.826721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:28.832650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:28.833139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:28.833581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:28.834295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:28.834759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:28.835205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:28.966730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:28.975390 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5c8fa5d6-cd29-4d79-84e5-6e8c578c214c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1676 microversion: 2.1 time: 0.154142 Oct 18 14:30:28.975970 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3708/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:28 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:29.998892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:29.999530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:30.006895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:30.007409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:30.007861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:30.008599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:30.009111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:30.009561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:30.554502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:30.562549 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d80a35a-a851-4b07-a0aa-f3b0f227de43 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1676 microversion: 2.1 time: 0.567517 Oct 18 14:30:30.563128 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3861/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:29 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1676 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:31.586041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:31.586695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:31.593548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:31.594037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:31.594522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:31.595220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:31.595736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:31.596169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:31.734264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:31.742899 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1f1032c6-b266-4dd9-8d85-de8b4559671c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.160788 Oct 18 14:30:31.744355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3709/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:31 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:32.768395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:32.769054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:32.776057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:32.776564 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:32.777023 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:32.777767 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:32.778278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:32.778732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:32.906201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:32.914497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abe01cef-652f-4920-8a34-00f912e40e8a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.150873 Oct 18 14:30:32.915079 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3862/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:32 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:33.938215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:33.938834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:33.946274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:33.946759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:33.947199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:33.947883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:33.948343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:33.948774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:34.076051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:34.084078 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02a569f7-98f1-425c-8943-36e47aff0439 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.149809 Oct 18 14:30:34.084659 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3710/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:33 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:35.107175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:35.107841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:35.115366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:35.115880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:35.116346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:35.117061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:35.117543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:35.117999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:35.248653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:35.256501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f64ca64d-6139-4479-98f2-015191956120 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.153282 Oct 18 14:30:35.257080 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3863/7573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:35 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:36.280811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:36.281352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:36.288779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:36.289270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:36.289719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:36.290436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:36.290901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:36.291338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:36.422450 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:36.430310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-15e6fe30-8c58-4e38-8d4d-dfb7c9dc43ed tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.153458 Oct 18 14:30:36.430901 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3711/7574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:36 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:37.453925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:37.455572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:37.462007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:37.462544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:37.467230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:37.467230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:37.467230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:37.467230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:37.592182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:37.600025 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-006400ee-3f02-44bc-9300-d77136c2e932 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.149980 Oct 18 14:30:37.600601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3864/7575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:37 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:38.624340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:38.624977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:38.632011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:38.633045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:38.633045 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:38.633656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:38.634135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:38.634566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:38.767017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:38.775462 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37d26b7e-1a7e-46c6-a728-d4c376bf9a86 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.155031 Oct 18 14:30:38.776031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3712/7576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:38 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:39.798993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:39.799534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:39.806509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:39.807015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:39.807476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:39.808210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:39.808686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:39.809133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:39.940588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:39.948484 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-618aa48d-099b-49a0-9430-c8b069ac1fd0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.153499 Oct 18 14:30:39.949065 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3865/7577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:39 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:40.972666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:40.973193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:40.980039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:40.980534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:40.980983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:40.981687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:40.982185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:40.982621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:41.109899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:41.118268 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e9b1e14a-0243-4d4a-90e7-bc4834f57543 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.150197 Oct 18 14:30:41.118845 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3713/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:40 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:42.143390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:42.144024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:42.150286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:42.150793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:42.151254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:42.151961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:42.152440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:42.152888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:42.286301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:42.294003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f25a373-f4b1-4ad1-9bea-4dae9e35a965 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1681 microversion: 2.1 time: 0.155657 Oct 18 14:30:42.294609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3866/7579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:42 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:43.318144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:43.318711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:43.325015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:43.325499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:43.325941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:43.326658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:43.327212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:43.327644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:43.463568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:43.471549 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1dd47dca-1bb5-419d-9f6b-f1e2c1947b2b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1680 microversion: 2.1 time: 0.158230 Oct 18 14:30:43.472396 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3714/7580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:43 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:43.920113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-unplugged", "status": "completed", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:43.932156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:43.933766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:43.933766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:43.944979 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Creating event network-vif-unplugged:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h1-858383-13 Oct 18 14:30:43.950215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] Instance adde8549-89d6-4664-84e8-fb187f8ee212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:30:43.961067 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9733208c-6214-4dea-9bc3-205ca1f77d24 req-223e4d4e-0023-4eba-bfe9-99e2c5c39824 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044618 Oct 18 14:30:43.961651 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3867/7581] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:44.496622 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:44.501680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:44.505785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:44.506310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:44.506752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:44.507621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:44.508082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:44.508515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:44.730367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:44.738586 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2033eda5-5a14-4808-ae61-6b32196ca8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1680 microversion: 2.1 time: 0.245967 Oct 18 14:30:44.739307 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3715/7582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:44 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:45.764391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:45.765019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:45.771674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:45.772173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:45.772627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:45.773326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:45.773798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:45.774269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:45.912943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:45.920832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-470d47c4-7fe9-496f-b1b9-d282794c365b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1678 microversion: 2.1 time: 0.161931 Oct 18 14:30:45.921397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3868/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:45 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:45.975853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:45.985872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:45.986393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:45.986826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:46.000634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Creating event network-changed:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h1-858383-13 Oct 18 14:30:46.005939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] Instance adde8549-89d6-4664-84e8-fb187f8ee212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:30:46.016863 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6596d17a-bd7d-41f7-b648-cf19799db451 req-8a6fcaa7-460b-47f3-aa92-ec9afe32d777 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044621 Oct 18 14:30:46.017485 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3716/7584] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:46.944625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:46.945177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:46.951955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:46.952455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:46.952911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:46.953617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:46.954115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:46.954565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:47.105593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:47.116592 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2e7232f-2cc4-4ace-ad51-8ca79f55f70d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1678 microversion: 2.1 time: 0.176051 Oct 18 14:30:47.117561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3869/7585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:46 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:48.143274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:48.144016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:48.150243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.150768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.151236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.151937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.152400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.152837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.281912 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:48.290452 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ce4a1939-6ac5-4283-941e-76e9b1f49cf0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1675 microversion: 2.1 time: 0.153060 Oct 18 14:30:48.291031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3717/7586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:48 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:48.312715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:48.313276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:48.320009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.320517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.320969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.321668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.322329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.322854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.360770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.361283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.361819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.362608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.363094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.363544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.384080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:30:48.389563 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:30:48.682073 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50c2af86-0542-4562-9cac-3e2f1d7edef5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/action" status: 202 len: 0 microversion: 2.1 time: 0.372947 Oct 18 14:30:48.683011 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3870/7587] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:30:48 2022] POST /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:30:48.691775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:48.692408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:48.698931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.699809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.700267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.700980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:48.701574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:48.702030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:48.838794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:48.846559 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11a76efb-4c67-4e8b-bc80-4b579192f44b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.159422 Oct 18 14:30:48.847134 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3718/7588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:48 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:49.082359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-plugged", "status": "completed", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:49.093886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:49.094515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:49.094975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:49.107643 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Creating event network-vif-plugged:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h1-858383-13 Oct 18 14:30:49.114191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] Instance adde8549-89d6-4664-84e8-fb187f8ee212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:30:49.126214 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1494ece8-83c2-47bf-a150-8e6dfab2dde9 req-fee21528-f754-42b8-ad84-9114c5115c18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048306 Oct 18 14:30:49.126214 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3871/7589] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:49.869950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:49.870594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:49.877380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:49.878816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:49.879327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:49.880033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:49.880512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:49.880950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:50.022909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:50.030711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-612c200e-756c-4dbb-afeb-2662e5f063e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.164713 Oct 18 14:30:50.031297 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3719/7590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:49 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:51.055499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:51.056253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:51.062485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:51.062995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:51.063461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:51.064180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:51.064657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:51.065128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:51.193408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:51.201339 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4c8bab3-a423-4e2c-ac93-a77c0b375a64 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.151069 Oct 18 14:30:51.201917 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3872/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:51 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:52.225368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:52.225991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:52.232955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:52.233452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:52.233904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:52.234632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:52.235228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:52.235661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:52.367273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:52.375209 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9967768a-4a30-4d4d-87f3-f40edba3ec29 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.153805 Oct 18 14:30:52.375832 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3720/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:52 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:52.736995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-unplugged", "status": "completed", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:52.749251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:52.749251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:52.749251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:52.763832 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Creating event network-vif-unplugged:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:30:52.769296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] Instance adde8549-89d6-4664-84e8-fb187f8ee212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:30:52.780377 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5f7def0b-4e2a-4635-917a-68d3c7447c5a req-8e1d70d7-ef88-4ea1-a934-01ab90baaa33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047215 Oct 18 14:30:52.780974 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3873/7593] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:53.399974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:53.400937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:53.407903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:53.408928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:53.410028 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:53.410897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:53.411440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:53.411951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:53.551534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:53.559450 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c8bd4b85-f702-4036-b29a-32d3502caec1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.163537 Oct 18 14:30:53.560017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3721/7594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:53 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:54.584838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:54.585552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:54.591771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:54.592279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:54.592739 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:54.593446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:54.593926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:54.594410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:54.613671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:54.726870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:54.734523 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7de5c691-770c-4c39-9180-2423e5d6d7ea tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.155348 Oct 18 14:30:54.735094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3874/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:54 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:54.794781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:54.805370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:54.805855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:54.806330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:54.818403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Creating event network-changed:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:30:54.820807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:54.824185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] Instance adde8549-89d6-4664-84e8-fb187f8ee212 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:30:54.834860 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-efdc1395-69b5-435c-a3a5-930a5aec2c85 req-73283a52-532c-411a-810a-15e348578db4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043735 Oct 18 14:30:54.835452 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3722/7596] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:55.759022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:55.759656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:55.767064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:55.769069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:55.769069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:55.769415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:55.769846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:55.770325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:55.915348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:55.923480 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a8a716c-2dd2-43a7-86df-fab85f7d7d0e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1674 microversion: 2.1 time: 0.168868 Oct 18 14:30:55.924060 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3875/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:55 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:56.949033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:56.949778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:56.956666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:56.957144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:56.957598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:56.958346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:56.958813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:56.959251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.092200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:57.100601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d54216a8-346a-4da1-97e8-99959376709b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1667 microversion: 2.1 time: 0.156755 Oct 18 14:30:57.101185 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3723/7598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:56 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:57.123167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:57.123821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:57.130715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.131213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.131670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.132384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.132839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.133279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.260593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:57.269275 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7cc71a7-6804-41fc-a2d5-0a02a106383d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1667 microversion: 2.1 time: 0.149522 Oct 18 14:30:57.269844 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3876/7599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:57 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:30:57.292177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:57.292795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:57.299756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.300246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.300706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.301386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.302024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.302610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.435809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:57.444496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bd4ec64-baae-4b97-babf-da5ab52be35f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1667 microversion: 2.1 time: 0.156163 Oct 18 14:30:57.445094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3724/7600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:57 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:57.468246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:57.468703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:57.474894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.475454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.475923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.476651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.477135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.477595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.502615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:30:57.524928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-plugged", "status": "completed", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:30:57.533283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=41 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:57.535509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.536067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.536512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.548210 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] Creating event network-vif-plugged:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:30:57.553270 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4e8c4415-549a-4a37-b99c-3ef6a60c2bd3 req-757f711d-339b-42ff-9f09-bcbc491136e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032070 Oct 18 14:30:57.561488 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3725/7601] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:30:57.798738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c816c4cc-1cdb-4e66-b11f-a5c4c429cc0f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 204 len: 0 microversion: 2.1 time: 0.333580 Oct 18 14:30:57.799294 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3877/7602] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:30:57 2022] DELETE /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:30:57.808534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:57.809242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:57.816616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.817090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.817531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.818299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:57.818763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:57.819192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:57.946412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:57.955034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7dd91587-1b07-464e-8d42-b8e2cc873110 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1673 microversion: 2.1 time: 0.150709 Oct 18 14:30:57.955610 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3726/7603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:57 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:30:58.979326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:30:58.980083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:30:58.983110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:58.983857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:58.989327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:58.989839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:58.990332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:58.991097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:30:58.991577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:30:58.992030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:30:59.127005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:30:59.134747 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d62b294b-586a-411c-a305-355ff4315d92 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1673 microversion: 2.1 time: 0.159750 Oct 18 14:30:59.135322 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3878/7604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:30:58 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:00.097769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde8549-89d6-4664-84e8-fb187f8ee212", "name": "network-vif-deleted", "tag": "9e10fee7-f568-4db9-89ba-e74aa3c3f8e1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:00.111179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:00.111745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:00.115251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:00.125597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] Creating event network-vif-deleted:9e10fee7-f568-4db9-89ba-e74aa3c3f8e1 for instance adde8549-89d6-4664-84e8-fb187f8ee212 on n-h2-858383-13 Oct 18 14:31:00.131790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c8b1f019-d66c-49f4-8db1-7303d91e179b req-511b1ce6-3a20-482c-82eb-35c5f5dad6a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044517 Oct 18 14:31:00.132745 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3727/7605] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:00.158606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:00.159292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:00.168789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:00.170416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:00.171156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:00.171916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:00.172524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:00.172979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:00.247446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:00.257714 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a0eebaf-9f2d-488f-9c0c-9ce5c5a182bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 200 len: 1605 microversion: 2.1 time: 0.102878 Oct 18 14:31:00.259133 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3879/7606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:00 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:01.283396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:01.284151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:01.291366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.291867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.292324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.293026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.293495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.293937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.307007 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 HTTP/1.1 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'adde8549-89d6-4664-84e8-fb187f8ee212'} Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:01.308618 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe20c338-a26b-45b9-a5e7-ad9e9cfe6248 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 404 len: 111 microversion: 2.1 time: 0.030919 Oct 18 14:31:01.313468 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3728/7607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:01 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:31:01.327009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:01.327644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:01.335270 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.335774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.336243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.336952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.337439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.337892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.351080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 HTTP/1.1 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'adde8549-89d6-4664-84e8-fb187f8ee212'} Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:01.352730 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b45da88-9661-41b4-905b-4a64ab47ae69 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 404 len: 111 microversion: 2.1 time: 0.031045 Oct 18 14:31:01.357437 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3880/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:01 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:31:01.408436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-720382175", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "800eccd6-fea4-49d7-a44b-3c60a6d5993e"}], "security_groups": [{"name": "tempest-securitygroup--1445599598"}], "key_name": "tempest-keypair-63924846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:01.516010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] validate_networks() for [('800eccd6-fea4-49d7-a44b-3c60a6d5993e', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:31:01.933014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:31:01.933529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:31:01.934042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:31:01.934485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:31:01.934914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:31:01.943948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.944443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.944929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.945699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:01.946198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:01.946640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:01.964098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:31:01.969467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:31:01.982778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:31:01.985175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:31:02.111550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-76c83475-3421-4898-b3f1-0bbbd4447374 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706908 Oct 18 14:31:02.112213 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3729/7609] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:31:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:31:02.123476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3232c7ad-93b9-4f9d-94c0-0019ec617e39 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:02.124110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3232c7ad-93b9-4f9d-94c0-0019ec617e39 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:02.179115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3232c7ad-93b9-4f9d-94c0-0019ec617e39 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:02.187458 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3232c7ad-93b9-4f9d-94c0-0019ec617e39 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1236 microversion: 2.1 time: 0.067863 Oct 18 14:31:02.198561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3881/7610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:02 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:03.213035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:03.213670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:03.220500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:03.222016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:03.222016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:03.222272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:03.223835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:03.224269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:03.286253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:03.294159 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f7f0e1d2-0449-4e7d-a778-54bd86dd4941 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1232 microversion: 2.1 time: 0.086007 Oct 18 14:31:03.294728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3730/7611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:03 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:04.322906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:04.323466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:04.331284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:04.339988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:04.339988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:04.339988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:04.339988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:04.339988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:04.397083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:04.405061 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15b5d6ed-169b-47d2-bbb7-dfa9963248e1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1294 microversion: 2.1 time: 0.086237 Oct 18 14:31:04.408902 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3882/7612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:04 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:31:05.429091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:05.430019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:05.437073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:05.437665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:05.438289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:05.439015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:05.439482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:05.439919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:05.947905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:05.956130 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-928d47f4-0799-43a5-a453-85a55c945bda tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.531097 Oct 18 14:31:05.968192 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3731/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:05 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:06.071772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:06.082909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:06.083410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:06.083861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:06.095980 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] Creating event network-changed:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:31:06.101481 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0046549a-2e91-4dfb-8e40-db0d1eedf702 req-5939a3c9-27c6-41b4-92db-135a9f0df150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Oct 18 14:31:06.101991 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3883/7614] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:06.979933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:06.980490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:06.987616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:06.988109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:06.989093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:06.989854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:06.990382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:06.990819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:07.120998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:07.128671 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-435e849e-c909-4f07-a45b-d7028859636f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.152735 Oct 18 14:31:07.129761 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3732/7615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:06 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:08.154954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:08.155678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:08.163761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:08.164281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:08.164749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:08.165486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:08.165971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:08.166462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:08.294896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:08.302753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c36de27-2e07-43f3-a3ca-cb987efb7b09 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.152875 Oct 18 14:31:08.303334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3884/7616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:08 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:09.326209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:09.326833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:09.333730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:09.334271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:09.334718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:09.335412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:09.335877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:09.336310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:09.469564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:09.478220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afa47cce-cd9e-434f-bdf1-5172947173c1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.155802 Oct 18 14:31:09.478724 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3733/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:09 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:10.502536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:10.503174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:10.510108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:10.510620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:10.511085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:10.511796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:10.512278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:10.512731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:10.643165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:10.651041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de4297fb-51e4-4acd-a688-aaac38fe55a6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.152685 Oct 18 14:31:10.651621 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3885/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:10 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:11.157247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "name": "network-vif-plugged", "status": "completed", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:11.167811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:11.168303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:11.168742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:11.179659 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] Creating event network-vif-plugged:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:31:11.184605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-17797b9e-649e-4086-b770-ed694d3b8891 req-3dc372b6-4bba-4920-8447-aeaefadc8657 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Oct 18 14:31:11.185187 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3734/7619] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:11.675031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:11.676454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:11.683313 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:11.683812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:11.684267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:11.684998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:11.685476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:11.685920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:11.816149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:11.824532 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08197792-8880-4b5d-9aef-6e3db38c3771 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1362 microversion: 2.1 time: 0.153764 Oct 18 14:31:11.825102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3886/7620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:11 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:12.848499 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:12.849305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:12.854303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:12.855074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:12.861058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:12.861549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:12.862005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:12.862716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:12.863183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:12.863602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:12.996573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:13.004998 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-02daef52-e57d-4efe-9b5b-461f659f4ff0 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1548 microversion: 2.1 time: 0.158071 Oct 18 14:31:13.005566 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3735/7621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:12 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:13.028447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:13.028956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:13.030943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:13.037095 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:13.037602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:13.038108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:13.038796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:13.039277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:13.039727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:13.120351 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-995f895a-a8db-4c3a-8fc1-4ca13cbaca3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095690 Oct 18 14:31:13.120956 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3887/7622] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:31:13 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:14.104140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:14.115750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:14.116331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:14.116843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:14.128925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] Creating event network-changed:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:31:14.134368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-825495b0-bad5-4100-a382-3fd8c76e18be req-f6884fb0-9ed9-4f26-9f6c-4eba26ca5288 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Oct 18 14:31:14.135223 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3736/7623] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:52.584880 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=21 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:52.585660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:52.586885 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 14:31:52.595845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:52.601608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:52.614931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:52.615449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:52.615924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:52.616652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:52.617185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:52.617627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:52.751834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:52.759730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c7beb74-ae8a-4660-b767-d7db5ccccbce tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1667 microversion: 2.1 time: 0.176817 Oct 18 14:31:52.760316 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3888/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:52 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1667 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:52.785225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce822b2-9c54-4910-8b01-1c2bc486cdf2"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:52.788307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:52.791159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:52.791813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=61 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:52.796793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:52.797284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:52.797727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:52.798449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:52.798909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:52.801918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:53.537665 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec54ea34-ca3a-409b-bf65-f98aca7aa403 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756805 Oct 18 14:31:53.538234 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3737/7625] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:31:52 2022] POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:32:05.319024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:05.321315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:05.324072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:05.325657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:05.330337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.330837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.331291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.332000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.332475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.333261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.362184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:05.367652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Old instance type m1.heat2, new instance type m1.heat {{(pid=121010) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:32:05.375137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:32:05.375572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:32:05.376059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:32:05.376486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:32:05.376910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:32:05.583461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b768627-51e4-487a-b4a9-97138eadf91a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/action" status: 202 len: 0 microversion: 2.1 time: 0.268388 Oct 18 14:32:05.584082 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3889/7626] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:32:05 2022] POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:32:05.590563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:05.596353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:05.596353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:05.596353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:05.602698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.603189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.603633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.604337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.604799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.605235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.742901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:05.751556 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6af4130-5ba6-433e-a5a7-242c62480499 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1722 microversion: 2.1 time: 0.163115 Oct 18 14:32:05.752239 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3738/7627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:05 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:06.776670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:06.777319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:06.784339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:06.784841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:06.785298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:06.786000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:06.786499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:06.786949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:06.921136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:06.929710 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-91b4e5db-1cbd-4711-8f38-dce046e43cec tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1722 microversion: 2.1 time: 0.157832 Oct 18 14:32:06.930330 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3890/7628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:06 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:07.954004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:07.954711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:07.962214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:07.962713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:07.963164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:07.963865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:07.964360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:07.964798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:08.161588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:08.170149 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fdacb0d-e36c-4650-9829-784bea6d974a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1722 microversion: 2.1 time: 0.220511 Oct 18 14:32:08.170833 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3739/7629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:07 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:09.193990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:09.194659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:09.201998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:09.202537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:09.202998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:09.203700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:09.204175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:09.204621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:09.331747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:09.340147 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b09c420d-694c-4bbd-ab67-209baab466f7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.150120 Oct 18 14:32:09.340721 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3891/7630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:09 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:10.364413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:10.365014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:10.372273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:10.372762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:10.373206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:10.373911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:10.374452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:10.374885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:10.509839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:10.519078 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1f5dbe0b-f89c-4a60-8c43-535ba561812e tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.158562 Oct 18 14:32:10.519657 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3740/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:10 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:11.542779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:11.543454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:11.550150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:11.550653 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:11.551104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:11.551895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:11.552369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:11.552896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:11.690794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:11.699719 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09450e2a-27c4-4d41-9deb-cfc03402b8cd tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.160520 Oct 18 14:32:11.700286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3892/7632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:11 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:12.723890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:12.724535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:12.731564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:12.732051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:12.732491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:12.733179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:12.733641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:12.734089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:12.865816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:12.875105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-303bbe86-2911-44a1-9d7d-5695075b6ce8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.155178 Oct 18 14:32:12.875683 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3741/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:12 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:13.898714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:13.899266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:13.906257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:13.906754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:13.907211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:13.907908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:13.908378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:13.908824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:14.039446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:14.048356 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc81cd2d-8760-4390-8c3c-a4d61491fc87 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.153539 Oct 18 14:32:14.048936 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3893/7634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:13 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:15.073271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:15.074098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:15.081512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:15.082002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:15.082480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:15.083170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:15.083630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:15.084060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:15.215589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:15.223947 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3abb3d44-b74e-44a0-a281-e05fad383164 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.154817 Oct 18 14:32:15.224528 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3742/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:15 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:16.247638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:16.248263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:16.255171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:16.255677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:16.256137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:16.256843 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:16.257317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:16.257759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:16.390825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:16.399337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28050fba-fc1d-4ca0-beaf-f54787c7b1d6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.156010 Oct 18 14:32:16.399925 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3894/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:16 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:17.423350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:17.423968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:17.430858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:17.431348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:17.431791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:17.432495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:17.432939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:17.433398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:17.565841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:17.574550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-723d0491-6efc-40c5-9b45-3a266b0e7221 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.155498 Oct 18 14:32:17.575126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3743/7637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:17 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:18.598163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:18.598789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:18.605709 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:18.606254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:18.607271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:18.607990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:18.608460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:18.608902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:18.736789 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:18.745029 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1e738f3-d59c-4c98-94be-c207e9245893 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.150767 Oct 18 14:32:18.745602 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3895/7638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:18 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:19.768905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:19.769444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:19.776261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:19.776750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:19.777198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:19.777884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:19.778374 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:19.778812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:19.911040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:19.919918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-493012c7-915d-40ae-b2f6-e03403c944fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.154527 Oct 18 14:32:19.920495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3744/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:19 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:20.943907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:20.944539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:20.951927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.952424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.952885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.953588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.954082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.954528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:21.083347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:21.092139 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1d39c85-e288-40ab-9fde-e7477c2dfd68 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.152114 Oct 18 14:32:21.092708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3896/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:20 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:22.115414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:22.116044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:22.123039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:22.123539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:22.123990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:22.124690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:22.125158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:22.125596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:22.260430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:22.269785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-36064224-9f7b-42ab-aa2e-44cae70f7423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.158251 Oct 18 14:32:22.270394 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3745/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:22 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:23.293398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:23.294015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:23.301682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:23.302211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:23.302680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:23.303393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:23.303870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:23.304318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:23.436696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:23.445060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e08835c-bda3-43e0-81a3-3bed25ca7ed6 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.155712 Oct 18 14:32:23.445635 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3897/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:23 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:24.525336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:24.525951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:24.532827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:24.533279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:24.533721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:24.534435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:24.534896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:24.535325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:24.665913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:24.674252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8d44a5c3-2eab-42f5-82b4-670bab24d3dc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.152786 Oct 18 14:32:24.674827 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3746/7643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:24 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:25.698263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:25.698898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:25.706328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:25.706780 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:25.707239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:25.707953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:25.708444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:25.708879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:25.837326 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:25.846361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e242d81-c4be-46e9-9964-6a22b76d427d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.151940 Oct 18 14:32:25.846949 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3898/7644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:25 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:26.869829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:26.870483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:26.877910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:26.878443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:26.878890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:26.879598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:26.880061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:26.880500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:27.019421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:27.027014 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1c335fc6-3d0b-44f0-a03e-f61728070a3c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.161080 Oct 18 14:32:27.027608 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3747/7645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:26 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:28.050660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:28.051307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:28.058291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:28.061547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:28.061547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:28.061547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:28.061547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:28.061547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:28.199305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:28.208372 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f34b4a4a-6525-4214-8ff6-013aabeb2356 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1727 microversion: 2.1 time: 0.161544 Oct 18 14:32:28.208986 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3899/7646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:28 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:29.232697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:29.234142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:29.240357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:29.240848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:29.241290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:29.241987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:29.242484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:29.242916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:29.258233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "name": "network-vif-unplugged", "status": "completed", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:29.268695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:29.269202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:29.269656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:29.282399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Creating event network-vif-unplugged:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h2-858383-13 Oct 18 14:32:29.287911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:32:29.299669 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-415b4eef-696e-4834-8a57-8f902b2bb266 req-fafa5833-edb7-4e85-8b2e-5e730724fd94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045936 Oct 18 14:32:29.300464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3900/7647] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:32:29.377294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:29.385930 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-89c3c832-1099-4024-94d9-362cb3441ddf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1726 microversion: 2.1 time: 0.157779 Oct 18 14:32:29.386893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3748/7648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:29 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:30.413783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:30.414617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:30.421893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:30.422551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:30.423022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:30.423748 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:30.424230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:30.424684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:30.620993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:30.630003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-76529a19-df8b-4b6f-9a07-77c802eb6286 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1726 microversion: 2.1 time: 0.222073 Oct 18 14:32:30.630615 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3901/7649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:30 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:31.313810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:31.324081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:31.324563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:31.325000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:31.336768 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Creating event network-changed:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h2-858383-13 Oct 18 14:32:31.342583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:32:31.353247 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7ab11c9d-61cc-4792-8b9a-221ee862d94a req-b4c5295b-1ef1-4a8f-9242-d805f94ad81f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043202 Oct 18 14:32:31.353836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3749/7650] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:31.654860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:31.657619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:31.670677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:31.889625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:31.905613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c29ee98-5440-44ad-ab6d-f0b4942a8b2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.255172 Oct 18 14:32:31.906277 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3902/7651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:31 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:32.932112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:32.932815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:32.938965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:32.939454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:32.939904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:32.940611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:32.941050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:32.941480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:33.089925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:33.099483 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e25855b6-b000-43ca-bc78-56e6dd1bdc5c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.172582 Oct 18 14:32:33.100118 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3750/7652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:32 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:34.123449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:34.124221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:34.131464 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:34.134353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:34.134353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:34.134353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:34.134353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:34.134353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:34.271303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:34.280227 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b71e007b-b0c3-47da-afac-6f339a22f03f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.161154 Oct 18 14:32:34.280802 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3903/7653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:34 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:35.304131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:35.304671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:35.312302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:35.312747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:35.313198 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:35.313893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:35.314390 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:35.314831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:35.447316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:35.456108 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8c126c9-2778-4c6c-b97d-23749d7fc423 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.156004 Oct 18 14:32:35.456711 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3751/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:35 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:36.479427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:36.480058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:36.482978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=35 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:36.487697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:36.488199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:36.488655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:36.489357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:36.489830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:36.490306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:36.492850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:36.621255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:36.630120 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a997d875-b128-4680-8cd9-6f79fbc01628 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.154600 Oct 18 14:32:36.630699 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3904/7655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:36 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:37.654585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:37.655340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:37.658151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=29 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:37.662869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:37.663358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:37.663801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:37.664508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:37.664950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:37.665439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:37.797867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:37.806251 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9374bdcd-4081-4367-84e6-257ba01f0308 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.155539 Oct 18 14:32:37.806861 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3752/7656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:37 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:38.831416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:38.831968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:38.838837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:38.839338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:38.839797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:38.840524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:38.840995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:38.841437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:38.974179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:38.982537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-06fbefc3-1988-4af4-85d0-2c7d703080da tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.155045 Oct 18 14:32:38.983122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3905/7657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:38 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:40.006611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:40.016732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:40.017223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:40.020834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=89 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:40.145171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:40.153598 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ef8e85ed-7331-4bf8-9fed-9f9ab3a34a44 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.151035 Oct 18 14:32:40.154943 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3753/7658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:40 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:41.178623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:41.179257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:41.186198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:41.186703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:41.187160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:41.187867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:41.188343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:41.188794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:41.320383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:41.328641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2680ed7b-f333-41a3-9eb0-bc7b9dc2b76a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.153922 Oct 18 14:32:41.329221 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3906/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:41 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:42.352036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:42.352666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:42.359590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:42.360088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:42.360540 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:42.361239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:42.361707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:42.362173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:42.490663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:42.498974 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a625100-16bc-48e1-b304-6ba7be5779cb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.150850 Oct 18 14:32:42.499556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3754/7660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:42 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:43.522869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:43.523512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:43.530940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:43.531450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:43.531911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:43.532623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:43.533101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:43.533550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:43.668235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:43.676572 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-010e0f9e-517d-488d-8db5-2a052cfe20d7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1724 microversion: 2.1 time: 0.157637 Oct 18 14:32:43.677144 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3907/7661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:43 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:44.699917 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:44.700452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:44.707950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.708475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.708924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.709620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.710112 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.710554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.843095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:44.851397 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b501b190-8114-45fc-b5f3-f5e9c701bb9b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1721 microversion: 2.1 time: 0.155460 Oct 18 14:32:44.851972 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3755/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:44 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:44.874450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:44.875007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:44.881776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.882353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.882812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.883527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.884005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.884453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.921336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.921836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.922331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.923076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:44.923550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:44.923997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:44.944246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:32:44.949376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Getting quotas for user 89856fba9c264090baecbb3468b770ba and project 727cc4f10b7f4910a0ff9f9910e7f0e9. Resources: {'cores', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:32:45.280021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fd7b72d-1df6-43ad-96c7-bee0f74ec71c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/action" status: 202 len: 0 microversion: 2.1 time: 0.409803 Oct 18 14:32:45.280640 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3908/7663] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:32:44 2022] POST /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:32:45.288775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:45.292357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:45.296599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:45.297097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:45.297545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:45.298278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:45.298744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:45.299205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:45.431773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:45.440420 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5f272a25-d6ee-4511-94b7-9f3b3b6d6ceb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.155207 Oct 18 14:32:45.441004 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3756/7664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:45 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:46.465477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:46.466391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:46.473762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:46.474389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:46.474927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:46.475753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:46.476299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:46.476903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:46.606139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:46.615207 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cbb3fb1-0843-4964-a3c6-84b3a6734ecc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.154911 Oct 18 14:32:46.615780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3909/7665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:46 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:47.639899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:47.640451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:47.647231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:47.647725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:47.648169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:47.648858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:47.649322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:47.649759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:48.045825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "name": "network-vif-plugged", "status": "completed", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:48.074749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:48.075913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:48.076386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:48.095156 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Creating event network-vif-plugged:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h2-858383-13 Oct 18 14:32:48.101482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:32:48.117602 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-eb8d68ad-c5d2-4958-a91e-193f935cf75a req-d2154a7a-1dd0-462c-9f40-101e515b086e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075444 Oct 18 14:32:48.123933 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3910/7666] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:48.128852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:48.164492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6fd542e7-f6ae-4f8f-a99d-915cf70262bf tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.528678 Oct 18 14:32:48.174271 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3757/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:47 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:49.189870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:49.190606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:49.196754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:49.197249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:49.197700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:49.198428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:49.198903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:49.199396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:49.338072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:49.346898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1836fd97-ed38-4efb-ac1f-802664ffae2f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.162313 Oct 18 14:32:49.347474 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3911/7668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:49 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:50.371518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:50.372174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:50.379708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:50.380203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:50.380650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:50.381342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:50.381805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:50.382272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:50.513649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:50.522289 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d0206607-5e29-45d1-91e1-a86a4ffdf5be tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.154622 Oct 18 14:32:50.525928 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3758/7669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:50 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:51.548328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:51.549606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:51.556089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:51.556625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:51.557087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:51.557808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:51.558315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:51.558763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:51.628463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "name": "network-vif-unplugged", "status": "completed", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:51.639692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:51.640213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:51.640648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:51.652890 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Creating event network-vif-unplugged:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:32:51.659251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:32:51.680277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6c4a91d3-cb69-495f-b2fd-895e6474a288 req-c85dcee3-e501-4f29-9512-c416d32a2166 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056592 Oct 18 14:32:51.680968 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3759/7670] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:32:51.703115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:51.711593 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9f8ab52-a908-4c3d-857a-a7db0d8e0eb2 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.167753 Oct 18 14:32:51.712379 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3912/7671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:51 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:52.737521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:52.738246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:52.744862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:52.745370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:52.745801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:52.746612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:52.747129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:52.747660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:52.971049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:52.981183 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a6f4887-87f8-4b38-806f-b88671b50d1b tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.248709 Oct 18 14:32:52.981791 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3760/7672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:52 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:53.696159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:53.707777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:53.708276 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:53.709247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:53.999965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Creating event network-changed:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:32:54.005585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:54.006249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:32:54.013117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:54.013646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:54.014932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:54.015385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:54.016094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:54.016724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:54.017167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:54.018402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bef73d9c-8058-44c9-b0e3-47cdcac1aca2 req-19dd169e-e0c3-4715-9bcf-b166bd054e15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325995 Oct 18 14:32:54.019171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3913/7673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:54.174828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:54.186677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2cef012-efdb-4ada-a062-8082bd68f6e8 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.185691 Oct 18 14:32:54.188260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3761/7674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:53 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:32:55.213502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:55.214275 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:55.217080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:55.222725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:55.223239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:55.223706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:55.224419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:55.224902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:55.225360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:55.363617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:55.372123 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8cd6038d-bff5-47a3-b738-a690470dc5d1 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.162938 Oct 18 14:32:55.372691 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3914/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:55 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:56.395899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:56.396515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:56.403391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:56.403909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:56.404400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:56.405098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:56.405564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:56.406001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:56.540684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:56.549548 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-82e3f5e2-c7f7-43a2-9645-8357edf4cd33 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.157505 Oct 18 14:32:56.550132 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3762/7676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:56 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:57.573986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:57.574644 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:57.582250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:57.582747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:57.583210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:57.583951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:57.584429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:57.584878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:57.718704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:57.727533 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-201b30fb-7aa9-4c29-9111-f470a4bf0c83 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.157417 Oct 18 14:32:57.728048 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3915/7677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:57 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:58.751473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:58.752020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:58.758727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:58.759313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:58.759760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:58.760448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:58.761017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:58.761458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:58.893737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:58.902190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01a20679-5ab2-49b1-82e5-cde616a47730 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.154804 Oct 18 14:32:58.902759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3763/7678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:58 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:59.926906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:59.927674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:59.936852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:59.937364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:59.937832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:59.938573 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:59.939087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:59.939536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:00.073743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:00.082888 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9947c43c-2059-4e2f-a55b-0bdb7f529118 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.160583 Oct 18 14:33:00.083464 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3916/7679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:59 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:01.106088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:01.106707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:01.113648 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:01.114164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:01.114611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:01.115294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:01.115745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:01.116182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:01.247804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:01.256676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-21d202ba-9d3c-44ee-bb1d-a1568879e289 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.154509 Oct 18 14:33:01.257241 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3764/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:01 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:02.280773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:02.281411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:02.288924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:02.289438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:02.289905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:02.290657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:02.291143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:02.291598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:02.473253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:02.481814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-41fc8dba-645c-4af7-9490-f959ea5884e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.204887 Oct 18 14:33:02.482312 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3917/7681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:02 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:03.505536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:03.506210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:03.513119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:03.513665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:03.514389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:03.515076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:03.515534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:03.515961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:03.703281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:03.712116 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f940a6e2-d0e2-4e3b-9281-4576bcb80566 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.210876 Oct 18 14:33:03.712643 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3765/7682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:03 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:04.736887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:04.737576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:04.744897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:04.745423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:04.745899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:04.746651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:04.747139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:04.747597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:04.763137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:04.885746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:04.894270 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3efbd3ad-f5c2-4527-8904-11c29bfb727d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1720 microversion: 2.1 time: 0.162200 Oct 18 14:33:04.894845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3918/7683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:04 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:05.918262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:05.918878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:05.926227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:05.926739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:05.927188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:05.927872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:05.928391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:05.928821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.063801 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:06.072224 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8c59cb63-eddb-47c4-9cf2-993d066ce3fb tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1713 microversion: 2.1 time: 0.157948 Oct 18 14:33:06.072795 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3766/7684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:05 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:06.095314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:06.095986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:06.103986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.109198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.109198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.109198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.109198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.109198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.242925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:06.251297 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dba05506-7f5c-49e1-9100-3ef201fee200 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1713 microversion: 2.1 time: 0.160379 Oct 18 14:33:06.251899 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3919/7685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:06 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:06.273730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:06.274400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:06.280357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.280843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.281294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.281982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.282472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.282906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.412914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:06.421202 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2caa67af-b7e8-41cc-b66b-55a9be57e478 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1713 microversion: 2.1 time: 0.151336 Oct 18 14:33:06.421782 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3767/7686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:06 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:06.443693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:06.444148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:06.450151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.450652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.451432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.452163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.452647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.453097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.479298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:33:06.658377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:06.732790 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-65571594-a6cf-429e-bf12-0b881b9285a9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 204 len: 0 microversion: 2.1 time: 0.292684 Oct 18 14:33:06.733325 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3920/7687] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:33:06 2022] DELETE /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:33:06.741564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:06.742269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:06.748546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.749042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.749489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.750207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:06.750669 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:06.751102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:06.880683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:06.889391 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48d6db47-80b7-4844-a2e8-45cda1fb33ab tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1719 microversion: 2.1 time: 0.151425 Oct 18 14:33:06.889964 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3768/7688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:06 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:07.914105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:07.914859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:07.921708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:07.922255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:07.922716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:07.923425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:07.923900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:07.924373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:08.058126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:08.066500 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a0efaa16-2171-48eb-a7ba-69760598f839 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1719 microversion: 2.1 time: 0.157635 Oct 18 14:33:08.067077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3921/7689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:07 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:09.091496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:09.092370 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:09.095500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=34 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:09.104323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:09.104838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:09.105730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:09.106022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:09.106521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:09.106964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:09.200906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:09.210162 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b3e88cc-5559-4885-ab80-421e7efd5095 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1651 microversion: 2.1 time: 0.122791 Oct 18 14:33:09.210744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3769/7690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:09 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1651 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:09.319732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe0065-8c1d-4c0d-b9f2-545ffa05d277", "name": "network-vif-deleted", "tag": "e67c88e2-4573-415d-9105-cf5ef60dc5f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:09.330395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:09.330893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:09.331347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:09.342837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] Creating event network-vif-deleted:e67c88e2-4573-415d-9105-cf5ef60dc5f5 for instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 on n-h1-858383-13 Oct 18 14:33:09.348151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-716e6a3f-a09d-4c63-a36c-5ea913197eae req-5c5c5926-c0db-4695-85b9-08bed7c0fbad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032868 Oct 18 14:33:09.349059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3922/7691] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:33:10.233694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:10.234549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:10.242762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:10.243272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:10.243922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:10.244944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:10.245453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:10.246149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:10.249424 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=100 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:10.318283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:10.328267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b0200bb-7dbd-4207-856c-a37f32a966e7 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1367 microversion: 2.1 time: 0.098502 Oct 18 14:33:10.328961 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3770/7692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:10 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:11.352953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:11.353708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:11.360394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:11.360899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:11.361354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:11.362082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:11.362590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:11.363102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:11.428879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:11.437454 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dd83b42-acef-4765-bd88-e23b7776d817 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1367 microversion: 2.1 time: 0.089005 Oct 18 14:33:11.438150 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3923/7693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:11 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:12.461420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:12.462081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:12.468852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:12.469362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:12.469843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:12.470565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:12.471040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:12.471484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:12.538955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:12.547881 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db704151-f06f-4e18-ba35-228472335ed9 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1367 microversion: 2.1 time: 0.090840 Oct 18 14:33:12.548466 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3771/7694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:12 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:13.571127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:13.571800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:13.578945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:13.579472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:13.579952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:13.580676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:13.581163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:13.581640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:13.650811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89856fba9c264090baecbb3468b770ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:13.659228 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e9385fe-cff8-4ddf-8d73-74714657f0cc tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 200 len: 1367 microversion: 2.1 time: 0.092188 Oct 18 14:33:13.660327 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3924/7695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:13 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:14.683890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:14.684439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:14.692249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:14.692745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:14.693189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:14.693886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:14.694433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:14.694870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:14.709834 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 HTTP/1.1 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'bbbe0065-8c1d-4c0d-b9f2-545ffa05d277'} Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:14.711526 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58f8e883-824c-43f6-a54e-772dceb056e5 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 404 len: 111 microversion: 2.1 time: 0.033173 Oct 18 14:33:14.716217 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3772/7696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:14 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:14.776032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:14.778301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:14.785354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:14.785872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:14.786377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:14.787107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:14.787595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:14.788054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:14.801395 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-volume_attachments HTTP/1.1 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': 'bbbe0065-8c1d-4c0d-b9f2-545ffa05d277'} Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:14.803164 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa980b44-57b6-45eb-954b-8f0445d876e4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032619 Oct 18 14:33:14.807424 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3925/7697] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:33:14 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.252619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.253144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.260842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.261328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.261768 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.262512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.262968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.263401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.279852 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 HTTP/1.1 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'bbbe0065-8c1d-4c0d-b9f2-545ffa05d277'} Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.281400 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-567e8f58-6a1b-4e93-b93c-c2f3260c6620 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 404 len: 111 microversion: 2.1 time: 0.034128 Oct 18 14:33:18.285550 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3773/7698] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:33:18 2022] DELETE /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.291271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.291905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: bbbe0065-8c1d-4c0d-b9f2-545ffa05d277] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.298836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.299345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.299807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.301034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.301508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.301958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.315501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 HTTP/1.1 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'bbbe0065-8c1d-4c0d-b9f2-545ffa05d277'} Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.318552 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33cea738-831f-478f-88cc-78a74aa3dd2c tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277" status: 404 len: 111 microversion: 2.1 time: 0.031686 Oct 18 14:33:18.322582 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3926/7699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:18 2022] GET /compute/v2.1/servers/bbbe0065-8c1d-4c0d-b9f2-545ffa05d277 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.327579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.328153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.334943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.335368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.335811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.336505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.336974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.337405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.350991 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 HTTP/1.1 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'adde8549-89d6-4664-84e8-fb187f8ee212'} Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.352537 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0ca67e16-3549-410e-b443-8c42b459db0d tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 404 len: 111 microversion: 2.1 time: 0.030178 Oct 18 14:33:18.356744 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3774/7700] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:33:18 2022] DELETE /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.363714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.364600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: adde8549-89d6-4664-84e8-fb187f8ee212] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.370821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.371350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.371838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.372584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.373059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.373507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.390998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 HTTP/1.1 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'adde8549-89d6-4664-84e8-fb187f8ee212'} Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.392561 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance adde8549-89d6-4664-84e8-fb187f8ee212 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0aedfab-1b67-4c4a-b5de-91e5bfba49a4 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212" status: 404 len: 111 microversion: 2.1 time: 0.034770 Oct 18 14:33:18.396845 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3927/7701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:18 2022] GET /compute/v2.1/servers/adde8549-89d6-4664-84e8-fb187f8ee212 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.402760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.403263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.409186 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.409700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.410168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.410862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.411321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.411753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.425083 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb HTTP/1.1 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '3de02421-a079-40e6-9e79-0872676391fb'} Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.427210 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5272fb1-0df1-4a5e-af48-301f05deeb32 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 404 len: 111 microversion: 2.1 time: 0.029769 Oct 18 14:33:18.431335 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3775/7702] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:33:18 2022] DELETE /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.438194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.438998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: 3de02421-a079-40e6-9e79-0872676391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.445868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.446484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.447020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.452529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.452529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.452529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.463726 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb HTTP/1.1 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3de02421-a079-40e6-9e79-0872676391fb'} Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.465405 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance 3de02421-a079-40e6-9e79-0872676391fb could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7616b566-4601-4443-a31a-f043284f9540 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb" status: 404 len: 111 microversion: 2.1 time: 0.032994 Oct 18 14:33:18.471857 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3928/7703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:18 2022] GET /compute/v2.1/servers/3de02421-a079-40e6-9e79-0872676391fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.475484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.475986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.482004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.482528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.482972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.483661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.484118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.484587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.498819 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 HTTP/1.1 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'e3a05020-04db-4b25-b6ff-888113493c39'} Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.500351 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3dd9e626-6bb8-40f0-97ad-55f7d32cb44f tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 404 len: 111 microversion: 2.1 time: 0.030162 Oct 18 14:33:18.504831 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3776/7704] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:33:18 2022] DELETE /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:33:18.510979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.511657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [instance: e3a05020-04db-4b25-b6ff-888113493c39] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:18.518159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.528247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.528247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.528247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:18.528247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:18.528247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:18.535452 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] HTTP exception thrown: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Request method failure captured: Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 HTTP/1.1 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrebtlwP57rqQt4YiSNG_t3TrPVVSxxs7FT7xj1rgZ6yQrzthY6R_dZf8Engg70wc2-uOIkKrM93_BqOan929wkjkOcUH1biXeElE36JCSfRo6wq2LtRajLxr1D3teFe2OYeM34rddASXgZJI6MAVnoVBQ1zNF9N2AgIcvHJ9D7dPjI Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_727cc4f10b7f4910a0ff9f9910e7f0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 727cc4f10b7f4910a0ff9f9910e7f0e9 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerActionsTestJSON-653508496 Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 89856fba9c264090baecbb3468b770ba Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServerActionsTestJSON-653508496-project Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'e3a05020-04db-4b25-b6ff-888113493c39'} Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:33:18.536696 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Returning 404 to user: Instance e3a05020-04db-4b25-b6ff-888113493c39 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed03dec6-9d84-40b1-a1c2-099cd9d46916 tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39" status: 404 len: 111 microversion: 2.1 time: 0.031111 Oct 18 14:33:18.541977 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3929/7705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:18 2022] GET /compute/v2.1/servers/e3a05020-04db-4b25-b6ff-888113493c39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:33:18.548173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a0d12431-e436-40fa-b06a-bdaf40d57c3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] Calling method '.version_select at 0x7fb330c9b280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:18.553099 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0d12431-e436-40fa-b06a-bdaf40d57c3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [0598c815-ea50-4c78-85fc-969d50894498] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:33:19.560390 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0d12431-e436-40fa-b06a-bdaf40d57c3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] [0598c815-ea50-4c78-85fc-969d50894498] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36610. Oct 18 14:33:19.628605 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a0d12431-e436-40fa-b06a-bdaf40d57c3a tempest-ServerActionsTestJSON-653508496 tempest-ServerActionsTestJSON-653508496-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63924846" status: 202 len: 0 microversion: 2.1 time: 1.084337 Oct 18 14:33:19.629185 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3777/7706] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 14:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63924846 => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:33:31.717577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:31.719796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:31.852301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-701922099", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "fe271099-3140-4412-9246-1d2f2b81d012"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:31.915096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] validate_networks() for [('fe271099-3140-4412-9246-1d2f2b81d012', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:33:32.315126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:33:32.315595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:33:32.316089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:33:32.316518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:33:32.316953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:33:32.325888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:32.326433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:32.326893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:32.327691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:32.328116 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:32.328572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:32.347388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Getting quotas for project 72e2ab854c824c68bfc6ca1f34621484. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:33:32.353300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Getting quotas for user 5211250033404c4698bbfd10470fc19e and project 72e2ab854c824c68bfc6ca1f34621484. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:33:32.368186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:33:32.370614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:33:32.505894 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcfb273e-0780-4ea7-93b5-8f3d10e3f839 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797552 Oct 18 14:33:32.506815 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3930/7707] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:33:32.518094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=21 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:32.519327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:32.523684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58fec151-16df-4eb5-aaa5-86af1fa3de4e tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:32.524613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58fec151-16df-4eb5-aaa5-86af1fa3de4e tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:32.601451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-58fec151-16df-4eb5-aaa5-86af1fa3de4e tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:32.609432 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58fec151-16df-4eb5-aaa5-86af1fa3de4e tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1216 microversion: 2.1 time: 0.093008 Oct 18 14:33:32.615764 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3778/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:32 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:33.632658 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:33:33.633297 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:33:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a (ip 10.222.0.27) !!! Oct 18 14:33:33.643746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9afce08c-36ad-4301-9f5c-2546c5c622bf tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:33.643746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9afce08c-36ad-4301-9f5c-2546c5c622bf tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:33.703129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9afce08c-36ad-4301-9f5c-2546c5c622bf tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:33.715412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9afce08c-36ad-4301-9f5c-2546c5c622bf tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1216 microversion: 2.1 time: 0.086428 Oct 18 14:33:33.723971 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3931/7709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:33 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:34.739993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:34.740627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:34.742841 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:33:34.742989 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:33:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a (ip 10.222.0.27) !!! Oct 18 14:33:34.752264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:34.752770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:34.753223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:34.753937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:34.754467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:34.755215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:34.829643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:34.838755 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-75f9ae99-2af6-4473-aeac-ebfb73651c9b tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1268 microversion: 2.1 time: 0.103545 Oct 18 14:33:34.839346 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3779/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:34 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1268 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:35.862667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:35.863328 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:35.871630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.872147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.872616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:35.873350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.873834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.874315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:36.018476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:36.026555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ade634dd-213b-4e0d-9c00-5c2f80b86f71 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.167796 Oct 18 14:33:36.027127 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3932/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:35 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:36.918222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94ad3b-4c20-4b91-9b8d-0f498791748a", "tag": "6363efae-4480-4580-a2db-8e05cd930eac"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:36.927628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:36.933434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:36.933434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:36.939307 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] Creating event network-changed:6363efae-4480-4580-a2db-8e05cd930eac for instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a on n-h2-858383-13 Oct 18 14:33:36.944686 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-05c7c7d7-20e0-4899-b9a0-cdd859e89cfe req-09e988d3-3fbb-4983-b151-b57ea2aca4eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091426 Oct 18 14:33:36.945271 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3780/7712] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:33:37.050501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:37.051156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:37.058045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:37.058586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:37.059051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:37.059770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:37.060249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:37.060701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:37.272126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:37.279824 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2c56c03-c52f-4ef6-9c87-f5d823e327ce tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.233518 Oct 18 14:33:37.280392 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3933/7713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:37 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:38.305548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:38.306349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:38.312642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:38.313123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:38.313565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:38.314280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:38.314740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:38.315168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:38.445307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:38.453403 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b9d6dd3-bfad-44af-8b8b-1bd01d554d04 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.154363 Oct 18 14:33:38.453983 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3781/7714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:38 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:39.476013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:39.476652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:39.483525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:39.484032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:39.484489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:39.485195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:39.485676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:39.486205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:39.614630 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:39.622428 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6336217d-a5da-4c20-9ebe-c29812f03b6f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.150897 Oct 18 14:33:39.623010 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3934/7715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:39 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:40.646252 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:40.646883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:40.653898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:40.654435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:40.654887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:40.655587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:40.656054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:40.656494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:40.783614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:40.791972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f7f4722-10cf-443b-b467-489a7967c6c5 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.149709 Oct 18 14:33:40.792548 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3782/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:40 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:41.815198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:41.815862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:41.822015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:41.822546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:41.823005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:41.823711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:41.824187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:41.824634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:41.961907 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:41.970126 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6fbb7f70-3c6c-4764-b630-8ae06a513793 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.159196 Oct 18 14:33:41.978453 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3935/7717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:41 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:42.994085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:42.994718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:42.997038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:43.001923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:43.002446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:43.002877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:43.003566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:43.004753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:43.005608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:43.138610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:43.147298 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ba2e3cb-6293-417a-852a-5472364dc787 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.157154 Oct 18 14:33:43.147893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3783/7718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:42 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:44.170963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:44.171598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:44.171962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:44.173339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:44.180102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:44.180605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:44.181086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:44.181788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:44.182289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:44.182727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:44.230209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a94ad3b-4c20-4b91-9b8d-0f498791748a", "name": "network-vif-plugged", "status": "completed", "tag": "6363efae-4480-4580-a2db-8e05cd930eac"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:44.245385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:44.245744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:44.246226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:44.258085 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] Creating event network-vif-plugged:6363efae-4480-4580-a2db-8e05cd930eac for instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a on n-h2-858383-13 Oct 18 14:33:44.263397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-901e6cda-1a0b-4db6-ba91-e677c6ce2b68 req-a7c0d1f6-219a-4cc6-bd7d-51b6cf9c29d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096847 Oct 18 14:33:44.264230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3936/7719] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:33:44.319866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:44.329024 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aef1ebbc-435e-40cc-8e4a-c1147ebf687f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.162115 Oct 18 14:33:44.329613 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3784/7720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:44 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:45.353234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:45.353950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:45.361098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:45.361598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:45.362082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:45.362775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:45.363785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:45.364232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:45.499493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:45.508052 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-014bff3e-d142-45b1-9902-c585a0342dbe tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1316 microversion: 2.1 time: 0.159431 Oct 18 14:33:45.508621 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3937/7721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:45 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:46.531133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:46.531751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:46.539188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:46.539672 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:46.540111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:46.540792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:46.541244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:46.541671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:46.672702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:46.681438 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-24f7b544-ea36-49ab-90ea-f77f5d9a54b3 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.154153 Oct 18 14:33:46.682017 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3785/7722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:46 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:46.743496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2101173893", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "fe271099-3140-4412-9246-1d2f2b81d012"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:46.797406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] validate_networks() for [('fe271099-3140-4412-9246-1d2f2b81d012', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:33:47.164260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:33:47.164741 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:33:47.165235 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:33:47.165665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:33:47.166127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:33:47.175200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:47.175708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:47.176170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:47.176920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:47.177396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:47.177845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:47.195157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Getting quotas for project 72e2ab854c824c68bfc6ca1f34621484. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:33:47.200389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Getting quotas for user 5211250033404c4698bbfd10470fc19e and project 72e2ab854c824c68bfc6ca1f34621484. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:33:47.213355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:33:47.215734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:33:47.323227 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0a78265-434f-4eb3-8171-36721f5ec685 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583521 Oct 18 14:33:47.323804 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3938/7723] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:33:47.335570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1227182a-041e-4f5f-a7fc-99cbe093bf51 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:47.336185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1227182a-041e-4f5f-a7fc-99cbe093bf51 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:47.389097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1227182a-041e-4f5f-a7fc-99cbe093bf51 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:47.396861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1227182a-041e-4f5f-a7fc-99cbe093bf51 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1217 microversion: 2.1 time: 0.065870 Oct 18 14:33:47.397433 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3786/7724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:47 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:48.419984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:48.420627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:48.429314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:48.429836 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:48.430335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:48.431106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:48.431665 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:48.432121 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:48.499735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:48.507676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4edd4653-d73a-4742-af51-ebcfdafe56b2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1221 microversion: 2.1 time: 0.091815 Oct 18 14:33:48.508875 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3939/7725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:48 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:49.531209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:49.531834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:49.539483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:49.539915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:49.540363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:49.541094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:49.541560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:49.541995 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:49.605330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:49.613234 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a7a9d44-5ef3-4ef3-b7f1-8aaaa90ead19 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1269 microversion: 2.1 time: 0.085881 Oct 18 14:33:49.613804 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3787/7726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:49 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:50.639068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:50.640202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:50.648124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:50.649021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:50.649759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:50.650980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:50.651730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:50.652424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:50.801423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:50.810953 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5a131e96-9f3e-48df-9c32-cbd736b80278 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.176812 Oct 18 14:33:50.815828 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3940/7727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:50 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:51.485690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5e4171-c4b1-483f-b388-86b986c645ce", "tag": "e285a7df-f673-4a47-a8e5-07f7947051d1"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:51.496765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:51.499263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:51.499263 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:51.509642 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] Creating event network-changed:e285a7df-f673-4a47-a8e5-07f7947051d1 for instance ca5e4171-c4b1-483f-b388-86b986c645ce on n-h1-858383-13 Oct 18 14:33:51.515027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3fbf81a3-f669-4bc7-b9d5-2e9a40f2d11f req-698bba6d-67e2-4503-bd01-ad4f712e19da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Oct 18 14:33:51.515787 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3788/7728] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:33:51.835178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:51.835847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:51.843022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:51.843538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:51.844004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:51.844734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:51.845215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:51.845671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:51.977350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:51.985152 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d91efcce-df41-4e65-845e-90cf26fd3bb7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.154391 Oct 18 14:33:51.985749 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3941/7729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:51 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:53.009984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:53.010731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:53.017173 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:53.017693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:53.018213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:53.018908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:53.019371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:53.019806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:53.152345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:53.160070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-68856943-f42b-4e1d-8dd0-d2740fa7715a tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.155949 Oct 18 14:33:53.160641 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3789/7730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:53 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:54.183346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:54.183988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:54.190904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:54.191415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:54.191884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:54.193143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:54.193624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:54.194099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:54.326994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:54.335094 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2eecc6c-579e-4a54-ad7f-033d30116981 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.155641 Oct 18 14:33:54.335661 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3942/7731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:54 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:55.358153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:55.358714 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:55.365543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:55.366029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:55.366505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:55.367193 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:55.367655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:55.368089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:55.496419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:55.504042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cae66a44-7242-40f1-b066-59fe65a1e466 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.149867 Oct 18 14:33:55.504608 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3790/7732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:55 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:56.527796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:56.528355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:56.535190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:56.535695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:56.536187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:56.537423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:56.537930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:56.538399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:56.670133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:56.677867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e31e238-36d2-4ab8-8846-4ce9074930d9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.154092 Oct 18 14:33:56.678480 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3943/7733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:56 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:57.700794 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:57.701416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:57.704489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:57.709257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:57.709741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:57.710256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:57.714332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:57.714332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:57.714332 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:57.844555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:57.853285 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22ce4449-3f0d-429f-a84e-d6c6c7b7e9f9 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.156374 Oct 18 14:33:57.853893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3791/7734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:57 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:57.901929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5e4171-c4b1-483f-b388-86b986c645ce", "name": "network-vif-plugged", "status": "completed", "tag": "e285a7df-f673-4a47-a8e5-07f7947051d1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:57.907092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:57.907773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:57.914410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:57.914914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:57.915368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:57.926443 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] Creating event network-vif-plugged:e285a7df-f673-4a47-a8e5-07f7947051d1 for instance ca5e4171-c4b1-483f-b388-86b986c645ce on n-h1-858383-13 Oct 18 14:33:57.932358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7d946204-0d74-46bf-bf18-3a6c96e508af req-c0142188-51c8-4539-bfc7-b3b60355b1f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034071 Oct 18 14:33:57.932913 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3944/7735] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:33:58.876844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:58.877463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:58.884203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:58.884690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:58.885132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:58.885821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:58.886304 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:58.886733 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:59.013569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:59.022257 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8b4ef0cd-a141-4b40-a252-8c72c14e7c1d tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1317 microversion: 2.1 time: 0.149348 Oct 18 14:33:59.022833 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3792/7736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:58 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:00.047123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:00.047840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:00.055246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.055750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.056284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.056917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.057391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.057862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.189114 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:00.197087 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0805e4a2-9af7-4ab5-8e6f-bd648789bbdd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1505 microversion: 2.1 time: 0.155388 Oct 18 14:34:00.197586 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3945/7737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:00 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:00.219545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:00.220167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:00.227756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.228254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.228711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.229411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.229881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.230375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.255555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:34:00.532027 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-83909f37-c11d-4fec-b9d9-f3060c15ad31 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 204 len: 0 microversion: 2.1 time: 0.316275 Oct 18 14:34:00.532741 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3793/7738] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:34:00 2022] DELETE /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:34:00.541896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:00.542586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:00.549170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.549697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.550187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.550945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:00.551421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:00.551870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:00.690737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:00.699036 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ec01823-aa32-4c6b-876f-8a13f6dd3b41 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1511 microversion: 2.1 time: 0.161384 Oct 18 14:34:00.699600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3946/7739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:00 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:34:01.723533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:01.724800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:01.730837 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:01.731338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:01.731790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:01.732486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:01.732957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:01.733400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:01.869258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:01.877533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-186373d7-4ad0-4446-b53d-e1b499cc829f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1511 microversion: 2.1 time: 0.159338 Oct 18 14:34:01.878131 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3794/7740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:01 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:02.495455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5e4171-c4b1-483f-b388-86b986c645ce", "name": "network-vif-deleted", "tag": "e285a7df-f673-4a47-a8e5-07f7947051d1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:02.506035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:02.508792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:02.509307 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:02.509770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:02.514315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=81 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:02.523314 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] Creating event network-vif-deleted:e285a7df-f673-4a47-a8e5-07f7947051d1 for instance ca5e4171-c4b1-483f-b388-86b986c645ce on n-h1-858383-13 Oct 18 14:34:02.529122 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-504e271e-3b6a-4da6-9db3-c453c4a5787d req-5fe7c01b-e0b9-4eab-ba6e-bc96ddf943eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037519 Oct 18 14:34:02.530161 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3947/7741] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:02.901249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:02.901875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:02.909247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:02.909742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:02.910220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:02.910916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:02.911902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:02.912338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:02.916484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:02.945524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:02.946011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:02.946482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:02.946934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lazy-loading 'fault' on Instance uuid ca5e4171-c4b1-483f-b388-86b986c645ce {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:34:02.987715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:02.995822 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9d7da664-63dd-44c5-b049-728d9ef0382c tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 200 len: 1307 microversion: 2.1 time: 0.098803 Oct 18 14:34:02.996395 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3795/7742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:02 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:04.021524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.022316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.029395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.029901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.030446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.037610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.037610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.037610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.045943 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce HTTP/1.1 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ca5e4171-c4b1-483f-b388-86b986c645ce'} Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.047613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 404 to user: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b84f5411-036e-4730-b17e-8d66238fa2a4 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 404 len: 111 microversion: 2.1 time: 0.033269 Oct 18 14:34:04.053600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3948/7743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:34:04.058927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.059549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.066952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.072442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.072442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.072442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.072442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.072442 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.205132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:04.212799 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54d33e69-e24e-4da1-bcf9-baffab2171d1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.157979 Oct 18 14:34:04.213363 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3796/7744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:04.235124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:04.237415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 28c6211f-b5ab-4365-972e-f8c70d6c00b6] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.243889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/28c6211f-b5ab-4365-972e-f8c70d6c00b6/action HTTP/1.1 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 32 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: {"resize": {"flavorRef": "452"}} Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '28c6211f-b5ab-4365-972e-f8c70d6c00b6', 'body': {'resize': {'flavorRef': '452'}}} Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:34:04.245472 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 404 to user: Instance 28c6211f-b5ab-4365-972e-f8c70d6c00b6 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0dc659c2-a45f-4a9e-9ccc-16e0d98d7c92 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "POST /compute/v2.1/servers/28c6211f-b5ab-4365-972e-f8c70d6c00b6/action" status: 404 len: 111 microversion: 2.1 time: 0.015806 Oct 18 14:34:04.250553 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3949/7745] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:34:04 2022] POST /compute/v2.1/servers/28c6211f-b5ab-4365-972e-f8c70d6c00b6/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:34:04.255902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.256520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.262383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.262861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.263302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.263986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.264693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.265124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.393785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:04.401585 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e505264d-7c9b-48f4-80fd-cdda731ad9b0 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.150110 Oct 18 14:34:04.402372 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3797/7746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:04.425747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.426432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.434446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.435098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.435887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.436879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.437585 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.438287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.569840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:04.577940 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b74a49e2-070d-4e93-8734-0d06723c8335 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.156182 Oct 18 14:34:04.578771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3950/7747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:04.600926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "016687ce-486f-41e3-9607-e3fef482ced4"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:04.603129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.609212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.609703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.610185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.610887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.611354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.611792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.652170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:04.657467 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: request: POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action HTTP/1.1 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 65 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: {"resize": {"flavorRef": "016687ce-486f-41e3-9607-e3fef482ced4"}} Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: exception: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '9a94ad3b-4c20-4b91-9b8d-0f498791748a', 'body': {'resize': {'flavorRef': '016687ce-486f-41e3-9607-e3fef482ced4'}}} Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:04.680174 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 400 to user: Flavor 016687ce-486f-41e3-9607-e3fef482ced4 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e69afc9d-bc09-428b-8d2f-5f29bb156f29 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action" status: 400 len: 107 microversion: 2.1 time: 0.085287 Oct 18 14:34:04.684979 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3798/7748] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:34:04 2022] POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action => generated 107 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:34:04.690535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.691184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.697188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.697698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.698202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.698922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.699408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.699863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.829482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:04.837753 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3c3a065-44f0-46dd-835f-cc6ed834d0b7 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.151089 Oct 18 14:34:04.838356 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3951/7749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:04.861292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:04.861847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:04.863704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:04.868808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.869295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.869744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:04.870460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:04.870919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:04.871344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.005156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:05.013668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a307b159-d070-4d63-8584-f486af7dc025 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.156453 Oct 18 14:34:05.016285 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3799/7750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:04 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:05.035953 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2e5c02c-d491-4498-a32c-619d9c777b02 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2e5c02c-d491-4498-a32c-619d9c777b02 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action HTTP/1.1 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 29 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: {"resize": {"flavorRef": ""}} Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '9a94ad3b-4c20-4b91-9b8d-0f498791748a', 'body': {'resize': {'flavorRef': ''}}} Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.039610 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2e5c02c-d491-4498-a32c-619d9c777b02 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2e5c02c-d491-4498-a32c-619d9c777b02 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action" status: 400 len: 113 microversion: 2.1 time: 0.009062 Oct 18 14:34:05.053812 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3952/7751] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:34:05 2022] POST /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:34:05.055628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:05.056243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:05.062194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.062748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.063110 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.063795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.064254 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.064684 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.193910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:05.201584 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ecc90015-9b57-45eb-aecf-d87eb74b9740 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1504 microversion: 2.1 time: 0.150185 Oct 18 14:34:05.202176 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3800/7752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:05 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:05.227652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:05.228176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:05.236138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.236647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.237109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.237821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.238334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.238788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.254449 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce HTTP/1.1 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ca5e4171-c4b1-483f-b388-86b986c645ce'} Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:34:05.256117 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 404 to user: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-060c6c81-f713-454b-8fb5-976e876bc5e1 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 404 len: 111 microversion: 2.1 time: 0.034297 Oct 18 14:34:05.260674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3953/7753] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:34:05 2022] DELETE /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:34:05.266716 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:05.267338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: ca5e4171-c4b1-483f-b388-86b986c645ce] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:05.273250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.273732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.274202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.274887 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.275345 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.275774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.289187 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce HTTP/1.1 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'ca5e4171-c4b1-483f-b388-86b986c645ce'} Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:05.290713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 404 to user: Instance ca5e4171-c4b1-483f-b388-86b986c645ce could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5ddd89b-6d24-461f-b970-1b4180af91a6 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce" status: 404 len: 111 microversion: 2.1 time: 0.029438 Oct 18 14:34:05.295435 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3801/7754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:05 2022] GET /compute/v2.1/servers/ca5e4171-c4b1-483f-b388-86b986c645ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:34:05.300336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:05.300850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:05.307299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.307801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.308260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.308965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.309438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.309885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.334361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:34:05.609014 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9b7c753-5d88-464e-93a7-0c92112c8f30 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 204 len: 0 microversion: 2.1 time: 0.312112 Oct 18 14:34:05.609840 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3954/7755] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:34:05 2022] DELETE /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:34:05.617569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:05.618251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:05.624287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.624779 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.625227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.625919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:05.626415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:05.626859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:05.761125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:05.769144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f7d6ebf-e355-48bb-bca8-3ef723dfb5bd tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1510 microversion: 2.1 time: 0.155424 Oct 18 14:34:05.769709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3802/7756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:05 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:06.794259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:06.794910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:06.801819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:06.802371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:06.802838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:06.804151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:06.804631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:06.805087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:06.934159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:06.941998 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2d222745-1551-40de-b381-fc458ea73e10 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1510 microversion: 2.1 time: 0.152224 Oct 18 14:34:06.942606 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3955/7757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:06 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:07.618249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a94ad3b-4c20-4b91-9b8d-0f498791748a", "name": "network-vif-deleted", "tag": "6363efae-4480-4580-a2db-8e05cd930eac"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:07.632778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:07.633274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:07.633721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:07.646320 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] Creating event network-vif-deleted:6363efae-4480-4580-a2db-8e05cd930eac for instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a on n-h2-858383-13 Oct 18 14:34:07.653931 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7237a12f-8de7-44e1-9173-052bf118a51c req-a7ce412d-c862-4187-af41-b199296ed7fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038256 Oct 18 14:34:07.653931 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3803/7758] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:34:07.965002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:07.965775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:07.973344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:07.973872 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:07.974440 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:07.976439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:07.976439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:07.976439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:08.021021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:08.021538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:08.022043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:08.022540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lazy-loading 'fault' on Instance uuid 9a94ad3b-4c20-4b91-9b8d-0f498791748a {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:34:08.063924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5211250033404c4698bbfd10470fc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e2ab854c824c68bfc6ca1f34621484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:08.071990 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4aef54e-83f5-4ac2-ae89-ad50a657eab2 tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 200 len: 1306 microversion: 2.1 time: 0.111132 Oct 18 14:34:08.072564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3956/7759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:07 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:09.095077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:09.095715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] [instance: 9a94ad3b-4c20-4b91-9b8d-0f498791748a] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:09.103007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:09.103924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:09.103924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:09.104627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:09.105105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:09.105546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:09.120769 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] HTTP exception thrown: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Request method failure captured: Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a HTTP/1.1 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrk7G7vMf_jfBg4D_MfQWroybZZAgdZmmtsJ1e_KgpXT6lPuzFb6n6dtOt_4IDXgZsuiDxSPPjmKOe-btfMSia-VnrAAIjMjlzQxTm3lN2zyxQO13fvhCwoisXtRArktkVFfCuBQLe288Ni_eYR83sb-fFkgqfmLIOjww7peMIuEsAQ Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72e2ab854c824c68bfc6ca1f34621484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 72e2ab854c824c68bfc6ca1f34621484 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-ServersNegativeTestJSON-604112046 Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 5211250033404c4698bbfd10470fc19e Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-ServersNegativeTestJSON-604112046-project Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '9a94ad3b-4c20-4b91-9b8d-0f498791748a'} Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:34:09.122436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] Returning 404 to user: Instance 9a94ad3b-4c20-4b91-9b8d-0f498791748a could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4ed31a42-a14f-4853-b14b-c7335c1fe71f tempest-ServersNegativeTestJSON-604112046 tempest-ServersNegativeTestJSON-604112046-project] 10.222.0.27 "GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a" status: 404 len: 111 microversion: 2.1 time: 0.033146 Oct 18 14:34:09.127436 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3804/7760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:09 2022] GET /compute/v2.1/servers/9a94ad3b-4c20-4b91-9b8d-0f498791748a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:34:53.732230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:53.732230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:53.895294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d5ad057-ea8b-444f-8091-8173b21de126 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: .version_select at 0x7fb32bb73dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-676574660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk1qStU2CwOJHkkgSIUWH6gj2ooi6g67Ag/awcHnEQU2eg8FvTigj4XzTqDmFIKNvi1kIlX9ncIz6Eo7lU81UoA1cAO96GdWf6anLyzoT/F+U+NAD4oPvbv3Gve3bHUHQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:53.911179 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7d5ad057-ea8b-444f-8091-8173b21de126 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:34:53.917099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-7d5ad057-ea8b-444f-8091-8173b21de126 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:34:54.012461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d5ad057-ea8b-444f-8091-8173b21de126 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.290994 Oct 18 14:34:54.013005 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3957/7761] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:34:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:54.066517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-709550879", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-676574660", "networks": [{"uuid": "78425b1e-97fd-4784-a907-94dfcd86166a"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:54.075978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=11 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:54.076727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=47 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:54.123312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] validate_networks() for [('78425b1e-97fd-4784-a907-94dfcd86166a', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:34:54.518207 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:34:54.518742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:34:54.519222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:34:54.519640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:34:54.520058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:34:54.531022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:54.531519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:54.531968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:54.532706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:54.533167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:54.533601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:54.554778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:34:54.560615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:34:54.577228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:34:54.579943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:34:54.710141 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6d4ca241-afa0-4170-88cf-c5166c3dd50d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647432 Oct 18 14:34:54.718495 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3805/7762] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 14:34:54.724363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52470e7d-b4ce-47a2-98e7-618f93d3d9d6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:54.725060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52470e7d-b4ce-47a2-98e7-618f93d3d9d6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:54.795255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-52470e7d-b4ce-47a2-98e7-618f93d3d9d6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:54.803277 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52470e7d-b4ce-47a2-98e7-618f93d3d9d6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1261 microversion: 2.1 time: 0.083380 Oct 18 14:34:54.804059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3958/7763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:54 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:55.826938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:55.827660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:55.834360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:55.834826 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:55.835269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:55.836467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:55.836928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:55.837438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:55.904686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:55.913502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fa753bda-0577-41c4-bae7-5c79db4ec922 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1265 microversion: 2.1 time: 0.091616 Oct 18 14:34:55.914849 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3806/7764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:55 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:34:56.937847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:56.939104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:56.946951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:56.947586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:56.948058 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:56.948801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:56.949286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:56.949738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:57.036059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:57.047352 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27f94918-afbf-4fd5-9c0e-678f87d6daea tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1313 microversion: 2.1 time: 0.113149 Oct 18 14:34:57.047864 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3959/7765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:56 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:58.072799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:58.074082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:58.082639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:58.083269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:58.083938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:58.084729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:58.085271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:58.085828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:58.231427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:58.239919 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5211a70c-4c69-4ad2-8bc0-02398a746292 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.171576 Oct 18 14:34:58.240519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3807/7766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:58 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:58.816706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2449b29b-9fa0-4c64-b00f-da6508c6730c", "tag": "2d94cf63-7084-4a2f-9aec-c04a7725b9f0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:58.827017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:58.827597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:58.828124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:58.840032 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] Creating event network-changed:2d94cf63-7084-4a2f-9aec-c04a7725b9f0 for instance 2449b29b-9fa0-4c64-b00f-da6508c6730c on n-h2-858383-13 Oct 18 14:34:58.845296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-299cbbae-2908-4686-b618-8c3f2e070b76 req-9e101762-3da1-4189-a7c3-d71006e86363 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032375 Oct 18 14:34:58.845896 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3960/7767] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:59.264300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:59.265203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:59.272143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:59.272635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:59.273951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:59.274516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:59.274979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:59.275423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:59.412038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:34:59.420236 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7ab4a8db-800d-443f-a089-18316f45127e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.159865 Oct 18 14:34:59.421141 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3808/7768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:34:59 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:00.444144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:00.445075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:00.452352 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:00.452866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:00.453330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:00.454489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:00.454593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:00.455046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:00.609037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:00.616889 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d79ebbff-35e2-4ad0-baba-f9886ef4c901 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.177145 Oct 18 14:35:00.617466 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3961/7769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:00 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:01.648423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:01.649058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:01.656217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:01.656711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:01.657158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:01.657859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:01.658359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:01.658798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:01.793408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:01.801252 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dc2bf2e1-0cde-46f3-8a71-f97bc94b5c57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.156740 Oct 18 14:35:01.801821 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3809/7770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:01 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:02.824888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:02.831291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:02.832534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:02.833047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:02.833514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:02.834277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:02.834756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:02.835207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:02.969762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:02.978125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f03d514b-8454-4e0d-af97-7b4c05fbf789 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.157209 Oct 18 14:35:02.978705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3962/7771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:02 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:04.001781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:04.002425 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:04.009267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:04.009769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:04.013704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:04.013704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:04.013704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:04.013704 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:04.141626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:04.149830 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c63192ba-d6cb-43d7-a68d-84d8f953fd68 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.151982 Oct 18 14:35:04.150455 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3810/7772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:03 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:04.532219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2449b29b-9fa0-4c64-b00f-da6508c6730c", "name": "network-vif-plugged", "status": "completed", "tag": "2d94cf63-7084-4a2f-9aec-c04a7725b9f0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:04.543044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:04.545616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:04.545616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:04.555468 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] Creating event network-vif-plugged:2d94cf63-7084-4a2f-9aec-c04a7725b9f0 for instance 2449b29b-9fa0-4c64-b00f-da6508c6730c on n-h2-858383-13 Oct 18 14:35:04.560784 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ccbe963d-757a-402e-ac3d-474a8a4ade9c req-d8598dfd-c75a-45db-b7ab-16eddd5b406d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Oct 18 14:35:04.561375 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3963/7773] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:05.175216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:05.175850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:05.177811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:05.178582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:05.184387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:05.184883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:05.185335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:05.186037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:05.186567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:05.187014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:05.321600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:05.329338 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2b67483c-b735-4cc5-86e2-5492a55f7c00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1361 microversion: 2.1 time: 0.158067 Oct 18 14:35:05.329930 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3811/7774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:05 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:35:06.354347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:06.354989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:06.357024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:06.362850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.363354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.363840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.364543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.365018 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.369762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.496207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:06.504128 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8782a257-152c-4bd5-b953-6d62c3470ae8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1554 microversion: 2.1 time: 0.154827 Oct 18 14:35:06.504710 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3964/7775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:06 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:06.527763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:06.528387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:06.535247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.535736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.536180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.537029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.537508 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.537941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.666938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:06.674670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b07c2f0a-4c1c-488b-9a37-7ce7c1d6775b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1554 microversion: 2.1 time: 0.151320 Oct 18 14:35:06.675253 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3812/7776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:06 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:09.808580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a2fc561-cf8c-43f0-ba04-7f390c58a50b"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:09.810990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:09.817773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:09.818320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:09.818783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:09.819498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:09.819980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:09.820933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:10.546488 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cec41aaf-5166-42d6-b4bc-89f939267f59 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741650 Oct 18 14:35:10.547182 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3965/7777] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:35:09 2022] POST /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:22.316232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:22.316738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:22.319780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:22.320472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=44 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:22.325340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:22.325822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:22.326312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:22.327012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:22.327483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:22.327925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:22.407166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lazy-loading 'services' on Instance uuid 2449b29b-9fa0-4c64-b00f-da6508c6730c {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:35:22.580670 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9a40086a-a5f4-476e-ada0-e69a14ee799c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments/0a2fc561-cf8c-43f0-ba04-7f390c58a50b" status: 202 len: 0 microversion: 2.1 time: 0.268389 Oct 18 14:35:22.581291 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3813/7778] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:35:22 2022] DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments/0a2fc561-cf8c-43f0-ba04-7f390c58a50b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:35:22.588882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:22.589722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:22.594022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:22.596428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:22.604347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:22.604857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:22.605321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:22.606043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:22.606544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:22.606994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:22.636543 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b6afe5a-758b-48a5-ac2f-f4481fb9e16f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050708 Oct 18 14:35:22.637105 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3966/7779] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:22 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:23.651041 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:23.660433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:23.660433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:23.660433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:23.660795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:23.661287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:23.661749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:23.662240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:23.694585 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5e9da69f-d403-4f51-ad6f-740ea7afced1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049427 Oct 18 14:35:23.695157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3814/7780] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:23 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:24.707339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:24.709453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:24.717679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:24.718215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:24.718690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:24.719428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:24.719910 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:24.720408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:24.758360 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-589be465-2859-4838-b11f-38e228329e0e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055421 Oct 18 14:35:24.759034 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3967/7781] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:24 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:25.771999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:25.774123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:25.781014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:25.781502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:25.781951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:25.782670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:25.783131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:25.783565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:25.813837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c07a5357-2b3f-4e57-a32f-5ab253b65ec0 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 Oct 18 14:35:25.814432 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3815/7782] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:25 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:26.827182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:26.829361 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:26.836846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:26.837359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:26.838434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:26.839152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:26.839625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:26.840071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:26.870288 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-903d4718-6a11-4884-8a06-5f7232b24776 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Oct 18 14:35:26.871764 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3968/7783] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:26 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:27.882935 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:27.885763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:27.892788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.893277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.893732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:27.894446 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.894905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.898165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:27.924100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e15a5e46-06b4-449d-afce-7a1faf04e3bf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045199 Oct 18 14:35:27.926869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3816/7784] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:27 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:35:27.936194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:27.936712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:27.943506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.944016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.944481 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:27.945201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.945675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.946156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:28.020923 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c is not attached to volume 0a2fc561-cf8c-43f0-ba04-7f390c58a50b Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments/0a2fc561-cf8c-43f0-ba04-7f390c58a50b HTTP/1.1 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c is not attached to volume 0a2fc561-cf8c-43f0-ba04-7f390c58a50b Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '2449b29b-9fa0-4c64-b00f-da6508c6730c', 'id': '0a2fc561-cf8c-43f0-ba04-7f390c58a50b'} Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0a2fc561-cf8c-43f0-ba04-7f390c58a50b. Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c is not attached to volume 0a2fc561-cf8c-43f0-ba04-7f390c58a50b Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:28.043680 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c is not attached to volume 0a2fc561-cf8c-43f0-ba04-7f390c58a50b Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c is not attached to volume 0a2fc561-cf8c-43f0-ba04-7f390c58a50b {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b87c09a-21b3-448c-88e2-7434292d279d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments/0a2fc561-cf8c-43f0-ba04-7f390c58a50b" status: 404 len: 154 microversion: 2.1 time: 0.113169 Oct 18 14:35:28.051486 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3969/7785] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:35:27 2022] DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c/os-volume_attachments/0a2fc561-cf8c-43f0-ba04-7f390c58a50b => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:35:31.641619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:31.642125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:31.649147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:31.649637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:31.650100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:31.651459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:31.651916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:31.652349 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:31.681513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:35:32.000410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-72aa78ac-2d6c-48d6-84f8-36b2a73df9f4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 204 len: 0 microversion: 2.1 time: 0.362074 Oct 18 14:35:32.001051 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3817/7786] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:35:31 2022] DELETE /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:35:32.009541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:32.010716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:32.019411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:32.019928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:32.020392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:32.021153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:32.021633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:32.022134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:32.157252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:32.165453 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a1a90a0-71c2-4f79-8a4b-6b70143d4cd1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1560 microversion: 2.1 time: 0.159868 Oct 18 14:35:32.166028 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3970/7787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:32 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:33.188780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:33.189487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:33.196455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:33.196944 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:33.197387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:33.198765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:33.199220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:33.199651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:33.328498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:33.336679 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3c92f1c-2253-4057-bb27-a81f8e79782f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1560 microversion: 2.1 time: 0.152104 Oct 18 14:35:33.337272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3818/7788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:33 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:34.155399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2449b29b-9fa0-4c64-b00f-da6508c6730c", "name": "network-vif-deleted", "tag": "2d94cf63-7084-4a2f-9aec-c04a7725b9f0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:34.165833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:34.166916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:34.168568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:34.178591 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] Creating event network-vif-deleted:2d94cf63-7084-4a2f-9aec-c04a7725b9f0 for instance 2449b29b-9fa0-4c64-b00f-da6508c6730c on n-h2-858383-13 Oct 18 14:35:34.184295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2fdc468d-94ac-492a-aa35-6ce4f18bdf59 req-07dbea45-88d2-450d-8ce0-96b06de7ecf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Oct 18 14:35:34.184882 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3971/7789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:34.360316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:34.360936 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:34.367836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:34.368322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:34.368765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:34.370167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:34.370645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:34.371043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:34.445153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:34.455135 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9ba2654-a76a-48c3-835b-0c9f8f37b9cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 200 len: 1346 microversion: 2.1 time: 0.098834 Oct 18 14:35:34.472052 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3819/7790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:34 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:35.481409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:35.482163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 2449b29b-9fa0-4c64-b00f-da6508c6730c] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:35.488431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:35.488943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:35.489409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:35.490150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:35.490633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:35.491085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:35.504742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c HTTP/1.1 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '2449b29b-9fa0-4c64-b00f-da6508c6730c'} Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:35.506415 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 2449b29b-9fa0-4c64-b00f-da6508c6730c could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a10a5d89-65d8-4cbd-8a16-66ed33dd5c82 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c" status: 404 len: 111 microversion: 2.1 time: 0.031770 Oct 18 14:35:35.512249 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3972/7791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:35 2022] GET /compute/v2.1/servers/2449b29b-9fa0-4c64-b00f-da6508c6730c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:35:35.517431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1d169ad3-6a98-4803-9605-801adfa140c5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '.version_select at 0x7fb330cba700>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:35.601795 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1d169ad3-6a98-4803-9605-801adfa140c5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-676574660" status: 202 len: 0 microversion: 2.1 time: 0.088472 Oct 18 14:35:35.602413 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3820/7792] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-676574660 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:35:35.621175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47949dab-3e2a-4aff-a7a3-2117077e02fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: .version_select at 0x7fb32b9ea5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-820779520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZC57SOS0DyfBQd734EzciGk23Ji4BXkytnuS/KxFG8IIPrIav/aryofX8niT0BKjukO2flpreGuV3gokQ+6kKOO1WoP3mZCimMB08drUB9nBU5Z3Ara7pNCZwlRd8pQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:35.637678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-47949dab-3e2a-4aff-a7a3-2117077e02fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:35:35.643926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-47949dab-3e2a-4aff-a7a3-2117077e02fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:35:35.710706 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47949dab-3e2a-4aff-a7a3-2117077e02fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094093 Oct 18 14:35:35.711234 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3973/7793] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:35:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:35:35.763397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-563471451", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-820779520", "networks": [{"uuid": "78425b1e-97fd-4784-a907-94dfcd86166a"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:35.816046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] validate_networks() for [('78425b1e-97fd-4784-a907-94dfcd86166a', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:35:36.182958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:35:36.183400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:35:36.183874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:35:36.184283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:35:36.184693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:35:36.193447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:36.193928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:36.194402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:36.195124 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:36.195580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:36.196007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:36.213765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:35:36.219107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:35:36.232420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:35:36.234791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:35:36.368627 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc4fa918-c5c0-4699-9ac6-181e47cf8e5d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609116 Oct 18 14:35:36.369278 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3821/7794] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:35:36.380488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c034aa2-36be-4aeb-b33a-218450438f90 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:36.381125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c034aa2-36be-4aeb-b33a-218450438f90 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:36.436075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c034aa2-36be-4aeb-b33a-218450438f90 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:36.443006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c034aa2-36be-4aeb-b33a-218450438f90 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1261 microversion: 2.1 time: 0.066382 Oct 18 14:35:36.443575 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3974/7795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:36 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:37.468589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:37.469322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:37.476210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.476707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.481619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.481619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.481619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.481619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.540175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:37.547883 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cf783847-d10a-4ff5-bcc7-992133e4ee87 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1265 microversion: 2.1 time: 0.085443 Oct 18 14:35:37.548453 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3822/7796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:37 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:38.571714 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:38.572379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:38.579416 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:38.583894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:38.583894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:38.583894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:38.583894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:38.583894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:38.650633 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:38.659070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c75fce4-669a-4656-bb26-214f3c25955a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1321 microversion: 2.1 time: 0.091485 Oct 18 14:35:38.659653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3975/7797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:38 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:39.682617 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:39.683242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:39.690023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:39.690571 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:39.691003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:39.691693 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:39.692159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:39.692587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:39.826070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:39.834231 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1207a76e-8346-4e4f-8546-03a790ee1331 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.155619 Oct 18 14:35:39.834903 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3823/7798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:39 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:40.079070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22984c73-ea1b-49d3-8d93-c97afe7a4c88", "tag": "343024e7-0045-438b-8514-06b032f6df18"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:40.090188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:40.090700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:40.091160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:40.103226 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] Creating event network-changed:343024e7-0045-438b-8514-06b032f6df18 for instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 on n-h2-858383-13 Oct 18 14:35:40.109291 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c881ddf4-bfe3-48f7-b695-b27b3944f10a req-9a284836-7082-41e1-8325-e5e9fc4fb937 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033604 Oct 18 14:35:40.109893 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3976/7799] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:40.858385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:40.859013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:40.865849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:40.866383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:40.866834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:40.867527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:40.867988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:40.868423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:41.005181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:41.013563 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-682be80a-f775-446d-a750-c51fdcbe5ab6 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.159756 Oct 18 14:35:41.015854 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3824/7800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:40 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:42.038374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:42.039031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:42.046207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:42.046718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:42.047185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:42.047961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:42.048438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:42.048890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:42.184718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:42.192496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c121f5b2-0e93-40ad-b51e-c72c0bfad3c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.158627 Oct 18 14:35:42.196799 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3977/7801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:42 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:43.217291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:43.217910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:43.224351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:43.224841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:43.225320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:43.226049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:43.226541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:43.226977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:43.354392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:43.362088 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-641582c3-1448-445d-9c18-f5d819d9a9ef tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.149388 Oct 18 14:35:43.362671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3825/7802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:43 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:44.385008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:44.385639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:44.394303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:44.398000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:44.398000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:44.398000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:44.398000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:44.398000 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:44.529759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:44.537549 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17401c69-eecd-40db-bb95-6e2748abe0e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.156661 Oct 18 14:35:44.538139 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3978/7803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:44 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:45.561511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:45.562156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:45.568932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:45.569417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:45.569883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:45.570603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:45.571065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:45.571492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:45.700418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:45.708185 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd8a2187-ff0a-48fc-9c64-1463f0cc0815 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.151123 Oct 18 14:35:45.708691 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3826/7804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:45 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:46.702316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22984c73-ea1b-49d3-8d93-c97afe7a4c88", "name": "network-vif-plugged", "status": "completed", "tag": "343024e7-0045-438b-8514-06b032f6df18"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:46.708295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:46.713548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:46.714077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:46.714535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:46.726002 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] Creating event network-vif-plugged:343024e7-0045-438b-8514-06b032f6df18 for instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 on n-h2-858383-13 Oct 18 14:35:46.731891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-418a63d4-7772-4d75-a4dd-8432a05f3ff0 req-da6cc888-8620-414d-b45c-c5e793f85f4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033388 Oct 18 14:35:46.732704 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3979/7805] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:46.733011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:46.733645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:46.735848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:46.736586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:46.742278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:46.742774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:46.743224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:46.743928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:46.744398 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:46.744833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:46.884998 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:46.895738 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-31dd7f69-549e-4d2c-a015-a15ae1ebe16e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.166966 Oct 18 14:35:46.895951 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3827/7806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:46 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:35:47.920331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:47.927774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:47.927774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:47.928237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:47.928698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:47.929434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:47.929955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:47.930419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:48.100752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:48.108730 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b6a731b4-6ad7-4002-ae8d-731969b2e5d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1361 microversion: 2.1 time: 0.193602 Oct 18 14:35:48.109314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3980/7807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:47 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:49.132857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:49.133487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:49.141089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:49.141591 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:49.142044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:49.142776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:49.143243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:49.143686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:49.274430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:49.277819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:49.282375 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-18b735b1-7902-45e9-8834-d5cac553f7aa tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1553 microversion: 2.1 time: 0.153458 Oct 18 14:35:49.282975 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3828/7808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:49 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:49.305376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:49.306007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:49.313477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:49.313985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:49.314496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:49.315198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:49.315676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:49.316133 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:49.444044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:49.452233 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7dba93e7-10fd-4f41-96d7-bc9c5e58d939 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1553 microversion: 2.1 time: 0.150725 Oct 18 14:35:49.452809 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3981/7809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:49 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:52.449148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6018cbf1-fdf5-45fe-a0a1-73c57a12e715"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:52.452491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:52.456681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:52.460806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:52.461272 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:52.461710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:52.462439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:52.462896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:52.463326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:53.116644 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-80937f12-7a29-4990-9208-e336a8eba239 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671674 Oct 18 14:35:53.117257 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3829/7810] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:35:52 2022] POST /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:04.899524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:04.900067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:04.903540 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:04.909575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=68 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:04.909575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:04.909575 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:04.909944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:04.910850 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:04.911325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:04.911920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:04.995425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lazy-loading 'services' on Instance uuid 22984c73-ea1b-49d3-8d93-c97afe7a4c88 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:36:05.232808 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-031c5b77-a731-4631-989a-8e8027a9c89a tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments/6018cbf1-fdf5-45fe-a0a1-73c57a12e715" status: 202 len: 0 microversion: 2.1 time: 0.337248 Oct 18 14:36:05.233407 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3982/7811] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:36:04 2022] DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments/6018cbf1-fdf5-45fe-a0a1-73c57a12e715 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:05.240096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:05.240883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:05.245128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:05.247472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:05.253479 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:05.253975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:05.254454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:05.255157 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:05.255620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:05.256055 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:05.289391 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71a8fa4d-de71-4f07-bba6-f204d0f0523b tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051408 Oct 18 14:36:05.290026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3830/7812] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:05 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:06.303704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:06.306152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:06.313218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:06.313737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:06.314309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:06.315049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:06.315537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:06.315997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:06.349862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0f8003d-12ba-4ede-80b3-11e84b42d78f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051475 Oct 18 14:36:06.350478 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3983/7813] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:06 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:07.364484 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:07.367057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:07.375460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:07.375969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:07.376421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:07.377150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:07.377628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:07.378096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:07.411155 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b1e72f8d-ee30-4a37-9e17-7c2c89a6231f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051376 Oct 18 14:36:07.411750 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3831/7814] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:07 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:08.423314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:08.425553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:08.432521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:08.432971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:08.433432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:08.434215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:08.434656 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:08.435107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:08.466569 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61a70bce-9d10-47d0-a613-0613e599739c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Oct 18 14:36:08.471897 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3984/7815] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:08 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:09.479436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:09.481766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:09.489910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:09.490448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:09.490905 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:09.491619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:09.492088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:09.492547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:09.522560 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2240282b-1bdf-4cd3-9c6b-a9a95356f7fd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Oct 18 14:36:09.523137 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3832/7816] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:09 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:36:10.535696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:10.537821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:10.544169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:10.544670 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:10.545126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:10.545827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:10.546837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:10.547285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:10.576259 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a85e4eac-a6f7-4265-bfac-f0d453b0f860 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044621 Oct 18 14:36:10.576811 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3985/7817] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:10 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:36:10.587640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:10.588150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:10.595007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:10.595502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:10.595994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:10.596689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:10.597150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:10.597587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:10.673815 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 is not attached to volume 6018cbf1-fdf5-45fe-a0a1-73c57a12e715 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments/6018cbf1-fdf5-45fe-a0a1-73c57a12e715 HTTP/1.1 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 is not attached to volume 6018cbf1-fdf5-45fe-a0a1-73c57a12e715 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': '22984c73-ea1b-49d3-8d93-c97afe7a4c88', 'id': '6018cbf1-fdf5-45fe-a0a1-73c57a12e715'} Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6018cbf1-fdf5-45fe-a0a1-73c57a12e715. Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 is not attached to volume 6018cbf1-fdf5-45fe-a0a1-73c57a12e715 Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:10.675795 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 is not attached to volume 6018cbf1-fdf5-45fe-a0a1-73c57a12e715 Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 is not attached to volume 6018cbf1-fdf5-45fe-a0a1-73c57a12e715 {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3e51ae40-370f-4022-ad9d-c855f2e915d8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments/6018cbf1-fdf5-45fe-a0a1-73c57a12e715" status: 404 len: 154 microversion: 2.1 time: 0.093669 Oct 18 14:36:10.680691 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3833/7818] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:36:10 2022] DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88/os-volume_attachments/6018cbf1-fdf5-45fe-a0a1-73c57a12e715 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:36:14.252690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:14.253218 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:14.260570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.261072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.261532 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.262291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.262773 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.263221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.289029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:36:14.565868 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e83bb30-d8a7-4bbb-9523-1a1f517cc199 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 204 len: 0 microversion: 2.1 time: 0.317397 Oct 18 14:36:14.566501 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3986/7819] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:36:14 2022] DELETE /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:36:14.574971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:14.575615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:14.582322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.587210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.587210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.587210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.587210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.587210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.733428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:14.742370 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-431ac423-4935-4bdb-ba45-be09db7dd27d tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1559 microversion: 2.1 time: 0.171356 Oct 18 14:36:14.742992 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3834/7820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:14 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:36:15.770822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:15.771475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:15.778469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.778986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.779455 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:15.780174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.780660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.781110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:15.910470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:15.918364 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00514a11-7a41-4b5f-8258-aab20bb0abce tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1559 microversion: 2.1 time: 0.151957 Oct 18 14:36:15.918946 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3987/7821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:15 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:16.723513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22984c73-ea1b-49d3-8d93-c97afe7a4c88", "name": "network-vif-deleted", "tag": "343024e7-0045-438b-8514-06b032f6df18"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:16.735062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:16.735062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:16.735291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:16.746676 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] Creating event network-vif-deleted:343024e7-0045-438b-8514-06b032f6df18 for instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 on n-h2-858383-13 Oct 18 14:36:16.752597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d1a8d43e-66a6-439c-98df-ee87b11fd14d req-9656ccc2-7504-4d60-aaf2-d7deccfda367 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Oct 18 14:36:16.753197 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3835/7822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:16.942048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:16.942648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:16.949398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:16.950233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:16.950410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:16.951067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:16.951539 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:16.951984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.019696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:17.028101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abda514a-aa26-4d46-b8f6-e9971b5549fb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 200 len: 1346 microversion: 2.1 time: 0.089926 Oct 18 14:36:17.028698 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3988/7823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:16 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:18.052977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:18.053682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 22984c73-ea1b-49d3-8d93-c97afe7a4c88] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:18.060824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.061312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.061751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.063070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.063549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.063964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.077091 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 HTTP/1.1 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '22984c73-ea1b-49d3-8d93-c97afe7a4c88'} Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:18.078827 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 22984c73-ea1b-49d3-8d93-c97afe7a4c88 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df53b982-d004-4b6f-82ca-2b531898b661 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88" status: 404 len: 111 microversion: 2.1 time: 0.031577 Oct 18 14:36:18.083490 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3836/7824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:18 2022] GET /compute/v2.1/servers/22984c73-ea1b-49d3-8d93-c97afe7a4c88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:36:18.089195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-494f688f-6659-4762-8ec4-47a84a62d9a8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '.version_select at 0x7fb3303f9160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:18.166426 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-494f688f-6659-4762-8ec4-47a84a62d9a8 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-820779520" status: 202 len: 0 microversion: 2.1 time: 0.081074 Oct 18 14:36:18.167014 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3989/7825] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-820779520 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:18.185380 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38044f1e-c9c1-4c44-babc-cd5ac19d06bb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: .version_select at 0x7fb330255550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-371682899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NrUMkSw/FnKDCnJMeSqEOTeczXyl33qMJzjDf7w9FL8/YEzWxjyK5ECNAJ56M+/EaejSCqFyTauax2sY4L0bmLpvc1jfoLGQgzkXVK23LIHkTDD+595rLvXMTMOKBLg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:18.201322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-38044f1e-c9c1-4c44-babc-cd5ac19d06bb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:36:18.207190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-38044f1e-c9c1-4c44-babc-cd5ac19d06bb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:36:18.303597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38044f1e-c9c1-4c44-babc-cd5ac19d06bb tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.122379 Oct 18 14:36:18.304128 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3837/7826] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:36:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:18.354752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1992790598", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-371682899", "networks": [{"uuid": "78425b1e-97fd-4784-a907-94dfcd86166a"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:18.407112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] validate_networks() for [('78425b1e-97fd-4784-a907-94dfcd86166a', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:36:18.869574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:36:18.870048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:36:18.870568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:36:18.871003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:36:18.871461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:36:18.880187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.880695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.881160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.881916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.882428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.882891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.900839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:36:18.906851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Getting quotas for user a599af629ce6421499d5b545acad45d0 and project d76dfb43e63b4caa88f8c8d0cc669927. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:36:18.919226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:36:18.921558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:36:19.045584 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [4d750013-115b-448d-b629-0d9eec324e94] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:36:20.053608 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [4d750013-115b-448d-b629-0d9eec324e94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 37430. Oct 18 14:36:20.057524 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae3a7dfe-2293-4b57-91f0-d964d726e6d4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706813 Oct 18 14:36:20.058247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3990/7827] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:36:20.070202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1ab04e17-fbff-4923-8db0-349668f275dd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:20.070827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1ab04e17-fbff-4923-8db0-349668f275dd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:20.125797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1ab04e17-fbff-4923-8db0-349668f275dd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:20.132729 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1ab04e17-fbff-4923-8db0-349668f275dd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1262 microversion: 2.1 time: 0.067334 Oct 18 14:36:20.133311 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3838/7828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:20 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:21.156988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:21.157620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:21.167664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:21.168174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:21.168686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:21.169403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:21.169916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:21.170399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:21.237601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:21.245695 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78459bf3-402b-4fd5-ac0b-105507291ed7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1266 microversion: 2.1 time: 0.093706 Oct 18 14:36:21.246326 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3991/7829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:21 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:22.269205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:22.270091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:22.277730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:22.278327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:22.278767 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:22.279461 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:22.279921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:22.280366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:22.346651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:22.354459 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f17f1afb-09bd-46b6-b0d8-7d394b94dad1 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1322 microversion: 2.1 time: 0.089439 Oct 18 14:36:22.355037 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3839/7830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:22 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1322 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:23.381731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:23.382396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:23.389234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:23.389742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:23.390493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:23.391318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:23.391819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:23.392331 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:23.621284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:23.629681 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0fae7d4-96f7-446a-ab27-a6015a615b7f tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.251947 Oct 18 14:36:23.630286 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3992/7831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:23 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:23.856280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3441644a-4f6c-4914-9c02-5ace3fbde796", "tag": "815d5c42-e3ce-4e6c-b93c-25d56e712361"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:23.867353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:23.867840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:23.868281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:23.881516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] Creating event network-changed:815d5c42-e3ce-4e6c-b93c-25d56e712361 for instance 3441644a-4f6c-4914-9c02-5ace3fbde796 on n-h2-858383-13 Oct 18 14:36:23.886480 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-89f5a63a-7e27-4b30-89c5-a7e4da9acc36 req-50fbe6e9-2b30-4ded-bc43-57df807170f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033988 Oct 18 14:36:23.887094 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3840/7832] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:36:24.657227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:24.657957 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:24.664883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:24.665480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:24.665868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:24.666598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:24.667075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:24.667523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:24.798820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:24.806503 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-651dbd12-c25a-4c2d-a42a-72b03f26186e tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.153822 Oct 18 14:36:24.807094 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3993/7833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:24 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:25.831712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:25.832337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:25.838582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:25.839072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:25.839518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:25.840209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:25.840671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:25.841106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:25.974287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:25.982006 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ff94df53-70f0-4b06-91c0-6e77c9c2d5e9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.155571 Oct 18 14:36:25.982607 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3841/7834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:25 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:27.005786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:27.006580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:27.013435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:27.013992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:27.015779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:27.016566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:27.017143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:27.017605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:27.152010 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:27.159770 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-720b6bd3-dca6-4991-9880-cfc4dfa7003c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.157930 Oct 18 14:36:27.160350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3994/7835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:27 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:28.183179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:28.183802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:28.190810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:28.191300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:28.191746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:28.192441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:28.192906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:28.193341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:28.320788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:28.328774 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-119aace3-ce1b-4c3f-bcb6-3e68a869d0f7 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.149543 Oct 18 14:36:28.329360 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3842/7836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:28 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:28.922763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441644a-4f6c-4914-9c02-5ace3fbde796", "name": "network-vif-plugged", "status": "completed", "tag": "815d5c42-e3ce-4e6c-b93c-25d56e712361"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:28.936206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:28.936206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:28.936206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:28.936206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:28.936206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:28.946514 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] Creating event network-vif-plugged:815d5c42-e3ce-4e6c-b93c-25d56e712361 for instance 3441644a-4f6c-4914-9c02-5ace3fbde796 on n-h2-858383-13 Oct 18 14:36:28.951544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e755afbb-5060-4219-bf2e-3d05fb88f7c3 req-ce05b130-506e-45a3-aae0-a5ee037e02b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Oct 18 14:36:28.952122 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3995/7837] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:29.352315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:29.352858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:29.360166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:29.360655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:29.361100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:29.361791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:29.362293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:29.362732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:29.492985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:29.501423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07da97e6-bf2d-490d-ae64-9743fd20b872 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1362 microversion: 2.1 time: 0.153085 Oct 18 14:36:29.502007 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3843/7838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:29 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:30.526974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:30.527725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:30.534577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.535091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.535559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.536272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.536750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.537200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.669812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:30.678215 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-34f49343-10a5-46a5-bfec-45bf245f9baf tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1554 microversion: 2.1 time: 0.157112 Oct 18 14:36:30.678791 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3996/7839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:30 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:30.701106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:30.701655 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:30.703677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:30.709625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.710149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.716574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.716574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.716574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.716574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.841146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:30.848909 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-92bf2cda-146c-4957-b5e4-cff454370361 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1554 microversion: 2.1 time: 0.151887 Oct 18 14:36:30.849483 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3844/7840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:30 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:33.837588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645168a6-d826-43b4-aae0-d81f0439941d"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:33.848489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:33.848489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:33.848489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:33.848489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:33.848908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:33.849045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:33.849490 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:34.386337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:34.557858 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f424493-b7ba-4454-9f90-da2fc82e58df tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "POST /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723836 Oct 18 14:36:34.562256 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3997/7841] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:36:33 2022] POST /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:46.324839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:46.325395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:46.328251 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:46.331950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=66 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:46.333632 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:46.334164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:46.334623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:46.335321 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:46.335787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:46.336219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:46.415804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lazy-loading 'services' on Instance uuid 3441644a-4f6c-4914-9c02-5ace3fbde796 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:36:46.615406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-37b77e7e-6138-439e-81ef-89a78586716c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments/645168a6-d826-43b4-aae0-d81f0439941d" status: 202 len: 0 microversion: 2.1 time: 0.294301 Oct 18 14:36:46.616093 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3845/7842] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:36:46 2022] DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments/645168a6-d826-43b4-aae0-d81f0439941d => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:46.625641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:46.628303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:46.631360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:46.636583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:46.637096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:46.637558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:46.638317 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:46.638798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:46.639248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:46.669353 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e1fa12c-6dec-45b4-a921-4735f6fc61b4 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Oct 18 14:36:46.669932 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3998/7843] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:46 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:47.684091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:47.686477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:47.692782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:47.693279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:47.693769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:47.694466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:47.694934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:47.695363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:47.735049 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08b6c9f6-d3ed-4220-90f4-13c8c49854c9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056118 Oct 18 14:36:47.735637 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3846/7844] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:47 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:48.748197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:48.750908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:48.758381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:48.758894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:48.759357 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:48.760087 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:48.760560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:48.761003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:48.793726 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5571de88-17a5-4b1b-bf9c-9bfe0b3eef6c tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049970 Oct 18 14:36:48.794352 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3999/7845] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:48 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:49.806690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:49.808848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:49.815604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:49.816096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:49.816604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:49.817298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:49.817759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:49.818229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:49.848259 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-12135621-f136-46d5-83ff-0a568718a2cd tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Oct 18 14:36:49.848836 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3847/7846] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:49 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:50.861640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:50.863881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:50.871002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:50.871520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:50.871990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:50.872713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:50.873196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:50.873652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:50.906886 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cb70a41-f328-45c1-8907-823c27616a21 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050101 Oct 18 14:36:50.909562 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4000/7847] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:50 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:51.918888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:51.921213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:51.928128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:51.928636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:51.929085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:51.929792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:51.930294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:51.930734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:51.961256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb5737d5-a755-448d-907b-b3b457c08d57 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046412 Oct 18 14:36:51.961830 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3848/7848] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:36:51 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:36:51.973281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:51.974397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:51.982391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:51.982906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:51.983368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:51.984155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:51.984632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:51.985090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:52.066258 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 is not attached to volume 645168a6-d826-43b4-aae0-d81f0439941d Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments/645168a6-d826-43b4-aae0-d81f0439941d HTTP/1.1 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 is not attached to volume 645168a6-d826-43b4-aae0-d81f0439941d Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '3441644a-4f6c-4914-9c02-5ace3fbde796', 'id': '645168a6-d826-43b4-aae0-d81f0439941d'} Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 645168a6-d826-43b4-aae0-d81f0439941d. Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 is not attached to volume 645168a6-d826-43b4-aae0-d81f0439941d Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:52.068131 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 is not attached to volume 645168a6-d826-43b4-aae0-d81f0439941d Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 is not attached to volume 645168a6-d826-43b4-aae0-d81f0439941d {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e019f35-dcc4-493f-8c91-708e7ffeda00 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments/645168a6-d826-43b4-aae0-d81f0439941d" status: 404 len: 154 microversion: 2.1 time: 0.100601 Oct 18 14:36:52.078175 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4001/7849] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:36:51 2022] DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796/os-volume_attachments/645168a6-d826-43b4-aae0-d81f0439941d => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:36:55.613031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:55.614639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:55.621465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:55.621960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:55.622436 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:55.623354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:55.623819 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:55.624798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:55.651451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:36:55.924820 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fc0ca5b9-4c3b-497a-b4fc-b382600c8fc9 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 204 len: 0 microversion: 2.1 time: 0.315617 Oct 18 14:36:55.925431 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3849/7850] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:36:55 2022] DELETE /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:36:55.933990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:55.934775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:55.943816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:55.944335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:55.944933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:55.945662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:55.946193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:55.946651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:56.084853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:56.093537 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-051946f7-ea07-4d43-9fbd-ce5f2895d1f5 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1560 microversion: 2.1 time: 0.162861 Oct 18 14:36:56.095072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4002/7851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:55 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:57.119016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:57.119751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:57.126782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:57.127268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:57.127711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:57.128403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:57.128866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:57.129297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:57.257214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:57.265733 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-43120488-494a-43e5-ad46-92c37b6c9f40 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1560 microversion: 2.1 time: 0.150240 Oct 18 14:36:57.266348 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3850/7852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:57 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:58.133215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441644a-4f6c-4914-9c02-5ace3fbde796", "name": "network-vif-deleted", "tag": "815d5c42-e3ce-4e6c-b93c-25d56e712361"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:58.144430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:58.147712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:58.147712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:58.156583 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] Creating event network-vif-deleted:815d5c42-e3ce-4e6c-b93c-25d56e712361 for instance 3441644a-4f6c-4914-9c02-5ace3fbde796 on n-h2-858383-13 Oct 18 14:36:58.161947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a63c9524-e1ab-498a-9af8-3a9c71721050 req-da7be4f8-7dde-4fd6-a7c3-ea9503df7c5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Oct 18 14:36:58.162561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4003/7853] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:58.289029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:58.289575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:58.297067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:58.297563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:58.298006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:58.298736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:58.299197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:58.299634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:58.365727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a599af629ce6421499d5b545acad45d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd76dfb43e63b4caa88f8c8d0cc669927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:58.373715 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f882228f-a0e7-46e5-ac81-4fd3629c4ec3 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 200 len: 1347 microversion: 2.1 time: 0.088774 Oct 18 14:36:58.378014 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3851/7854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:58 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 1347 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:59.400402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:59.401136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] [instance: 3441644a-4f6c-4914-9c02-5ace3fbde796] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:59.408906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:59.409402 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:59.409869 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:59.410628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:59.411113 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:59.411570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:59.425742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] HTTP exception thrown: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Request method failure captured: Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 HTTP/1.1 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTrmGuVgsihntoFuytfJ4Cni3PHVFf1hHE35xKqB2KTvH5UXaZE414IxkTGZY0Y6CiMQ9HyaKUUrmEHCM6sskt4swFMvzR56Qy2QQiY4-i25X6JEwz9tnPBxTOWbUD8oPxf7HvZawWgVTMonUHzdTToX-ViBYRsQ0TCwo-MsiV7dyumE Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d76dfb43e63b4caa88f8c8d0cc669927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: d76dfb43e63b4caa88f8c8d0cc669927 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-540574891 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: a599af629ce6421499d5b545acad45d0 Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestEncryptedCinderVolumes-540574891-project Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '3441644a-4f6c-4914-9c02-5ace3fbde796'} Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:59.427445 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Returning 404 to user: Instance 3441644a-4f6c-4914-9c02-5ace3fbde796 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6c7b1b8-2787-4cc3-a5ea-699b0ad1dd20 tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796" status: 404 len: 111 microversion: 2.1 time: 0.032989 Oct 18 14:36:59.432091 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4004/7855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:59 2022] GET /compute/v2.1/servers/3441644a-4f6c-4914-9c02-5ace3fbde796 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:36:59.438177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0b684cc6-4261-47dd-bbac-fe7d3db028ac tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] Calling method '.version_select at 0x7fb33048f5e0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:59.502876 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0b684cc6-4261-47dd-bbac-fe7d3db028ac tempest-TestEncryptedCinderVolumes-540574891 tempest-TestEncryptedCinderVolumes-540574891-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-371682899" status: 202 len: 0 microversion: 2.1 time: 0.068549 Oct 18 14:36:59.503467 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3852/7856] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 14:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-371682899 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:37:32.092082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-182250b8-c5f1-42d3-b702-a0ec6d54e54c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: .version_select at 0x7fb3303f9430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2083701732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKGTYhrE9UCcmzDz/eaJQkzOZQrwgnAws/Tt3malJKbw1tKyrSvIqUJ/FbpEQc5lMVUv1PXsYFEILLmhG7WF8c8wN4vE58o8P4+Ii1B6gt3qBGKriGKpmqTv6Jm44mgVA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:32.099242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.099933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.111569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-182250b8-c5f1-42d3-b702-a0ec6d54e54c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:37:32.116704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-182250b8-c5f1-42d3-b702-a0ec6d54e54c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for user 57bf494036c8499e9ef5f4452ef23f85 and project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:37:32.182216 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-182250b8-c5f1-42d3-b702-a0ec6d54e54c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.094284 Oct 18 14:37:32.182825 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4005/7857] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:37:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:37:32.232509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.233529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.238416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-291506993", "imageRef": "b1a6da15-e5e2-4a53-b791-9905f6817530", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2083701732", "networks": [{"uuid": "d194c480-d262-474e-b97e-7b51cd7f3f04"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:32.292164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] validate_networks() for [('d194c480-d262-474e-b97e-7b51cd7f3f04', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:37:32.762761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:37:32.763189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:37:32.763662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:37:32.764075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:37:32.764490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:37:32.774017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:32.774529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:32.774968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:32.775688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:32.776142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:32.776567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:32.794372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:37:32.799524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for user 57bf494036c8499e9ef5f4452ef23f85 and project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:37:32.811572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:37:32.813777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1a6da15-e5e2-4a53-b791-9905f6817530',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:37:32.947844 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8190c3e6-a275-413f-8272-ea7817fef07e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718062 Oct 18 14:37:32.948426 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3853/7858] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:37:32.960613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8b2b009-b90f-4cb2-a4b7-becf692ccbc0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:32.961312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8b2b009-b90f-4cb2-a4b7-becf692ccbc0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:33.018673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a8b2b009-b90f-4cb2-a4b7-becf692ccbc0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:33.026806 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8b2b009-b90f-4cb2-a4b7-becf692ccbc0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1258 microversion: 2.1 time: 0.070583 Oct 18 14:37:33.027388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4006/7859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:32 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:37:34.050460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:34.050997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:34.060513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:34.060997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:34.061469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:34.062209 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:34.062792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:34.063233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:34.124770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:34.132596 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-af359666-8d80-4a94-950c-0b52fe01a0b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1262 microversion: 2.1 time: 0.087657 Oct 18 14:37:34.133381 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3854/7860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:34 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:35.156390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:35.157037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:35.168604 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:35.169124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:35.169592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:35.170341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:35.170827 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:35.171291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:35.242830 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:35.251720 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec35fe21-4ba3-4750-af49-8b5f5b0393e8 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1318 microversion: 2.1 time: 0.098652 Oct 18 14:37:35.252315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4007/7861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:35 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:36.275897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:36.277705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:36.286829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:36.287806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:36.288518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:36.289583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:36.290118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:36.290757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:36.475154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:36.488062 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-018bfd47-8e5c-427c-aeb5-df7f395d6002 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.215637 Oct 18 14:37:36.490278 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3855/7862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:36 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:37.511890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:37.512675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:37.520043 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:37.520559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:37.521022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:37.521735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:37.522250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:37.522737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:37.668936 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:37.677612 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd804681-22e5-42cf-9d48-c3517b80b805 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.169626 Oct 18 14:37:37.678556 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4008/7863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:37 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:38.702391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:38.703034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:38.711300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:38.711836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:38.712423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:38.713286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:38.713822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:38.714433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:38.855731 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:38.864124 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7cae3482-8276-4d45-9fcf-9ff62096c558 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.165586 Oct 18 14:37:38.878099 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3856/7864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:38 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:39.888774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:39.889437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:39.897703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:39.898344 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:39.898892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:39.899686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:39.900375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:39.900895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:40.043479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:40.051971 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e28905e9-fee2-4215-8882-e18b764dd111 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.167296 Oct 18 14:37:40.052560 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4009/7865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:39 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:41.078113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:41.079427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:41.086988 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:41.087409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:41.087858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:41.088554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:41.089014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:41.089444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:41.232343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:41.241484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e8a2325f-e6db-4393-a473-47e78e8db24a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.168970 Oct 18 14:37:41.249697 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3857/7866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:41 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:42.270106 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:42.270924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:42.280098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:42.280625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:42.281096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:42.282461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:42.282899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:42.283314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:42.481698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:42.491741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7033ea5c-a33c-4064-8ee0-91cc9a279891 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.226662 Oct 18 14:37:42.493280 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4010/7867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:42 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:43.517482 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:43.518269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:43.520172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:43.520854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:43.525659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:43.526183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:43.526634 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:43.527330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:43.527793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:43.528232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:43.659302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:43.667219 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4d04502-f33b-4ac0-a4ed-5b5314668018 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.154189 Oct 18 14:37:43.667829 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3858/7868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:43 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:44.418315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:44.423327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:44.429475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:44.429969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:44.430444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:44.442314 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] Creating event network-changed:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:37:44.447596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-cf61fb95-c37f-4e0b-85fa-cad1b765f6be req-29cf8508-2bc6-4a95-90ce-fa3d75733797 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Oct 18 14:37:44.448561 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4011/7869] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:37:44.691800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:44.692427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:44.700102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:44.700102 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:44.700493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:44.701200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:44.701663 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:44.702125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:44.843583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:44.851621 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ea173ef0-4af0-47e6-b6e3-30d246721851 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.164332 Oct 18 14:37:44.852215 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3859/7870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:44 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:45.877523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:45.878264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:45.884457 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:45.884951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:45.885404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:45.886124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:45.886599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:45.887042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:46.019743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:46.027504 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95c2f7ad-9af2-4c58-9c97-ac87d0328f3a tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.155565 Oct 18 14:37:46.028072 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4012/7871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:45 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:47.050465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:47.051084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:47.057904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:47.058422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:47.058867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:47.059550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:47.060004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:47.060434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:47.204129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:47.212119 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b63844f7-5fea-4027-b81e-88b3a2e20573 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.165530 Oct 18 14:37:47.212695 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3860/7872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:47 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:48.235922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:48.236591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:48.243432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:48.243954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:48.244409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:48.245111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:48.245582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:48.246044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:48.379239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:48.387031 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-113f0843-089a-4994-abbc-466f24b0fff3 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.155061 Oct 18 14:37:48.387599 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4013/7873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:48 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:49.409996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:49.410640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:49.418947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.419551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.420077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.420851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.421393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.421900 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.564991 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:49.573837 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-14276cfc-bdd8-4506-87d8-bcff7bb94dc9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.167015 Oct 18 14:37:49.574019 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3861/7874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:49 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:50.597420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:50.598072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:50.605044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:50.605545 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:50.605999 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:50.606733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:50.607203 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:50.607647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:50.743399 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:50.751142 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ef37694-0813-48bc-9841-005151dbf7e5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.158508 Oct 18 14:37:50.751720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4014/7875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:50 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:51.247061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "name": "network-vif-plugged", "status": "completed", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:51.257300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:51.260535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:51.260535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:51.269479 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] Creating event network-vif-plugged:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:37:51.274700 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1d000098-7e47-496f-8885-2abb74c0179f req-db6023f9-e0ab-4aac-b08b-f220ca05f517 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Oct 18 14:37:51.275315 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3862/7876] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:37:51.774996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:51.775577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:51.782462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:51.782975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:51.783445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:51.784167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:51.784669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:51.785127 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:51.912763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:51.920722 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2693c057-28d1-494e-9f3d-c8b2f66ef4f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1358 microversion: 2.1 time: 0.149847 Oct 18 14:37:51.921305 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4015/7877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:51 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:52.944688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:52.945404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:52.951978 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:52.952475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:52.952922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:52.953630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:52.954658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:52.955106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.092793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:53.101573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6412ce00-217e-4da3-bd65-d4106b894804 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1548 microversion: 2.1 time: 0.162078 Oct 18 14:37:53.102170 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3863/7878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:52 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:53.126625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:53.127272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:53.134261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.134781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.135251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.135972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.136458 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.136942 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.360925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:53.368880 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcc59bc7-b8a5-4927-b686-b17b788bfb43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1548 microversion: 2.1 time: 0.246351 Oct 18 14:37:53.369463 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4016/7879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:53 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1548 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:53.392291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:53.397105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:53.397883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Searching by: {'deleted': False, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 14:37:53.403188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.403678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.404126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.404856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.405318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.405756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.429267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 14:37:53.458898 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f9430d51-c51f-4ce3-bb67-13c0412db068 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071238 Oct 18 14:37:53.459519 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3864/7880] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 14:37:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:37:53.471486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:53.472224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:53.478484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.479073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.479700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.480500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:53.481059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:53.481606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.644244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:53.652496 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-200e903f-9f3a-4b4c-b8b9-faf1ad3f888f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1548 microversion: 2.1 time: 0.185107 Oct 18 14:37:53.653071 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4017/7881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:53 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:56.475369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6fbd8fb-c850-46bd-8258-333929038d49"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:56.477699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:56.484583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:56.485067 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:56.485505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:56.486289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:56.486748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:56.487178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:57.127012 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bc9d29f-d774-48b6-b360-23e57fa2fd76 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655524 Oct 18 14:37:57.128380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3865/7882] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:37:56 2022] POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:38:11.465785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:11.466462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:11.468719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:11.469424 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=62 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:11.474216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:11.474737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:11.475200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:11.475921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:11.476403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:11.476859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:11.728889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:11.737248 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c039ca5-e7a9-493c-b75d-e76401d2f6fe tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1594 microversion: 2.1 time: 0.275706 Oct 18 14:38:11.741743 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4018/7883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:11 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1594 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:13.701342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:13.712296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:13.715785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:13.715785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:13.715997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:13.716489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:13.716923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:13.729816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] Creating event network-changed:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:38:13.735059 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-82b972c5-9531-4272-b1f3-9d025d038a70 req-1aa98846-d7ab-4948-adbb-94335c8338e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037746 Oct 18 14:38:13.738862 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3866/7884] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:38:15.926441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1883081369"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:15.926996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:15.934439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:15.934949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:15.935439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:15.936146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:15.936619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:15.937094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:16.062862 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Adding security group 5545a065-ed27-4e87-8531-174d85bd26fb to port c8dd8750-68f7-4b66-843c-b63e2c09212c Oct 18 14:38:16.427422 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3bfe448-5bfb-4ba4-a4a7-c5839b49e793 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action" status: 202 len: 0 microversion: 2.1 time: 0.504947 Oct 18 14:38:16.429055 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4019/7885] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:38:15 2022] POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:38:16.439158 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:16.439849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:16.440183 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:16.462084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:16.466496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:16.466496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:16.466496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:16.467566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:16.467986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:16.473371 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:16.474176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:16.475406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:16.488342 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] Creating event network-changed:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:38:16.495660 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fa39a010-1ce2-4819-a7fa-122aa2a7c860 req-832e61b7-860a-449e-8467-892d743f85aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060734 Oct 18 14:38:16.496927 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3867/7886] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:38:16.761154 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:16.773554 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5eb76d4d-f381-4bf6-ae0b-56da9e18d9b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1760 microversion: 2.1 time: 0.338514 Oct 18 14:38:16.790298 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4020/7887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:16 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1760 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:54.371117 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:39:54.371615 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action (ip 10.222.0.27) !!! Oct 18 14:39:54.372583 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:39:54.372713 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action (ip 10.222.0.27) !!! Oct 18 14:39:54.379166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:54.382855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:54.397677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.401658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.401658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.401658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.401658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.401658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.621949 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e948321e-d642-41bb-9842-30e7ac05ea65 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action" status: 202 len: 0 microversion: 2.1 time: 0.253514 Oct 18 14:39:54.622620 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3868/7888] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:39:54 2022] POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:39:54.629024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:54.629796 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:54.630914 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:39:54.631201 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 (ip 10.222.0.27) !!! Oct 18 14:39:54.633143 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:39:54.633268 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 (ip 10.222.0.27) !!! Oct 18 14:39:54.637895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:54.638508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:54.647746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.648261 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.648861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.649579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.650073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.650889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.831137 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:54.839497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f29a35cc-1501-44df-8b66-32e2f9bcf33c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1762 microversion: 2.1 time: 0.212439 Oct 18 14:39:54.840079 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4021/7889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:54 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1762 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:55.864578 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:55.865284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:55.872320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:55.872810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:55.873280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:55.874003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:55.874526 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:55.874959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:56.105006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:56.113351 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29cdd7fa-227a-4ed8-8dbf-1e44540a42e1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1767 microversion: 2.1 time: 0.253830 Oct 18 14:39:56.113920 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3869/7890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:55 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1767 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:57.136844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:57.137631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:57.145143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:57.145576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:57.146044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:57.146785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:57.147265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:57.147718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:57.372029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:57.380595 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-abd9e8ee-4af1-42fe-b530-46f8b750e4a0 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1760 microversion: 2.1 time: 0.247677 Oct 18 14:39:57.381161 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4022/7891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:57 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1760 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:11.941491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:11.942293 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:11.946280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1883081369"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:11.946818 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:11.952611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:11.954640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:11.954640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:11.954640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:11.954941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:11.955168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.087791 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.network.security_group_api [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Removing security group 5545a065-ed27-4e87-8531-174d85bd26fb from port c8dd8750-68f7-4b66-843c-b63e2c09212c Oct 18 14:41:12.485659 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4c91198-4335-4472-ba0c-241169891390 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action" status: 202 len: 0 microversion: 2.1 time: 0.546163 Oct 18 14:41:12.493571 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.494537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.494911 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3870/7892] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:41:11 2022] POST /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:41:12.574080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:12.587774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.587774 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.588470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.600794 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] Creating event network-changed:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:41:12.604514 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] [d0e42a66-df81-4f86-8d7d-b67f08ec7576] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:41:13.613840 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] [d0e42a66-df81-4f86-8d7d-b67f08ec7576] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38016. Oct 18 14:41:13.618325 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-33dc0587-9c03-4374-92ba-862677c5d30c req-05418e16-c7d0-4a9b-80a9-d07eaf427c9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.126828 Oct 18 14:41:13.618953 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4023/7893] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:13.688830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:13.689359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:13.695468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:13.696175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:13.696628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:13.697329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:13.697973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:13.698427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:13.790335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lazy-loading 'services' on Instance uuid f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:41:13.978974 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d09e6217-8c97-4121-a6ce-2e0bb6a5127f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments/c6fbd8fb-c850-46bd-8258-333929038d49" status: 202 len: 0 microversion: 2.1 time: 0.295492 Oct 18 14:41:13.980380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3871/7894] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:41:13 2022] DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments/c6fbd8fb-c850-46bd-8258-333929038d49 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:41:13.992181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:13.998212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:14.006928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:14.007964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:14.008437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:14.009347 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:14.010187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:14.010648 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:14.046081 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8461ad28-64da-4634-a0bc-26f01064b932 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061071 Oct 18 14:41:14.050999 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4024/7895] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:13 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:15.060250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:15.062525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:15.068781 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.069280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.069728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.070455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.070918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.071352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.100900 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-55fb4b89-2fb0-4eb0-bf2f-9407edb43279 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Oct 18 14:41:15.101464 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3872/7896] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:15 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:15.633855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:15.645123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.645628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.646105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.658358 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] Creating event network-changed:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:41:15.663805 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-855bb1ac-77d0-4641-b667-a478eb859e7f req-f9281270-7468-4ec8-b5df-481abdcd5cfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033710 Oct 18 14:41:15.664589 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4025/7897] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:16.114002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:16.116383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:16.124089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:16.124695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:16.125139 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:16.125830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:16.126309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:16.126771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:16.159143 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-971943ff-82f5-403d-813f-52c1d97a095f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Oct 18 14:41:16.164252 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3873/7898] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:16 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:17.173336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:17.175701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:17.182824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:17.183338 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:17.183801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:17.184518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:17.184997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:17.185446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:17.215490 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-637ffad7-f3b9-43b8-a824-d8f5c597b864 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Oct 18 14:41:17.216062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4026/7899] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:17 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:18.228595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:18.230860 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:18.238224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:18.238719 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:18.239168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:18.239864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:18.240329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:18.240763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:18.270573 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8899effc-f417-4917-b7f0-6c70f024d6b7 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Oct 18 14:41:18.271139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3874/7900] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:18 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:19.283768 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:19.285945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:19.292730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:19.293227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:19.293683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:19.294410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:19.294882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:19.295322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:19.323683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f0fc377-12d0-4651-93d3-2846aeebe6af tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044658 Oct 18 14:41:19.324230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4027/7901] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:41:19 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:41:19.335448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:19.336013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:19.343584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:19.344082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:19.344533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:19.345266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:19.345758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:19.346250 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:19.420335 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] HTTP exception thrown: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 is not attached to volume c6fbd8fb-c850-46bd-8258-333929038d49 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Request method failure captured: Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: request: DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments/c6fbd8fb-c850-46bd-8258-333929038d49 HTTP/1.1 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTroayLUuHQjAeR08TJKoomrPAc0htwUJm41_TA-yQPcWThDC-ICQ1M_kbH7UFOkvB70hAKNbDrQPX5myjSH6WBJLRvUoHgDmsBsZNla7cEtE_7uguexsoIeJavf7v-1vcm_lTetQ2Ds7076bY8tsq27sUBu_May1IRaryxn25gkCZ2M Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 57bf494036c8499e9ef5f4452ef23f85 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 is not attached to volume c6fbd8fb-c850-46bd-8258-333929038d49 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'server_id': 'f64cbd4a-a12f-4e08-aeb1-68b12dee03f3', 'id': 'c6fbd8fb-c850-46bd-8258-333929038d49'} Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c6fbd8fb-c850-46bd-8258-333929038d49. Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 is not attached to volume c6fbd8fb-c850-46bd-8258-333929038d49 Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:19.421952 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 is not attached to volume c6fbd8fb-c850-46bd-8258-333929038d49 Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Returning 404 to user: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 is not attached to volume c6fbd8fb-c850-46bd-8258-333929038d49 {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d1396de0-6c1c-491a-b196-d7dc94f84db1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments/c6fbd8fb-c850-46bd-8258-333929038d49" status: 404 len: 154 microversion: 2.1 time: 0.092081 Oct 18 14:41:19.427029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3875/7902] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:41:19 2022] DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3/os-volume_attachments/c6fbd8fb-c850-46bd-8258-333929038d49 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:22.818687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:22.819186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:22.826301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:22.826807 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:22.827274 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:22.827994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:22.828471 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:22.828918 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:22.853858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:41:23.173190 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1c65196-3de5-4903-917d-bd2f9dbd67b4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 204 len: 0 microversion: 2.1 time: 0.358188 Oct 18 14:41:23.173861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4028/7903] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:41:22 2022] DELETE /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:41:23.182134 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:23.182756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:23.190418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:23.190911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:23.191350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:23.192042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:23.192498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:23.192927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:23.323806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:23.332348 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-db2aa222-ba3b-4001-b476-1afc75094f94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1554 microversion: 2.1 time: 0.154183 Oct 18 14:41:23.332936 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3876/7904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:23 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:41:24.356913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:24.357561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:24.365456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:24.366016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:24.371887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:24.371887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:24.371887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:24.371887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:24.508760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:24.517399 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e8faf6f5-62ce-4a79-aa75-2a75b0582815 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1554 microversion: 2.1 time: 0.164698 Oct 18 14:41:24.517982 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4029/7905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:24 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:25.526473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64cbd4a-a12f-4e08-aeb1-68b12dee03f3", "name": "network-vif-deleted", "tag": "c8dd8750-68f7-4b66-843c-b63e2c09212c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:25.536525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:25.537009 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:25.537445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:25.541429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:25.542165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:25.549763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:25.550310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:25.550776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:25.550900 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] Creating event network-vif-deleted:c8dd8750-68f7-4b66-843c-b63e2c09212c for instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 on n-h2-858383-13 Oct 18 14:41:25.551497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:25.551986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:25.552419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:25.555790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-31d2d14a-7639-4852-88d2-da292391b92a req-0159d30d-a90a-46a9-bbb6-4de2324e5186 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091264 Oct 18 14:41:25.556760 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3877/7906] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:25.620359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:25.635118 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2d69206-b9c2-4190-b93c-39bf25e5e44f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 200 len: 1512 microversion: 2.1 time: 0.097407 Oct 18 14:41:25.635640 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4030/7907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:25 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 1512 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:41:26.660089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:26.660836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: f64cbd4a-a12f-4e08-aeb1-68b12dee03f3] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:26.667079 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:26.671034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:26.671034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:26.671034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:26.671034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:26.671034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:26.683250 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] HTTP exception thrown: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Request method failure captured: Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 HTTP/1.1 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTroayLUuHQjAeR08TJKoomrPAc0htwUJm41_TA-yQPcWThDC-ICQ1M_kbH7UFOkvB70hAKNbDrQPX5myjSH6WBJLRvUoHgDmsBsZNla7cEtE_7uguexsoIeJavf7v-1vcm_lTetQ2Ds7076bY8tsq27sUBu_May1IRaryxn25gkCZ2M Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 57bf494036c8499e9ef5f4452ef23f85 Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'f64cbd4a-a12f-4e08-aeb1-68b12dee03f3'} Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:26.684871 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Returning 404 to user: Instance f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b88fa604-4b8c-4edb-9c33-aa794f7a7cae tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 18 14:41:26.690673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3878/7908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:26 2022] GET /compute/v2.1/servers/f64cbd4a-a12f-4e08-aeb1-68b12dee03f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:26.696443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ae01d22-c0ce-4fce-8fcc-c6c6daf0899d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '.version_select at 0x7fb331132040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:26.777170 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ae01d22-c0ce-4fce-8fcc-c6c6daf0899d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2083701732" status: 202 len: 0 microversion: 2.1 time: 0.084440 Oct 18 14:41:26.777766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4031/7909] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 18 14:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2083701732 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:41:38.196295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0dc5480d-e7b8-4506-a62b-28f95e298fdb tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: .version_select at 0x7fb32bc28160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-910709681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6v/C68puR6c7Sk1yHzE65h4PjFpi49/HB/WEeBFxAwKw7tNYHVmUMbSHyWCYyy8FKKKrhdh7oDndSWGBX/S+441IVYeper5SILB0Yp7U23kS770R7EFmiKrlceNUSmEg=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:38.204018 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=18 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.206143 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.215082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0dc5480d-e7b8-4506-a62b-28f95e298fdb tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:41:38.220790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-0dc5480d-e7b8-4506-a62b-28f95e298fdb tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for user 57bf494036c8499e9ef5f4452ef23f85 and project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:41:38.323227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0dc5480d-e7b8-4506-a62b-28f95e298fdb tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.130691 Oct 18 14:41:38.323816 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3879/7910] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:41:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:38.372374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.373187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.377189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-699475331", "imageRef": "7c46c58d-01df-463d-a39b-3770f240341e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-910709681", "networks": [{"uuid": "d194c480-d262-474e-b97e-7b51cd7f3f04"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:38.429655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] validate_networks() for [('d194c480-d262-474e-b97e-7b51cd7f3f04', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:41:38.852582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:41:38.853061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:41:38.853559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:41:38.853989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:41:38.854461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:41:38.863294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:38.863799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:38.864260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:38.865011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:38.865491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:38.865965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:38.883695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:41:38.889546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Getting quotas for user 57bf494036c8499e9ef5f4452ef23f85 and project 2df5b6291a724accb3ca9bf1baa7cf29. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:41:38.902199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:41:38.904438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c46c58d-01df-463d-a39b-3770f240341e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:41:39.024916 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-405f9f91-5d66-4c87-9628-53a7d2c14c35 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654840 Oct 18 14:41:39.025498 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4032/7911] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:41:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:41:39.036431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0035f5f8-8203-4262-ae3a-dec234531f43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:39.037050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0035f5f8-8203-4262-ae3a-dec234531f43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:39.092344 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0035f5f8-8203-4262-ae3a-dec234531f43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:39.099553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0035f5f8-8203-4262-ae3a-dec234531f43 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1257 microversion: 2.1 time: 0.066964 Oct 18 14:41:39.100116 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3880/7912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:39 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:40.122905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:40.123548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:40.130407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:40.130908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:40.131367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:40.132064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:40.132537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:40.132984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:40.195732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:40.203626 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e32d171-4678-4797-8bbf-66bbe6d43027 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1261 microversion: 2.1 time: 0.085521 Oct 18 14:41:40.204197 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4033/7913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:40 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:41.227718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:41.228352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:41.237203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:41.237848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:41.238338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:41.239058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:41.239520 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:41.239962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:41.331884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:41.339672 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-66494875-dad3-445b-9b35-8abdd2926499 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1317 microversion: 2.1 time: 0.116029 Oct 18 14:41:41.340251 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3881/7914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:41 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:42.366209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:42.367618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:42.375146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:42.376740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:42.377442 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:42.378746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:42.379567 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:42.380340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:42.533489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:42.542497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5610bae1-5c44-407f-92ea-f016e087a901 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.181135 Oct 18 14:41:42.543238 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4034/7915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:42 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:43.569495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:43.570232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:43.576744 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:43.577530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:43.578857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:43.579746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:43.580410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:43.580854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:43.730404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:43.743240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-280f1f0a-1a66-40f4-96a3-a67c04996f06 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.177973 Oct 18 14:41:43.744050 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3882/7916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:43 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:44.766734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:44.767759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:44.775006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:44.775510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:44.776008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:44.776728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:44.777202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:44.777834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:44.929353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:44.937447 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3f8452f-70d9-41db-b6e6-29afe962b7b2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.175079 Oct 18 14:41:44.943850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4035/7917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:44 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:45.961054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:45.961670 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:45.968667 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:45.969825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:45.970299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:45.971007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:45.971466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:45.971896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:46.147257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:46.156295 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-262ef103-6b30-4cb0-8aa3-f41c15f451c9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.199003 Oct 18 14:41:46.156901 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3883/7918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:45 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:47.180605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:47.182280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:47.190148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:47.190921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:47.191462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:47.192230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:47.192715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:47.193205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:47.332963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:47.341175 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ff2b771-838e-49bb-aecf-3bd7685bd2f5 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.164643 Oct 18 14:41:47.359052 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4036/7919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:47 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:48.379051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:48.379836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:48.391385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:48.391889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:48.392595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:48.393327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:48.393785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:48.394432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:48.543784 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:48.552505 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d5d72d06-1ea5-4b11-98be-750709af42e2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.188152 Oct 18 14:41:48.555523 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3884/7920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:48 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:49.577991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:49.578598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:49.581285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:49.582248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:49.587036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:49.587729 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:49.587986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:49.588788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:49.589268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:49.589708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:49.728862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:49.736896 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3afe6366-c083-4712-859a-7afc9311e0fc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.162940 Oct 18 14:41:49.750244 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4037/7921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:49 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:50.063350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:50.072926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:50.084242 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:50.085113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:50.085872 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:50.106157 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] Creating event network-changed:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:41:50.114927 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-35932f39-32fa-4a70-af95-0ef3e5f65002 req-06dd555e-c961-4b42-8fcf-b5cb8fbd939f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058140 Oct 18 14:41:50.115930 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3885/7922] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:50.761992 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:50.763252 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:50.772820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:50.773454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:50.773991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:50.774950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:50.775521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:50.775996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:51.007410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:51.007410 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-991e8018-a8d6-43d0-8889-bc0d3e73ab49 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.173907 Oct 18 14:41:51.007410 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4038/7923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:50 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:52.030346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:52.031057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:52.037707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:52.038231 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:52.038679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:52.039369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:52.039898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:52.040359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:52.168352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:52.176568 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-54a75473-b92e-42ee-9ac8-8d4ef113b492 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.151360 Oct 18 14:41:52.177149 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3886/7924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:52 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:53.200286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:53.200919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:53.207845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:53.208652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:53.208851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:53.209551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:53.210030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:53.210498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:53.336531 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:53.344209 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf4c2767-da9a-4a06-afb9-e085e3d334cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.148017 Oct 18 14:41:53.344780 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4039/7925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:53 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:54.367565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:54.368192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:54.375001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:54.375495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:54.375946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:54.376644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:54.377107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:54.377544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:54.510323 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:54.518303 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3328875-a77a-4f83-9db8-5979af77e3d1 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.154656 Oct 18 14:41:54.518864 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3887/7926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:54 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:55.541453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:55.542120 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:55.549186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:55.549687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:55.550171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:55.551435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:55.551915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:55.552367 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:55.682605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:55.694211 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a89aa11e-c1d7-450f-90b4-84b579624ec9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.152842 Oct 18 14:41:55.694211 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4040/7927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:55 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:56.714338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:56.714986 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:56.722005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:56.722524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:56.723602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:56.724301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:56.724759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:56.725191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:56.855325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:56.862954 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d993887e-6121-4374-a3a2-504889516f97 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.152603 Oct 18 14:41:56.863526 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3888/7928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:56 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:57.891978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:57.893517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:57.905702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:57.906661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:57.907514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:57.908809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:57.909680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:57.910528 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:58.076062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:58.084407 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd5de411-10dc-45b8-9a2c-f03449bee85c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.200249 Oct 18 14:41:58.085038 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4041/7929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:57 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:58.104382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "name": "network-vif-plugged", "status": "completed", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:58.114762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:58.117958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:58.117958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:58.127454 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] Creating event network-vif-plugged:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:41:58.133267 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1f19c578-3d53-4700-abc5-745b042f951d req-6f94fd02-b6fd-439a-8c3d-8ff6f873ad1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107406 Oct 18 14:41:58.133893 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3889/7930] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:41:59.112828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:59.114293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:59.121132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:59.121640 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:59.122129 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:59.122848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:59.123354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:59.123805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:59.254627 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:59.262305 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e92c0ca-1b9e-451c-9325-60a537f166ea tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1357 microversion: 2.1 time: 0.153444 Oct 18 14:41:59.262872 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4042/7931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:59 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:00.288115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:00.288757 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:00.295141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.295627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.296068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.296755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.297212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.297639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.436104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:00.444150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fe9137bb-ed66-415e-b896-4f838dd951fd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1547 microversion: 2.1 time: 0.162022 Oct 18 14:42:00.444736 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3890/7932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:00 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:00.467294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:00.468005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:00.476062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.476829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.477450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.478153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.478635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.479273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.615400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:00.623629 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-822130a1-f10f-4c79-9e63-80816431c21c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1547 microversion: 2.1 time: 0.160185 Oct 18 14:42:00.624314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4043/7933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:00 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:00.647035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:00.651856 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:00.652638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Searching by: {'deleted': False, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29'} {{(pid=121009) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 14:42:00.657955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.658483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.658934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.659668 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.660162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.660600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.683226 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.multi_cell_list [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121009) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 14:42:00.710368 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07631d0e-cb77-4b60-b86e-45c5650d6b32 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068066 Oct 18 14:42:00.710955 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3891/7934] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 14:42:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:42:00.722699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:00.723334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:00.729253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.729755 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.730250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.730956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:00.731429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:00.731996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:00.861697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:00.872909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a216daaf-eab9-40ac-b407-bbebfe33556e tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1547 microversion: 2.1 time: 0.153933 Oct 18 14:42:00.873403 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4044/7935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:00 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:03.694285 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1ed7676-94e2-4e54-8ab0-e259ad49e15b"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:03.696625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:03.703598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:03.707564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:03.707564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:03.707564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:03.707564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:03.707564 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:04.379352 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb5856fc-60d0-4f78-9590-f6b71b8da398 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689474 Oct 18 14:42:04.383796 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3892/7936] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 18 14:42:03 2022] POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:42:16.207427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:16.208706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:16.211166 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:42:16.211978 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:42:16.212560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:16.213325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=74 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:16.218247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:16.218763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:16.219228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:16.219949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:16.220433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:16.220890 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:16.349321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:16.357682 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-632dfb6d-cfed-4d90-997e-c0379c602946 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1593 microversion: 2.1 time: 0.154274 Oct 18 14:42:16.358301 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4045/7937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:16 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:18.576395 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:18.577558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:18.578228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:18.582396 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:18.593411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:18.594357 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:18.594974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:18.608460 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] Creating event network-changed:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:42:18.615104 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-374527fa-2bb1-4904-b9e9-226a6a18d6a1 req-ec263b3b-acf3-4567-afc7-b594da8bac25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039716 Oct 18 14:42:18.615770 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3893/7938] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:42:21.159780 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38336. Oct 18 14:42:21.163506 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38338. Oct 18 14:42:21.226465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-562535064"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:21.227029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:21.234355 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:21.234874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:21.235346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:21.236070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:21.236546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:21.238757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:21.371925 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Adding security group 30275959-c1f1-4f07-97b3-e43962a0b0ec to port ffebb354-641d-4bc8-bca1-daa4e35e31d0 Oct 18 14:42:21.740721 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-448fb11a-823b-4c18-9453-d078bcaf0197 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action" status: 202 len: 0 microversion: 2.1 time: 0.594706 Oct 18 14:42:21.740721 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4046/7939] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:42:21 2022] POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:42:21.749529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:21.750125 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:21.752364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:21.760949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:21.764161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:21.764161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:21.769305 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:21.770828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:21.771649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:21.772873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:21.773529 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:21.774311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:21.780158 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] Creating event network-changed:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:42:21.788993 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1ed19e93-674a-457d-9b78-6d39a85bbbbd req-1dda4e30-ff44-42b9-a315-392930a462ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Oct 18 14:42:21.789720 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4047/7940] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:42:22.034769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:22.044446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-95be4c4e-42a8-4b97-b14f-ae59c9dffcbc tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1757 microversion: 2.1 time: 0.299437 Oct 18 14:42:22.045036 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3894/7941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:21 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1757 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:36.036412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:36.041184 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:36.041988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:36.042693 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:36.047732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:36.048268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:36.048734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:36.049448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:36.049928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:36.050410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:36.307012 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04cc38ed-03c2-4ec8-8644-2a671588968f tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action" status: 202 len: 0 microversion: 2.1 time: 0.274511 Oct 18 14:42:36.307583 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4048/7942] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:42:36 2022] POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:42:36.315689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:36.321604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:36.321604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:36.321604 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:36.325217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:36.325708 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:36.326179 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:36.326882 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:36.327342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:36.327775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:36.518093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:36.526707 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b8510ba5-a8de-44ed-8672-752f9acc98ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1749 microversion: 2.1 time: 0.214916 Oct 18 14:42:36.527327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3895/7943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:36 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:37.551128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:37.551884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:37.558920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:37.559418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:37.560027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:37.560727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:37.561197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:37.561637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:37.721383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:37.730670 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bb80026-d07f-47b1-8d91-ece3f0477948 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.184649 Oct 18 14:42:37.731273 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4049/7944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:37 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:38.755312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:38.755928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:38.762967 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:38.763612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:38.763844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:38.764528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:38.764983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:38.765409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:38.912223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:38.921111 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4738cdcc-0ad9-4bc9-b87b-66252ec99680 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.169800 Oct 18 14:42:38.921693 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3896/7945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:38 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:39.945062 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:39.945734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:39.952629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:39.953134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:39.953597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:39.954332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:39.954809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:39.955257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:40.096001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:40.104813 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-603bb1b5-d71a-4577-84ba-3810e69efc5d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.163734 Oct 18 14:42:40.105421 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4050/7946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:39 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:41.133294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:41.133940 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:41.140732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:41.141216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:41.141656 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:41.142629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:41.143090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:41.143512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:41.283990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:41.292804 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8364d03d-00fb-43c9-bbd2-d6169d74770b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.164002 Oct 18 14:42:41.293380 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3897/7947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:41 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:42.316771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:42.317414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:42.324461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:42.324972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:42.325445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:42.326189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:42.326674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:42.327167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:42.475151 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:42.483821 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c360ba39-1435-4811-8193-eb708a36cba2 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.170964 Oct 18 14:42:42.484916 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4051/7948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:42 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:43.508447 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:43.509060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:43.515510 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:43.516001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:43.516470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:43.517185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:43.517901 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:43.518428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:43.660080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:43.668354 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2ee56c3c-084f-4937-93db-81c3bbcdf74d tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.164648 Oct 18 14:42:43.668935 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3898/7949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:43 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:44.692301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:44.692937 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:44.700529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:44.701191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:44.701612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:44.702359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:44.702831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:44.703278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:44.860251 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:44.872854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18496deb-a552-4e5b-bbba-c9c6b5d18271 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.184152 Oct 18 14:42:44.873767 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4052/7950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:44 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:45.897091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:45.897712 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:45.904538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:45.905017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:45.905456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:45.906159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:45.906614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:45.907040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:46.056816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:46.065150 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b679b35-a2dd-4a58-b63b-7dde29e727e6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.172004 Oct 18 14:42:46.065728 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3899/7951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:45 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:47.089437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:47.089988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:47.097096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:47.097601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:47.098081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:47.098788 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:47.099260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:47.099703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:47.242006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:47.250373 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d741cca8-6bc0-4023-b317-5c0833036ce9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1754 microversion: 2.1 time: 0.165582 Oct 18 14:42:47.250945 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4053/7952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:47 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:48.275386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:48.276148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:48.283234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:48.283718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:48.284169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:48.284879 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:48.285338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:48.285827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:48.426686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:48.435854 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-094aeba3-f258-49d5-8a4f-2dd4574f6424 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1757 microversion: 2.1 time: 0.164951 Oct 18 14:42:48.436309 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3900/7953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:48 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:21.235377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-562535064"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:21.236019 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:21.238378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:21.239131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:21.245245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:21.256255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:21.256255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:21.256255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:21.256255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:21.256255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:21.438844 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Removing security group 30275959-c1f1-4f07-97b3-e43962a0b0ec from port ffebb354-641d-4bc8-bca1-daa4e35e31d0 Oct 18 14:43:21.832296 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-794a5c69-ecf0-40c0-a8d8-a08fe5ed9874 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action" status: 202 len: 0 microversion: 2.1 time: 0.601226 Oct 18 14:43:21.833115 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4054/7954] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:43:21 2022] POST /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:43:21.839652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:21.847500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:21.848210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:21.849217 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:43:21.849368 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:43:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 14:43:21.857356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:21.857842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:21.858373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:21.873728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] Creating event network-changed:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:43:21.879823 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-59111c4e-0628-4ceb-86be-fad683c6b088 req-842e72c0-42ba-4b68-b1c0-8f058052600f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 Oct 18 14:43:21.880938 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3901/7955] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:23.167105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:23.167849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:23.174048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:23.174595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:23.175064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:23.175786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:23.176453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:23.176908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:23.260535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lazy-loading 'services' on Instance uuid 4524efe8-d720-411a-9252-1852b4c76356 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:43:23.489352 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a0d131e-f315-480d-a298-3d59a0bd43ad tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments/c1ed7676-94e2-4e54-8ab0-e259ad49e15b" status: 202 len: 0 microversion: 2.1 time: 0.327283 Oct 18 14:43:23.489970 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4055/7956] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:43:23 2022] DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments/c1ed7676-94e2-4e54-8ab0-e259ad49e15b => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:43:23.501452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:23.503909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:23.511470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:23.511976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:23.512420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:23.513137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:23.513600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:23.514036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:23.548026 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc358421-9f4b-4bc1-b46d-0cfe00afb403 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052588 Oct 18 14:43:23.548603 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3902/7957] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:23 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:23.903909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:23.925084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:23.925589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:23.926048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:23.937989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] Creating event network-changed:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:43:23.942904 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1733b7f2-abbd-4026-9b18-87cd661c4ef5 req-3ecf72eb-45d6-4af9-8ea7-7d5f1fc55502 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046245 Oct 18 14:43:23.943564 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4056/7958] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:24.561641 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:24.564759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:24.571809 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:24.574289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:24.574289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:24.574289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:24.574289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:24.574753 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:24.606261 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-703512c1-f45b-4739-a9fa-c14733c7861c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Oct 18 14:43:24.606844 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3903/7959] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:24 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:25.620408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:25.622746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:25.629196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:25.629704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:25.630196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:25.630916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:25.631931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:25.632385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:25.666570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca89b1ff-8e05-48a1-bdd3-411500602fe9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Oct 18 14:43:25.667137 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4057/7960] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:25 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:26.686391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:26.688608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:26.695588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:26.696075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:26.696521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:26.697222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:26.697687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:26.698144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:26.731071 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e16faad0-4071-47c2-bfcd-3658db870b51 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Oct 18 14:43:26.731578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3904/7961] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:26 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:27.743525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:27.745610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:27.752734 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:27.753232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:27.753690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:27.754682 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:27.755155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:27.755598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:27.785409 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9321d015-8116-43aa-93be-96c0ce17a406 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Oct 18 14:43:27.786218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4058/7962] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:27 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:43:28.801044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:28.803747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:28.810507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:28.810994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:28.811438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:28.812122 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:28.812580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:28.813010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:28.842225 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e8a21bc-9c1d-4d09-8a02-30579a826fec tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047341 Oct 18 14:43:28.842815 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3905/7963] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 14:43:28 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:43:28.854475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:28.854996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:28.861883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:28.862376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:28.862839 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:28.863553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:28.864027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:28.864477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:28.939870 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] HTTP exception thrown: Instance 4524efe8-d720-411a-9252-1852b4c76356 is not attached to volume c1ed7676-94e2-4e54-8ab0-e259ad49e15b Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Request method failure captured: Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments/c1ed7676-94e2-4e54-8ab0-e259ad49e15b HTTP/1.1 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTroayLUuHQjAeR08TJKoomrPAc0htwUJm41_TA-yQPcWThDC-ICQ1M_kbH7UFOkvB70hAKNbDrQPX5myjSH6WBJLRvUoHgDmsBsZNla7cEtE_7uguexsoIeJavf7v-1vcm_lTetQ2Ds7076bY8tsq27sUBu_May1IRaryxn25gkCZ2M Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 57bf494036c8499e9ef5f4452ef23f85 Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 4524efe8-d720-411a-9252-1852b4c76356 is not attached to volume c1ed7676-94e2-4e54-8ab0-e259ad49e15b Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'server_id': '4524efe8-d720-411a-9252-1852b4c76356', 'id': 'c1ed7676-94e2-4e54-8ab0-e259ad49e15b'} Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c1ed7676-94e2-4e54-8ab0-e259ad49e15b. Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4524efe8-d720-411a-9252-1852b4c76356 is not attached to volume c1ed7676-94e2-4e54-8ab0-e259ad49e15b Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:28.941542 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4524efe8-d720-411a-9252-1852b4c76356 is not attached to volume c1ed7676-94e2-4e54-8ab0-e259ad49e15b Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Returning 404 to user: Instance 4524efe8-d720-411a-9252-1852b4c76356 is not attached to volume c1ed7676-94e2-4e54-8ab0-e259ad49e15b {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-197cdc3b-2644-46ac-8032-fa5b0526d7d6 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments/c1ed7676-94e2-4e54-8ab0-e259ad49e15b" status: 404 len: 154 microversion: 2.1 time: 0.092708 Oct 18 14:43:28.947776 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4059/7964] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 18 14:43:28 2022] DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356/os-volume_attachments/c1ed7676-94e2-4e54-8ab0-e259ad49e15b => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:43:32.333673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:32.334241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:32.341280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:32.341774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:32.342257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:32.342961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:32.343426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:32.343866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:32.371248 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:43:32.656654 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8730afab-a3e6-4da0-9a28-7abcf3a6f5c4 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 204 len: 0 microversion: 2.1 time: 0.326151 Oct 18 14:43:32.657296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3906/7965] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:43:32 2022] DELETE /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:43:32.666256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:32.671467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:32.674696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:32.675213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:32.675684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:32.676409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:32.676894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:32.677350 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:32.818315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:32.826448 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbdf3c10-a99f-45a2-8c43-04b57ca7fb94 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1553 microversion: 2.1 time: 0.164814 Oct 18 14:43:32.827020 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4060/7966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:32 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:33.850694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:33.851409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:33.858302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:33.858800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:33.859247 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:33.860025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:33.860454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:33.860897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:33.989594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:33.997560 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f5695f39-10a7-4320-8b6e-a19cc65dd11c tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1553 microversion: 2.1 time: 0.151240 Oct 18 14:43:33.998157 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3907/7967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:33 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:35.025072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:35.026460 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:35.033717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:35.034356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:35.034997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:35.035740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:35.036312 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:35.036679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:35.105786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:35.107044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4524efe8-d720-411a-9252-1852b4c76356", "name": "network-vif-deleted", "tag": "ffebb354-641d-4bc8-bca1-daa4e35e31d0"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:35.115459 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5e9b4c9-54c2-4f2a-a85b-b7f7f5b5859b tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1511 microversion: 2.1 time: 0.094331 Oct 18 14:43:35.117189 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4061/7968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:35 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:35.117844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:35.118350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:35.118785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:35.129932 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] Creating event network-vif-deleted:ffebb354-641d-4bc8-bca1-daa4e35e31d0 for instance 4524efe8-d720-411a-9252-1852b4c76356 on n-h1-858383-13 Oct 18 14:43:35.135358 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4e5612c4-4469-4ad2-a63d-e922d77d9d2c req-892dafb9-765b-4087-a58c-2865a618b5b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Oct 18 14:43:35.135910 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3908/7969] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:43:36.139930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:36.140581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:36.147803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:36.149076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:36.149507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:36.150272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:36.150762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:36.151220 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:36.185914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:36.186463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:36.186926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:36.187400 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lazy-loading 'fault' on Instance uuid 4524efe8-d720-411a-9252-1852b4c76356 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:43:36.229801 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bf494036c8499e9ef5f4452ef23f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df5b6291a724accb3ca9bf1baa7cf29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:36.237638 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13e47de9-f7c6-4205-9d50-07951979eab9 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 200 len: 1347 microversion: 2.1 time: 0.101716 Oct 18 14:43:36.238241 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4062/7970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:36 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:37.277772 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:37.278503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] [instance: 4524efe8-d720-411a-9252-1852b4c76356] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:37.284643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:37.285133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:37.285575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:37.286294 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:37.286756 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:37.287189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:37.301148 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] HTTP exception thrown: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Request method failure captured: Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 HTTP/1.1 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTroayLUuHQjAeR08TJKoomrPAc0htwUJm41_TA-yQPcWThDC-ICQ1M_kbH7UFOkvB70hAKNbDrQPX5myjSH6WBJLRvUoHgDmsBsZNla7cEtE_7uguexsoIeJavf7v-1vcm_lTetQ2Ds7076bY8tsq27sUBu_May1IRaryxn25gkCZ2M Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2df5b6291a724accb3ca9bf1baa7cf29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 2df5b6291a724accb3ca9bf1baa7cf29 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978789456 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 57bf494036c8499e9ef5f4452ef23f85 Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestMinimumBasicScenario-978789456-project Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '4524efe8-d720-411a-9252-1852b4c76356'} Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:37.302811 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Returning 404 to user: Instance 4524efe8-d720-411a-9252-1852b4c76356 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-701f1b1f-a2c2-4fc1-8c10-554d621d33cd tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356" status: 404 len: 111 microversion: 2.1 time: 0.032031 Oct 18 14:43:37.307977 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3909/7971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:37 2022] GET /compute/v2.1/servers/4524efe8-d720-411a-9252-1852b4c76356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:43:37.313353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-172a1386-52ea-417d-87d8-eb569faaf141 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] Calling method '.version_select at 0x7fb330ffc9d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:37.411455 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-172a1386-52ea-417d-87d8-eb569faaf141 tempest-TestMinimumBasicScenario-978789456 tempest-TestMinimumBasicScenario-978789456-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-910709681" status: 202 len: 0 microversion: 2.1 time: 0.101951 Oct 18 14:43:37.412044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4063/7972] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 14:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-910709681 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:43:50.225721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:50.226503 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:50.384869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b36abf92-9368-4287-ae9f-b34c9911e9df tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: .version_select at 0x7fb32bc21dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-445815490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8k9uRJmGoCsrV5znEvEJkKrNS6wnCpySxAJBizckBKefGwtllGzx9qJ2tMirNS/yiCAocxcvnMnDAkdnc4xm00Lt0soXzjJj+XK50vU3ZcI3SZADYpsqgvo/xL8gBNSQ=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:50.401812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b36abf92-9368-4287-ae9f-b34c9911e9df tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:43:50.406959 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b36abf92-9368-4287-ae9f-b34c9911e9df tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:43:50.520302 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b36abf92-9368-4287-ae9f-b34c9911e9df tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.299664 Oct 18 14:43:50.521045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3910/7973] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:43:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:59.759711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1700304518", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "a630ddc7-5218-495a-a227-965b6919efe4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-445815490", "security_groups": [{"name": "tempest-secgroup-smoke-961992303"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:59.793504 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:59.797195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:59.915122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] validate_networks() for [('a630ddc7-5218-495a-a227-965b6919efe4', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:44:00.370722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:44:00.371386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:44:00.371896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:44:00.372330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:44:00.372771 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:44:00.382792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:00.383309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:00.383775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:00.384533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:00.385054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:00.385514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:00.403279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:44:00.409185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:44:00.423566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:44:00.425931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:44:00.564835 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [4d750013-115b-448d-b629-0d9eec324e94] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:44:01.574567 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [4d750013-115b-448d-b629-0d9eec324e94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38648. Oct 18 14:44:01.578987 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb6fefe9-9fb0-49f5-931e-642556656ca4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.823276 Oct 18 14:44:01.579844 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4064/7974] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:43:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:44:01.588934 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:01.590120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:01.594397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6a019ccb-d4d0-401e-8ce0-b8d6ab7205ec tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:01.595022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6a019ccb-d4d0-401e-8ce0-b8d6ab7205ec tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:01.674814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6a019ccb-d4d0-401e-8ce0-b8d6ab7205ec tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:01.683065 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6a019ccb-d4d0-401e-8ce0-b8d6ab7205ec tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1266 microversion: 2.1 time: 0.095829 Oct 18 14:44:01.683645 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3911/7975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:01 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:02.707632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bda78973-bd9c-4627-9704-6fd7ee181ecc tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:02.708205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bda78973-bd9c-4627-9704-6fd7ee181ecc tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:02.762761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bda78973-bd9c-4627-9704-6fd7ee181ecc tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:02.769981 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bda78973-bd9c-4627-9704-6fd7ee181ecc tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1266 microversion: 2.1 time: 0.067358 Oct 18 14:44:02.770605 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4065/7976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:02 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:03.793996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:03.794605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:03.802211 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:03.802741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:03.803194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:03.803898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:03.804364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:03.804807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:03.867475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:03.875265 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-06fd0969-3015-45eb-88db-617d73190129 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1318 microversion: 2.1 time: 0.086403 Oct 18 14:44:03.875832 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3912/7977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:03 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:04.899017 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:04.899696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:04.911360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:04.911805 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:04.912303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:04.913015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:04.913501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:04.913964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:04.991385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:04.999470 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b9cde9d-22bc-474e-8c33-c4fb01116f9b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1336 microversion: 2.1 time: 0.104389 Oct 18 14:44:05.003074 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4066/7978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:04 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:06.023031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:06.023721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:06.031453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:06.031953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:06.032400 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:06.033104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:06.033567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:06.034002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:06.180225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:06.188372 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de4513d1-8c66-4eac-838f-a220edd3786f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.169231 Oct 18 14:44:06.189055 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3913/7979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:06 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:06.444597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2301c2-3e67-4423-b85b-be8b2ad0d661", "tag": "d754ffe9-d658-4d47-ae0f-c7a1bde985f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:06.456182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:06.456696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:06.457169 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:06.469864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] Creating event network-changed:d754ffe9-d658-4d47-ae0f-c7a1bde985f5 for instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 on n-h2-858383-13 Oct 18 14:44:06.475100 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-db4433ae-237d-4fbc-84ac-90c7e051e094 req-9d1b77f0-8f67-401f-a93f-5bbaa99f8377 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034636 Oct 18 14:44:06.475862 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4067/7980] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:07.215853 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:07.216490 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:07.223327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:07.223829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:07.230113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:07.230113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:07.230113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:07.230113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:07.359043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:07.366695 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c5e3706d-4d54-4665-8590-a403983ec849 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.154853 Oct 18 14:44:07.367272 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3914/7981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:07 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:08.392298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:08.393279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:08.399553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:08.400065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:08.400703 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:08.401327 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:08.401812 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:08.402654 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:08.565430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:08.574486 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2442148-c453-4399-9a25-d1edaadc240c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.187001 Oct 18 14:44:08.575161 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4068/7982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:08 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:09.597631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:09.598286 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:09.605091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:09.605576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:09.606022 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:09.606823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:09.607279 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:09.607709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:09.745645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:09.753296 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bb93f9b9-d282-46d3-863f-8742857760e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.160026 Oct 18 14:44:09.753869 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3915/7983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:09 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:10.777901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:10.778625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:10.785152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:10.786599 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:10.787177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:10.787702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:10.788551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:10.789028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:10.789476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:10.931913 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:10.940035 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72a2aaf6-7ce6-4dc9-913e-845fd6f5609b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.166608 Oct 18 14:44:10.943053 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4069/7984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:10 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:11.964457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:11.965083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:11.967188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:11.972066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:11.972565 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:11.973017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:11.973715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:11.974219 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:11.974659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:12.106541 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:12.114220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8686bb33-add1-4a98-8564-07267fdfa368 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.153900 Oct 18 14:44:12.114842 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3916/7985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:11 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:12.966538 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2301c2-3e67-4423-b85b-be8b2ad0d661", "name": "network-vif-plugged", "status": "completed", "tag": "d754ffe9-d658-4d47-ae0f-c7a1bde985f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:12.972663 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:12.978330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:12.978894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:12.979362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:12.991130 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] Creating event network-vif-plugged:d754ffe9-d658-4d47-ae0f-c7a1bde985f5 for instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 on n-h2-858383-13 Oct 18 14:44:12.996555 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-31e3cce1-a607-4f97-aab4-75c8fe238073 req-5a527ed6-f466-4647-9ef7-e8860aa9ade5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Oct 18 14:44:13.001858 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4070/7986] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:13.138034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:13.138659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:13.147861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:13.148585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:13.149025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:13.149726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:13.150206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:13.150665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:13.287711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:13.295599 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-800454ee-0941-4a0d-8c7d-18b17e03660d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.162078 Oct 18 14:44:13.296170 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3917/7987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:13 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:14.319281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:14.320257 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:14.327972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:14.328487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:14.328954 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:14.329683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:14.330222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:14.330677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:14.468201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:14.476019 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc718914-d1a5-4a43-980d-f598ef98459a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1391 microversion: 2.1 time: 0.161022 Oct 18 14:44:14.476609 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4071/7988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:14 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:15.504147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:15.504773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:15.511815 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.512326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.512785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.513481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.513949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.514413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.645138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:15.653601 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-698a2d12-250e-4b77-97bc-38ffea144f7c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1563 microversion: 2.1 time: 0.152927 Oct 18 14:44:15.654208 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3918/7989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:15 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:15.676432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:15.677077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:15.683976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.684488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.684961 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.685676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.686188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.686647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.817833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:15.826341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd9d62bd-d275-4a19-b034-6affa84a0a41 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1563 microversion: 2.1 time: 0.153861 Oct 18 14:44:15.826918 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4072/7990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:15 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:18.139537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2301c2-3e67-4423-b85b-be8b2ad0d661", "tag": "d754ffe9-d658-4d47-ae0f-c7a1bde985f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:18.142230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:18.149311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:18.153510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:18.154797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:18.155435 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:18.157362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:18.158032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:18.158538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:18.159313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:18.159974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:18.160415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:18.171596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] Creating event network-changed:d754ffe9-d658-4d47-ae0f-c7a1bde985f5 for instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 on n-h2-858383-13 Oct 18 14:44:18.176854 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b85ae1bc-714c-4e05-9607-4007c553ce5c req-52d72bd8-9096-4c4e-ad69-11c2e73ac3ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041067 Oct 18 14:44:18.177759 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4073/7991] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:44:18.303926 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:18.312428 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-57001cbc-db49-4408-964c-cb62eea00fc8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1563 microversion: 2.1 time: 0.180174 Oct 18 14:44:18.313158 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3919/7992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:18 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:41.602891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:41.603662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=38 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:41.607919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:41.610238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:41.616334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:41.616832 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:41.617339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:41.618041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:41.618569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:41.619015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:41.675783 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0790bf28-1a41-4c3e-b614-400824c35625 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action" status: 200 len: 24560 microversion: 2.1 time: 0.074829 Oct 18 14:44:41.676447 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4074/7993] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:41 2022] POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action => generated 24560 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:52.712758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:52.713348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:52.715243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=20 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:52.716026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=48 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:52.720861 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.721402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.721875 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:52.722596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.723056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.728256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:52.937534 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a332d1d4-fa3a-4d66-af58-84d4f74ddbf4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action" status: 202 len: 0 microversion: 2.1 time: 0.228977 Oct 18 14:44:52.938342 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3920/7994] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:52 2022] POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:44:52.948351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:52.953232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:52.956798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.957311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.957770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:52.958518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.958991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.959434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.101565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:53.109412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82543618-1c20-431c-b079-5e6975963433 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1686 microversion: 2.1 time: 0.166086 Oct 18 14:44:53.114822 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4075/7995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:52 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:54.135586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:54.136306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:54.143389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:54.143889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:54.144337 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:54.145036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:54.145504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:54.145943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:54.282238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:54.290040 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-755b22cb-9d30-449a-bd60-aaef9b4e8cb9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1666 microversion: 2.1 time: 0.159821 Oct 18 14:44:54.290640 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3921/7996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:54 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:55.387211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:55.389451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:55.398309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.398814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.399278 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.399987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.400461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.401155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.455995 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a77c884-8da5-4cfc-9564-0b3a66980d5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action" status: 200 len: 32637 microversion: 2.1 time: 0.072859 Oct 18 14:44:55.456585 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4076/7997] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:55 2022] POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:55.468246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:55.468790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:55.475674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.476166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.476614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.477329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.477792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.478245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.765208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d9d4b4f3-86a1-46c4-a474-dd22ac9b3bc7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action" status: 202 len: 0 microversion: 2.1 time: 0.300603 Oct 18 14:44:55.765799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3922/7998] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:55 2022] POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:44:55.774878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:55.775608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:55.782680 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.791118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.791118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.791118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.791118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.791118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.920903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:55.929231 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25cffd7a-8dea-49b6-9240-76f84951a50a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1673 microversion: 2.1 time: 0.158615 Oct 18 14:44:55.929803 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4077/7999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:55 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:56.954914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:56.955646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:56.961863 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.962399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.962848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:56.963536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.963997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.964431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.170870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:57.179137 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-962b9db4-2339-47c3-9019-9e488f903110 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1681 microversion: 2.1 time: 0.230030 Oct 18 14:44:57.179705 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3923/8000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:56 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:57.275196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:57.277417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:57.285837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.286384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.286858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.287581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.288068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.288521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.349048 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cfabfa22-3000-4333-9473-ea862c5fa548 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action" status: 200 len: 38418 microversion: 2.1 time: 0.077554 Oct 18 14:44:57.349876 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4078/8001] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:57 2022] POST /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661/action => generated 38418 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:58.425631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2301c2-3e67-4423-b85b-be8b2ad0d661", "tag": "d754ffe9-d658-4d47-ae0f-c7a1bde985f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:58.433013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:58.433534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:58.440697 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.441873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.442449 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.443234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.443787 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.444108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.444366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.444616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.445079 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.456947 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] Creating event network-changed:d754ffe9-d658-4d47-ae0f-c7a1bde985f5 for instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 on n-h2-858383-13 Oct 18 14:44:58.461920 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-46b634b9-69c4-4307-a5c3-fdc16447fc0f req-2b5ea388-5078-49f1-957c-9640a0af7dec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Oct 18 14:44:58.462835 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4079/8002] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:58.475929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:44:58.764496 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-accfc7ec-b957-4d05-aee3-b3a440544902 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 204 len: 0 microversion: 2.1 time: 0.345994 Oct 18 14:44:58.765561 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3924/8003] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:44:58 2022] DELETE /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:44:58.777643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:58.779334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:58.788594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.789417 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.789960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.790833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.791657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.792124 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.934383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:58.942345 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c82e7165-6440-455b-8346-e6e11caebe97 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1687 microversion: 2.1 time: 0.171472 Oct 18 14:44:58.942925 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4080/8004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:58 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:59.967338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:59.968051 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:59.975480 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:59.975977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:59.976427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:59.977182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:59.977645 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:59.978172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:00.115844 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:00.123828 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81e37c25-2d30-4e1d-990b-37a6e8f8e8e6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1687 microversion: 2.1 time: 0.160817 Oct 18 14:45:00.124410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3925/8005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:59 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:01.056390 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2301c2-3e67-4423-b85b-be8b2ad0d661", "name": "network-vif-deleted", "tag": "d754ffe9-d658-4d47-ae0f-c7a1bde985f5"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:01.067386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:01.069831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:01.069831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:01.080673 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] Creating event network-vif-deleted:d754ffe9-d658-4d47-ae0f-c7a1bde985f5 for instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 on n-h2-858383-13 Oct 18 14:45:01.085871 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e8ef5952-fd8a-4e26-8c5f-16c21a4b9f80 req-348fe847-e0ec-44ce-b53c-3a6bfac1b60b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033343 Oct 18 14:45:01.086507 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4081/8006] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:01.148650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:01.149253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:01.156165 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:01.156658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:01.157104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:01.158411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:01.158927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:01.159359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:01.225335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:01.234144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fdae11f9-f5c4-4db3-b5d1-467a40a90669 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 200 len: 1502 microversion: 2.1 time: 0.089452 Oct 18 14:45:01.245446 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3926/8007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:01 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 1502 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:02.261186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:02.261912 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: ce2301c2-3e67-4423-b85b-be8b2ad0d661] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:02.268833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:02.269341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:02.269811 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:02.270558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:02.271047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:02.271498 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:02.286238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] HTTP exception thrown: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Request method failure captured: Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 HTTP/1.1 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTruln0rt_OS3qmFcoKHX48qFWOFU__bSEGV2lrDCrpxVVgExZctwhbC6gWwbhDkC9Oj-mzUkJnqooLVra1g_Ufm_FDjEd58qRsyYWcZt_zQXY2nklkUejwZDLsC9Fz78k6DlWWSAj7x8vSMLVJk4G9ljAAvc34ucoGKiEEvvH5vvJKo Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/381041942f024a3fb56e35c99475ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_381041942f024a3fb56e35c99475ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1b02196b7d35453b8a710ef6f4835dec Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'ce2301c2-3e67-4423-b85b-be8b2ad0d661'} Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:45:02.287847 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Returning 404 to user: Instance ce2301c2-3e67-4423-b85b-be8b2ad0d661 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-26917c35-4b27-4086-b40e-9d38763c8612 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661" status: 404 len: 111 microversion: 2.1 time: 0.034054 Oct 18 14:45:02.293515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4082/8008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:02 2022] GET /compute/v2.1/servers/ce2301c2-3e67-4423-b85b-be8b2ad0d661 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:45:06.148947 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53f875eb-8455-4df5-9111-13ffc9cd955d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '.version_select at 0x7fb33528fca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:06.219413 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53f875eb-8455-4df5-9111-13ffc9cd955d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-445815490" status: 202 len: 0 microversion: 2.1 time: 0.074214 Oct 18 14:45:06.220006 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3927/8009] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Oct 18 14:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-445815490 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:45:06.248508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b8f7a08-b6a0-4053-bed3-c3e1cb782c4e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: .version_select at 0x7fb3354445e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-29083735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ16tvLDR7ylqtkhVfl6VArzHmRVZZfnoFq7rHo5nchJ2MpIamh/fXpXiatLakFcY8Fxzid/HLVsOYTLjdN7BDN4UZSuK45hR6Ru7mmpmhCx/8y1BAdToRquk+mPOcvIA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:06.266321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5b8f7a08-b6a0-4053-bed3-c3e1cb782c4e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:45:06.272452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-5b8f7a08-b6a0-4053-bed3-c3e1cb782c4e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:45:06.368737 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b8f7a08-b6a0-4053-bed3-c3e1cb782c4e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.124140 Oct 18 14:45:06.369343 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4083/8010] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:45:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:14.302743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:14.307064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1654290610", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "8b0691e0-deda-4b65-9364-ee3c28748ccd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-29083735", "security_groups": [{"name": "tempest-secgroup-smoke-1716135029"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:14.425141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] validate_networks() for [('8b0691e0-deda-4b65-9364-ee3c28748ccd', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:45:14.917310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:45:14.917951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:45:14.918478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:45:14.919256 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:45:14.919736 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:45:14.948437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:14.949116 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:14.949584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:14.950518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:14.951010 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:14.951441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:14.980602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:45:14.987034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:45:15.005847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:45:15.008440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:45:15.187030 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b6b0069c-88ca-427b-a6b9-b3ad00678ff1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.884353 Oct 18 14:45:15.193857 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3928/8011] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:45:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:45:15.218284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-01188abc-ce6f-4408-acf4-a6b9e920df46 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:15.218977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-01188abc-ce6f-4408-acf4-a6b9e920df46 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:15.232862 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=36 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:15.318861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-01188abc-ce6f-4408-acf4-a6b9e920df46 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:15.326773 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-01188abc-ce6f-4408-acf4-a6b9e920df46 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1265 microversion: 2.1 time: 0.130558 Oct 18 14:45:15.327959 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4084/8012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:15 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:16.351150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:16.351776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:16.358999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:16.359539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:16.360210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:16.360910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:16.361366 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:16.361834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:16.432054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:16.440939 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2d39f66b-9d7f-4a34-9c01-dddf3688c76d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1269 microversion: 2.1 time: 0.094029 Oct 18 14:45:16.441530 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3929/8013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:16 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:17.465791 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:17.466595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:17.477131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:17.477815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:17.478333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:17.479050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:17.479527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:17.479977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:17.551238 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:17.559056 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-733c1631-667d-4f06-8422-9e157618df0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1325 microversion: 2.1 time: 0.098065 Oct 18 14:45:17.559621 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4085/8014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:17 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:18.583743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:18.584513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:18.591577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:18.592160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:18.592682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:18.593467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:18.593999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:18.594643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:18.732575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:18.740366 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-64cc575c-1fdd-43ea-a52e-59aeaa5bbba6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.161315 Oct 18 14:45:18.742618 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3930/8015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:18 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:19.127993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3bfc4b-cf48-435c-b4d1-226edd8f138f", "tag": "de58c9b8-9df7-4538-9f63-2fe5f45d35ce"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:19.139025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:19.139525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:19.139977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:19.153052 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] Creating event network-changed:de58c9b8-9df7-4538-9f63-2fe5f45d35ce for instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f on n-h2-858383-13 Oct 18 14:45:19.162794 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1a801389-d1ec-4c42-bf42-fd745bcd66f8 req-ff7784d0-1095-493d-95ab-789e2b2e5578 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038741 Oct 18 14:45:19.164059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4086/8016] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:19.764599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:19.765156 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:19.773001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:19.773497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:19.773960 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:19.774685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:19.775151 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:19.775593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:19.910976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:19.918872 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-872ef2a4-838a-4d15-9dc4-8976c1e0064f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.158342 Oct 18 14:45:19.919510 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3931/8017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:19 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:20.943136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:20.943857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:20.951039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:20.951566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:20.952020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:20.952722 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:20.953196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:20.953641 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:21.084684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:21.092412 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1e7cc1a-944b-4f01-a608-cb3a60ffe8d0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.154154 Oct 18 14:45:21.092978 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4087/8018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:20 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:22.115192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:22.115830 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:22.122705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:22.123202 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:22.123647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:22.124342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:22.124805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:22.125241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:22.521660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:22.529387 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-74984c2a-90ea-475a-9424-714ba230a8af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.418037 Oct 18 14:45:22.529953 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3932/8019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:22 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:23.551854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:23.552497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:23.554996 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:23.559903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:23.560421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:23.560886 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:23.563480 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:23.563985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:23.564976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:23.722798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:23.731034 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67d4113d-d1ab-4e37-aef8-e8cf93666689 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.183186 Oct 18 14:45:23.731622 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4088/8020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:23 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:24.754839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:24.755481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:24.758306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:24.763014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:24.763536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:24.763989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:24.764689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:24.765150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:24.765584 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:24.901266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:24.908936 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d6414c76-c3fb-4f16-9ee0-9a5f792e2c84 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.158018 Oct 18 14:45:24.909489 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3933/8021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:24 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:25.342161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3bfc4b-cf48-435c-b4d1-226edd8f138f", "name": "network-vif-plugged", "status": "completed", "tag": "de58c9b8-9df7-4538-9f63-2fe5f45d35ce"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:25.347784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:25.353756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:25.354281 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:25.354735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:25.366154 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] Creating event network-vif-plugged:de58c9b8-9df7-4538-9f63-2fe5f45d35ce for instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f on n-h2-858383-13 Oct 18 14:45:25.371295 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4d094fef-cb06-42d8-b09a-6d3d83939cea req-6a8205b4-bb25-469b-a303-ee0fbb36a25f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032874 Oct 18 14:45:25.371891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4089/8022] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:25.931695 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:25.932322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:25.934172 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:25.934916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:25.940494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:25.940992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:25.941438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:25.942176 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:25.942679 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:25.943114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:26.078007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:26.085785 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f135bd10-0fc1-4c27-af80-2f8cefcb6639 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1391 microversion: 2.1 time: 0.158547 Oct 18 14:45:26.086461 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3934/8023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:25 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:27.109815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:27.110510 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:27.117867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:27.118513 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:27.118883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.119598 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:27.120081 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:27.120559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.262492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:27.270673 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b131dbdb-bda2-452d-a880-4528e5d559eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1563 microversion: 2.1 time: 0.166050 Oct 18 14:45:27.271999 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4090/8024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:27 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:27.293502 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:27.294289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:27.301277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:27.301828 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:27.302382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.303086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:27.303555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:27.304001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.433937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:27.441756 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8e321928-c0ba-496e-8597-bd74853f484d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1563 microversion: 2.1 time: 0.152172 Oct 18 14:45:27.442363 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3935/8025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:27 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:29.657512 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:29.658183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:29.662352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3bfc4b-cf48-435c-b4d1-226edd8f138f", "tag": "de58c9b8-9df7-4538-9f63-2fe5f45d35ce"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:29.665740 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:29.666286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:29.666750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:29.667700 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:29.668345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:29.668803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:29.675103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:29.675893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:29.676546 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:29.692127 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] Creating event network-changed:de58c9b8-9df7-4538-9f63-2fe5f45d35ce for instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f on n-h2-858383-13 Oct 18 14:45:29.698362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-bcf70804-4484-4774-8444-6718ac16aa4f req-9e474b8a-5522-4da2-8b87-1397067f3395 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039613 Oct 18 14:45:29.699260 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3936/8026] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:29.899583 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:29.909864 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-736f3a97-3d52-4790-8006-008795e06f01 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1563 microversion: 2.1 time: 0.256315 Oct 18 14:45:29.910615 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4091/8027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:29 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:53.153098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=7 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:53.153842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=46 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:53.158021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:53.160335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:53.166681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:53.167197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:53.167623 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:53.168317 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:53.168786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:53.169225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:53.221724 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a03c567f-b4ef-40be-8655-80d7724caeee tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action" status: 200 len: 24565 microversion: 2.1 time: 0.070441 Oct 18 14:45:53.222429 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3937/8028] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:45:53 2022] POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action => generated 24565 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:46:04.118676 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:46:04.120974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:04.123426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:04.124212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=34 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:04.129444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:04.129956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:04.130443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:04.131159 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:04.131639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:04.132091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:04.364441 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1546178f-62c1-4e1c-b763-23dc84bb4f2b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action" status: 202 len: 0 microversion: 2.1 time: 0.249544 Oct 18 14:46:04.365183 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4092/8029] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:46:04 2022] POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:46:04.374236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:04.374958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:04.377916 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:04.379653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:04.384650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:04.385146 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:04.385593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:04.386407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:04.386847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:04.387282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:04.524994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:04.532816 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8ab727c3-cf7f-4df6-9266-eea33228e6f1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1674 microversion: 2.1 time: 0.163026 Oct 18 14:46:04.533387 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3938/8030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:04 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:05.558176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:05.558920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:05.565306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:05.566345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:05.566970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:05.567689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:05.568176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:05.568629 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:05.718208 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:05.726125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f947b2d7-01ac-497f-9266-b2c0ccef9d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.173349 Oct 18 14:46:05.726701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4093/8031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:05 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:06.750189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:06.750746 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:06.758896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:06.759393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:06.759842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:06.760539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:06.761004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:06.761443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:06.897812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:06.905711 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-662697f2-9d99-4fef-9183-c61158ce31b4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.159529 Oct 18 14:46:06.906447 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3939/8032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:06 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:07.929041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:07.929683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:07.936642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:07.943028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:07.943028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:07.943028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:07.943028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:07.943028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:08.073335 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:08.081217 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16aa57d4-0417-4d9d-be0b-a6b613d1c52d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.156200 Oct 18 14:46:08.081805 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4094/8033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:07 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:09.104954 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:09.105491 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:09.112351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:09.112846 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:09.113298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:09.113996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:09.114496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:09.114937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:09.243824 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:09.251572 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ddf60880-64f6-4a1c-a459-1d3565dfeeaf tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.150663 Oct 18 14:46:09.252139 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3940/8034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:09 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:10.275792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:10.276431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:10.283330 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:10.283834 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:10.284324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:10.285003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:10.285482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:10.285931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:10.416423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:10.424361 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-014264ee-59a2-4dee-adca-bd077346f227 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.152486 Oct 18 14:46:10.425443 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4095/8035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:10 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:11.449131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:11.449761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:11.457421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:11.457921 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:11.458393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:11.459096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:11.459562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:11.459999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:11.589548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:11.597395 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c308fee9-f345-4a21-ba4c-039c5b29c563 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.152193 Oct 18 14:46:11.597969 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3941/8036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:11 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:12.619968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:12.620608 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:12.627659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:12.628800 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:12.629266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:12.629989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:12.630502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:12.631280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:12.770413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:12.778242 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59142136-b1fd-4012-b515-b97bf03b516d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.162151 Oct 18 14:46:12.778817 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4096/8037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:12 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:13.800866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:13.801486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:13.808364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:13.808869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:13.809326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:13.810024 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:13.810522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:13.810969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:13.944003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:13.951726 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a4669791-fdb1-4455-b7c0-a2caf0fab486 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.154809 Oct 18 14:46:13.952331 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3942/8038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:13 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:14.976746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:14.977389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:14.984408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:14.984945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:14.985375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:14.986105 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:14.986590 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:14.987036 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:15.118901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:15.126750 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-623c1c45-bbb6-4ca7-bce6-e07439a84d39 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.154497 Oct 18 14:46:15.127322 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4097/8039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:14 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:16.151523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:16.152144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:16.159049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:16.159543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:16.159997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:16.160694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:16.161161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:16.161600 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:16.296329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:16.305310 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ddd88458-6e74-47dc-9b4b-c6dcb8fac857 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1679 microversion: 2.1 time: 0.157765 Oct 18 14:46:16.305890 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3943/8040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:16 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:17.329056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:17.329684 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:17.336986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:17.337517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:17.337975 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:17.338707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:17.339181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:17.339625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:17.475749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:17.483674 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67794eb4-b94a-488d-95c6-a486e8f7d39a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1682 microversion: 2.1 time: 0.158581 Oct 18 14:46:17.484244 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4098/8041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:17 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:43.678593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:46:43.680834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:43.683034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=12 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:43.687255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:43.688953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:43.689443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:43.689890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:43.690612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:43.691074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:43.691536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:43.747810 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35a4594a-a9fb-4e23-ae39-090707f51f9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action" status: 200 len: 69075 microversion: 2.1 time: 0.073419 Oct 18 14:46:43.748420 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3944/8042] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:46:43 2022] POST /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f/action => generated 69075 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:46:50.872353 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:50.872947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:50.876190 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=14 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:50.877117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:50.884123 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:50.884775 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:50.885382 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:50.886141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:50.886804 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:50.887259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:50.915300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:46:50.946874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3bfc4b-cf48-435c-b4d1-226edd8f138f", "tag": "de58c9b8-9df7-4538-9f63-2fe5f45d35ce"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:46:50.959324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:50.959817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:50.960264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:50.971428 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] Creating event network-changed:de58c9b8-9df7-4538-9f63-2fe5f45d35ce for instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f on n-h2-858383-13 Oct 18 14:46:50.977410 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-1822d969-5025-44b3-985f-711c8f61b750 req-db7a245e-7519-47d0-bc81-5599119b4c5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105779 Oct 18 14:46:50.977410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3945/8043] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:46:51.166224 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e6aafaf-a7c5-41b5-8877-3e23c648cae2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 204 len: 0 microversion: 2.1 time: 0.297862 Oct 18 14:46:51.166919 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4099/8044] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:46:50 2022] DELETE /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:46:51.176300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:51.177012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:51.183602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:51.184096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:51.184608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:51.185517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:51.186741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:51.187340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:51.329895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:51.337972 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4b1042c-3573-4901-b88f-0801df7cebd8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1688 microversion: 2.1 time: 0.166442 Oct 18 14:46:51.338846 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3946/8045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:51 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:52.363388 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:52.364110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:52.370336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:52.370844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:52.371332 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:52.372048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:52.372521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:52.372972 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:52.508929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:52.517355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-deafd91e-3db6-4c00-8899-898f3263cd15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1688 microversion: 2.1 time: 0.158471 Oct 18 14:46:52.517939 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4100/8046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:52 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:53.454870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3bfc4b-cf48-435c-b4d1-226edd8f138f", "name": "network-vif-deleted", "tag": "de58c9b8-9df7-4538-9f63-2fe5f45d35ce"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:46:53.465548 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:53.466190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:53.466643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:53.479128 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] Creating event network-vif-deleted:de58c9b8-9df7-4538-9f63-2fe5f45d35ce for instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f on n-h2-858383-13 Oct 18 14:46:53.484317 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-3c0bb9af-ec8b-45bd-a1c8-8c7fd9aaaafa req-0eeb0b7f-e819-4fb8-a491-c0a21ffe9f41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Oct 18 14:46:53.484973 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3947/8047] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:46:53.542178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:53.542817 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:53.549821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:53.551728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:53.551728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:53.551728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:53.552067 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:53.552426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:53.619835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:46:53.628402 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8bc081a0-e929-4293-b5e2-26b51b5cc4eb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 200 len: 1501 microversion: 2.1 time: 0.090226 Oct 18 14:46:53.629314 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4101/8048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:53 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 1501 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:46:54.653300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:54.654011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 2b3bfc4b-cf48-435c-b4d1-226edd8f138f] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:46:54.661121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:54.661613 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:54.662093 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:54.662795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:46:54.663258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:46:54.663694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:46:54.676663 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] HTTP exception thrown: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Request method failure captured: Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f HTTP/1.1 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTruln0rt_OS3qmFcoKHX48qFWOFU__bSEGV2lrDCrpxVVgExZctwhbC6gWwbhDkC9Oj-mzUkJnqooLVra1g_Ufm_FDjEd58qRsyYWcZt_zQXY2nklkUejwZDLsC9Fz78k6DlWWSAj7x8vSMLVJk4G9ljAAvc34ucoGKiEEvvH5vvJKo Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/381041942f024a3fb56e35c99475ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_381041942f024a3fb56e35c99475ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1b02196b7d35453b8a710ef6f4835dec Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '2b3bfc4b-cf48-435c-b4d1-226edd8f138f'} Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:46:54.678322 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Returning 404 to user: Instance 2b3bfc4b-cf48-435c-b4d1-226edd8f138f could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d88c3c3d-114a-438f-a92d-afcc1a580f86 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f" status: 404 len: 111 microversion: 2.1 time: 0.030784 Oct 18 14:46:54.683419 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3948/8049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:46:54 2022] GET /compute/v2.1/servers/2b3bfc4b-cf48-435c-b4d1-226edd8f138f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:46:58.169445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c931a66-8271-4162-9a77-25c8d495473e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '.version_select at 0x7fb330ce1820>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:46:58.234578 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c931a66-8271-4162-9a77-25c8d495473e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-29083735" status: 202 len: 0 microversion: 2.1 time: 0.069035 Oct 18 14:46:58.235171 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4102/8050] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 14:46:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-29083735 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:46:58.263500 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c4616460-6604-4047-9a2b-2422a51a410c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: .version_select at 0x7fb32bc3cc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1300888290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIc4gew/2YfSy64tUlEP1+CM10CC9cUN7I9xbrKCianMHKhNa/4TSnvTZCbHwZfwXNzi68jDiU0bLlEoieQd4kzFSbk+fzqzltOxq2pJ+BamswyiWRiQPjF8IMmPNyiO6w=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:46:58.281142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c4616460-6604-4047-9a2b-2422a51a410c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:46:58.287088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-c4616460-6604-4047-9a2b-2422a51a410c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:46:58.359669 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c4616460-6604-4047-9a2b-2422a51a410c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.099981 Oct 18 14:46:58.360199 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3949/8051] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:46:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:47:06.927156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:06.939152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1765183440", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "4da729a6-fccc-4fa7-af12-5d2070d8f417"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1300888290", "security_groups": [{"name": "tempest-secgroup-smoke-960825126"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:07.093522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] validate_networks() for [('4da729a6-fccc-4fa7-af12-5d2070d8f417', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:47:07.515084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:47:07.515525 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:47:07.516020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:47:07.516469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:47:07.516908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:47:07.526268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:07.526776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:07.527233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:07.527982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:07.528659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:07.529501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:07.547492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:47:07.552758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:47:07.566239 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:47:07.568649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:47:07.716837 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70185f14-e8ec-447b-90c0-9216c45bd5ce tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791278 Oct 18 14:47:07.717630 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4103/8052] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:47:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:47:07.726964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=16 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:07.731138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bdd9706b-d095-4eb1-907e-eb81d28aac15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:07.731765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bdd9706b-d095-4eb1-907e-eb81d28aac15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:07.797125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bdd9706b-d095-4eb1-907e-eb81d28aac15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:07.804367 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bdd9706b-d095-4eb1-907e-eb81d28aac15 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1267 microversion: 2.1 time: 0.079289 Oct 18 14:47:07.804937 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3950/8053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:07 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:08.830293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8c474e75-3d15-4116-9d7c-683aa0c15ca6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:08.832273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8c474e75-3d15-4116-9d7c-683aa0c15ca6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:08.889927 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8c474e75-3d15-4116-9d7c-683aa0c15ca6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:08.900668 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8c474e75-3d15-4116-9d7c-683aa0c15ca6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1267 microversion: 2.1 time: 0.075843 Oct 18 14:47:08.910752 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4104/8054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:08 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:09.927161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-38e5fe40-5e58-4798-b12c-3fb10fb709fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:09.927850 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-38e5fe40-5e58-4798-b12c-3fb10fb709fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:09.987603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-38e5fe40-5e58-4798-b12c-3fb10fb709fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:09.994682 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-38e5fe40-5e58-4798-b12c-3fb10fb709fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1267 microversion: 2.1 time: 0.071487 Oct 18 14:47:09.995246 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3951/8055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:09 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:11.018028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-34ce14d2-de6e-4afb-a338-6a5ca5f7a037 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:11.019550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-34ce14d2-de6e-4afb-a338-6a5ca5f7a037 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:11.075221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-34ce14d2-de6e-4afb-a338-6a5ca5f7a037 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:11.082397 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-34ce14d2-de6e-4afb-a338-6a5ca5f7a037 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1267 microversion: 2.1 time: 0.068349 Oct 18 14:47:11.082968 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4105/8056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:11 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1267 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:12.105904 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:12.106464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:12.113035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:12.113528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:12.113980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:12.114706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:12.115170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:12.115607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:12.178919 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:12.187288 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e6f12705-7654-4f0b-ab7b-7fd9822595ef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1271 microversion: 2.1 time: 0.085578 Oct 18 14:47:12.187875 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3952/8057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:12 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:13.211295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:13.211905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:13.218794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:13.219290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:13.219756 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:13.220483 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:13.220969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:13.221427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:13.288196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:13.296741 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5570b4e-40a3-4ad1-8c24-36d6e71b97f5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1319 microversion: 2.1 time: 0.089399 Oct 18 14:47:13.297329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4106/8058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:13 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:14.324394 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:14.324965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:14.332513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:14.333016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:14.333467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:14.334201 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:14.334718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:14.335178 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:14.422162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:14.430439 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0fc10880-7b33-4b5b-9fd3-267d22ea4424 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1325 microversion: 2.1 time: 0.109962 Oct 18 14:47:14.431041 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3953/8059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:14 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1325 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:15.460799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:15.461444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:15.468882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:15.469408 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:15.470078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:15.470815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:15.471321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:15.471779 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:15.608929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:15.616933 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-114457bf-9945-4a73-861c-dc3422153367 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.160022 Oct 18 14:47:15.617525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4107/8060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:15 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:15.839764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:15.850810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:15.851303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:15.851752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:15.863181 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] Creating event network-changed:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h2-858383-13 Oct 18 14:47:15.868208 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-54ca3f20-3220-41bd-8fbc-4c84de8ba457 req-79a1f4ad-eeab-474b-b1e0-7e3be6ad53c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Oct 18 14:47:15.868862 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3954/8061] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:47:16.640750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:16.641386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:16.649236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:16.649745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:16.650247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:16.650966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:16.651444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:16.651944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:16.782359 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:16.790322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d41d020-0d02-4c44-864e-9a2d4e1857e1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.154166 Oct 18 14:47:16.790904 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4108/8062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:16 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:17.815007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:17.815729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:17.822083 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:17.822577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:17.823029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:17.823729 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:17.824196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:17.824638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:17.959476 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:17.967848 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8595dad1-7a0a-4691-9a4a-4820bfcd58f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.157993 Oct 18 14:47:17.968451 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3955/8063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:17 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:18.991213 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:18.991845 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:18.993725 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:18.999502 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:19.000012 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:19.000478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:19.001188 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:19.001668 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:19.002150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:19.136059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:19.144659 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dae2d7b-6930-46e1-b6b7-f0151364cd56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.157554 Oct 18 14:47:19.145238 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4109/8064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:18 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:20.168575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:20.169310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:20.173432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=8 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:20.178845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:20.179350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:20.179800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:20.180513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:20.180981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:20.181417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:20.316310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:20.324333 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec97b7da-7b46-43fd-b1fc-6e6a395a0bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.159657 Oct 18 14:47:20.324924 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3956/8065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:20 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:21.348418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:21.349076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:21.351101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:21.351856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:21.356482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:21.356988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:21.357445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:21.358183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:21.358660 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:21.359102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:21.494496 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:21.502814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4bcae323-4f70-4755-96f8-5c5a3f15f8e7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.159096 Oct 18 14:47:21.503398 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4110/8066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:21 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:47:21.934013 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "name": "network-vif-plugged", "status": "completed", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:21.939037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:21.946652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:21.946652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:21.946652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:21.956668 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] Creating event network-vif-plugged:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h2-858383-13 Oct 18 14:47:21.961677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4eae0113-6894-4504-ae90-d115818975d5 req-ef4498b6-050c-426a-ae42-ee0fc34242c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087618 Oct 18 14:47:21.962305 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3957/8067] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:47:22.526379 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:22.527021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:22.534426 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:22.534933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:22.535431 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:22.536152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:22.536625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:22.537076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:22.670726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:22.678991 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba0ab3d4-d41c-4c4b-a090-f7496b60b6de tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1392 microversion: 2.1 time: 0.156594 Oct 18 14:47:22.679566 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4111/8068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:22 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:23.704687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:23.705994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:23.712453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:23.712965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:23.713397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:23.714127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:23.714599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:23.715039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:23.848843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:23.856677 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eba1c1ab-e396-4028-812c-0f1ca49fedd9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1565 microversion: 2.1 time: 0.157465 Oct 18 14:47:23.857279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3958/8069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:23 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:23.880546 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:23.881211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:23.888126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:23.892376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:23.892376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:23.892376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:23.892376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:23.892376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:24.023634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:24.031566 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1628959e-4e84-4180-9a71-71faa0d8c6fe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1565 microversion: 2.1 time: 0.156051 Oct 18 14:47:24.032137 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4112/8070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:23 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:25.992569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:25.993799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:25.997161 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:26.001489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:26.002687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:26.003141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:26.004258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:26.005194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:26.005651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:26.009420 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:26.009964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:26.010505 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:26.022189 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] Creating event network-changed:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h2-858383-13 Oct 18 14:47:26.028324 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-9ac85abe-2fa5-4f9d-81df-da8be6477402 req-65709e45-7814-4466-8fb4-58de1a54228f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034627 Oct 18 14:47:26.029106 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4113/8071] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:47:26.236895 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:47:26.246359 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6ef03d6b-3d14-4bc8-acf7-3989378eab9e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1565 microversion: 2.1 time: 0.257583 Oct 18 14:47:26.251806 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3959/8072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:25 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:47:49.822340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:49.824624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:49.827582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=7 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:49.828250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=46 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:49.833198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:49.833706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:49.834205 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:49.834924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:49.835403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:49.835853 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:49.890659 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-479e80c7-9f26-48c8-8c03-2b802f9417b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action" status: 200 len: 24567 microversion: 2.1 time: 0.072483 Oct 18 14:47:49.891323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4114/8073] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:47:49 2022] POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action => generated 24567 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:48:00.768726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:00.771255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:00.773350 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=5 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:00.774014 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=40 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:00.778821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:00.779316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:00.779766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:00.780458 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:00.780922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:00.781356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:00.824692 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:00.832089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Old instance type m1.heat2, new instance type m1.heat {{(pid=121009) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:48:00.839629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:48:00.841924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:48:00.841924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:48:00.841924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:48:00.841924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:48:01.022014 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [f925a644-adc3-4202-a0a0-9de802011c63] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:48:02.029696 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [f925a644-adc3-4202-a0a0-9de802011c63] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39082. Oct 18 14:48:02.033466 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5586dba3-6c6a-4767-b157-3322806b02af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action" status: 202 len: 0 microversion: 2.1 time: 1.269108 Oct 18 14:48:02.034115 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3960/8074] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:48:00 2022] POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:48:02.043145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:02.044101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:02.047241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:02.052793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:02.053301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:02.053765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:02.054523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:02.055166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:02.055619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:02.191008 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:02.198989 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0ca95ea7-fd2e-46f5-9dd9-bc1c4ea1dbd4 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1693 microversion: 2.1 time: 0.160310 Oct 18 14:48:02.199559 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4115/8075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:02 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:03.224277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:03.224914 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:03.232514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:03.233072 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:03.233532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:03.234266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:03.234740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:03.235181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:03.371918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:03.379720 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4e3822d-1e04-49be-a12d-ee836d5f8258 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1693 microversion: 2.1 time: 0.160207 Oct 18 14:48:03.380296 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3961/8076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:03 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:04.403727 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:04.404397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:04.411391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:04.411908 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:04.412374 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:04.413096 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:04.413574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:04.414027 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:04.549223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:04.557772 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3fb98a5-de25-41bb-93f3-0359739836b2 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1693 microversion: 2.1 time: 0.158088 Oct 18 14:48:04.559450 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4116/8077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:04 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:05.583228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:05.583785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:05.590649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:05.591142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:05.591597 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:05.592298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:05.592769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:05.593203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:05.735628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:05.737645 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-29512b39-eb75-4cb2-9838-eb9cd53ae13a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1693 microversion: 2.1 time: 0.158630 Oct 18 14:48:05.738256 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3962/8078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:05 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:06.762362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:06.762916 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:06.770041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:06.770584 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:06.771051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:06.771766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:06.772250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:06.772706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:06.920979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:06.928898 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a79ccaa-647c-4295-b01d-c6f3ff25e25c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.171031 Oct 18 14:48:06.929495 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4117/8079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:06 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:07.952849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:07.953593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:07.960475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:07.960964 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:07.961410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:07.962128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:07.962598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:07.963033 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:08.092559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:08.100423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-01a6c088-a05f-4517-b2a3-df143bbcda34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.151505 Oct 18 14:48:08.101023 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3963/8080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:07 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:09.124325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:09.124955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:09.132605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:09.133109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:09.133572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:09.134309 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:09.134784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:09.135230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:09.264298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:09.272456 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bfd7369-f4ab-4802-818c-25b65d7fd440 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.152038 Oct 18 14:48:09.273038 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4118/8081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:09 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:10.296555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:10.297190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:10.304516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:10.305019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:10.305473 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:10.306222 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:10.306694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:10.307132 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:10.443329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:10.451183 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4b2cd163-e354-4f66-b909-f720806c1a1a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.158517 Oct 18 14:48:10.451761 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3964/8082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:10 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:11.474712 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:11.475348 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:11.482242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:11.482746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:11.483199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:11.483900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:11.484373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:11.484813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:11.617394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:11.626113 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2bd5856-ef5d-472c-8901-ea92134f54b3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.155287 Oct 18 14:48:11.626688 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4119/8083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:11 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:12.650852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:12.651467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:12.657689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:12.658224 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:12.658675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:12.659383 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:12.659890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:12.660298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:12.790166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:12.798497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-212e0102-866b-4687-bf5a-730fd934ab56 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.151870 Oct 18 14:48:12.799076 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3965/8084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:12 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:13.822931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:13.823565 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:13.831476 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:13.831986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:13.832475 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:13.833193 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:13.833675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:13.834146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:13.964784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:13.972692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37f19931-a15b-44f2-9a11-291980ca8edd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.153677 Oct 18 14:48:13.973266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4120/8085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:13 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:14.997468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:14.998732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:15.005629 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:15.006147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:15.006593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:15.007284 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:15.007743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:15.008174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:15.144938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:15.152809 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-de01430a-24a2-4471-90c3-d8a737dc2a4c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.159224 Oct 18 14:48:15.153313 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3966/8086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:14 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:16.176616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:16.177391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:16.184098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:16.192952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:16.192952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:16.192952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:16.192952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:16.192952 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:16.317865 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:16.325689 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-806e40b9-da86-49e4-84e6-fbab7bddbf42 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.153034 Oct 18 14:48:16.326850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4121/8087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:16 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:17.350563 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:17.351123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:17.357981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:17.358513 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:17.358966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:17.359671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:17.360142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:17.360585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:17.494142 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:17.502553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c991c1aa-8391-4f4b-98b4-7ffe2d1b050f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.155931 Oct 18 14:48:17.503138 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3967/8088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:17 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:18.526530 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:18.527227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:18.534080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:18.534622 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:18.535092 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:18.535813 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:18.536311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:18.536749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:18.672295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:18.680646 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c1025fe-c554-41e3-b3e1-62ae89306412 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.158056 Oct 18 14:48:18.681218 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4122/8089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:18 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:19.704923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:19.705456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:19.713243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:19.713742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:19.714227 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:19.714933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:19.715428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:19.715867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:19.852399 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:19.857085 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ed3bdc08-0e7b-43db-a4d9-2d5e16235eb1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.156150 Oct 18 14:48:19.857675 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3968/8090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:19 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:20.881450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:20.885323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:20.889046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:20.889555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:20.890021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:20.890758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:20.891236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:20.891688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:21.067778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:21.075725 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27b517d2-c392-4400-900f-080158a429d1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.198886 Oct 18 14:48:21.076308 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4123/8091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:20 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:22.099137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:22.099681 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:22.106551 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:22.107049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:22.107498 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:22.108187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:22.108653 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:22.109089 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:22.243694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:22.251538 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-485f431a-4abc-4bf0-a7d2-220ffc3cc85e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.156506 Oct 18 14:48:22.252113 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3969/8092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:22 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:23.277099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:23.277737 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:23.284171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:23.284677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:23.285134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:23.285841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:23.286337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:23.287334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:23.498998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:23.507174 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4caba28-ba5d-4fda-83ed-0464550fd66e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1698 microversion: 2.1 time: 0.234190 Oct 18 14:48:23.510744 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4124/8093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:23 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:24.179587 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "name": "network-vif-unplugged", "status": "completed", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:24.189976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:24.195326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:24.195326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:24.203502 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Creating event network-vif-unplugged:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h1-858383-13 Oct 18 14:48:24.209454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121009) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:48:24.220340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-072ead40-8088-4266-a1b5-fb5fa06f29e1 req-86e6a22b-a8fb-4b3a-89e4-24438cb680ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044635 Oct 18 14:48:24.220932 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3970/8094] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:48:24.531255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:24.531887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:24.539128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:24.539617 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:24.540073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:24.540785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:24.541254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:24.541699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:24.676494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:24.684886 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0db17e44-6cc3-40f7-8c36-f5f309fb7378 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1697 microversion: 2.1 time: 0.157499 Oct 18 14:48:24.685461 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4125/8095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:24 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:25.711371 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:25.712084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:25.718241 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:25.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:25.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:25.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:25.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:25.722258 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:25.852188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:25.860100 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cb1b49e9-411d-4c61-abe2-2673da32c6d8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1695 microversion: 2.1 time: 0.154531 Oct 18 14:48:25.860674 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3971/8096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:25 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:26.235795 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:26.246500 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:26.246995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:26.247447 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:26.259743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Creating event network-changed:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h1-858383-13 Oct 18 14:48:26.265134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:48:26.276071 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dd3d5fa5-53f3-47dd-8c1e-45e02fe9683c req-393ef891-4adc-4f53-9325-13fc296ca509 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044172 Oct 18 14:48:26.276653 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4126/8097] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:48:26.884144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:26.884771 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:26.891685 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:26.892180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:26.892631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:26.893328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:26.893798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:26.894534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:27.119181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:27.126979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48dbbc7d-18d7-4534-9f1d-b9b85c6b07fb tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1695 microversion: 2.1 time: 0.246866 Oct 18 14:48:27.127553 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3972/8098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:26 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:28.153029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:28.153659 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.159828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.165011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.165011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.165011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.165011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.165011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.298478 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:28.306655 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-523e71b6-81a1-4bea-9f77-35fa2e232723 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1692 microversion: 2.1 time: 0.158827 Oct 18 14:48:28.307219 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4127/8099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:28 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:28.330120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:28.330676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.337487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.337982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.338469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.339171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.339643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.340121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.578209 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1b7d782e-ae72-401a-9f2b-c2721e4987f3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action" status: 204 len: 0 microversion: 2.1 time: 0.251928 Oct 18 14:48:28.578853 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3973/8100] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:48:28 2022] POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:48:28.586922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:28.587582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.593600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.594167 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.594645 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.595345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.595820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.596262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.735870 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:28.744435 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b4445c48-4a22-4a04-812b-08ebaf608efe tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1692 microversion: 2.1 time: 0.161310 Oct 18 14:48:28.745015 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4128/8101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:28 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:28.767533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:28.773119 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.775412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.775899 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.776342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.777031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.777495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.777961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.793312 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:28.938353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:28.946355 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd8c9f22-b436-4dff-8ce7-34e6fccae59d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1692 microversion: 2.1 time: 0.183085 Oct 18 14:48:28.948623 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3974/8102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:28 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:29.607931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "name": "network-vif-plugged", "status": "completed", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:29.619233 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:29.619742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:29.620200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:29.633736 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Creating event network-vif-plugged:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h1-858383-13 Oct 18 14:48:29.639911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-13', 'n-h2-858383-13'} {{(pid=121010) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:48:29.652676 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c68bdcf5-c3ff-49dd-86e4-1a8126eb6285 req-485ca90e-5edb-4de6-879f-7381802cde53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049190 Oct 18 14:48:29.653323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4129/8103] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:48:29.971572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:29.972460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:29.980268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:29.980775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:29.981229 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:29.981990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:29.982487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:29.982933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:30.113053 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:30.120966 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a511ce83-56dc-4088-aeab-8043cd16cd00 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1692 microversion: 2.1 time: 0.153669 Oct 18 14:48:30.121569 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3975/8104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:29 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:31.147825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:31.148578 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:31.155336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:31.155840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:31.156292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:31.156994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:31.157466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:31.157914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:31.290582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:31.298312 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7d415049-3683-4629-ad56-44b530e7921e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1684 microversion: 2.1 time: 0.157184 Oct 18 14:48:31.298880 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4130/8105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:31 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:53.486085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:53.486924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=9 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:53.530945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:53.533205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:53.539239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:53.539734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:53.540203 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:53.541466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:53.541938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:53.542474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:53.595597 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-60850a0b-6a60-48c5-bb36-aacfe7ebf3a9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action" status: 200 len: 24570 microversion: 2.1 time: 0.114894 Oct 18 14:48:53.596224 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3976/8106] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:48:53 2022] POST /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26/action => generated 24570 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:49:00.881707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:00.882433 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:00.884922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=32 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:00.886346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:00.891931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:00.892524 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:00.893254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:00.894153 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:00.894977 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:00.895506 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:00.925405 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:49:00.943257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:00.954431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:00.955019 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:00.955814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:00.967530 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] Creating event network-changed:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h1-858383-13 Oct 18 14:49:00.973104 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8136e273-ea6d-4eef-8dc6-c177384e9c51 req-b7850091-222e-4099-a566-54549f544477 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099314 Oct 18 14:49:00.973897 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3977/8107] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:49:01.225978 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e7be7342-3a10-46ac-b676-a5599780e56f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 204 len: 0 microversion: 2.1 time: 0.354997 Oct 18 14:49:01.230132 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4131/8108] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:49:00 2022] DELETE /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:49:01.236486 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:01.237694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:01.244701 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:01.245194 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:01.245878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:01.250738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:01.250738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:01.250738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:01.385454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:01.399105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-566ae367-9c9f-4282-bdf4-2cc8f451b5d9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1690 microversion: 2.1 time: 0.167055 Oct 18 14:49:01.400163 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3978/8109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:01 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:49:02.424242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:02.424976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:02.431911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:02.432425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:02.432897 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:02.434258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:02.434713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:02.435170 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:02.577202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:02.585405 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4b620c6-4f50-412c-9329-f73eadd38708 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1690 microversion: 2.1 time: 0.165442 Oct 18 14:49:02.585984 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4132/8110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:02 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:03.200951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c656ea1c-619b-4d99-80c2-e8e6ad0a5a26", "name": "network-vif-deleted", "tag": "ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:03.212084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:03.212574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:03.213017 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:03.225041 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] Creating event network-vif-deleted:ed1dcd8e-c251-4dbc-ab8d-7a2f24dd54e7 for instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 on n-h1-858383-13 Oct 18 14:49:03.230037 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c8fabd7c-c220-4318-a9c3-114af9404230 req-13bfc16a-ddac-41a9-9a13-ee56a76eec0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Oct 18 14:49:03.230649 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3979/8111] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:49:03.609923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:03.610605 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:03.617794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:03.621492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:03.621492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:03.621492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:03.621492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:03.621492 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:03.654384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:03.655003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:03.655566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:03.656039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lazy-loading 'fault' on Instance uuid c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:49:03.719059 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:03.719059 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a22cd80-2399-45e8-8bd0-cb30a3f87bc6 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 200 len: 1357 microversion: 2.1 time: 0.106271 Oct 18 14:49:03.719059 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4133/8112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:03 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:04.737382 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:04.738121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: c656ea1c-619b-4d99-80c2-e8e6ad0a5a26] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:04.744324 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:04.744821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:04.745271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:04.746627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:04.747422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:04.748076 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:04.762325 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] HTTP exception thrown: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Request method failure captured: Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 HTTP/1.1 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTruln0rt_OS3qmFcoKHX48qFWOFU__bSEGV2lrDCrpxVVgExZctwhbC6gWwbhDkC9Oj-mzUkJnqooLVra1g_Ufm_FDjEd58qRsyYWcZt_zQXY2nklkUejwZDLsC9Fz78k6DlWWSAj7x8vSMLVJk4G9ljAAvc34ucoGKiEEvvH5vvJKo Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/381041942f024a3fb56e35c99475ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_381041942f024a3fb56e35c99475ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1b02196b7d35453b8a710ef6f4835dec Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': 'c656ea1c-619b-4d99-80c2-e8e6ad0a5a26'} Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:49:04.763957 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Returning 404 to user: Instance c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5ad38890-7b3f-4e04-a048-84ed7dbe8e77 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26" status: 404 len: 111 microversion: 2.1 time: 0.033236 Oct 18 14:49:04.769240 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3980/8113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:04 2022] GET /compute/v2.1/servers/c656ea1c-619b-4d99-80c2-e8e6ad0a5a26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:49:08.219138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-55b6c1a0-a2e5-4211-b5c0-546e93ab019b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '.version_select at 0x7fb330c26040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:08.307263 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-55b6c1a0-a2e5-4211-b5c0-546e93ab019b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300888290" status: 202 len: 0 microversion: 2.1 time: 0.092001 Oct 18 14:49:08.307861 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4134/8114] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 18 14:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300888290 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:49:08.337114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dbad9bbf-8d82-453f-875f-9201e1f14ec9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: .version_select at 0x7fb32bc943a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1238958273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7OHTbc28lD9Bj9Pp7Chsj+aq0MUZ2PqRepkqFLlXBXOFiu8XzGlugNTkiYRhgGVMGTMYk+VCG9d7fpOVkXaF6fZbO6NKkN2QhpYwJ7/DpTS2i9PY3uGdJOpBEYVl2u8A=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:08.354347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dbad9bbf-8d82-453f-875f-9201e1f14ec9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:49:08.359842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-dbad9bbf-8d82-453f-875f-9201e1f14ec9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:49:08.443691 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dbad9bbf-8d82-453f-875f-9201e1f14ec9 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.110487 Oct 18 14:49:08.444293 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3981/8115] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:49:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:49:16.907798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1282455364", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "84c588fc-fca7-42fe-a253-41fcc642a5f7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1238958273", "security_groups": [{"name": "tempest-secgroup-smoke-296351885"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:16.921217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:17.037160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] validate_networks() for [('84c588fc-fca7-42fe-a253-41fcc642a5f7', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:49:17.488097 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:49:17.488541 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:49:17.489037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:49:17.489461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:49:17.490202 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:49:17.501603 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:17.502574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:17.503298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:17.504174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:17.504749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:17.505259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:17.533472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:49:17.540288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:49:17.560453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:49:17.563364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:49:17.710079 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b26e9181-5a98-4f0c-938e-bf003f9c2760 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804857 Oct 18 14:49:17.714154 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4135/8116] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:49:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:49:17.725005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b3cf2e90-b848-465e-b35b-8784460fc022 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:17.732950 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b3cf2e90-b848-465e-b35b-8784460fc022 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:17.735943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=16 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:17.809763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b3cf2e90-b848-465e-b35b-8784460fc022 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:17.818971 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b3cf2e90-b848-465e-b35b-8784460fc022 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1267 microversion: 2.1 time: 0.099904 Oct 18 14:49:17.820501 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3982/8117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:17 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:18.844466 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:18.845108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:18.852982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:18.853495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:18.853944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:18.854692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:18.855863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:18.856284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:18.926666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:18.936355 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42e1a74c-3ce7-433a-be9a-b72bb51bcc2a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1271 microversion: 2.1 time: 0.095802 Oct 18 14:49:18.936958 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4136/8118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:18 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:49:19.960328 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:19.961512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:19.970352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:19.971115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:19.971651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:19.972594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:19.973071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:19.973517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:20.050282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:20.058979 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-735800fb-4b5a-4147-be98-b98fea9e824f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1327 microversion: 2.1 time: 0.103468 Oct 18 14:49:20.059551 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3983/8119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:19 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:21.083831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:21.084395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:21.091831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:21.092351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:21.092819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:21.093628 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:21.094211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:21.094848 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:21.231547 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:21.239479 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5c0e76e5-a5bf-4552-ba25-5cc5f683f287 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.159787 Oct 18 14:49:21.240051 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4137/8120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:21 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:21.660044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d1d730-6586-43db-8be4-bed571c16ddc", "tag": "2e6270b4-afb3-4f9f-b382-8f22cd4d02ba"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:21.671495 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:21.672015 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:21.672453 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:21.686988 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] Creating event network-changed:2e6270b4-afb3-4f9f-b382-8f22cd4d02ba for instance 70d1d730-6586-43db-8be4-bed571c16ddc on n-h2-858383-13 Oct 18 14:49:21.692497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-98c6c01c-1bbe-4963-82b8-3b55e6b31c6f req-3461268f-abda-487d-b6bc-48325541d5fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036287 Oct 18 14:49:21.693436 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3984/8121] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:49:22.264389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:22.265033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:22.272746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:22.273258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:22.273717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:22.274462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:22.274939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:22.275393 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:22.415077 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:22.423742 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd8263b7-5c38-42fb-8a1a-980eef3641ca tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.164045 Oct 18 14:49:22.424345 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4138/8122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:22 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:23.449527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:23.450276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:23.456823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:23.457315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:23.457845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:23.458575 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:23.459034 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:23.459496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:23.592807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:23.601031 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee99e2e6-d89f-4bfd-88e3-05afff20b982 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.157158 Oct 18 14:49:23.601598 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3985/8123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:23 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:24.624052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:24.624688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:24.632349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:24.632881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:24.633373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:24.634119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:24.634601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:24.635049 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:24.773601 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:24.781986 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2b8daa13-faa7-43de-8d7c-5c2e68d0788d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.162425 Oct 18 14:49:24.782600 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4139/8124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:24 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:25.805393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:25.806037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:25.809362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:25.814080 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:25.814576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:25.815025 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:25.815720 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:25.816181 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:25.816616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:25.948071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:25.956313 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb7c5db0-f274-4113-8ebd-a3a4a214acb0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.154835 Oct 18 14:49:25.956881 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3986/8125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:25 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:26.385815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d1d730-6586-43db-8be4-bed571c16ddc", "name": "network-vif-plugged", "status": "completed", "tag": "2e6270b4-afb3-4f9f-b382-8f22cd4d02ba"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:26.397246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:26.397745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:26.398237 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:26.409706 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] Creating event network-vif-plugged:2e6270b4-afb3-4f9f-b382-8f22cd4d02ba for instance 70d1d730-6586-43db-8be4-bed571c16ddc on n-h2-858383-13 Oct 18 14:49:26.414821 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fd76c38d-71a4-4d36-8a20-1d718470871d req-8b9aee77-7121-4644-b6a5-b84c4b8caf22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Oct 18 14:49:26.415390 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4140/8126] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:49:26.978902 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:26.980314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:26.987543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:26.988042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:26.988497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:26.989266 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:26.989760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:26.990235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:27.120098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:27.128446 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d057e0b9-5e66-4efa-a286-8051736eae75 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1392 microversion: 2.1 time: 0.153476 Oct 18 14:49:27.129026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3987/8127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:26 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:28.150987 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:28.151799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:28.155911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:28.156631 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:28.163060 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:28.163736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:28.164228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:28.164965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:28.165465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:28.165909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:28.300423 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:28.308693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-813ea41c-c257-450e-a7b7-3f4ff19eb8be tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1563 microversion: 2.1 time: 0.159542 Oct 18 14:49:28.309269 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4141/8128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:28 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:28.331706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:28.332326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:28.334478 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:28.340121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:28.340666 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:28.341115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:28.341808 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:28.342295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:28.344841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:28.479296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:28.487938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c6ff4104-7428-4189-8765-866e2ef95423 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1563 microversion: 2.1 time: 0.160202 Oct 18 14:49:28.488598 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3988/8129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:28 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:30.504582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:49:30.505868 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:30.506511 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d1d730-6586-43db-8be4-bed571c16ddc", "tag": "2e6270b4-afb3-4f9f-b382-8f22cd4d02ba"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:30.514874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:30.515453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:30.518080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:30.518080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:30.518080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:30.518080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:30.518734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:30.519569 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:30.520403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:30.533256 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] Creating event network-changed:2e6270b4-afb3-4f9f-b382-8f22cd4d02ba for instance 70d1d730-6586-43db-8be4-bed571c16ddc on n-h2-858383-13 Oct 18 14:49:30.538516 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-261c4269-fb97-41e8-8582-f6731c7a8e4e req-ffc63668-ffa3-4110-9661-4003fa029a70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035857 Oct 18 14:49:30.539203 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3989/8130] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:49:30.664255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:49:30.673070 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2cdbe53-f604-4283-9250-6a249d0e436a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1563 microversion: 2.1 time: 0.173338 Oct 18 14:49:30.674376 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4142/8131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:49:30 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:49:54.242874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=7 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:54.243643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=34 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:54.248516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:49:54.250803 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:49:54.256839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:54.258647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:54.258647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:54.258647 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:49:54.258984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:49:54.259346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:49:54.318464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98804126-051a-4dbd-b64e-d26b06c4cd7f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action" status: 200 len: 24569 microversion: 2.1 time: 0.077500 Oct 18 14:49:54.319095 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3990/8132] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:49:54 2022] POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action => generated 24569 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:50:05.324333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:05.326745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:05.327517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=40 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:05.332173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:05.332683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:05.333148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:05.356021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:50:05.519347 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-40ce01af-a544-44a7-9071-7f3460f69142 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action" status: 202 len: 0 microversion: 2.1 time: 0.199379 Oct 18 14:50:05.520020 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4143/8133] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:50:05 2022] POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:50:05.530240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:05.530965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:05.533865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:05.534554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:05.543386 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:05.543888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:05.544385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:05.545074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:05.545544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:05.545985 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:05.740869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:05.748714 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7b7a1fa6-3bea-4fb9-b4c9-cf202b4e5bf8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.224029 Oct 18 14:50:05.749289 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3991/8134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:05 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:06.774833 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:06.776149 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:06.782474 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:06.782984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:06.783449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:06.784160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:06.784636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:06.785085 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:06.919606 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:06.927383 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d6322b78-607b-4f27-9410-70078e9c4da5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.158155 Oct 18 14:50:06.927965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4144/8135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:06 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:07.951168 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:07.951792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:07.958694 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:07.959184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:07.959633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:07.960353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:07.960843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:07.961278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:08.091081 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:08.098899 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48c1407a-81de-432d-97aa-1f12daeb7543 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.151621 Oct 18 14:50:08.099471 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3992/8136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:07 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:09.124244 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:09.124878 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:09.132439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:09.132948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:09.133406 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:09.134134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:09.135112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:09.135572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:09.274928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:09.280774 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32d67b3a-a905-4953-b011-a6919cf79b34 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.161508 Oct 18 14:50:09.281349 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4145/8137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:09 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:10.306519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:10.307129 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:10.313984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:10.314515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:10.314963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:10.315659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:10.316127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:10.316567 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:10.445811 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:10.454340 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2630d12d-04cb-4904-8f35-e41a1997d655 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.151733 Oct 18 14:50:10.454930 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3993/8138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:10 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:11.478398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:11.479033 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:11.486438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:11.486947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:11.487409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:11.488118 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:11.488597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:11.489047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:11.619904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:11.627903 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6631cca3-2ed7-42d1-890e-d0e4b03bdc18 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.153450 Oct 18 14:50:11.628650 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4146/8139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:11 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:12.652418 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:12.653064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:12.659979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:12.660504 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:12.660961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:12.661661 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:12.662187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:12.662628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:12.797296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:12.805046 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35545a16-54ca-496e-a183-1ab3aadbed88 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.156883 Oct 18 14:50:12.805619 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3994/8140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:12 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:13.829391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:13.830015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:13.837025 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:13.837535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:13.838230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:13.839104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:13.839577 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:13.840024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:13.971816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:13.979969 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd12a391-7b5a-4a58-9573-7edea2176738 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.154535 Oct 18 14:50:13.980536 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4147/8141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:13 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:15.004274 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:15.004892 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:15.012343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:15.012832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:15.013278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:15.013968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:15.014454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:15.014888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:15.144483 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:15.153094 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-880d2291-ac58-4042-b19d-82d88c8e88af tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1692 microversion: 2.1 time: 0.152849 Oct 18 14:50:15.153671 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3995/8142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:14 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:16.176735 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:16.177375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:16.184394 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:16.184905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:16.185373 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:16.186110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:16.186591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:16.187048 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:16.323728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:16.331882 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e60ace0f-78d5-4629-8f45-1d52ca85ebf7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1669 microversion: 2.1 time: 0.159046 Oct 18 14:50:16.332539 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4148/8143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:16 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:17.431403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:17.434273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:17.441290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:17.441786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:17.442270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:17.442977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:17.443448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:17.443891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:17.503308 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-63f966bc-dd3a-4c58-b867-a0d32a56644d tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action" status: 200 len: 38428 microversion: 2.1 time: 0.075679 Oct 18 14:50:17.503997 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3996/8144] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:50:17 2022] POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action => generated 38428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:50:17.515911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:17.522905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:17.523412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:17.523874 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:17.546699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Going to try to start instance {{(pid=121010) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:50:17.733743 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9f79c1d-84b5-4cb4-8b5c-ce07c7daed5e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action" status: 202 len: 0 microversion: 2.1 time: 0.221362 Oct 18 14:50:17.734365 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4149/8145] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:50:17 2022] POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:50:17.743006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:17.745318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:17.750797 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:17.751297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:17.751752 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:17.752459 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:17.752923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:17.753362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:17.920896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:17.928832 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4efcef26-aee7-4101-b79d-ff464a50c7e3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1678 microversion: 2.1 time: 0.189997 Oct 18 14:50:17.929410 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3997/8146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:17 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:18.954582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:18.955297 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:18.961477 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:18.962026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:18.963034 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:18.963268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:18.963743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:18.964189 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:19.101786 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:19.111024 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e1c95359-1706-4bf4-8503-447631e5166b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1678 microversion: 2.1 time: 0.161834 Oct 18 14:50:19.111624 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4150/8147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:18 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:20.135707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:20.136341 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:20.143273 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:20.143769 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:20.144225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:20.144928 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:20.145403 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:20.145842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:20.280699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:20.288458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-8228674b-bfdb-4687-9adb-991473dc97f7 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1682 microversion: 2.1 time: 0.157256 Oct 18 14:50:20.289026 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3998/8148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:20 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:44.490625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:44.492857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:44.496255 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:44.503102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:44.503102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:44.503102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:44.503102 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:44.503537 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:44.503798 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:44.504243 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:44.558047 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c5467395-87a1-4d0a-9800-8f5292ef9ca8 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action" status: 200 len: 62985 microversion: 2.1 time: 0.071260 Oct 18 14:50:44.558732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4151/8149] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:50:44 2022] POST /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc/action => generated 62985 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:50:51.858496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:51.859061 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:51.861472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d1d730-6586-43db-8be4-bed571c16ddc", "tag": "2e6270b4-afb3-4f9f-b382-8f22cd4d02ba"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:51.862377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=16 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:51.863057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=46 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:51.868774 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:51.869532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:51.870813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:51.871822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:51.872360 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:51.873037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:51.873951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:51.874472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:51.874921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:51.889375 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] Creating event network-changed:2e6270b4-afb3-4f9f-b382-8f22cd4d02ba for instance 70d1d730-6586-43db-8be4-bed571c16ddc on n-h2-858383-13 Oct 18 14:50:51.895331 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-402e97ec-f06a-4cd4-a647-85eb7ec48e51 req-5a05dc43-e1af-4760-8f36-b72ea325425c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038924 Oct 18 14:50:51.896247 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4152/8150] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:50:51.903603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:50:52.184918 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a826cfe3-a488-470e-b213-8d76c601f236 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 204 len: 0 microversion: 2.1 time: 0.331235 Oct 18 14:50:52.185529 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 3999/8151] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:50:51 2022] DELETE /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:50:52.194515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:52.195303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:52.202976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:52.204074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:52.204074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:52.204717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:52.205200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:52.205649 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:52.344026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:52.352017 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-097b5453-09b9-4928-87c3-f43e4307e8fd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1688 microversion: 2.1 time: 0.161833 Oct 18 14:50:52.352588 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4153/8152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:52 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:53.383056 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:53.383859 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:53.390972 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:53.391466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:53.391913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:53.392611 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:53.393077 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:53.393521 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:53.529646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:53.537484 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-212b20e9-7781-4131-97de-7a7e21a50be0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1688 microversion: 2.1 time: 0.158858 Oct 18 14:50:53.538079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4000/8153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:53 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:54.379797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d1d730-6586-43db-8be4-bed571c16ddc", "name": "network-vif-deleted", "tag": "2e6270b4-afb3-4f9f-b382-8f22cd4d02ba"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:54.390956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:54.391550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:54.392002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:54.403625 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] Creating event network-vif-deleted:2e6270b4-afb3-4f9f-b382-8f22cd4d02ba for instance 70d1d730-6586-43db-8be4-bed571c16ddc on n-h2-858383-13 Oct 18 14:50:54.408570 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f35058c7-1d0b-4536-831b-d984493b1fad req-c28bb212-f630-4193-9b4f-1d0b46b5653b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Oct 18 14:50:54.409143 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4154/8154] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:50:54.562609 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:54.563163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:54.570048 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:54.570574 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:54.571031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:54.571734 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:54.572199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:54.572636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:54.636160 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:54.644184 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0a1ec8d3-4b03-42a0-b6da-336a1d663e27 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 200 len: 1352 microversion: 2.1 time: 0.085584 Oct 18 14:50:54.644779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4001/8155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:54 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:50:55.669689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:55.670437 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 70d1d730-6586-43db-8be4-bed571c16ddc] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:55.676723 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:55.677228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:55.677690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:55.678439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:55.678921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:55.679377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:55.693367 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] HTTP exception thrown: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Request method failure captured: Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc HTTP/1.1 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTruln0rt_OS3qmFcoKHX48qFWOFU__bSEGV2lrDCrpxVVgExZctwhbC6gWwbhDkC9Oj-mzUkJnqooLVra1g_Ufm_FDjEd58qRsyYWcZt_zQXY2nklkUejwZDLsC9Fz78k6DlWWSAj7x8vSMLVJk4G9ljAAvc34ucoGKiEEvvH5vvJKo Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/381041942f024a3fb56e35c99475ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_381041942f024a3fb56e35c99475ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 1b02196b7d35453b8a710ef6f4835dec Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '70d1d730-6586-43db-8be4-bed571c16ddc'} Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:50:55.695051 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Returning 404 to user: Instance 70d1d730-6586-43db-8be4-bed571c16ddc could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2034457a-ae65-4083-b1a9-a9b1942a380e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc" status: 404 len: 111 microversion: 2.1 time: 0.032681 Oct 18 14:50:55.700613 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4155/8156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:55 2022] GET /compute/v2.1/servers/70d1d730-6586-43db-8be4-bed571c16ddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:50:59.473205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5662f1cc-ecbb-4403-9278-ef10983e605f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '.version_select at 0x7fb330240280>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:59.560089 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5662f1cc-ecbb-4403-9278-ef10983e605f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1238958273" status: 202 len: 0 microversion: 2.1 time: 0.091551 Oct 18 14:50:59.561013 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4002/8157] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 18 14:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1238958273 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:50:59.599186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a058f9c3-7578-4e06-b177-4c1a2db77159 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: .version_select at 0x7fb330b7f8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1043223254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChRpsPa6Gtjb8Jo927cFyKlrF7TS2fj1kPzAq0im8gjLylrLZGM3C7na4f7ZYQGgn5L9L8fRI6jaXMZuW+1JEkg5uX5twLaJIR4ITISJzIFUhjlEogqYpnUjI6Bt9QN0A=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:59.617993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a058f9c3-7578-4e06-b177-4c1a2db77159 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:50:59.623934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-a058f9c3-7578-4e06-b177-4c1a2db77159 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:50:59.842762 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a058f9c3-7578-4e06-b177-4c1a2db77159 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.247652 Oct 18 14:50:59.843307 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4156/8158] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:50:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:51:08.046329 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:08.050545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-450713671", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "networks": [{"uuid": "2c87703f-2016-46b9-ace5-1d8f45e0c259"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1043223254", "security_groups": [{"name": "tempest-secgroup-smoke-741645162"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:08.178099 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] validate_networks() for [('2c87703f-2016-46b9-ace5-1d8f45e0c259', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:51:08.635429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:51:08.635612 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:51:08.636196 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:51:08.636725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:51:08.637223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:51:08.647230 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:08.648216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:08.648718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:08.649493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:08.650039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:08.651941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:08.674448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:51:08.679770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Getting quotas for user 1b02196b7d35453b8a710ef6f4835dec and project 381041942f024a3fb56e35c99475ff61. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:51:08.692906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:51:08.695281 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:51:08.800604 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3965158c-573a-420c-9fdf-dda7376d03d5 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756046 Oct 18 14:51:08.807907 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4003/8159] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:51:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:51:08.811555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=16 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:08.822759 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb10bcfd-63be-4811-8fe4-c38ddf064e99 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:08.824467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb10bcfd-63be-4811-8fe4-c38ddf064e99 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:08.908706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-bb10bcfd-63be-4811-8fe4-c38ddf064e99 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:08.932734 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb10bcfd-63be-4811-8fe4-c38ddf064e99 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1266 microversion: 2.1 time: 0.122349 Oct 18 14:51:08.933627 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4157/8160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:08 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:09.957170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:09.957910 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:09.974557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:09.975638 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:09.976315 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:09.977354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:09.978123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:09.978949 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:10.056414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:10.065463 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-aee7afaa-2bc3-427c-a928-cd72c537acef tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1270 microversion: 2.1 time: 0.113222 Oct 18 14:51:10.066571 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4004/8161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:09 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:11.089091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:11.089906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:11.100884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:11.101560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:11.102174 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:11.103175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:11.103826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:11.104391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:11.175378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:11.184021 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64a6cf90-c1c0-4160-a16f-70c0d7b28e0e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1336 microversion: 2.1 time: 0.098505 Oct 18 14:51:11.184871 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4158/8162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:11 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:12.208848 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:12.209583 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:12.216170 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:12.216660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:12.217107 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:12.217835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:12.218397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:12.218834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:12.372405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:12.380349 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-22eedf4b-2e56-4569-b1d0-4f245956403e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.175792 Oct 18 14:51:12.380926 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4005/8163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:12 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:12.729674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f0e7ff-9ce9-4cfa-bac9-50ee20226810", "tag": "565d136c-c850-44da-a213-c863859c1d03"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:12.740579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:12.741086 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:12.741568 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:12.753693 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] Creating event network-changed:565d136c-c850-44da-a213-c863859c1d03 for instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 on n-h1-858383-13 Oct 18 14:51:12.758851 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-c2c4d851-245c-4316-a2a2-a1462d1f76b8 req-fcdf75be-6f86-4f47-9e57-238bae6edad1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Oct 18 14:51:12.759451 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4159/8164] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:51:13.405408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:13.406218 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:13.413140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:13.413631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:13.414174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:13.414880 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:13.415429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:13.415994 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:13.552413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:13.560913 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4d729329-5468-46a0-8556-da86fc6dd9b1 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.160358 Oct 18 14:51:13.563504 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4006/8165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:13 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:14.584894 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:14.585655 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:14.588553 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:14.593979 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:14.594520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:14.595055 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:14.600998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:14.600998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:14.600998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:14.731301 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:14.739240 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffcc53f0-935e-4a62-a51c-a06d67bcc2c0 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.158662 Oct 18 14:51:14.739833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4160/8166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:14 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:15.763164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:15.763728 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:15.771126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:15.771627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:15.772085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:15.772789 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:15.773262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:15.773707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:15.907475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:15.915365 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7093bf84-7aca-4567-9d86-dad4abfd0e04 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.156120 Oct 18 14:51:15.922117 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4007/8167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:15 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:16.939329 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:16.940001 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:16.946988 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:16.947499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:16.948022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:16.948745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:16.949250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:16.949702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:17.088231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:17.096548 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7412fbd1-9505-4f68-9f34-720902b62b64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.161833 Oct 18 14:51:17.097124 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4161/8168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:16 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:18.016427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f0e7ff-9ce9-4cfa-bac9-50ee20226810", "name": "network-vif-plugged", "status": "completed", "tag": "565d136c-c850-44da-a213-c863859c1d03"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:18.027372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:18.027865 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:18.028309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:18.039187 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] Creating event network-vif-plugged:565d136c-c850-44da-a213-c863859c1d03 for instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 on n-h1-858383-13 Oct 18 14:51:18.044146 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-4befff66-9d17-4370-bf43-03cd8bd6d537 req-421e16e5-a838-4f73-a9e1-f97a32c28a6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 Oct 18 14:51:18.044725 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4008/8169] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:51:18.119661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:18.120688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:18.128429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:18.129380 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:18.129943 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:18.130923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:18.131621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:18.132253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:18.266815 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:18.274709 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-751bc34c-1dfe-4465-824d-05d041486c78 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.159046 Oct 18 14:51:18.275297 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4162/8170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:18 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:19.297068 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:19.297854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:19.303969 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:19.304682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:19.311867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:19.312362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:19.313042 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:19.313749 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:19.314253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:19.314686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:19.453593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:19.461553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-710a6e83-844d-4893-874c-21736ff04722 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1391 microversion: 2.1 time: 0.165960 Oct 18 14:51:19.462153 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4009/8171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:19 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:20.485039 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:20.485823 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:20.487858 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:20.493671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:20.494246 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:20.494728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:20.495446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:20.495924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:20.496377 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:20.635596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:20.644042 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46113316-bf2e-4128-8ddb-b6ad17b8ee1e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1564 microversion: 2.1 time: 0.163016 Oct 18 14:51:20.644548 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4163/8172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:20 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:20.666832 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:20.667456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:20.674388 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:20.674881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:20.675325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:20.676020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:20.676481 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:20.676915 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:20.809782 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:20.818144 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6c14c5d8-81fa-4017-a138-db6c36d1ed64 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1564 microversion: 2.1 time: 0.155159 Oct 18 14:51:20.818738 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4010/8173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:20 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:23.050418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:23.051745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:23.056113 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f0e7ff-9ce9-4cfa-bac9-50ee20226810", "tag": "565d136c-c850-44da-a213-c863859c1d03"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:23.058286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:23.058877 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:23.059321 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:23.060038 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:23.060698 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:23.061148 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:23.065869 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:23.067642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:23.068141 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:23.068594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:23.080905 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] Creating event network-changed:565d136c-c850-44da-a213-c863859c1d03 for instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 on n-h1-858383-13 Oct 18 14:51:23.086203 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-86326f2d-f5ab-456f-baac-308350cddebf req-9f9c997f-d57d-4ae1-81eb-cc5ad543e837 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035818 Oct 18 14:51:23.087079 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4011/8174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:51:23.233931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:23.244562 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ebc9454-894a-40da-8228-c8f72fc014ac tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1564 microversion: 2.1 time: 0.198960 Oct 18 14:51:23.256729 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4164/8175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:23 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1564 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:46.493996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=42 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:46.498348 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:46.500636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:46.507297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:46.507796 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:46.508249 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:46.508951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:46.509451 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:46.509894 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:46.571164 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4488c39-06bf-438d-ad00-8281c5b2317f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action" status: 200 len: 24563 microversion: 2.1 time: 0.078944 Oct 18 14:51:46.571838 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4012/8176] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:51:46 2022] POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action => generated 24563 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:51:57.523425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:51:57.523990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:57.526214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=9 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:57.527288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=38 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:57.532772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:57.533280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:57.533745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:57.534485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:57.534970 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:57.541494 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:57.558945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lazy-loading 'flavor' on Instance uuid 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:51:57.810792 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be9b6ff0-405b-4f22-a08e-e229219fa53e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action" status: 202 len: 0 microversion: 2.1 time: 0.291851 Oct 18 14:51:57.811388 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4165/8177] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:51:57 2022] POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:51:57.820770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:57.821460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:57.824816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:57.830342 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:57.830831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:57.831277 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:57.831977 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:57.832463 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:57.832897 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:57.967212 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:57.975018 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-779c141f-0638-444b-8374-aaefd8b4abb3 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1691 microversion: 2.1 time: 0.159197 Oct 18 14:51:57.975585 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4013/8178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:57 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:51:59.000107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:51:59.000831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:51:59.007690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:59.008198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:59.008662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:59.009381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:51:59.009863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:51:59.010343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:51:59.145412 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:51:59.153596 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-74039560-5956-41fc-8deb-2d29f0ebdb5b tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1674 microversion: 2.1 time: 0.158823 Oct 18 14:51:59.154195 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4166/8179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:51:58 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:00.250325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:00.252472 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:00.260215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.260718 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.261174 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.261884 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.262381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.262827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.323055 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-84af68be-47ce-47a0-9586-36221b03c64f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action" status: 200 len: 37985 microversion: 2.1 time: 0.076731 Oct 18 14:52:00.324856 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4014/8180] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:52:00 2022] POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action => generated 37985 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:52:00.336462 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:00.337084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:00.344064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.344580 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.345051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.345770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.346287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.346745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.588707 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca5195fc-fb7f-4af5-8c2c-9cbeac8ad48f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action" status: 202 len: 0 microversion: 2.1 time: 0.256416 Oct 18 14:52:00.589361 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4167/8181] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:52:00 2022] POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:52:00.598636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:00.599454 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:00.606528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.607131 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.607595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.608308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:00.608777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:00.609223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:00.761519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:00.770185 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-08d947af-3933-4fb0-bdab-faacc5286385 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1680 microversion: 2.1 time: 0.175696 Oct 18 14:52:00.770779 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4015/8182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:00 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:01.796061 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:01.796837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:01.803657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:01.804163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:01.804625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:01.805334 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:01.805809 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:01.806287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:01.938842 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:01.946924 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8fcb13fd-fbe3-46fa-a9ca-10e60e983e87 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1680 microversion: 2.1 time: 0.156069 Oct 18 14:52:01.947502 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4168/8183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:01 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:02.970852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:02.971467 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:02.979505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:02.979996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:02.980440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:02.981128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:02.981690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:02.982153 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:03.111705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:03.119524 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-eb3148af-6e48-4891-8b0e-4eb6eba24c0a tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1683 microversion: 2.1 time: 0.152572 Oct 18 14:52:03.122216 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4016/8184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:02 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:03.223794 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:03.226044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:03.234619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:03.235143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:03.235635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:03.236378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:03.236859 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:03.237340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:03.280304 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a8161a90-7322-4ad2-b0a8-266d5fd3d8bd tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action" status: 200 len: 37985 microversion: 2.1 time: 0.061085 Oct 18 14:52:03.280944 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4169/8185] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:52:03 2022] POST /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810/action => generated 37985 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:52:04.344137 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:04.345031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:04.352822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:04.353333 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:04.353791 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:04.354580 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:04.355346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:04.355799 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:04.385452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:52:04.416342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f0e7ff-9ce9-4cfa-bac9-50ee20226810", "tag": "565d136c-c850-44da-a213-c863859c1d03"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:04.429806 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:04.430320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:04.431866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:04.441467 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] Creating event network-changed:565d136c-c850-44da-a213-c863859c1d03 for instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 on n-h1-858383-13 Oct 18 14:52:04.446497 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-87ff3748-bd59-4fd9-87cc-add39f3af722 req-7b2427ed-e99e-4691-aba8-621acdde496a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103347 Oct 18 14:52:04.447230 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4170/8186] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:52:04.722421 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71cce245-1f6c-49c1-b94b-d11890484f67 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 204 len: 0 microversion: 2.1 time: 0.381718 Oct 18 14:52:04.723759 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4017/8187] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:52:04 2022] DELETE /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:52:04.733340 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:04.734200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:04.741090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:04.741616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:04.742383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:04.743523 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:04.744245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:04.744967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:04.888554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:04.897027 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1fd00b28-3bbe-4d40-b089-f5d9bab04449 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1689 microversion: 2.1 time: 0.168527 Oct 18 14:52:04.897616 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4171/8188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:04 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:05.922730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:05.923437 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:05.930893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:05.931385 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:05.931831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:05.932522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:05.932982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:05.933414 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:06.064057 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:06.072161 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-11199ddd-1639-49a5-a247-3d4dc812e91e tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1689 microversion: 2.1 time: 0.153793 Oct 18 14:52:06.072737 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4018/8189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:05 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:07.097364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:07.098155 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:07.105117 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:07.105624 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:07.106107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:07.106826 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:07.107303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:07.107753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:07.178685 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:07.193544 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49b056ca-b393-4708-9193-14e18e528c0c tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1503 microversion: 2.1 time: 0.094036 Oct 18 14:52:07.193544 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4172/8190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:07 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:07.239547 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f0e7ff-9ce9-4cfa-bac9-50ee20226810", "name": "network-vif-deleted", "tag": "565d136c-c850-44da-a213-c863859c1d03"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:07.250280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:07.257389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:07.257389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:07.262097 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] Creating event network-vif-deleted:565d136c-c850-44da-a213-c863859c1d03 for instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 on n-h1-858383-13 Oct 18 14:52:07.267034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-42a7b0b3-68ef-45b5-ac00-6767ce0ee9fa req-45d9d381-2ca3-4564-aff5-3b85b10d0e35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031854 Oct 18 14:52:07.267624 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4019/8191] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:52:08.211754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:08.212342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:08.219300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:08.219993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:08.220260 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:08.220973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:08.221452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:08.221904 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:08.258080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:08.258588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:08.259052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:08.259675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lazy-loading 'fault' on Instance uuid 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:52:08.304555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02196b7d35453b8a710ef6f4835dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381041942f024a3fb56e35c99475ff61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:08.311583 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f211771-5694-47ec-bd7c-c35328b78085 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 200 len: 1356 microversion: 2.1 time: 0.104394 Oct 18 14:52:08.312159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4173/8192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:08 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:09.337870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:09.338523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] [instance: 38f0e7ff-9ce9-4cfa-bac9-50ee20226810] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:09.345064 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:09.345566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:09.346021 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:09.346763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:09.347236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:09.347676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:09.361542 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] HTTP exception thrown: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Request method failure captured: Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 HTTP/1.1 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTruln0rt_OS3qmFcoKHX48qFWOFU__bSEGV2lrDCrpxVVgExZctwhbC6gWwbhDkC9Oj-mzUkJnqooLVra1g_Ufm_FDjEd58qRsyYWcZt_zQXY2nklkUejwZDLsC9Fz78k6DlWWSAj7x8vSMLVJk4G9ljAAvc34ucoGKiEEvvH5vvJKo Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/381041942f024a3fb56e35c99475ff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/381041942f024a3fb56e35c99475ff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_381041942f024a3fb56e35c99475ff61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: 381041942f024a3fb56e35c99475ff61 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1673550477 Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 1b02196b7d35453b8a710ef6f4835dec Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1673550477-project Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '38f0e7ff-9ce9-4cfa-bac9-50ee20226810'} Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:52:09.363213 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Returning 404 to user: Instance 38f0e7ff-9ce9-4cfa-bac9-50ee20226810 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0406434e-3f6c-4219-a85a-c2126fda0799 tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810" status: 404 len: 111 microversion: 2.1 time: 0.032607 Oct 18 14:52:09.368533 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4020/8193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:09 2022] GET /compute/v2.1/servers/38f0e7ff-9ce9-4cfa-bac9-50ee20226810 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:52:13.517581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7cb8cfd6-e4ce-41b4-8e01-1806dfd5e19f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] Calling method '.version_select at 0x7fb33103ef70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:13.579935 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7cb8cfd6-e4ce-41b4-8e01-1806dfd5e19f tempest-TestNetworkAdvancedServerOps-1673550477 tempest-TestNetworkAdvancedServerOps-1673550477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1043223254" status: 202 len: 0 microversion: 2.1 time: 0.068056 Oct 18 14:52:13.580832 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4174/8194] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Oct 18 14:52:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1043223254 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:52:28.227094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:28.227864 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:28.413812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f351ea8c-b8f9-4dbf-afa7-78748953cdbc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'create', calling method: .version_select at 0x7fb3305d2b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1724135525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ASOz2XEuIPwI4uZq4M9FsoN7zxJwvSfd2ltXQRxjpSxElD6LSjWFSQVOM7Yxs2OScDe33zon1WnMO8+6G5iLdlGpL3FL1Lxp4hiAnz3ZN7QUO8rcfIql9Bc6OxFP9hw=="}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:28.431065 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f351ea8c-b8f9-4dbf-afa7-78748953cdbc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for project 163bbf1c864a47e08e6060545462a3a9. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:52:28.436870 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-f351ea8c-b8f9-4dbf-afa7-78748953cdbc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for user 199f47687c2c44b0a97d4bf529bc9957 and project 163bbf1c864a47e08e6060545462a3a9. Resources: {'key_pairs'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:52:28.530367 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f351ea8c-b8f9-4dbf-afa7-78748953cdbc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309814 Oct 18 14:52:28.530978 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4021/8195] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:52:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:52:30.860171 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-494514977", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1724135525", "security_groups": [{"name": "tempest-secgroup-smoke-1511033467"}], "networks": [{"uuid": "75988e47-7c4d-4149-8ea2-455498a425f1"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:30.870661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:30.871351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:30.974037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] validate_networks() for [('75988e47-7c4d-4149-8ea2-455498a425f1', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:52:31.495444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:52:31.495960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:52:31.496591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:52:31.497110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:52:31.497610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:52:31.507300 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:31.507915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:31.508444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:31.509305 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:31.509835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:31.510311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:31.527666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for project 163bbf1c864a47e08e6060545462a3a9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:52:31.532949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for user 199f47687c2c44b0a97d4bf529bc9957 and project 163bbf1c864a47e08e6060545462a3a9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:52:31.545956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:52:31.548319 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:52:31.660724 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-63c0efd5-32ba-4042-85da-e27847bdda5a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804323 Oct 18 14:52:31.661705 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4175/8196] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:52:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:52:31.674228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e4ddc437-f37e-4c46-8678-56fc8746f419 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:31.674973 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e4ddc437-f37e-4c46-8678-56fc8746f419 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:31.745027 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e4ddc437-f37e-4c46-8678-56fc8746f419 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:31.752547 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e4ddc437-f37e-4c46-8678-56fc8746f419 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1246 microversion: 2.1 time: 0.082484 Oct 18 14:52:31.753985 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4022/8197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:31 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:32.778383 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7541989a-c969-4636-a155-b6bd8aac4f9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:32.779051 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7541989a-c969-4636-a155-b6bd8aac4f9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:32.842389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7541989a-c969-4636-a155-b6bd8aac4f9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:32.849465 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7541989a-c969-4636-a155-b6bd8aac4f9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1246 microversion: 2.1 time: 0.076504 Oct 18 14:52:32.850044 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4176/8198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:32 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:33.872238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:33.872862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:33.880402 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:33.880907 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:33.881363 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:33.882090 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:33.883166 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:33.883616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:33.947536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:33.955466 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c2e821a9-6d25-4b68-8ace-172793cf761c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1298 microversion: 2.1 time: 0.087159 Oct 18 14:52:33.960556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4023/8199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:33 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:34.978763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:34.979973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:34.987623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:34.988138 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:34.988594 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:34.989308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:34.989783 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:34.990266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:35.138742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:35.148551 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b65e80c-0bb4-4b58-b150-d989ac1832f3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.173543 Oct 18 14:52:35.162658 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4177/8200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:34 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:35.748412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:35.766240 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:35.766755 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:35.767542 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:35.781553 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] Creating event network-changed:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:52:35.787367 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-8c06f00a-546a-409e-899f-d30d0ecbc597 req-b3270151-4679-4265-877f-7add5f4800cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043183 Oct 18 14:52:35.787983 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4024/8201] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:52:36.172751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:36.173384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:36.180362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.180866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.181322 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:36.182032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.182533 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.182982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:36.319119 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:36.327648 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a548a3ca-9501-4bc4-ba1f-0c36f69ceb8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.158860 Oct 18 14:52:36.328477 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4178/8202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:36 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:37.351650 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:37.352535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:37.359673 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:37.360197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:37.360651 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:37.361358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:37.361825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:37.362301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:37.501554 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:37.508048 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-07d78747-0a44-41f9-959d-3894eb5a5ce0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.160842 Oct 18 14:52:37.508617 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4025/8203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:37 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:38.531993 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:38.532666 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:38.539595 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:38.540099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:38.540554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:38.541258 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:38.541730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:38.542206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:38.677597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:38.686550 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13b26705-c61c-49af-a701-42a14fa99128 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.158476 Oct 18 14:52:38.687123 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4179/8204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:38 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:39.710593 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:39.711164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:39.718246 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:39.718742 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:39.719191 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:39.719885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:39.720354 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:39.720790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:39.864778 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:39.872539 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-81297d1c-b0ea-4118-aa4a-1f4a39145915 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.165972 Oct 18 14:52:39.873126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4026/8205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:39 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:40.899950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:40.900516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:40.907730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:40.912720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:40.912720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:40.912720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:40.912720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:40.912720 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:41.039041 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:41.046932 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23cff060-2314-451c-a3ba-1f34f1ba0c8c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.151128 Oct 18 14:52:41.047515 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4180/8206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:40 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:42.071389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:42.071971 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:42.074316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:42.079128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:42.079615 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:42.080063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:42.080750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:42.081210 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:42.081644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:42.214817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:42.222477 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-def0746e-582c-4f39-8aea-f56403456f44 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.155079 Oct 18 14:52:42.223045 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4027/8207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:42 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:52:43.246214 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:43.246898 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:43.248984 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:43.250612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:43.255671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:43.256206 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:43.256736 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:43.258037 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:43.258559 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:43.259080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:43.404687 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:43.412576 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4feb4b0-cb40-43b1-9030-6504eac2f349 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.171061 Oct 18 14:52:43.413405 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4181/8208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:43 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:43.671016 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "name": "network-vif-plugged", "status": "completed", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:43.681278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:43.684381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:43.684381 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:43.693895 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] Creating event network-vif-plugged:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:52:43.699493 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b97bfdc0-a759-4fae-869a-0793c16f8ba4 req-ae177de2-002e-493d-8d67-d68c67daca4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090835 Oct 18 14:52:43.700102 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4028/8209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:52:44.436217 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:44.436846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:44.443708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:44.444215 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:44.444674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:44.445369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:44.445841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:44.446308 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:44.578625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:44.586414 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee6eb8bb-0b9d-4195-a992-97131c299661 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1372 microversion: 2.1 time: 0.154263 Oct 18 14:52:44.586987 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4182/8210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:44 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:45.610518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:45.611223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:45.617981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.618493 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.618937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.619628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.620091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.620525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.755011 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:45.762852 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3c7885c5-4901-47e1-9e31-fc6b5f47af68 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1557 microversion: 2.1 time: 0.157723 Oct 18 14:52:45.765112 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4029/8211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:45 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:45.786930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:45.787562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:45.794960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.805296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.805296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.805296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.805296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.805296 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.935211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:45.943069 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-080991f6-b059-4530-902d-58b89fc4f42a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1557 microversion: 2.1 time: 0.160048 Oct 18 14:52:45.943637 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4183/8212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:45 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:47.854330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:47.864838 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:47.865331 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:47.865841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:47.877129 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] Creating event network-changed:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:52:47.882179 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-a9ab2266-b457-44b9-a0fe-b79a9522a25c req-cadd4084-0cc2-4d3b-b489-a88c81e846b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032444 Oct 18 14:52:47.883185 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4030/8213] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:54:45.899686 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:54:45.900627 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:54:45.904718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:45.905280 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:45.907366 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:45.908071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=44 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:45.909008 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:54:45.909142 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa/action (ip 10.222.0.27) !!! Oct 18 14:54:45.915966 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:45.917857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:45.917857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:45.917857 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:45.918232 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:45.918570 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:45.944165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lazy-loading 'flavor' on Instance uuid c7495179-1199-4799-a480-63cb7dc9bdaa {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:54:46.490692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57e17ce3-ee18-4c20-8f1e-94c2d6dea662 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa/action" status: 202 len: 0 microversion: 2.1 time: 0.592683 Oct 18 14:54:46.491321 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4184/8214] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:54:45 2022] POST /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:54:46.499341 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:54:46.500183 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:54:46.500867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:46.501635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=36 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:46.502737 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:54:46.502882 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 14:54:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa (ip 10.222.0.27) !!! Oct 18 14:54:46.504222 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 14:54:46.509579 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:46.511886 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:46.518338 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:46.518836 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:46.519282 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:46.519979 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:46.520469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:46.520958 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:46.658528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:46.666616 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-df103c33-b4c0-42dc-a0d3-fa479fdc9444 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.170482 Oct 18 14:54:46.667192 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4031/8215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:46 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:54:47.693207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:47.693923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:47.703882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:47.704386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:47.704888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:47.705548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:47.706020 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:47.706491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:47.710858 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39820. Oct 18 14:54:47.713060 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39818. Oct 18 14:54:47.844981 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:47.852762 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0470be74-3616-478f-9b6f-4f6966983160 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.165237 Oct 18 14:54:47.853376 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4185/8216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:47 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:48.887937 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:48.890023 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:48.902939 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:48.903433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:48.903881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:48.904581 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:48.905044 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:48.905475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:48.911363 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39826. Oct 18 14:54:48.912444 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39828. Oct 18 14:54:49.041637 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:49.049377 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dadb80d9-9f7b-4283-a0b3-24c6298aee28 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.166022 Oct 18 14:54:49.049944 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4032/8217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:48 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:50.073586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:50.074256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:50.081743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:50.082288 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:50.082751 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:50.083461 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:50.083939 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:50.084391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:50.213487 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:50.221887 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71b46db7-441a-4542-aea0-e38494e6b97f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.152224 Oct 18 14:54:50.222505 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4186/8218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:50 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:51.244726 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:51.245351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:51.257127 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:51.258000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:51.258833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:51.260109 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:51.260983 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:51.261786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:51.401413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:51.409507 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-dafa84b9-82f4-4b22-94f2-f5e61ec202a0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.168705 Oct 18 14:54:51.410111 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4033/8219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:51 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:52.432501 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:52.433109 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:52.440542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:52.441040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:52.441495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:52.442227 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:52.442701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:52.443141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:52.583245 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:52.591033 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8007c1df-360e-4bd7-b8c2-923079d22e1f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.162505 Oct 18 14:54:52.591604 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4187/8220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:52 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:53.614562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:53.615298 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:53.621970 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:53.622489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:53.622933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:53.624125 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:53.624601 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:53.625243 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:53.763665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:53.771762 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2414a28c-857e-474c-bd42-9e56cffb5461 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.161147 Oct 18 14:54:53.772343 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4034/8221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:53 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:54.796516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:54.797078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:54.803935 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:54.804430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:54.805030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:54.805724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:54.806223 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:54.806664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:54.937467 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:54.945316 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf1fc834-d6ba-4371-9f62-b49aedbb830a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.153283 Oct 18 14:54:54.945908 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4188/8222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:54 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:55.970105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:55.970715 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:55.977533 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:55.978020 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:55.978492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:55.979177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:55.979646 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:55.980073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:56.111238 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:56.118975 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7df00664-3f64-427f-bcfe-24c11d1c9eee tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.153381 Oct 18 14:54:56.119545 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4035/8223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:55 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:57.143011 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:57.143667 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:57.150626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:57.151128 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:57.151582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:57.152291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:57.153030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:57.153718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:57.286899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:57.294697 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e996bf73-8f8c-459d-ba51-5dfeaf9c64da tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.156298 Oct 18 14:54:57.295288 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4189/8224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:57 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:58.318085 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:58.318750 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:58.325683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:58.326220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:58.327177 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:58.327873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:58.328369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:58.328806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:58.462152 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:58.470790 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-91533d66-b921-48bc-9e5e-aaf2f5dab4d8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1702 microversion: 2.1 time: 0.156622 Oct 18 14:54:58.471374 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4036/8225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:58 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:59.494593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:59.495592 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:59.503198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:59.503679 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:59.504141 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:59.504871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:59.505354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:59.505962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:59.649758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:59.661681 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1e01cd94-35ad-4a85-8f79-1a5cb9518138 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.171009 Oct 18 14:54:59.662930 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4190/8226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:59 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:00.691852 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:00.693070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:00.702423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:00.703352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:00.703806 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:00.704532 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:00.705002 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:00.705443 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:00.855531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:00.863982 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cc3e343a-2a34-4845-b5e4-260e1563c35f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.180536 Oct 18 14:55:00.864556 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4037/8227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:00 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:01.890938 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:01.892294 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:01.905054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:01.905914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:01.906690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:01.907719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:01.909463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:01.910209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.079727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "name": "network-vif-plugged", "status": "completed", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:02.103576 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:02.104313 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:02.104997 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.106365 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:02.121133 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f9bedfe2-c061-4120-b949-78757eeaa520 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.234919 Oct 18 14:55:02.138215 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4191/8228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:01 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:02.139327 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] Creating event network-vif-plugged:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:55:02.139327 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b53deb5f-0be7-4533-8e83-f2f9adcadd61 req-a3c59d29-f4fa-4fef-bc16-19400ba486f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062442 Oct 18 14:55:02.139327 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4038/8229] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:03.174231 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:03.297267 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:03.305200 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a9e161a-bb57-4866-8972-1dd62513ced5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.160189 Oct 18 14:55:03.305771 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4192/8230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:03 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:55:04.331427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:04.332758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:04.339358 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:04.340367 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:04.341311 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:04.342557 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:04.344144 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:04.344839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:04.501903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:04.511369 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-71000ce7-c8dd-4123-8636-c3b99d52f7aa tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.185305 Oct 18 14:55:04.511976 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4039/8231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:04 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:05.536761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:05.537536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:05.545499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:05.546364 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:05.547056 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:05.547991 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:05.548699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:05.549345 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:05.701536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:05.709891 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e28865c0-ed52-47bf-a0a9-3cbfd7820c07 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.177046 Oct 18 14:55:05.722243 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4193/8232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:05 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:06.737686 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:06.738302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:06.744866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:06.745359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:06.746012 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:06.746923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:06.747552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:06.748816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:06.976862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:06.988121 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bd91304-0d6e-4049-87c0-d00856f14317 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.256812 Oct 18 14:55:06.988653 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4040/8233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:06 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:55:08.012230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:08.013730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:08.020980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:08.021486 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:08.021945 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:08.022691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:08.023488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:08.024198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:08.169618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:08.178346 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17282c77-2fc0-4033-9190-a20a884469ac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.170047 Oct 18 14:55:08.184695 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4194/8234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:08 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:09.206795 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:09.208639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:09.216876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:09.217373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:09.217855 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:09.218590 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:09.219084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:09.219528 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:09.444512 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:09.453728 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e98d99ba-0c1c-4ace-8a2a-5f71c179ae39 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.254055 Oct 18 14:55:09.457033 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4041/8235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:09 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:10.484479 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:10.485111 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:10.492101 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:10.492600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:10.493057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:10.493760 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:10.494265 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:10.494708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:10.631985 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:10.640219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b48095c-01aa-4219-bb83-5f2e64bbdddd tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1697 microversion: 2.1 time: 0.160197 Oct 18 14:55:10.652077 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4195/8236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:10 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:11.664827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:11.665439 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:11.672190 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:11.672690 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:11.673135 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:11.673835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:11.674327 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:11.674770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:11.878411 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:11.886406 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b385893d-37d2-4228-ad9e-e0e75cd727c3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1679 microversion: 2.1 time: 0.225523 Oct 18 14:55:11.887126 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4042/8237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:11 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:12.911715 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:12.912354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:12.919316 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:12.919840 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:12.920314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:12.921022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:12.921499 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:12.921950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:13.052182 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:13.059950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10134146-40fc-4b3f-8a5e-5b2481f184d7 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1679 microversion: 2.1 time: 0.152173 Oct 18 14:55:13.061067 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4196/8238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:12 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:14.084474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:14.085038 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:14.092698 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:14.093199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:14.093658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:14.094391 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:14.094866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:14.095310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:14.232096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:14.242004 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b2966a19-d02d-443d-befe-5e721e2cdb30 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1679 microversion: 2.1 time: 0.161468 Oct 18 14:55:14.242639 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4043/8239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:14 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:15.267835 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:15.268465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:15.275955 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.276454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.276909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.277879 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.278378 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.278822 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.410844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:15.418641 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe6b2a21-96f9-4e89-a658-aa9747acdc50 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1622 microversion: 2.1 time: 0.156221 Oct 18 14:55:15.419206 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4197/8240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:15 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:15.441999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:15.442630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:15.449452 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.449942 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.450419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.451114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.451624 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.452046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.493596 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 14:55:15.788304 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bd69aa3f-37b0-4a8b-810c-6535ba4e8874 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa/action" status: 202 len: 0 microversion: 2.1 time: 0.350059 Oct 18 14:55:15.788852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4044/8241] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 14:55:15 2022] POST /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:55:15.796978 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:15.797716 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:15.804135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.804764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.805225 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.806013 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:15.806514 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:15.806956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:15.826863 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:15.940259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:15.948238 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-70cd9d91-3675-41a4-a260-32841f2d862b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1630 microversion: 2.1 time: 0.155127 Oct 18 14:55:15.948819 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4198/8242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:15 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:16.065148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "name": "network-vif-unplugged", "status": "completed", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:16.074834 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:16.075319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:16.075760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:16.088184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.compute.server_external_events [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] Unable to find a host for instance c7495179-1199-4799-a480-63cb7dc9bdaa. Dropping event network-vif-unplugged {{(pid=121009) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 14:55:16.089067 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-708493aa-cd18-4685-aed8-4f5c967a98d5 req-cab7a01c-2da8-444d-8a56-f7dfc183de73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028418 Oct 18 14:55:16.089658 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4045/8243] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 14:55:16.973733 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:16.974409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:16.977044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=31 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:16.982150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:16.983256 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:16.983718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:16.984441 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:16.984917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:16.985368 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:17.123315 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:17.131685 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e99d9914-ba8f-443d-bf2a-8de1def76073 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1630 microversion: 2.1 time: 0.163057 Oct 18 14:55:17.132266 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4199/8244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:16 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:18.156874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:18.157543 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:18.164485 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:18.164980 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:18.165430 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:18.166158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:18.166625 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:18.167058 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:18.169762 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:18.714585 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:18.722685 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-657b8b6b-9c94-44ba-9c6c-1bd9c55017ab tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.570573 Oct 18 14:55:18.723270 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4046/8245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:18 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:19.753026 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:19.754726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:19.763226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:19.764392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:19.764861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:19.765582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:19.766287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:19.766738 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:19.912851 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:19.921645 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad6e9a9b-9fee-48b9-9f6c-58211529f2fc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.174909 Oct 18 14:55:19.922448 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4200/8246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:19 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:20.946361 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:20.947709 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:20.953664 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:20.955549 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:20.956060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:20.956506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:20.957223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:20.957688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:20.958290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:21.103891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:21.112537 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ce570b6b-211b-4a8f-b75e-607884d9c0e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.170072 Oct 18 14:55:21.127958 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4047/8247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:20 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:22.138070 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:22.138792 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:22.145732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:22.146273 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:22.146742 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:22.147535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:22.147959 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:22.148414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:22.298550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:22.306521 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46684ffc-853f-4a87-8420-13431e1ccbcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.172342 Oct 18 14:55:22.307103 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4201/8248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:22 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:23.332702 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:23.333474 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:23.343607 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:23.344120 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:23.344572 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:23.345288 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:23.345760 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:23.346217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:23.501188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:23.509745 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5d55db56-921f-44bd-950c-eb9497c37262 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.183244 Oct 18 14:55:23.510747 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4048/8249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:23 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:24.534829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:24.535551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:24.542705 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:24.543212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:24.543671 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:24.544450 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:24.545456 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:24.545906 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:24.783814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:24.783814 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e91041e-2cc1-4ca4-b31e-b4c119cb6879 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.212212 Oct 18 14:55:24.783814 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4202/8250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:24 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:25.805035 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:25.805642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:25.813814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:25.814355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:25.814802 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:25.815523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:25.816063 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:25.816506 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:25.969356 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:25.977411 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-90d7a28d-8f80-4cb2-9b05-48eaea502505 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.176427 Oct 18 14:55:25.977989 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4049/8251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:25 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:27.003176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:27.003808 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:27.010903 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:27.011414 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:27.011873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:27.012582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:27.013192 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:27.014177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:27.150695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:27.158759 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e003ebc-cfb8-4452-a8bc-4115c330c47e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.159550 Oct 18 14:55:27.159329 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4203/8252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:26 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:28.181626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:28.182364 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:28.190682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:28.191182 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:28.191657 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:28.192362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:28.192825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:28.193268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:28.324721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:28.333492 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-fdbd96ea-d68e-4841-8319-28aa9a5906a3 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.155445 Oct 18 14:55:28.334303 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4050/8253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:28 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:29.358816 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:29.359449 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:29.366268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:29.366777 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:29.367241 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:29.367951 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:29.368429 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:29.368875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:29.500926 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:29.508756 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7810b668-1540-4072-af0b-a9d1fe5ddc3a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.154512 Oct 18 14:55:29.509323 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4204/8254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:29 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:30.533658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:30.534465 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:30.542316 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:30.542825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:30.543270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:30.544005 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:30.544507 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:30.545320 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:30.684559 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:30.693301 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-631dd509-b30b-42cd-b41f-7861e179108c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.163790 Oct 18 14:55:30.693894 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4051/8255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:30 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:31.717115 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:31.718581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:31.726047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:31.726589 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:31.727068 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:31.727790 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:31.728272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:31.728724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:31.867719 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:31.873840 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c920b8d-da53-481d-852b-f4d70e39fd9f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.160826 Oct 18 14:55:31.874494 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4205/8256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:31 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:32.170445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "name": "network-vif-plugged", "status": "completed", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:32.180841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:32.181325 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:32.181764 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:32.192679 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] Creating event network-vif-plugged:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:55:32.197792 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-b7c5af48-be51-421c-a35b-0cc2582495c4 req-dd9c6163-9ad7-4f4a-b7cb-3f59576d71ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Oct 18 14:55:32.198425 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4052/8257] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:55:32.897558 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:32.898283 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:32.906091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:32.906596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:32.907050 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:32.907752 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:32.908262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:32.908701 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:33.039369 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:33.047257 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5dd7adb6-c00e-4394-9c0b-18f5f3f1dc7d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.153632 Oct 18 14:55:33.047833 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4206/8258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:32 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:34.072626 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:34.075956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:34.080401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:34.080890 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:34.081336 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:34.082189 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:34.082659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:34.083095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:34.224851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:34.233004 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ab58e9b-c7c2-46d3-b2f1-fdd1278a4ad0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1688 microversion: 2.1 time: 0.165527 Oct 18 14:55:34.234197 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4053/8259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:34 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:35.259732 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:35.260370 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:35.267781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:35.268295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:35.268762 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:35.269470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:35.269960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:35.270443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:35.400482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:35.408895 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4886e411-95f0-4abc-af6a-0422925dc38e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1675 microversion: 2.1 time: 0.153154 Oct 18 14:55:35.409458 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4207/8260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:35 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:56:49.443823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=13 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:49.451976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=43 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=17 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=56 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:56:49.452135 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 14:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 14:56:49.452951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:49.452951 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:56:49.462821 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:49.463434 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:49.463945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:49.465175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:49.465727 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:49.466287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:49.495164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:56:49.521465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:56:49.532491 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:49.543156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:49.543156 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:49.545593 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] Creating event network-changed:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:56:49.551053 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d059b5bb-4786-4b35-aea7-65fb0e1567c5 req-1c36c562-0dec-44d5-984e-677a1fee72d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107522 Oct 18 14:56:49.551627 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4208/8261] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:56:49.887058 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-58b068d9-3c68-4d2c-98b2-0ddbbf8fc347 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 204 len: 0 microversion: 2.1 time: 0.445503 Oct 18 14:56:49.891225 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4054/8262] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 14:56:49 2022] DELETE /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:56:49.897363 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:49.898112 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:56:49.904621 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:49.905135 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:49.905591 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:49.906535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:49.907009 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:49.907664 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:50.051362 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:56:50.059341 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eceb2773-ccbd-4cec-9e5c-d7c61addffac tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.166215 Oct 18 14:56:50.061631 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4209/8263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:56:49 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:56:51.084560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:51.085268 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:56:51.093267 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:51.093766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:51.094237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:51.094932 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:51.095392 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:51.095816 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:51.281745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:56:51.289861 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c605a72d-6ae3-4fbe-bd5d-c2d946b89443 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1681 microversion: 2.1 time: 0.209720 Oct 18 14:56:51.291312 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4055/8264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:56:51 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:56:51.991572 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7495179-1199-4799-a480-63cb7dc9bdaa", "name": "network-vif-deleted", "tag": "c2f0e3ff-951d-4696-9c5e-b79184efaa35"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:56:52.001974 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:52.002509 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:52.002963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:52.013967 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] Creating event network-vif-deleted:c2f0e3ff-951d-4696-9c5e-b79184efaa35 for instance c7495179-1199-4799-a480-63cb7dc9bdaa on n-h2-858383-13 Oct 18 14:56:52.019006 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-fb971c3c-7bd3-4a9c-bf2b-068934e7e2a8 req-bd2f117d-90a4-4e4f-9f6f-10b3a053f313 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 Oct 18 14:56:52.019588 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4210/8265] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:56:52.315577 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:52.316941 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:56:52.324314 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:52.324814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:52.327906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:52.327906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:52.327906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:52.327906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:52.362675 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:52.363169 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:52.363619 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:52.364095 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.objects.instance [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lazy-loading 'fault' on Instance uuid c7495179-1199-4799-a480-63cb7dc9bdaa {{(pid=121009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:56:52.407965 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:56:52.416458 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0893900a-f860-4b26-bc44-7b9ba0a0b8d0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 200 len: 1336 microversion: 2.1 time: 0.104831 Oct 18 14:56:52.417046 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4056/8266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:56:52 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:56:53.441602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:53.442295 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: c7495179-1199-4799-a480-63cb7dc9bdaa] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:56:53.448385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:53.448889 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:53.449351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:53.450130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:56:53.450602 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:56:53.451107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:56:53.464921 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] HTTP exception thrown: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Request method failure captured: Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa HTTP/1.1 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTr2lVDRy_9RTSwwXKtt-PxDXxUnSEuxnBfsF8a3E_PMWqU4_HuYNb9tcvTKBzv5KvbWXdnWR1vOVTcyzCfL4ltUhEyGWKed3dT-4vmbqXvxzEGfHI9RHSH7eStqRcG024txdN_bZ0psYY0AmXvrx2jDZk4gBPV3up2gOmwjvY5kSwgw Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 163bbf1c864a47e08e6060545462a3a9 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestShelveInstance-656573515 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestShelveInstance-656573515 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 163bbf1c864a47e08e6060545462a3a9 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestShelveInstance-656573515 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestShelveInstance-656573515-project Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 199f47687c2c44b0a97d4bf529bc9957 Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestShelveInstance-656573515-project Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': 'c7495179-1199-4799-a480-63cb7dc9bdaa'} Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:56:53.466652 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Returning 404 to user: Instance c7495179-1199-4799-a480-63cb7dc9bdaa could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f360663-03e4-4dc3-ba84-cb722c43d9e5 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa" status: 404 len: 111 microversion: 2.1 time: 0.031907 Oct 18 14:56:53.473909 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4211/8267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:56:53 2022] GET /compute/v2.1/servers/c7495179-1199-4799-a480-63cb7dc9bdaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:56:53.706871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1e7f0de7-466a-421d-9b41-edf140b6e445 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '.version_select at 0x7fb335233d30>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:56:53.805557 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1e7f0de7-466a-421d-9b41-edf140b6e445 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1724135525" status: 202 len: 0 microversion: 2.1 time: 0.103333 Oct 18 14:56:53.806180 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4057/8268] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 14:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1724135525 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:56:53.831743 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23bba80b-9d64-4f9d-9f68-a5c7fb547486 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'create', calling method: .version_select at 0x7fb33103e040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1969868931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPhg9YIjuR8+r7LBRFAFyKZhvXH0ZCn3R56g6xsVO+Mh6tJWC+j4/xkou8XRLkrJES+rNGaTyXepcjDz2pr9y+jTuVKckIAtfkp6FoRhlCEhEfYLc8CqnbDzR3MLGRekg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:56:53.847444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-23bba80b-9d64-4f9d-9f68-a5c7fb547486 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for project 163bbf1c864a47e08e6060545462a3a9. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:56:53.852730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-23bba80b-9d64-4f9d-9f68-a5c7fb547486 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for user 199f47687c2c44b0a97d4bf529bc9957 and project 163bbf1c864a47e08e6060545462a3a9. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:56:53.967315 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23bba80b-9d64-4f9d-9f68-a5c7fb547486 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.139120 Oct 18 14:56:53.967315 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4212/8269] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 14:56:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:57:17.437683 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:17.438468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:17.442440 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2007320112", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1969868931", "security_groups": [{"name": "tempest-secgroup-smoke-277431906"}], "networks": [{"uuid": "75988e47-7c4d-4149-8ea2-455498a425f1"}], "block_device_mapping_v2": [{"uuid": "189c8f96-f348-48fc-8908-e9d7b599c1ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:17.556094 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] validate_networks() for [('75988e47-7c4d-4149-8ea2-455498a425f1', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:57:17.979167 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:57:17.979595 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:57:17.980075 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:57:17.980525 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:57:17.980945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:57:17.989707 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:17.990800 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:17.991245 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:17.991976 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:17.992445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:17.992883 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:18.010981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for project 163bbf1c864a47e08e6060545462a3a9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:57:18.016192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Getting quotas for user 199f47687c2c44b0a97d4bf529bc9957 and project 163bbf1c864a47e08e6060545462a3a9. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:57:18.073777 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:57:18.076000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='189c8f96-f348-48fc-8908-e9d7b599c1ab',volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:57:18.483908 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5374334a-a84f-4084-a4ea-83e6b7fd7c87 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.047832 Oct 18 14:57:18.484709 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4058/8270] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:57:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:57:18.494662 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:18.495413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:18.496065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:18.500015 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a70d3108-403a-456e-b76d-812d28c3747c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:18.500646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a70d3108-403a-456e-b76d-812d28c3747c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:18.557160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a70d3108-403a-456e-b76d-812d28c3747c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:18.564825 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a70d3108-403a-456e-b76d-812d28c3747c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1089 microversion: 2.1 time: 0.072114 Oct 18 14:57:18.565535 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4213/8271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:18 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:19.589271 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:19.589849 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:19.596100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:19.596602 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:19.597049 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:19.597748 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:19.598260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:19.598700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:19.681423 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:19.689609 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-e99977d5-0db3-41da-aef6-e276d78645c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1139 microversion: 2.1 time: 0.105306 Oct 18 14:57:19.693937 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4059/8272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:19 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1139 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:20.715168 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:20.715757 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:20.724194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:20.727882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:20.727882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:20.727882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:20.727882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:20.727882 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:20.789770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:20.797838 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a9095d9-48d9-4bd9-920b-0993580d3cf0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1195 microversion: 2.1 time: 0.088423 Oct 18 14:57:20.798373 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4214/8273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:20 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:21.822813 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:21.824187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:21.831158 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:21.835786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:21.835786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:21.835786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:21.835786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:21.835786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:21.991924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:22.000583 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-acc57d2f-4308-4c8d-b30d-b0763f550ee0 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1272 microversion: 2.1 time: 0.182382 Oct 18 14:57:22.001474 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4060/8274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:21 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:22.429828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:22.440187 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:22.440690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:22.441176 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:22.457091 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] Creating event network-changed:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h2-858383-13 Oct 18 14:57:22.463857 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-565eead6-4972-4cae-b738-0930b5e6d77d req-70fbce44-9830-4e1a-8c79-36a03f63625e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106096 Oct 18 14:57:22.464485 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4215/8275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:57:23.025448 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:23.027114 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:23.034096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:23.034759 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:23.035408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:23.036292 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:23.036866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:23.037405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:23.249416 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:23.250400 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-4fe89001-46fb-48e5-8e14-1299f64cb1f2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1272 microversion: 2.1 time: 0.229237 Oct 18 14:57:23.251096 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4061/8276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:23 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:24.276022 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:24.276782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:24.283289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:24.283797 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:24.284259 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:24.284968 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:24.285448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:24.285900 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:24.424944 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:24.433738 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfde9adc-0e49-493f-9dfe-1546a8981a47 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1272 microversion: 2.1 time: 0.163347 Oct 18 14:57:24.434601 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4216/8277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:24 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:25.458217 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:25.459185 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:25.471840 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:25.472372 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:25.472825 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:25.473566 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:25.474199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:25.474644 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:25.605353 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:25.613422 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-852645e0-a4f6-4a20-a3ba-a2562e575d27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1272 microversion: 2.1 time: 0.160205 Oct 18 14:57:25.614031 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4062/8278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:25 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:26.637005 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:26.637642 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:26.644516 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:26.645024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:26.645489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:26.646226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:26.646711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:26.647191 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:26.779495 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:26.787322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ceda991-6489-4b07-8fff-9d40cb157f80 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.154242 Oct 18 14:57:26.787891 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4217/8279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:26 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:27.810688 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:27.811255 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:27.818155 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:27.818649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:27.819100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:27.819804 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:27.820269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:27.820711 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:27.955335 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:27.963162 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d3558ff9-f349-4186-bb14-230c64840edb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.156517 Oct 18 14:57:27.963731 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4063/8280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:27 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:29.033147 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:29.034240 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:29.044986 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:29.045186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:29.045521 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:29.046277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:29.046761 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:29.047389 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:29.186336 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:29.186336 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ba1cfac8-7882-4ace-a794-d4c4621d883c tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.203641 Oct 18 14:57:29.186908 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4218/8281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:28 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:30.209197 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:30.209822 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:30.211743 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:30.212419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:30.218807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:30.219299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:30.219747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:30.220445 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:30.220913 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:30.221351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:30.350030 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:30.357497 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-915594c1-8b01-42bb-9c7e-1d3ccc860a37 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.152223 Oct 18 14:57:30.358175 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4064/8282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:30 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:31.379638 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:31.380277 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:31.383099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:31.388596 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:31.389099 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:31.389555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:31.390291 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:31.390766 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:31.391210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:31.524224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:31.532406 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0469c35e-b45e-436b-96b8-d66a16ab4380 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.156784 Oct 18 14:57:31.532975 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4219/8283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:31 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:32.555278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:32.555953 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:32.562938 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:32.563429 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:32.563877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:32.564573 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:32.565039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:32.565475 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:32.704841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:32.712648 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-65ae0299-324d-4849-8adb-8f8d78fc926f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.161369 Oct 18 14:57:32.713230 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4065/8284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:32 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:57:33.736614 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:33.737264 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:33.744612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:33.748661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:33.748661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:33.748661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:33.749003 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:33.749200 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:33.897635 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:33.905971 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10132d1d-527f-4365-8828-8cdcf4f954b2 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.173450 Oct 18 14:57:33.906574 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4220/8285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:33 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:34.931466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:34.932239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:34.941234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:34.941866 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:34.942531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:34.943426 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:34.943987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:34.944523 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:35.087118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:35.095034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1789d1e3-0863-49ec-8adf-f0321aba1ad6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.168742 Oct 18 14:57:35.095617 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4066/8286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:34 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:36.120855 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:36.121569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:36.129201 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:36.129724 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:36.130216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:36.130940 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:36.131425 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:36.131881 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:36.270544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:36.278691 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0464369-1983-45c6-b77c-284873c0c69e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.161481 Oct 18 14:57:36.279267 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4221/8287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:36 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:36.915115 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "name": "network-vif-plugged", "status": "completed", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:36.926150 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:36.926700 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:36.927138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:36.940070 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] Creating event network-vif-plugged:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h2-858383-13 Oct 18 14:57:36.945532 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-0f0f8807-fed6-4544-a429-3fd44fdfe350 req-b21c1d6a-9be5-45a1-86dd-b059470e6a84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 Oct 18 14:57:36.946167 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4067/8288] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:57:37.305163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:37.306157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:37.317306 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:37.318134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:37.318920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:37.320130 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:37.320923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:37.321721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:37.464247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:37.473041 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-115ba7f7-8a69-4eff-8535-71a874b7edcb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1260 microversion: 2.1 time: 0.174536 Oct 18 14:57:37.473611 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4222/8289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:37 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:38.501086 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:38.501785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:38.508123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:38.508616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:38.509062 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:38.509763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:38.510303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:38.515845 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:38.646004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:38.654317 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-200cc972-19f5-4ffc-97bf-2bee667765cc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1444 microversion: 2.1 time: 0.159144 Oct 18 14:57:38.654905 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4068/8290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:38 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:57:38.677917 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:38.678582 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:38.687626 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:38.688325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:38.688929 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:38.689914 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:38.690620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:38.691221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:38.831612 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:38.839501 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b06fb13a-5ff9-4b4f-8645-453439403f58 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1444 microversion: 2.1 time: 0.165514 Oct 18 14:57:38.840066 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4223/8291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:38 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:41.115175 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:41.127839 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:41.128339 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:41.128785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:41.141168 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] Creating event network-changed:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h2-858383-13 Oct 18 14:57:41.147362 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-fc915341-5a49-4ec2-b401-888a6016420e req-d71f8453-b766-4057-b0b3-12a25087496e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035640 Oct 18 14:57:41.148137 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4069/8292] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:00:07.502733 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:00:07.504699 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:00:07.504699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=24 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:07.505242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=56 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:07.506165 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:00:07.506321 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action (ip 10.222.0.27) !!! Oct 18 15:00:07.507955 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:00:07.508081 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action (ip 10.222.0.27) !!! Oct 18 15:00:07.509600 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:00:07.509715 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action (ip 10.222.0.27) !!! Oct 18 15:00:07.514415 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:07.514969 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:07.532376 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:07.532820 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:07.533284 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:07.534131 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:07.534615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:07.535071 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:07.560269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lazy-loading 'flavor' on Instance uuid 00e34631-920a-4089-b2b1-c95035f61034 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 15:00:07.865366 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cf8d9c2e-560c-4ed0-91b2-f96ea7f9a9b8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action" status: 202 len: 0 microversion: 2.1 time: 0.364375 Oct 18 15:00:07.865957 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4224/8293] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 15:00:07 2022] POST /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:00:07.873201 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:00:07.874398 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:00:07.874924 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:07.875674 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=60 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:07.876862 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:00:07.877017 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 15:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 (ip 10.222.0.27) !!! Oct 18 15:00:07.878302 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:00:07.878438 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 15:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 (ip 10.222.0.27) !!! Oct 18 15:00:07.883163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:07.883873 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:07.893098 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:07.893588 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:07.894032 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:07.894766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:07.895228 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:07.895659 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:08.117518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:08.125396 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-abf74713-fdc8-4183-8bf2-b20ec048de27 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.254394 Oct 18 15:00:08.125967 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4070/8294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:07 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:09.151157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:09.151902 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:09.161421 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:09.161921 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:09.162403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:09.163103 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:09.163574 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:09.164082 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:09.164790 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40392. Oct 18 15:00:09.171159 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40390. Oct 18 15:00:09.352323 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:09.352951 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ae0c5f8-b48c-4231-9058-f9979a81eaea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.207382 Oct 18 15:00:09.353518 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4225/8295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:09 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:10.376422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:10.377029 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:10.387180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:10.387671 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:10.388111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:10.388798 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:10.389260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:10.389689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:10.393879 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40400. Oct 18 15:00:10.396067 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40402. Oct 18 15:00:10.525725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:10.534614 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9678d38f-22e4-4287-b459-68813bb12e97 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.162168 Oct 18 15:00:10.535186 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4071/8296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:10 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:11.558964 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:11.559637 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:11.566465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:11.567181 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:11.567646 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:11.568354 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:11.568825 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:11.569269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:11.702349 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:11.710337 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fa25f6c6-573a-4813-833c-d930905d90d4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.156232 Oct 18 15:00:11.710911 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4226/8297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:11 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:12.733455 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:12.734000 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:12.740842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:12.741326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:12.741766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:12.742487 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:12.742948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:12.743375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:12.880299 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:12.888105 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-48f300f0-8f63-435b-88fa-bc6da64028cf tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.159300 Oct 18 15:00:12.888673 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4072/8298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:12 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:13.912551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:13.913175 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:13.920764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:13.921262 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:13.921718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:13.922443 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:13.922915 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:13.923358 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:14.060028 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:14.067955 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac0b478c-3d4d-4e7e-9e4e-ecf0fad09d3d tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.159305 Oct 18 15:00:14.068527 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4227/8299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:13 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:15.091582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:15.092264 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:15.098943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:15.099496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:15.099943 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:15.100630 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:15.101087 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:15.101516 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:15.243961 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:15.253322 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6bc3cffc-ebd7-453c-a43b-bfeb412dd649 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.166256 Oct 18 15:00:15.253891 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4073/8300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:15 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:16.277960 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:16.278636 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:16.285708 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:16.286254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:16.286758 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:16.287472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:16.287948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:16.288398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:16.420057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:16.428125 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4ab6d6a-ede7-4782-9d95-2c10b5685675 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.154080 Oct 18 15:00:16.428701 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4228/8301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:16 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:17.452290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:17.452918 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:17.459814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:17.460310 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:17.460761 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:17.461456 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:17.461923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:17.462389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:17.598269 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:17.601982 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-28e18f61-3584-4edb-bc3a-0d5a6001a6f4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.154256 Oct 18 15:00:17.602762 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4074/8302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:17 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:18.624782 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:18.625418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:18.632427 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:18.632930 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:18.633391 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:18.634144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:18.634620 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:18.635065 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:18.773403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:18.782272 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0214e19e-cee1-44af-88b5-bdddc1a8b3ec tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.161436 Oct 18 15:00:18.782850 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4229/8303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:18 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:19.813857 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:19.814530 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:19.821545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:19.822036 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:19.822514 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:19.823213 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:19.823678 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:19.824792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:19.957054 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:19.964985 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ec53d47a-40d1-4922-8c62-b610a4e47aea tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.154914 Oct 18 15:00:19.965559 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4075/8304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:19 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:20.988452 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:20.989006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:20.996084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:20.996586 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:20.997040 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:20.997746 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:20.998250 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:20.998697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:21.131074 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:21.139521 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2af7504d-f0d8-4cea-8baa-2e30745d9b31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.155117 Oct 18 15:00:21.140098 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4230/8305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:20 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:22.163438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:22.164060 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:22.171489 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:22.171974 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:22.172417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:22.173108 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:22.173568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:22.173999 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:22.312111 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:22.320010 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ee4ee7a4-2253-4768-aed4-583ad604a166 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.160539 Oct 18 15:00:22.320586 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4076/8306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:22 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:23.344647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:23.345324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:23.352196 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.352711 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.353180 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.353901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.354430 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.354905 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.492728 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:23.501187 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d9b3e1fa-62ca-46cf-8dfd-8d901d153202 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1508 microversion: 2.1 time: 0.160421 Oct 18 15:00:23.501887 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4231/8307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:23 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:23.524763 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:23.526106 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:23.532933 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.533433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.533885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.534649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.535118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.535555 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.565968 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121009) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 15:00:23.686956 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "name": "network-vif-unplugged", "status": "completed", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:23.697242 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.697730 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.698221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.711004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.compute.server_external_events [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] Unable to find a host for instance 00e34631-920a-4089-b2b1-c95035f61034. Dropping event network-vif-unplugged {{(pid=121010) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 15:00:23.711004 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-02a281d0-5a09-45c4-ad32-9b006065d752 req-84c57f56-0cc6-4ee8-b0be-7be775500154 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077543 Oct 18 15:00:23.711478 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4232/8308] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 18 15:00:23.882290 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-32b9d7e3-f79b-45c7-b3a9-3e0b5f80fb3b tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "POST /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action" status: 202 len: 0 microversion: 2.1 time: 0.361291 Oct 18 15:00:23.882909 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4077/8309] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 15:00:23 2022] POST /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:00:23.891160 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:23.891831 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:23.897867 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.898411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.898876 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:23.899593 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:23.900076 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:23.900529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:24.063856 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:24.071934 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9be673fe-245a-43ef-8947-a77751552c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1516 microversion: 2.1 time: 0.184668 Oct 18 15:00:24.072543 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4233/8310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:23 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:25.096006 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:25.096640 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:25.111948 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:25.112457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:25.112903 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:25.113616 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:25.114105 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:25.114545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:25.248123 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:25.256138 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-1153a5aa-6751-4c34-8b53-14f7b72c3943 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1516 microversion: 2.1 time: 0.164099 Oct 18 15:00:25.256799 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4078/8311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:25 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:26.280053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:26.280696 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:26.287544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:26.288053 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:26.288517 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:26.289236 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:26.289713 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:26.290204 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:26.434819 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:26.442764 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4e53c08-4565-4c61-8d38-b0593f6a5a54 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1516 microversion: 2.1 time: 0.167525 Oct 18 15:00:26.443334 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4234/8312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:26 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:27.466966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:27.467621 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:27.474628 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:27.475121 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:27.475568 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:27.476261 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:27.476723 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:27.477163 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:27.610117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:27.618136 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c48ddf23-6e55-494d-82b5-5be620e3adcc tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1516 microversion: 2.1 time: 0.155655 Oct 18 15:00:27.618719 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4079/8313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:27 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:28.641413 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:28.642045 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:28.649718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:28.652091 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:28.653143 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:28.655108 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:28.655403 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:28.657004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:28.790271 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:28.798804 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0658f25-3db3-407f-8f88-f09e7d479e20 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1516 microversion: 2.1 time: 0.161378 Oct 18 15:00:28.799371 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4235/8314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:28 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:29.821682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:29.822343 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:29.829319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:29.829827 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:29.830373 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:29.831309 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:29.831775 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:29.832214 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:29.964260 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:29.972281 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-34286148-d4ee-467a-9057-fafe2e5d612a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1518 microversion: 2.1 time: 0.154608 Oct 18 15:00:29.972859 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4080/8315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:29 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:30.996579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:30.997228 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:31.004254 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:31.004764 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:31.005230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:31.005948 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:31.006470 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:31.006924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:31.143386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:31.151511 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-17fa0006-8201-4940-8e23-b91dc74ecb31 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1518 microversion: 2.1 time: 0.158873 Oct 18 15:00:31.152102 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4236/8316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:30 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:32.177043 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:32.177906 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:32.184699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:32.185805 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:32.186278 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:32.186981 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:32.187441 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:32.187874 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:32.327468 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:32.335508 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-cd0c137b-ce04-4d4d-8d59-5ef68e55b856 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1518 microversion: 2.1 time: 0.162650 Oct 18 15:00:32.336098 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4081/8317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:32 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:33.359418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:33.360064 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:33.367089 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:33.367600 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:33.368075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:33.368799 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:33.369279 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:33.369731 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:33.508911 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:33.516949 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4e8dae9-f04d-453e-864b-f1572c55fee6 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1518 microversion: 2.1 time: 0.161426 Oct 18 15:00:33.517688 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4237/8318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:33 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:34.541037 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:34.541594 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:34.548705 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:34.549206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:34.549662 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:34.550409 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:34.550878 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:34.551318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:34.684140 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:34.692576 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-3ad1f153-a5c3-48f9-af68-54baf79ca756 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.155631 Oct 18 15:00:34.693152 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4082/8319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:34 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:35.717465 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:35.718339 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:35.725073 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:35.725569 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:35.726024 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:35.726750 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:35.727222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:35.727661 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:35.863448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:35.871388 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fb71b46-3102-4718-907c-dfec15e6bf8e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.158602 Oct 18 15:00:35.871952 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4238/8320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:35 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:35.901717 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:35.913216 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:35.917444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:35.917444 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:35.926034 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] Creating event network-changed:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h1-858383-13 Oct 18 15:00:35.929611 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] [f20f4e1b-5676-4600-9827-b3b44f8e74ec] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:00:36.895643 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:36.896272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:36.904854 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:36.905436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:36.905899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:36.906692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:36.907320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:36.908084 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:36.912997 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:36.943167 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] [f20f4e1b-5676-4600-9827-b3b44f8e74ec] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40496. Oct 18 15:00:36.947925 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-ef5fa934-c454-4931-8dd1-5061b7144e9f req-79f7e29a-b21d-4dda-8eb5-a9bda0dd5fef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050350 Oct 18 15:00:36.948555 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4083/8321] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:00:37.061384 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:37.069322 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-29cc7959-b43a-43a0-abbd-4d69771aafeb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.177543 Oct 18 15:00:37.069901 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4239/8322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:36 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:00:38.095517 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:38.096147 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:38.098171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:38.103691 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:38.104180 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:38.104620 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:38.105307 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:38.105766 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:38.106232 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:38.109405 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:38.241790 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:38.250292 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7f24e635-ee85-4a34-b4f7-b796faa053fb tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.160459 Oct 18 15:00:38.250871 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4084/8323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:38 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:39.273597 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:39.274290 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:39.276497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=33 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:39.281995 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:39.282527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:39.282994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:39.283706 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:39.284186 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:39.284639 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:39.417098 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:39.424950 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9bb3aae5-430a-466b-af54-9b1f47869336 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.155409 Oct 18 15:00:39.425525 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4240/8324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:39 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:40.448608 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:40.449239 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:40.455911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:40.456401 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:40.456842 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:40.457535 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:40.457996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:40.458477 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:40.592346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:40.600173 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c1637826-d455-4df1-9573-0b5c9be92403 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.155665 Oct 18 15:00:40.600746 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4085/8325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:40 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:41.626515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:41.627157 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:41.633998 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:41.634536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:41.635002 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:41.635707 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:41.636185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:41.636632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:41.770675 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:41.778918 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5d12741-e9b6-4cfc-ab1e-67b9c420cbb8 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.156401 Oct 18 15:00:41.779766 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4241/8326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:41 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:42.803300 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:42.803871 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:42.811287 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:42.811786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:42.812233 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:42.812929 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:42.813397 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:42.813835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:42.944280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:42.952242 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-53038dd0-b60a-41be-b6fe-bd7df41d138f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.152977 Oct 18 15:00:42.952819 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4086/8327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:42 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:43.975561 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:43.976221 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:43.983793 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:43.984299 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:43.984754 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:43.985453 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:43.985925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:43.986396 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:44.116588 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:44.124892 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-399a63b4-5c0c-4449-ba9e-76e634c2be43 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.153330 Oct 18 15:00:44.125456 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4242/8328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:43 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:45.148237 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:45.148877 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:45.156133 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:45.156631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:45.157084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:45.157785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:45.158291 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:45.158730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:45.291262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:45.299707 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-888a05f4-bd7b-489a-befd-faba2025b565 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.155414 Oct 18 15:00:45.300288 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4087/8329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:45 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:46.323341 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:46.324007 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:46.330928 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:46.331436 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:46.331893 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:46.333229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:46.333717 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:46.334197 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:46.477052 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:46.485461 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c3d17db-abda-4136-8ab9-074c24980c7e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.166311 Oct 18 15:00:46.486178 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4243/8330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:46 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:46.537162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "name": "network-vif-plugged", "status": "completed", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:46.547741 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:46.548234 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:46.548687 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:46.560220 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] Creating event network-vif-plugged:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h1-858383-13 Oct 18 15:00:46.565153 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d0af90a4-7a53-428b-903a-9f756b06a191 req-b6969e84-a52f-4701-9857-8d78ff3b7d16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Oct 18 15:00:46.565742 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4088/8331] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:00:47.515887 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:47.516522 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:47.523324 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:47.523810 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:47.524269 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:47.524971 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:47.525444 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:47.525888 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:47.657469 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:47.665359 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d33c886c-8c07-4966-9dc1-113bf7bf0415 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1574 microversion: 2.1 time: 0.153939 Oct 18 15:00:47.665965 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4244/8332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:47 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:48.689854 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:48.690605 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:48.696823 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:48.697306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:48.697745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:48.698464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:48.698925 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:48.699355 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:48.831538 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:48.839418 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-339bed45-814b-418e-aaf0-021cec8bc94f tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1561 microversion: 2.1 time: 0.155262 Oct 18 15:00:48.839996 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4089/8333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:48 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:27.108994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=9 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:27.109846 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=34 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:27.112408 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=11 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:27.113318 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=31 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:27.115080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:27.115745 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:27.123134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:27.123657 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:27.124677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:27.124837 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:27.125320 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:27.126006 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:27.153651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:02:27.174417 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:02:27.184889 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:27.185725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:27.186073 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:27.199634 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] Creating event network-changed:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h1-858383-13 Oct 18 15:02:27.204820 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-f86ddb70-9620-4790-82a1-48c29822eeed req-09ab1fd8-e0f8-43de-8f7f-483d76822254 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095277 Oct 18 15:02:27.210279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4090/8334] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:02:27.469683 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-30a69e66-2a89-42a4-88a8-7528dd22bd81 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 204 len: 0 microversion: 2.1 time: 0.362731 Oct 18 15:02:27.474162 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4245/8335] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 15:02:27 2022] DELETE /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:02:27.480652 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:27.481527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:27.489039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:27.489536 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:27.490244 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:27.491100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:27.491706 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:27.493347 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:27.628438 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:27.636522 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-f3f652ad-2de8-447f-a3ea-c4dce4c62574 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.161066 Oct 18 15:02:27.637251 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4091/8336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:27 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:28.661785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:28.662550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:28.670695 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:28.671209 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:28.671677 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:28.672409 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:28.672892 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:28.673346 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:28.824536 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:28.832699 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-918649a9-c53a-431c-8560-4133908fa412 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1567 microversion: 2.1 time: 0.175223 Oct 18 15:02:28.833369 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4246/8337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:28 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:29.856660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:29.859192 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:29.864276 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:29.864785 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:29.865236 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:29.865955 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:29.866562 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:29.867004 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:29.894166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e34631-920a-4089-b2b1-c95035f61034", "name": "network-vif-deleted", "tag": "e30aa69a-403b-4eb4-832f-a80a41f50ea4"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:02:29.904550 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:29.905397 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:29.905844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:29.917507 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] Creating event network-vif-deleted:e30aa69a-403b-4eb4-832f-a80a41f50ea4 for instance 00e34631-920a-4089-b2b1-c95035f61034 on n-h1-858383-13 Oct 18 15:02:29.922809 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-a1bbcacd-3097-4eb6-b229-49471eb94d4e req-6a4deb43-4c5e-4769-a59a-bdd0ed6bf207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032383 Oct 18 15:02:29.923482 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4247/8338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:02:29.939833 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:29.948429 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-9844d54c-e677-4aa5-95b0-442b3e875252 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1383 microversion: 2.1 time: 0.095597 Oct 18 15:02:29.950943 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4092/8339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:29 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1383 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:30.973814 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:30.974562 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:30.981526 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:30.982032 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:30.982515 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:30.983222 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:30.983694 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:30.984136 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:31.048044 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:31.056634 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ca493fe4-5af5-4ad7-a4dd-c91ded332d6a tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1220 microversion: 2.1 time: 0.087967 Oct 18 15:02:31.070098 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4248/8340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:30 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:32.080419 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:32.080982 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:32.088040 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:32.088544 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:32.088993 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:32.089710 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:32.090200 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:32.090642 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:32.157148 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:32.165227 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c5a9768-515e-4197-b6a5-64a18035c0c4 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1220 microversion: 2.1 time: 0.088858 Oct 18 15:02:32.165883 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4093/8341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:32 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:33.189210 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:33.189841 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:33.198314 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:33.198829 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:33.199292 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:33.200016 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:33.200489 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:33.200933 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:33.266787 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:33.276103 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1fef67a-96ec-429c-8c74-ca0d38b18c9e tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1220 microversion: 2.1 time: 0.090990 Oct 18 15:02:33.276708 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4249/8342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:33 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:34.300050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:34.300677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:34.307522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:34.308007 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:34.308464 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:34.309161 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:34.309660 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:34.310188 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:34.376946 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199f47687c2c44b0a97d4bf529bc9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163bbf1c864a47e08e6060545462a3a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:02:34.384938 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-0cf9fa01-a983-4615-b7c1-7a4d6dbb1774 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 200 len: 1220 microversion: 2.1 time: 0.088919 Oct 18 15:02:34.385528 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4094/8343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:34 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:02:35.410311 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:35.411104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] [instance: 00e34631-920a-4089-b2b1-c95035f61034] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:02:35.418778 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:35.420566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:35.420566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:35.420566 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:02:35.421021 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:02:35.421472 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:02:35.435219 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] HTTP exception thrown: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Request method failure captured: Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 HTTP/1.1 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTr2lVDRy_9RTSwwXKtt-PxDXxUnSEuxnBfsF8a3E_PMWqU4_HuYNb9tcvTKBzv5KvbWXdnWR1vOVTcyzCfL4ltUhEyGWKed3dT-4vmbqXvxzEGfHI9RHSH7eStqRcG024txdN_bZ0psYY0AmXvrx2jDZk4gBPV3up2gOmwjvY5kSwgw Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: 163bbf1c864a47e08e6060545462a3a9 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestShelveInstance-656573515 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_163bbf1c864a47e08e6060545462a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestShelveInstance-656573515 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: 163bbf1c864a47e08e6060545462a3a9 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestShelveInstance-656573515 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestShelveInstance-656573515-project Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 199f47687c2c44b0a97d4bf529bc9957 Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestShelveInstance-656573515-project Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '00e34631-920a-4089-b2b1-c95035f61034'} Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:02:35.436919 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Returning 404 to user: Instance 00e34631-920a-4089-b2b1-c95035f61034 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:02:35.445692 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b968b34e-6865-4e40-b715-7b7b7a8635e1 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034" status: 404 len: 111 microversion: 2.1 time: 0.032057 Oct 18 15:02:35.452787 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4250/8344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:02:35 2022] GET /compute/v2.1/servers/00e34631-920a-4089-b2b1-c95035f61034 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:02:35.658898 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-876aad45-057e-44fb-9251-cd8ceb924746 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] Calling method '.version_select at 0x7fb32bc3cca0>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:02:35.745464 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-876aad45-057e-44fb-9251-cd8ceb924746 tempest-TestShelveInstance-656573515 tempest-TestShelveInstance-656573515-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1969868931" status: 202 len: 0 microversion: 2.1 time: 0.091249 Oct 18 15:02:35.746075 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4095/8345] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 15:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1969868931 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 15:02:57.706224 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:57.707199 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:57.903325 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e87f72d-7255-452a-b276-27fd4593111a tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Action: 'create', calling method: .version_select at 0x7fb3304a11f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1944054614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv8e3MDPdyVVrpFShEKEfeqxC4jj0x3oD5GQp0/CALO7/FdlzHBGro9EvAV3lSxJVrgB3fDIoC64gMY036j1cMFUaLhVWaLiJmoUCz9t7EOO/c/NFtSSAy3b0iw5m2h7A=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:02:57.919847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4e87f72d-7255-452a-b276-27fd4593111a tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for project a10902613e0b4f14afc5a1792bec8efd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:02:57.925134 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-4e87f72d-7255-452a-b276-27fd4593111a tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for user 7283c557c7bd45fab6b08b3dc3bbc9eb and project a10902613e0b4f14afc5a1792bec8efd. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:02:58.019800 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e87f72d-7255-452a-b276-27fd4593111a tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.318934 Oct 18 15:02:58.020335 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4251/8346] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 18 15:02:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:03:00.812082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-775656716", "imageRef": "8cd3436a-01fb-4325-a6ee-cd057c374be6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1944054614", "security_groups": [{"name": "tempest-secgroup-smoke-1852467415"}], "networks": [{"uuid": "8ed41809-9311-48e0-b283-62d6cb929f1d"}]}} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:03:00.822876 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=26 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:00.823531 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:00.919963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.network.neutron [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] validate_networks() for [('8ed41809-9311-48e0-b283-62d6cb929f1d', None, None, None, None, None)] {{(pid=121009) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 15:03:01.375891 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Flavor limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:03:01.376215 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Image limits 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:03:01.376780 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Flavor pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:03:01.377117 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Image pref 0:0:0 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:03:01.377539 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.virt.hardware [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:03:01.386639 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:01.387071 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:01.387522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:01.388259 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:01.388725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:01.389162 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:01.408433 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for project a10902613e0b4f14afc5a1792bec8efd. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:03:01.415909 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.quota [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for user 7283c557c7bd45fab6b08b3dc3bbc9eb and project a10902613e0b4f14afc5a1792bec8efd. Resources: {'cores', 'instances', 'ram'} {{(pid=121009) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:03:01.426984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Going to run 1 instances... {{(pid=121009) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:03:01.429326 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8cd3436a-01fb-4325-a6ee-cd057c374be6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121009) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:03:01.561125 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-49fff0c2-0945-4f4a-80cf-ca33b06e47b2 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753107 Oct 18 15:03:01.568435 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4096/8347] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 15:03:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:03:01.573454 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60b8fe20-1586-4918-aabd-39cea6750811 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:01.574681 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60b8fe20-1586-4918-aabd-39cea6750811 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:01.634560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-60b8fe20-1586-4918-aabd-39cea6750811 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:01.643284 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60b8fe20-1586-4918-aabd-39cea6750811 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1248 microversion: 2.1 time: 0.073897 Oct 18 15:03:01.644134 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4252/8348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:01 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:02.669497 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:02.670460 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:02.677792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:02.678515 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:02.680308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:02.680308 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:02.681362 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:02.681817 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:02.757689 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:02.765684 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-44d7fbc3-d728-445d-819b-e3b899104279 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1252 microversion: 2.1 time: 0.102515 Oct 18 15:03:02.766403 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4097/8349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:02 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1252 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:03.788895 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:03.789543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:03.796428 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:03.796949 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:03.797411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:03.798145 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:03.798625 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:03.799075 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:03.879673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:03.889003 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8d063eb3-d8cd-47f8-8f20-8e6efd8070aa tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1308 microversion: 2.1 time: 0.103976 Oct 18 15:03:03.905087 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4253/8350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:03 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:04.911987 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:04.912713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:04.920984 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:04.921415 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:04.921862 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:04.922599 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:04.923066 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:04.923658 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:05.135908 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:05.144020 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-35d137b7-3c5a-4460-abb1-2d35ba22755b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.235926 Oct 18 15:03:05.144613 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4098/8351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:04 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:05.673982 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:03:05.685165 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:05.685674 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:05.686185 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:05.697192 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] Creating event network-changed:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:03:05.702867 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-983799bf-0070-4183-b35d-b16a9f1addc3 req-c12b7083-fc6b-47be-b8e0-52a98a92f66c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032242 Oct 18 15:03:05.703311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4254/8352] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:03:06.171618 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:06.172410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:06.179296 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:06.179793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:06.180235 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:06.180923 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:06.181412 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:06.181843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:06.420301 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:06.428423 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a8c46e74-fbec-4c09-ace3-2725c2011cc7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.260601 Oct 18 15:03:06.429057 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4099/8353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:06 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:07.455030 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:07.455404 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:07.462229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:07.462852 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:07.463207 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:07.463925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:07.464410 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:07.464860 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:07.601632 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:07.609842 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ce3d7f4b-c9db-485c-aa3a-51713824ec70 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.160695 Oct 18 15:03:07.610469 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4255/8354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:07 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:08.633393 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:08.637257 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:08.640931 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:08.641420 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:08.641867 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:08.642582 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:08.643039 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:08.643550 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:08.784359 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:08.792353 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-814cb782-f59c-4655-97fc-2b18f08127f6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.163483 Oct 18 15:03:08.792932 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4100/8355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:08 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:09.816497 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:09.817054 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:09.823875 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:09.824385 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:09.824847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:09.825555 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:09.826035 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:09.826508 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:09.955263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:09.963101 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3009c024-97c6-41e7-80d4-43a0ce2b36dc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.150992 Oct 18 15:03:09.963676 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4256/8356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:09 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:10.987225 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:10.987963 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:10.994100 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:10.994603 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:10.995047 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:10.995788 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:10.996206 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:10.996636 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:11.130428 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:11.138689 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2092e8c8-b357-49e2-a8a6-38df1ac79de6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.155621 Oct 18 15:03:11.139265 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4101/8357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:10 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:12.161967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:12.162669 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:12.165973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:12.171247 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:12.171763 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:12.172230 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:12.172946 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:12.173482 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:12.173934 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:12.309083 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:12.316777 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a190c4cf-1de8-4986-a841-47601c3bcdab tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.159061 Oct 18 15:03:12.317350 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4257/8358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:12 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:12.567966 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "name": "network-vif-plugged", "status": "completed", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:03:12.573050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:12.573730 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=6 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:12.579858 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:12.580346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:12.580792 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:12.592566 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] Creating event network-vif-plugged:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:03:12.597813 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-16c5b942-eb0f-474d-8399-4232ed5c94a9 req-1a5219bc-1835-463a-a8ac-824692ffe4d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Oct 18 15:03:12.598195 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4102/8359] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:03:13.339962 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:13.340647 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:13.347484 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:13.347989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:13.348445 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:13.349144 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:13.349619 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:13.350078 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:13.482989 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:13.490827 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4b0d5a9-a333-4788-b9f4-88ce41a07da3 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1374 microversion: 2.1 time: 0.154765 Oct 18 15:03:13.491397 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4258/8360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:13 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:14.514534 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:14.515253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:14.522128 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:14.522631 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:14.523091 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:14.527469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:14.527469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:14.527469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:14.657050 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:14.665383 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-7c167c38-2f5d-46b3-a691-79e2ff4a42b6 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1559 microversion: 2.1 time: 0.156356 Oct 18 15:03:14.665966 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4103/8361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:14 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:14.688072 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:03:14.688704 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:03:14.695973 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:14.696485 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:14.696947 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:14.697697 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:14.698198 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:14.698678 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:14.837922 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:03:14.846151 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-084be826-1543-4597-a2d5-6a80952a8d3f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1559 microversion: 2.1 time: 0.161907 Oct 18 15:03:14.846732 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4259/8362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:03:14 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:03:17.156682 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:03:17.167635 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:03:17.168118 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:03:17.168558 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:03:17.179666 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] Creating event network-changed:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:03:17.185029 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-6a99c68d-fd72-47cc-a094-3eaff212ee3a req-110adeec-f1b9-4825-bd3d-942dd9d3d73d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Oct 18 15:03:17.185578 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4104/8363] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:05:14.492248 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:05:14.493183 n-d-858383-13 devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 15:05:14.493753 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:14.494560 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=38 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:14.495451 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:05:14.495597 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818/action (ip 10.222.0.27) !!! Oct 18 15:05:14.497449 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:05:14.497573 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818/action (ip 10.222.0.27) !!! Oct 18 15:05:14.499351 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 15:05:14.499461 n-d-858383-13 devstack@n-api.service[121010]: Tue Oct 18 15:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818/action (ip 10.222.0.27) !!! Oct 18 15:05:14.505451 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1800296714"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:14.508411 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:14.517866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:14.518418 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:14.518873 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:14.519613 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:14.520226 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:14.520673 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:15.052865 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-038db039-1e6b-4c25-bf91-ed6d78637076 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "POST /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818/action" status: 202 len: 0 microversion: 2.1 time: 0.562442 Oct 18 15:05:15.053607 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4260/8364] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 15:05:14 2022] POST /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:05:21.007886 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:05:21.008719 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 15:05:21.009319 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:21.010509 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=42 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:21.011968 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:05:21.012119 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 15:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 15:05:21.013652 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 15:05:21.014511 n-d-858383-13 devstack@n-api.service[121009]: Tue Oct 18 15:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 18 15:05:21.025527 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "name": "network-vif-plugged", "status": "completed", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:21.038888 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:21.039614 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:21.040205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:21.057850 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] Creating event network-vif-plugged:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:05:21.066631 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-811ffd9b-9a60-4cb2-9150-49d391a3fe23 req-ccd21fe2-6d28-49b6-bd39-aaffc9e7af39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057687 Oct 18 15:05:21.067680 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4105/8365] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:05:30.710304 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:30.711107 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:30.715166 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-47236988", "imageRef": "9c395138-a8d7-414b-b7fe-01efbe8770db", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1944054614", "security_groups": [{"name": "tempest-secgroup-smoke-1852467415"}], "networks": [{"uuid": "8ed41809-9311-48e0-b283-62d6cb929f1d"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:30.738789 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae83d2ca-7ccd-4639-81ed-f6635e0fab94] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40966. Oct 18 15:05:30.739615 n-d-858383-13 devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] [1fd4b88c-e097-4515-a08b-446d0605cae4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40964. Oct 18 15:05:30.828216 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] validate_networks() for [('8ed41809-9311-48e0-b283-62d6cb929f1d', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 15:05:31.254386 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 15:05:31.254828 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 15:05:31.255351 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 15:05:31.255781 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 15:05:31.256212 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 15:05:31.265544 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:31.266042 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:31.266527 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:31.267272 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:31.267747 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:31.268195 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:31.289293 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for project a10902613e0b4f14afc5a1792bec8efd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 15:05:31.294616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.quota [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Getting quotas for user 7283c557c7bd45fab6b08b3dc3bbc9eb and project a10902613e0b4f14afc5a1792bec8efd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 15:05:31.306950 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 15:05:31.309463 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c395138-a8d7-414b-b7fe-01efbe8770db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 15:05:31.447007 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-864fa11b-8db6-4e2c-8bb4-788a1c365152 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.738790 Oct 18 15:05:31.447664 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4261/8366] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 15:05:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 15:05:31.466770 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-d699c8d7-a6e0-4f30-966b-a30f88a109dd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:31.467492 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-d699c8d7-a6e0-4f30-966b-a30f88a109dd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:31.481802 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40982. Oct 18 15:05:31.486962 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40984. Oct 18 15:05:31.582896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-d699c8d7-a6e0-4f30-966b-a30f88a109dd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:31.589900 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-d699c8d7-a6e0-4f30-966b-a30f88a109dd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1247 microversion: 2.1 time: 0.132891 Oct 18 15:05:31.590539 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4106/8367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:31 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1247 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:32.616287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-959a7910-fcc8-4d7d-adfd-aea4847b1e72 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:32.616287 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-959a7910-fcc8-4d7d-adfd-aea4847b1e72 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:32.668772 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-959a7910-fcc8-4d7d-adfd-aea4847b1e72 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:32.675749 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-959a7910-fcc8-4d7d-adfd-aea4847b1e72 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1247 microversion: 2.1 time: 0.066926 Oct 18 15:05:32.676311 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4262/8368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:32 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:33.699070 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-c97cdf62-c594-42bd-a635-1eb0079dd240 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:33.699725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-c97cdf62-c594-42bd-a635-1eb0079dd240 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:33.754253 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-c97cdf62-c594-42bd-a635-1eb0079dd240 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:33.761233 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-c97cdf62-c594-42bd-a635-1eb0079dd240 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1247 microversion: 2.1 time: 0.066070 Oct 18 15:05:33.761803 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4107/8369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:33 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1247 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:34.785211 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-43e42265-d22f-455f-b993-78c687cc4aa7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:34.785765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-43e42265-d22f-455f-b993-78c687cc4aa7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:34.844057 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-43e42265-d22f-455f-b993-78c687cc4aa7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:34.850965 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-43e42265-d22f-455f-b993-78c687cc4aa7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1247 microversion: 2.1 time: 0.069994 Oct 18 15:05:34.851533 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4263/8370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:34 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:35.066346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "name": "network-vif-unplugged", "status": "completed", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:35.076074 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:35.076552 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:35.076989 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:35.088332 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] Creating event network-vif-unplugged:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:05:35.093970 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-2b7b9540-6bc7-40e1-a21c-46e74d141e85 req-7e966bd2-7528-4a1b-aca6-8b057f0729a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090722 Oct 18 15:05:35.094577 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4108/8371] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:05:35.874069 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:35.874744 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:35.882360 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:35.882861 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:35.883318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:35.884080 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:35.884556 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:35.885004 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:35.949318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:35.957604 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94990080-219d-41f4-82c3-0738423a77a9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1251 microversion: 2.1 time: 0.087770 Oct 18 15:05:35.958193 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4264/8372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:35 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:36.983205 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:36.984149 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:36.992096 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:36.993303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:36.993758 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:36.994524 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:36.994990 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:36.995427 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:37.072413 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:37.080951 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-afa2309c-2f1c-4e70-9e10-60f7ebce1383 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1299 microversion: 2.1 time: 0.103622 Oct 18 15:05:37.081524 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4109/8373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:36 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:38.107534 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:38.108980 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:38.114535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:38.115178 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:38.115651 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:38.116375 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:38.116864 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:38.117318 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:38.181432 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:38.189423 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4f2024c-202b-4da9-9231-b14576dd371d tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1305 microversion: 2.1 time: 0.088123 Oct 18 15:05:38.189947 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4265/8374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:38 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:39.213369 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:39.214814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:39.224739 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:39.225676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:39.226330 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:39.227195 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:39.228494 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:39.229082 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:39.379896 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:39.391180 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-b4cb1b39-2afd-4017-b39d-66dcc0e64267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.182077 Oct 18 15:05:39.400681 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4110/8375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:39 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:40.428194 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:40.430551 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:40.443844 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:40.445100 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:40.445253 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:40.446047 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:40.446618 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:40.447132 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:40.603683 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:40.612000 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03396324-2e11-421a-980c-439598981b81 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.188068 Oct 18 15:05:40.612610 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4266/8376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:40 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:41.636270 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:41.636945 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:41.644922 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:41.649598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:41.649598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:41.649598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:41.649598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:41.649598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:41.802732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:41.810533 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-59404c79-4211-486f-b0eb-bfe04cf664ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.178182 Oct 18 15:05:41.811654 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4111/8377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:41 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:42.834146 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:42.834718 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:42.836576 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:42.843263 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:42.843765 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:42.844219 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:42.844923 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:42.845395 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:42.845838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:43.020094 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:43.029299 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cc35f65-c4b4-4371-8c56-5e256324e809 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.199159 Oct 18 15:05:43.030674 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4267/8378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:42 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:44.076466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:44.080829 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:44.087130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell0:SELECT=4 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:44.091088 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:44.091627 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:44.092084 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:44.092814 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:44.093289 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:44.093737 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:44.245346 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:44.261425 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-55fd715c-2b4b-4654-8299-b34a3e075576 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.203356 Oct 18 15:05:44.263861 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4112/8379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:44 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:45.290920 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:45.292303 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:45.301688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:45.303535 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:45.306459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:45.306459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:45.306459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:45.306459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:45.306459 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:45.453110 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:45.466306 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67e2aaf8-0771-45a6-a974-d34917681165 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.181726 Oct 18 15:05:45.467062 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4268/8380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:45 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:46.489404 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:46.490831 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:46.500765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:46.500765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:46.500765 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:46.501159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:46.505097 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:46.506589 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:46.656387 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:46.664185 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-5b02df31-6ecf-4cf3-9085-a23db9009798 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.179209 Oct 18 15:05:46.664867 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4113/8381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:46 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:47.688122 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:47.688824 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:47.695901 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:47.696439 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:47.696899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:47.697615 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:47.698126 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:47.698579 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:47.840542 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:47.848531 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6e0af89-96eb-4329-8cf3-522bf85e12bc tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.164441 Oct 18 15:05:47.849130 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4269/8382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:47 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:48.152290 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591ca997-34ca-458a-a290-fead67062169", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:48.163699 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:48.164130 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:48.164570 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:48.175687 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] Creating event network-changed:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:05:48.180667 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-d1cbe28e-2b2e-4ee5-ad42-5915baff37d0 req-238e169c-ec0e-433e-966f-aad21d64c954 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032144 Oct 18 15:05:48.181279 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4114/8383] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:05:48.873090 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:48.874503 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:48.882623 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:48.883310 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:48.883770 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:48.884749 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:48.885419 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:48.885931 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:49.021784 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:49.030268 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a56c518-2286-4a25-8e19-4441589f04ac tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.161072 Oct 18 15:05:49.030843 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4270/8384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:48 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:50.055773 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:50.056518 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:50.063352 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:50.063843 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:50.064297 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:50.064992 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:50.065457 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:50.065893 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:50.198560 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:50.206279 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bcf2185f-bde3-4184-bd76-afc40bcb4bfd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.155621 Oct 18 15:05:50.206860 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4115/8385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:50 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:51.229616 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:51.230286 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:51.237337 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:51.237847 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:51.238407 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:51.239183 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:51.239689 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:51.240139 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:51.376104 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:51.383912 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66697a42-145b-439f-b277-1f122976c267 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.158946 Oct 18 15:05:51.384497 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4271/8386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:51 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:52.408340 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:52.409001 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:52.415885 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:52.416368 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:52.416812 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:52.417496 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:52.417956 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:52.418407 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:52.555911 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:52.563759 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-a550db76-047c-4bd7-9142-bf8f63913d30 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.160225 Oct 18 15:05:52.564343 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4116/8387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:52 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:53.593229 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:53.593849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:53.600849 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:53.603925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:53.603925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:53.603925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:53.603925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:53.603925 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:53.741488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:53.749809 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-795a6430-db01-4334-938d-ec7571127701 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.160671 Oct 18 15:05:53.750186 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4272/8388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:53 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:53.765643 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591ca997-34ca-458a-a290-fead67062169", "name": "network-vif-plugged", "status": "completed", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:53.776280 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:53.776776 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:53.777221 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:53.789042 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] Creating event network-vif-plugged:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:05:53.794277 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-942b8ab2-9644-4fe2-876a-9c9dcfe5e0bd req-b39aea2d-42a0-45c9-9b17-f55de88a1218 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Oct 18 15:05:53.794923 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4117/8389] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:05:54.772721 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:54.773268 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:54.780150 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:54.780634 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:54.781343 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:54.782046 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:54.782548 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:54.782994 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:54.912702 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:54.921080 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b300da78-b6b7-4960-9680-310a37cf08eb tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1373 microversion: 2.1 time: 0.152327 Oct 18 15:05:54.921665 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4273/8390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:54 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:55.946159 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:55.946881 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:55.953154 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:55.953649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:55.954126 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:55.954835 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:55.955302 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:55.955740 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:56.094421 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:56.098237 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-ba4f664f-9aed-4048-9abf-bdf546923d2e tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1558 microversion: 2.1 time: 0.157264 Oct 18 15:05:56.099029 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4118/8391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:55 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:56.121289 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:05:56.121963 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:05:56.129302 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:56.131529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:56.131529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:56.131529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:56.131529 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:56.131909 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:56.268699 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:05:56.276420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3b067b1-88a1-471e-b592-15bd8eed411b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1558 microversion: 2.1 time: 0.159006 Oct 18 15:05:56.280487 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4274/8392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:05:56 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:05:58.212786 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591ca997-34ca-458a-a290-fead67062169", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:05:58.223103 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:05:58.223807 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:05:58.228466 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:05:58.236153 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] Creating event network-changed:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:05:58.241312 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-41bad342-ff8c-41b5-afd7-86c397d7a147 req-ea276da3-5d84-41e6-bb0b-d80384da1280 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088688 Oct 18 15:05:58.241914 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4119/8393] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:25.486493 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:25.487298 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=68 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:25.492266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-422262148"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:25.494690 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:25.500821 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:25.506891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:25.506891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:25.506891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:25.506891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:25.506891 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:25.936508 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0e4c75f-8e03-4bdd-9277-551217636f18 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "POST /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169/action" status: 202 len: 0 microversion: 2.1 time: 0.451740 Oct 18 15:07:25.937159 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4275/8394] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 18 15:07:25 2022] POST /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 15:07:32.199734 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 15:07:32.201474 n-d-858383-13 devstack@n-api.service[121009]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 18 15:07:32.202351 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=34 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:32.203375 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_cell1:SELECT=58 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:32.221303 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591ca997-34ca-458a-a290-fead67062169", "name": "network-vif-plugged", "status": "completed", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:32.231732 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:32.232377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:32.232927 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:32.245868 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] Creating event network-vif-plugged:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:07:32.251147 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-9835f51d-0eb1-4878-8193-ab7609495dfa req-6fcb307e-3296-4b0a-b4b2-fb53fb8c139f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053457 Oct 18 15:07:32.251758 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4120/8395] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:42.413680 n-d-858383-13 devstack@n-api.service[121009]: DEBUG dbcounter [-] [121009] Writing DB stats nova_api:SELECT=2 {{(pid=121009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:42.414333 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:42.414958 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:42.417967 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:42.418633 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591ca997-34ca-458a-a290-fead67062169", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:42.418838 n-d-858383-13 devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:42.424587 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:42.425803 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:42.425896 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:42.426688 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:42.427163 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:42.427610 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:42.431104 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:42.431598 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:42.432046 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:42.444993 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] Creating event network-changed:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:07:42.456060 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [71a4b2f8-d417-4494-a616-0e845ebed6b7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41302. Oct 18 15:07:42.458178 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-5f8a93a0-e021-4187-852c-fa6bc1819ef0 req-c36323d7-c6d1-4874-9ff3-8d45c4fc5b4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046409 Oct 18 15:07:42.458381 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:07:42.458792 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4121/8396] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:07:42.763502 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75a8fc7c-9e88-476e-8a63-4a49cd68fefd tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 204 len: 0 microversion: 2.1 time: 0.354071 Oct 18 15:07:42.764318 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4276/8397] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 15:07:42 2022] DELETE /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:07:42.773519 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:42.774462 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:42.776744 n-d-858383-13 devstack@n-api.service[121009]: INFO oslo.messaging._drivers.impl_rabbit [-] [fda578f7-bcdd-4838-b97c-9dcf1ab24567] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41300. Oct 18 15:07:42.782751 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:42.783223 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:42.783847 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:42.784724 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:42.785199 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:42.785725 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:42.921820 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:42.930190 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-99d920f3-550a-4c90-b990-90094edaf16b tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1683 microversion: 2.1 time: 0.161051 Oct 18 15:07:42.930773 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4122/8398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:42 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 15:07:43.954543 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:43.955776 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:43.962883 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:43.963398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:43.963866 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:43.964581 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:43.965063 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:43.965518 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:44.098285 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:44.106321 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f66597bb-ae0f-4cac-a4a7-5a14edbf1725 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1683 microversion: 2.1 time: 0.156028 Oct 18 15:07:44.107125 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4277/8399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:43 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:07:44.210003 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591ca997-34ca-458a-a290-fead67062169", "name": "network-vif-unplugged", "status": "completed", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:44.221469 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:44.221962 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:44.222432 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:44.233647 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] Creating event network-vif-unplugged:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:07:44.239138 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-7eb5689b-b291-4500-9f68-39298c14d0a3 req-06893c33-f729-4c28-aa10-13cea4f7f125 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032931 Oct 18 15:07:44.239852 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4123/8400] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:45.092266 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591ca997-34ca-458a-a290-fead67062169", "name": "network-vif-deleted", "tag": "0c2dec11-7db1-48aa-8312-36b99481a12c"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:45.102488 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:45.102990 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:45.103446 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:45.115173 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] Creating event network-vif-deleted:0c2dec11-7db1-48aa-8312-36b99481a12c for instance 591ca997-34ca-458a-a290-fead67062169 on n-h1-858383-13 Oct 18 15:07:45.120223 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3b3f5bba-c63e-4a8f-bc47-6bd1c55cf942 req-7a8080c9-dc33-4cc1-b75f-2b8e0ab3a092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086196 Oct 18 15:07:45.120826 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4278/8401] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:45.131721 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:45.132431 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:45.138747 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:45.139220 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:45.139665 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:45.140389 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:45.140851 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:45.141283 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:45.211138 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:45.226207 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-bc5bb35b-8f4d-41db-b5d9-03005250ca5f tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 200 len: 1496 microversion: 2.1 time: 0.099056 Oct 18 15:07:45.227355 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4124/8402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:45 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 1496 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:07:46.263507 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:46.264248 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 591ca997-34ca-458a-a290-fead67062169] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:46.271173 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:46.271686 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:46.272177 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:46.272924 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:46.273434 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:46.273884 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:46.289420 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] HTTP exception thrown: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Request method failure captured: Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 HTTP/1.1 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Accept: application/json Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Accept-Encoding: identity Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Connection: close Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Content-Length: 0 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Content-Type: application/json Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Host: 10.222.0.27 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: Openstack-System-Scope: None Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.12 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjTsAbIRUlTEuyB-pWSyZTt3qpVeGA41WOviJtie0khOR7CjUDldvUnAnoChzkSh9PrIuGlivblub70t-6OnfMkekn4DZ0BVbzqbzVR-rr2yxDGwEzUKCDDElSe0jhc-_olCqx1j9DZgsOYNAkOg1wZLLQ610EvD4vcvYfPy9UX541i7s Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Id: None Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Domain-Name: None Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Identity-Status: Confirmed Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Is-Admin-Project: True Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Id: default Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Domain-Name: Default Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Id: a10902613e0b4f14afc5a1792bec8efd Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Project-Name: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Role: member,reader Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Roles: member,reader Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Id: a10902613e0b4f14afc5a1792bec8efd Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-User: tempest-TestSnapshotPattern-1377280952-project Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Id: default Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-User-Domain-Name: Default Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-User-Id: 7283c557c7bd45fab6b08b3dc3bbc9eb Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: X-User-Name: tempest-TestSnapshotPattern-1377280952-project Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: method: > Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: exception: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: action_args: {'id': '591ca997-34ca-458a-a290-fead67062169'} Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:07:46.291093 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Returning 404 to user: Instance 591ca997-34ca-458a-a290-fead67062169 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9eec4ca5-698c-4f0a-8daf-b868437d1e85 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169" status: 404 len: 111 microversion: 2.1 time: 0.034259 Oct 18 15:07:46.294976 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4279/8403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:46 2022] GET /compute/v2.1/servers/591ca997-34ca-458a-a290-fead67062169 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:07:48.743377 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:48.744422 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:48.747392 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:48.753187 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:48.753306 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:48.753841 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:48.754810 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:48.755649 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:48.756262 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:48.759965 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:48.760438 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:48.760885 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:48.773017 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] Creating event network-changed:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:07:48.778597 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-163f821d-47b0-48a5-8173-07b183a26782 req-44de0fa3-3946-4152-9639-1477996f628e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Oct 18 15:07:48.779222 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4280/8404] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:48.790586 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Going to try to terminate instance {{(pid=121009) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:07:49.058974 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-2a18b475-8f2f-4d6d-8c5e-ef204e848e5c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 204 len: 0 microversion: 2.1 time: 0.319503 Oct 18 15:07:49.059767 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4125/8405] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 15:07:48 2022] DELETE /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:07:49.068692 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:49.069448 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:49.075726 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:49.076234 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:49.076691 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:49.077398 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:49.077871 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:49.078342 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:49.229029 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:49.237786 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ff0aaf5a-19ae-458a-8426-b5cf2169b88c tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1684 microversion: 2.1 time: 0.173457 Oct 18 15:07:49.241473 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4281/8406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:49 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:07:50.262703 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:50.263410 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:50.270677 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:50.271164 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:50.271610 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:50.272295 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:50.272754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:50.273184 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:50.406505 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.policy [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121009) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:50.415049 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-98850af0-32f7-4a40-b6c6-164b170ae8d7 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1684 microversion: 2.1 time: 0.156697 Oct 18 15:07:50.415632 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4126/8407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:50 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:07:51.438152 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:51.438785 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:51.446520 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:51.447031 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:51.452554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:51.452554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:51.452554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:51.452554 n-d-858383-13 devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:51.459793 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c56d51-8d85-4657-a935-63610e483818", "name": "network-vif-deleted", "tag": "3e6426b3-3b56-4d45-9798-bc48dfbb8f41"}]} {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:07:51.470545 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:51.471026 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:51.471470 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:51.482964 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.compute.server_external_events [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] Creating event network-vif-deleted:3e6426b3-3b56-4d45-9798-bc48dfbb8f41 for instance 93c56d51-8d85-4657-a935-63610e483818 on n-h2-858383-13 Oct 18 15:07:51.488685 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [req-c0f65ed1-6e49-4f54-94ff-dd7f2a5e5c2b req-2a617d43-d6c8-4fb0-81b5-f521d66e034c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039888 Oct 18 15:07:51.489330 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4127/8408] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 18 15:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:07:51.520356 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.policy [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7283c557c7bd45fab6b08b3dc3bbc9eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10902613e0b4f14afc5a1792bec8efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:07:51.528561 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97d5a4fb-1ce3-4041-887a-f29ac53c5237 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 200 len: 1497 microversion: 2.1 time: 0.094482 Oct 18 15:07:51.529141 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4282/8409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:51 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 1497 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:07:52.555031 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '>' {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:52.555745 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.compute.api [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] [instance: 93c56d51-8d85-4657-a935-63610e483818] Fetching instance by UUID {{(pid=121009) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:07:52.561996 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:52.562522 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:52.562975 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:52.563676 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Acquiring lock "589719e2-761e-418b-aee5-8deaa2841263" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:07:52.564754 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:07:52.569738 n-d-858383-13 devstack@n-api.service[121009]: DEBUG oslo_concurrency.lockutils [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Lock "589719e2-761e-418b-aee5-8deaa2841263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:07:52.578540 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.wsgi [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] HTTP exception thrown: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Request method failure captured: Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: request: GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 HTTP/1.1 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Accept: application/json Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Accept-Encoding: identity Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Connection: close Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Content-Length: 0 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Content-Type: application/json Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Host: 10.222.0.27 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: Openstack-System-Scope: None Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: User-Agent: python-urllib3/1.26.12 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Auth-Token: gAAAAABjTsAbIRUlTEuyB-pWSyZTt3qpVeGA41WOviJtie0khOR7CjUDldvUnAnoChzkSh9PrIuGlivblub70t-6OnfMkekn4DZ0BVbzqbzVR-rr2yxDGwEzUKCDDElSe0jhc-_olCqx1j9DZgsOYNAkOg1wZLLQ610EvD4vcvYfPy9UX541i7s Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Id: None Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Domain-Name: None Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Identity-Status: Confirmed Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Is-Admin-Project: True Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Id: default Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Domain-Name: Default Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Id: a10902613e0b4f14afc5a1792bec8efd Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Project-Name: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Role: member,reader Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Roles: member,reader Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a10902613e0b4f14afc5a1792bec8efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Id: a10902613e0b4f14afc5a1792bec8efd Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-Tenant-Name: tempest-TestSnapshotPattern-1377280952 Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-User: tempest-TestSnapshotPattern-1377280952-project Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Id: default Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Domain-Name: Default Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Id: 7283c557c7bd45fab6b08b3dc3bbc9eb Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: X-User-Name: tempest-TestSnapshotPattern-1377280952-project Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: method: > Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: exception: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: action_args: {'id': '93c56d51-8d85-4657-a935-63610e483818'} Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: {{(pid=121009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:07:52.580713 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: ERROR nova.api.openstack.wsgi Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: DEBUG nova.api.openstack.wsgi [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Returning 404 to user: Instance 93c56d51-8d85-4657-a935-63610e483818 could not be found. {{(pid=121009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: INFO nova.api.openstack.requestlog [None req-6e190f77-6b8f-4b5f-a301-7a3d51b4a3f9 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818" status: 404 len: 111 microversion: 2.1 time: 0.032371 Oct 18 15:07:52.584171 n-d-858383-13 devstack@n-api.service[121009]: [pid: 121009|app: 0|req: 4128/8410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 15:07:52 2022] GET /compute/v2.1/servers/93c56d51-8d85-4657-a935-63610e483818 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:07:52.800899 n-d-858383-13 devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9002949-7eac-48ab-aa6f-7885dbfc2259 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] Calling method '.version_select at 0x7fb3304acc10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:07:52.901060 n-d-858383-13 devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9002949-7eac-48ab-aa6f-7885dbfc2259 tempest-TestSnapshotPattern-1377280952 tempest-TestSnapshotPattern-1377280952-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1944054614" status: 202 len: 0 microversion: 2.1 time: 0.104586 Oct 18 15:07:52.901659 n-d-858383-13 devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4283/8411] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 15:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1944054614 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)